Natural Language Processing

Transformers – pretrained models for natural language processing

Transformers is a machine learning library developed by Hugging Face. It provides access to pretrained models for natural language processing, computer vision, audio processing, and multimodal applications. The library brings a wide range of model architectures together behind consistent interfaces for loading, configuring, training, and running inference.

For natural language processing, Transformers supports tasks such as text classification, named entity recognition, question answering, summarisation, translation, and text generation. Developers can select models suited to their task, run them locally, and adapt them to specialist datasets. The library is widely used in research, experimentation, and the development of applications that incorporate language models.

Transformers is closely integrated with the Hugging Face ecosystem, including the Model Hub, tokenisation tools, datasets, and parameter-efficient fine-tuning utilities. These integrations simplify working with models while allowing developers to retain control over model selection and execution.

This is free and open source software.

Key Features

  • Access pretrained models for text classification, token classification, question answering, summarisation, translation, and text generation.
  • Support encoder, decoder, and encoder-decoder transformer architectures.
  • Load model configurations, pretrained weights, tokenisers, and processing components through consistent interfaces.
  • Run inference using high-level pipelines or lower-level model APIs.
  • Fine-tune pretrained models on custom datasets using supported training workflows.
  • Generate text with configurable decoding strategies, including sampling and beam search.
  • Work with multilingual models and models trained for specific languages or domains.
  • Integrate models published through the Hugging Face Hub.
  • Support text, image, audio, video, and multimodal processing.
  • Provide facilities for model evaluation, configuration, and checkpoint management.

Website: github.com/huggingface/transformers
Support:
Developer: Hugging Face and contributors
License: Apache License 2.0

Pytorch-Transformers is written in Python. Learn Python with our recommended free books and free tutorials.


Related Software

Natural Language Processing
PyTorch-TransformersLibrary of state-of-the-art pre-trained models
Natural Language ToolkitSuite of open source Python modules, data sets and tutorials
Stanford CoreNLPExtensible annotation-based NLP pipeline
spaCyIndustrial strength natural language processing
scikit-learnMachine learning library for Python
GensimPython-based vector space modeling and topic modeling toolkit
flairSimple framework for state-of-the-art NLP
Apache OpenNLPMachine learning based toolkit
DL4JDeploy and train deep learning models
Apache LuceneFull-featured information retrieval software library
UIMAImplementation of the UIMA specification
tidytextText mining using dplyr, ggplot2, and other tidy tools
text2vecFramework with API for text analysis and NLP
quantedaR package for Quantitative Analysis of Textual Data
MosesStatistical machine translation system

Read our verdict in the software roundup.

Python Natural Language Processing Tools
PyTorch-TransformersLibrary of state-of-the-art pre-trained models for NLP
NLTKNatural Language Toolkit
spaCyIndustrial strength natural language processing
scikit-learnMachine learning library
HaystackAI orchestration framework
GensimVector space modeling and topic modeling toolkit
flairSimple framework for state-of-the-art NLP
TextBlobPython (2 and 3) library for processing textual data
doccanoData labelling and text annotation platform
BERTopicTopic modeling
textacyPython library for performing NLP tasks
PresidioData protection and de-identification SDK
polyglotMultilingual text (NLP) processing toolkit
AllenNLPApache 2.0 NLP research library
Snips NLUNatural Language Understanding Python library
PyNLPIVarious modules useful for common, and less common, NLP tasks
nlpnetNatural Language Processing with neural networks
PatternWeb mining module
GluonNLPDeep Learning for NLP
PyTorch-NLPNeural network layers, text processing modules and datasets
NLP ArchitectDeep Learning NLP/NLU library

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted