Transformers is a machine learning library developed by Hugging Face. It provides access to pretrained models for natural language processing, computer vision, audio processing, and multimodal applications. The library brings a wide range of model architectures together behind consistent interfaces for loading, configuring, training, and running inference.
For natural language processing, Transformers supports tasks such as text classification, named entity recognition, question answering, summarisation, translation, and text generation. Developers can select models suited to their task, run them locally, and adapt them to specialist datasets. The library is widely used in research, experimentation, and the development of applications that incorporate language models.
Transformers is closely integrated with the Hugging Face ecosystem, including the Model Hub, tokenisation tools, datasets, and parameter-efficient fine-tuning utilities. These integrations simplify working with models while allowing developers to retain control over model selection and execution.
This is free and open source software.
Key Features
- Access pretrained models for text classification, token classification, question answering, summarisation, translation, and text generation.
- Support encoder, decoder, and encoder-decoder transformer architectures.
- Load model configurations, pretrained weights, tokenisers, and processing components through consistent interfaces.
- Run inference using high-level pipelines or lower-level model APIs.
- Fine-tune pretrained models on custom datasets using supported training workflows.
- Generate text with configurable decoding strategies, including sampling and beam search.
- Work with multilingual models and models trained for specific languages or domains.
- Integrate models published through the Hugging Face Hub.
- Support text, image, audio, video, and multimodal processing.
- Provide facilities for model evaluation, configuration, and checkpoint management.
Website: github.com/huggingface/transformers
Support:
Developer: Hugging Face and contributors
License: Apache License 2.0
Pytorch-Transformers is written in Python. Learn Python with our recommended free books and free tutorials.
Related Software
| Natural Language Processing | |
|---|---|
| PyTorch-Transformers | Library of state-of-the-art pre-trained models |
| Natural Language Toolkit | Suite of open source Python modules, data sets and tutorials |
| Stanford CoreNLP | Extensible annotation-based NLP pipeline |
| spaCy | Industrial strength natural language processing |
| scikit-learn | Machine learning library for Python |
| Gensim | Python-based vector space modeling and topic modeling toolkit |
| flair | Simple framework for state-of-the-art NLP |
| Apache OpenNLP | Machine learning based toolkit |
| DL4J | Deploy and train deep learning models |
| Apache Lucene | Full-featured information retrieval software library |
| UIMA | Implementation of the UIMA specification |
| tidytext | Text mining using dplyr, ggplot2, and other tidy tools |
| text2vec | Framework with API for text analysis and NLP |
| quanteda | R package for Quantitative Analysis of Textual Data |
| Moses | Statistical machine translation system |
Read our verdict in the software roundup.
| Python Natural Language Processing Tools | |
|---|---|
| PyTorch-Transformers | Library of state-of-the-art pre-trained models for NLP |
| NLTK | Natural Language Toolkit |
| spaCy | Industrial strength natural language processing |
| scikit-learn | Machine learning library |
| Haystack | AI orchestration framework |
| Gensim | Vector space modeling and topic modeling toolkit |
| flair | Simple framework for state-of-the-art NLP |
| TextBlob | Python (2 and 3) library for processing textual data |
| doccano | Data labelling and text annotation platform |
| BERTopic | Topic modeling |
| textacy | Python library for performing NLP tasks |
| Presidio | Data protection and de-identification SDK |
| polyglot | Multilingual text (NLP) processing toolkit |
| AllenNLP | Apache 2.0 NLP research library |
| Snips NLU | Natural Language Understanding Python library |
| PyNLPI | Various modules useful for common, and less common, NLP tasks |
| nlpnet | Natural Language Processing with neural networks |
| Pattern | Web mining module |
| GluonNLP | Deep Learning for NLP |
| PyTorch-NLP | Neural network layers, text processing modules and datasets |
| NLP Architect | Deep Learning NLP/NLU library |
Read our verdict in the software roundup.
LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |


Please read our Comment Policy before commenting.