Natural Language Processing

PyTorch-NLP – library of neural network layers, text processing modules and datasets

PyTorch-NLP, or torchnlp for short, is a library of neural network layers, text processing modules and datasets designed to accelerate Natural Language Processing (NLP) research.

It’s built with the very latest research in mind, and was designed from day one to support rapid prototyping.

PyTorch-NLP comes with pre-trained embeddings, samplers, dataset loaders, metrics, neural network modules and text encoders. PyTorch-NLP also provides neural network modules and metrics.

The software is released under an open source license.

Packages:

  • torchnlp.datasets – introduces modules capable of downloading, caching and loading commonly used NLP datasets.
  • torchnlp.word_to_vector – introduces multiple pretrained word vectors. The package handles downloading, caching, loading, and lookup.
  • torchnlp.nn – introduces a set of torch.nn.Module commonly used in NLP.
  • torchnlp.encoders – supports encoding objects as a vector torch.Tensor and decoding a vector torch.Tensor back.
  • torchnlp.samplers – introduces a set of samplers. Samplers sample elements from a dataset. torchnlp.samplers plug into torch.utils.data.distributed.DistributedSampler and torch.utils.data.DataLoader.
  • torchnlp.metrics – introduces a set of modules able to compute common NLP metrics.
  • torchnlp.utils – contains any other module or object that is useful in building out a NLP pipeline.
  • torchnlp.download – contains modules useful for donwload and extracting datasets.

Website: github.com/PetrochukM/PyTorch-NLP
Support: Documentation
Developer: Michael Petrochuk and contributors
License: BSD 3-Clause “New” or “Revised” License

PyTorch-NLP is written in Python. Learn Python with our recommended free books and free tutorials.


Related Software

Python Natural Language Processing Tools
PyTorch-TransformersLibrary of state-of-the-art pre-trained models for NLP
NLTKNatural Language Toolkit
spaCyIndustrial strength natural language processing
scikit-learnMachine learning library
HaystackAI orchestration framework
GensimVector space modeling and topic modeling toolkit
flairSimple framework for state-of-the-art NLP
TextBlobPython (2 and 3) library for processing textual data
doccanoData labelling and text annotation platform
BERTopicTopic modeling
textacyPython library for performing NLP tasks
PresidioData protection and de-identification SDK
polyglotMultilingual text (NLP) processing toolkit
AllenNLPApache 2.0 NLP research library
Snips NLUNatural Language Understanding Python library
PyNLPIVarious modules useful for common, and less common, NLP tasks
nlpnetNatural Language Processing with neural networks
PatternWeb mining module
GluonNLPDeep Learning for NLP
PyTorch-NLPNeural network layers, text processing modules and datasets
NLP ArchitectDeep Learning NLP/NLU library

Read our verdict in the software roundup.


Best Free and Open Source Software Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.

This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk.

You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more.

Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form.
Subscribe
Notify of
guest
0 Comments
Oldest
Newest Most Voted