Natural Language Processing

PyTorch-NLP – library of neural network layers, text processing modules and datasets

PyTorch-NLP, or torchnlp for short, is a library of neural network layers, text processing modules and datasets designed to accelerate Natural Language Processing (NLP) research.

It’s built with the very latest research in mind, and was designed from day one to support rapid prototyping.

PyTorch-NLP comes with pre-trained embeddings, samplers, dataset loaders, metrics, neural network modules and text encoders. PyTorch-NLP also provides neural network modules and metrics.

The software is released under an open source license.

Packages:

  • torchnlp.datasets – introduces modules capable of downloading, caching and loading commonly used NLP datasets.
  • torchnlp.word_to_vector – introduces multiple pretrained word vectors. The package handles downloading, caching, loading, and lookup.
  • torchnlp.nn – introduces a set of torch.nn.Module commonly used in NLP.
  • torchnlp.encoders – supports encoding objects as a vector torch.Tensor and decoding a vector torch.Tensor back.
  • torchnlp.samplers – introduces a set of samplers. Samplers sample elements from a dataset. torchnlp.samplers plug into torch.utils.data.distributed.DistributedSampler and torch.utils.data.DataLoader.
  • torchnlp.metrics – introduces a set of modules able to compute common NLP metrics.
  • torchnlp.utils – contains any other module or object that is useful in building out a NLP pipeline.
  • torchnlp.download – contains modules useful for donwload and extracting datasets.

Website: github.com/PetrochukM/PyTorch-NLP
Support: Documentation
Developer: Michael Petrochuk and contributors
License: BSD 3-Clause “New” or “Revised” License

PyTorch-NLP is written in Python. Learn Python with our recommended free books and free tutorials.


Related Software

Python Natural Language Processing Tools
PyTorch-TransformersLibrary of state-of-the-art pre-trained models for NLP
NLTKNatural Language Toolkit
spaCyIndustrial strength natural language processing
scikit-learnMachine learning library
HaystackAI orchestration framework
GensimVector space modeling and topic modeling toolkit
flairSimple framework for state-of-the-art NLP
TextBlobPython (2 and 3) library for processing textual data
doccanoData labelling and text annotation platform
BERTopicTopic modeling
textacyPython library for performing NLP tasks
PresidioData protection and de-identification SDK
polyglotMultilingual text (NLP) processing toolkit
AllenNLPApache 2.0 NLP research library
Snips NLUNatural Language Understanding Python library
PyNLPIVarious modules useful for common, and less common, NLP tasks
nlpnetNatural Language Processing with neural networks
PatternWeb mining module
GluonNLPDeep Learning for NLP
PyTorch-NLPNeural network layers, text processing modules and datasets
NLP ArchitectDeep Learning NLP/NLU library

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted