Natural Language Processing

NLTK – toolkit for natural language processing

NLTK, the Natural Language Toolkit, provides a collection of tools, datasets, and educational resources for working with human language. It is designed for research, teaching, experimentation, and the development of language processing applications.

NLTK covers a broad range of linguistic techniques, from dividing text into sentences and words to analysing grammatical structure and applying statistical classification. It provides access to corpora and lexical resources, including WordNet, which can be used to investigate relationships between words and their meanings.

The toolkit is particularly useful in computational linguistics and educational settings. Its modular design allows users to explore individual processing stages, inspect intermediate results, and experiment with alternative algorithms.

NLTK is accompanied by extensive documentation and educational material, including the online book Natural Language Processing with Python. Its combination of linguistic resources and reusable algorithms makes it valuable for learning how natural language processing systems work.

This is free and open source software.

Key Features

  • Sentence and word tokenisation using a variety of tokenisers.
  • Part-of-speech tagging and grammatical analysis.
  • Stemming and lemmatisation for reducing words to their underlying forms.
  • Named entity recognition and chunking.
  • Constituency parsing and support for formal grammars.
  • Text classification with statistical and machine learning algorithms.
  • Access to corpora, lexical databases, and linguistic annotations.
  • WordNet integration for working with synonyms, semantic relationships, and lexical concepts.
  • Concordances, collocations, frequency distributions, and n-gram analysis.
  • Tools for language modelling, semantic analysis, and corpus research.
  • Graphical demonstrations and educational examples.
  • Cross-platform support – runs on Linux, macOS, and Windows.

Website: www.nltk.org
Support:
Developer: NLTK Team
License: Apache License 2.0

NLTK is written in Python. Learn Python with our recommended free books and free tutorials.


Related Software

Natural Language Processing
PyTorch-TransformersLibrary of state-of-the-art pre-trained models
Natural Language ToolkitSuite of open source Python modules, data sets and tutorials
Stanford CoreNLPExtensible annotation-based NLP pipeline
spaCyIndustrial strength natural language processing
scikit-learnMachine learning library for Python
GensimPython-based vector space modeling and topic modeling toolkit
flairSimple framework for state-of-the-art NLP
Apache OpenNLPMachine learning based toolkit
DL4JDeploy and train deep learning models
Apache LuceneFull-featured information retrieval software library
UIMAImplementation of the UIMA specification
tidytextText mining using dplyr, ggplot2, and other tidy tools
text2vecFramework with API for text analysis and NLP
quantedaR package for Quantitative Analysis of Textual Data
MosesStatistical machine translation system

Read our verdict in the software roundup.

Python Natural Language Processing Tools
PyTorch-TransformersLibrary of state-of-the-art pre-trained models for NLP
NLTKNatural Language Toolkit
spaCyIndustrial strength natural language processing
scikit-learnMachine learning library
HaystackAI orchestration framework
GensimVector space modeling and topic modeling toolkit
flairSimple framework for state-of-the-art NLP
TextBlobPython (2 and 3) library for processing textual data
doccanoData labelling and text annotation platform
BERTopicTopic modeling
textacyPython library for performing NLP tasks
PresidioData protection and de-identification SDK
polyglotMultilingual text (NLP) processing toolkit
AllenNLPApache 2.0 NLP research library
Snips NLUNatural Language Understanding Python library
PyNLPIVarious modules useful for common, and less common, NLP tasks
nlpnetNatural Language Processing with neural networks
PatternWeb mining module
GluonNLPDeep Learning for NLP
PyTorch-NLPNeural network layers, text processing modules and datasets
NLP ArchitectDeep Learning NLP/NLU library

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted