quanteda (Quantitative Analysis of Textual Data) is a comprehensive framework for managing, processing and analysing collections of text. It provides a consistent set of data structures and functions for quantitative text analysis, making it suitable for research involving anything from a small collection of documents to a substantial text corpus.
The package separates corpus management, tokenisation and statistical analysis into distinct stages. Researchers can organise documents together with their metadata, extract linguistic features and construct matrices suitable for subsequent analysis. Its design emphasises efficient processing, reproducibility and interoperability with other packages in the R text-analysis ecosystem.
This is free and open source software.
Key Features
- Creates and manages text corpora with document-level variables and metadata.
- Tokenises text into words, sentences, characters and other linguistic units.
- Provides transformations for case conversion, punctuation removal, stopwords, stemming and n-grams.
- Builds sparse document-feature matrices for quantitative analysis.
- Supports document-feature matrix weighting, trimming, grouping and selection.
- Constructs feature co-occurrence matrices for investigating relationships between terms.
- Provides keyword-in-context analysis for examining expressions in their original context.
- Supports dictionary-based analysis, including category matching and text classification workflows.
- Calculates similarities and distances between documents or features.
- Offers functions for identifying frequent terms and examining lexical distributions.
- Integrates with companion packages such as readtext and quanteda.textmodels for importing documents and statistical modelling.
- Provides efficient processing of large document collections using sparse representations.
- Cross-platform support – runs on Linux, macOS, and Windows.
Website: github.com/quanteda/quanteda
Support:
Developer: Kenneth Benoit and contributors
License: GNU General Public License v3.0
quanteda is written in R. Learn R with our recommended free books and free tutorials.
Related Software
| Natural Language Processing | |
|---|---|
| PyTorch-Transformers | Library of state-of-the-art pre-trained models |
| Natural Language Toolkit | Suite of open source Python modules, data sets and tutorials |
| Stanford CoreNLP | Extensible annotation-based NLP pipeline |
| spaCy | Industrial strength natural language processing |
| scikit-learn | Machine learning library for Python |
| Gensim | Python-based vector space modeling and topic modeling toolkit |
| flair | Simple framework for state-of-the-art NLP |
| Apache OpenNLP | Machine learning based toolkit |
| DL4J | Deploy and train deep learning models |
| Apache Lucene | Full-featured information retrieval software library |
| UIMA | Implementation of the UIMA specification |
| tidytext | Text mining using dplyr, ggplot2, and other tidy tools |
| text2vec | Framework with API for text analysis and NLP |
| quanteda | R package for Quantitative Analysis of Textual Data |
| Moses | Statistical machine translation system |
Read our verdict in the software roundup.
| R Natural Language Processing Tools | |
|---|---|
| tidytext | Text mining using dplyr, ggplot2, and other tidy tools |
| quanteda | R package for Quantitative Analysis of Textual Data |
| text2vec | Framework with API for text analysis and natural language processing |
| wordcloud | Create attractive word clouds |
| tm | Text Mining Infrastructure in R |
| srtringi | Fast and portable character string processing in R |
| Stringr | String manipulation in R |
| UDPipe | Tokenization, Tagging, Lemmatization and Dependency Parsing |
| tokenizers | Convert natural language text into tokens |
| spacyr | R wrapper around the Python spaCy package |
| Word Vectors | Build and explore embedding models |
| syuzhet | Extraction of sentiment and sentiment-based plot arcs from text |
| textTinyR | Text processing for small or big data |
| sentimentr | Dictionary based sentiment analysis |
| textclean | Collection of tools to clean and normalize text |
| TALL | Explore, model, and visualize textual data |
| corpustools | Various tools for analyzing text corpora |
| topicmodels | Interface to LDA and CTM models |
| text | Analyzing natural language with transformers-based large language models |
| RTextTools | Automatic text classification via supervised learning |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.