tm is a framework for text mining that provides facilities for organising, transforming and analysing collections of textual documents. It introduces a common representation for documents from different sources, allowing text-processing operations to be applied consistently across a corpus.
The package is designed around extensible document and corpus abstractions. It can work with collections stored in memory and provides mechanisms for handling document metadata, accessing different text formats and applying transformations to individual documents or entire collections.
tm also forms a foundation for statistical text analysis. After preparing a corpus, users can construct document-term or term-document matrices and apply other R packages for modelling, classification or exploratory analysis.
This is free and open source software.
Key Features
- Provides VCorpus, SimpleCorpus and PCorpus representations for text collections.
- Supports document collections created from directories, character vectors and structured data sources.
- Includes readers for plain text, PDF, XML and other document formats.
- Offers an extensible architecture for adding custom readers and document sources.
- Applies transformations through tm_map() and related functions.
- Supports case conversion, whitespace removal, stemming and stopword removal.
- Constructs sparse document-term and term-document matrices.
- Provides term-frequency statistics and functions for finding frequently occurring terms.
- Supports term association analysis for discovering relationships within document collections.
- Offers corpus filtering and indexing functions for selecting relevant documents.
- Manages document metadata separately from textual content.
- Supports integration with other statistical and text-mining tools through established R data structures.
Website: tm.r-forge.r-project.org
Support:
Developer: Ingo Feinerer and contributors
License: GNU General Public License v3.0
tm is written in R. Learn R with our recommended free books and free tutorials.
Related Software
| R Natural Language Processing Tools | |
|---|---|
| tidytext | Text mining using dplyr, ggplot2, and other tidy tools |
| quanteda | R package for Quantitative Analysis of Textual Data |
| text2vec | Framework with API for text analysis and natural language processing |
| wordcloud | Create attractive word clouds |
| tm | Text Mining Infrastructure in R |
| srtringi | Fast and portable character string processing in R |
| Stringr | String manipulation in R |
| UDPipe | Tokenization, Tagging, Lemmatization and Dependency Parsing |
| tokenizers | Convert natural language text into tokens |
| spacyr | R wrapper around the Python spaCy package |
| Word Vectors | Build and explore embedding models |
| syuzhet | Extraction of sentiment and sentiment-based plot arcs from text |
| textTinyR | Text processing for small or big data |
| sentimentr | Dictionary based sentiment analysis |
| textclean | Collection of tools to clean and normalize text |
| TALL | Explore, model, and visualize textual data |
| corpustools | Various tools for analyzing text corpora |
| topicmodels | Interface to LDA and CTM models |
| text | Analyzing natural language with transformers-based large language models |
| RTextTools | Automatic text classification via supervised learning |
Read our verdict in the software roundup.
LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |


Please read our Comment Policy before commenting.