Natural Language Processing

tm – text mining infrastructure for R

tm is a framework for text mining that provides facilities for organising, transforming and analysing collections of textual documents. It introduces a common representation for documents from different sources, allowing text-processing operations to be applied consistently across a corpus.

The package is designed around extensible document and corpus abstractions. It can work with collections stored in memory and provides mechanisms for handling document metadata, accessing different text formats and applying transformations to individual documents or entire collections.

tm also forms a foundation for statistical text analysis. After preparing a corpus, users can construct document-term or term-document matrices and apply other R packages for modelling, classification or exploratory analysis.

This is free and open source software.

Key Features

  • Provides VCorpus, SimpleCorpus and PCorpus representations for text collections.
  • Supports document collections created from directories, character vectors and structured data sources.
  • Includes readers for plain text, PDF, XML and other document formats.
  • Offers an extensible architecture for adding custom readers and document sources.
  • Applies transformations through tm_map() and related functions.
  • Supports case conversion, whitespace removal, stemming and stopword removal.
  • Constructs sparse document-term and term-document matrices.
  • Provides term-frequency statistics and functions for finding frequently occurring terms.
  • Supports term association analysis for discovering relationships within document collections.
  • Offers corpus filtering and indexing functions for selecting relevant documents.
  • Manages document metadata separately from textual content.
  • Supports integration with other statistical and text-mining tools through established R data structures.

Website: tm.r-forge.r-project.org
Support:
Developer: Ingo Feinerer and contributors
License: GNU General Public License v3.0

tm is written in R. Learn R with our recommended free books and free tutorials.


Related Software

R Natural Language Processing Tools
tidytextText mining using dplyr, ggplot2, and other tidy tools
quantedaR package for Quantitative Analysis of Textual Data
text2vecFramework with API for text analysis and natural language processing
wordcloudCreate attractive word clouds
tmText Mining Infrastructure in R
srtringiFast and portable character string processing in R
StringrString manipulation in R
UDPipeTokenization, Tagging, Lemmatization and Dependency Parsing
tokenizersConvert natural language text into tokens
spacyrR wrapper around the Python spaCy package
Word VectorsBuild and explore embedding models
syuzhetExtraction of sentiment and sentiment-based plot arcs from text
textTinyRText processing for small or big data
sentimentrDictionary based sentiment analysis
textcleanCollection of tools to clean and normalize text
TALLExplore, model, and visualize textual data
corpustoolsVarious tools for analyzing text corpora
topicmodelsInterface to LDA and CTM models
textAnalyzing natural language with transformers-based large language models
RTextToolsAutomatic text classification via supervised learning

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted