Natural Language Processing

MeTA – text retrieval and data analysis toolkit

MeTA, short for ModErn Text Analysis, is a toolkit for experiments in text retrieval, natural language processing and data mining. It brings indexing, document ranking and linguistic analysis into a modular environment intended for research and teaching.

The project addresses a common problem in experimental information retrieval: researchers need to compare how a retrieval model behaves when the tokenization, indexing or ranking stage changes. MeTA exposes separate components so text collections can be prepared, indexed and analysed through reproducible workflows.

This is free and open source software.

Key Features

  • Provides text tokenization and document preprocessing.
  • Builds compressed inverted and forward indexes.
  • Implements document-ranking functions for search experiments.
  • Includes text classification algorithms.
  • Offers topic models and statistical language models.
  • Provides conditional random fields for tagging and shallow parsing.
  • Includes graph algorithms used in data analysis.
  • Wraps liblinear and libsvm classification functionality.
  • Supports Unicode text analysis.
  • Includes multithreaded processing for supported algorithms.
  • Can analyse document corpora with alternative term weighting methods.
  • Provides reusable ranking components for experimental search engines.
  • Allows researchers to evaluate search and classification algorithms separately.
  • Provides multiple approaches to generating text-based features.
  • Includes examples and tutorials intended for coursework and research experiments.
  • Allows modules to be combined into configurable text analysis pipelines.
  • Cross-platform support – runs on Linux, macOS, and Windows.

Website: github.com/meta-toolkit/meta
Support:
Developer: MeTA Team, University of Illinois at Urbana-Champaign
License: MIT License and University of Illinois/NCSA Open Source License

MeTA is written in C++. Learn C++ with our recommended free books and free tutorials.


Related Software

C++ Natural Language Processing Tools
text2vecFramework with API for text analysis and natural language processing
MosesStatistical machine translation system
TiMBLTilburg Memory-Based Learner
MITIEMIT Information Extraction
MeTAModern C++ data sciences toolkit
Colibri CoreEfficient n-gram & skipgram modelling on text corpora
CRF++Yet Another CRF toolkit
BLLIP ParserStatistical natural language parser

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.