stringr simplifies string manipulation in R with consistent functions for matching, extracting, replacing, splitting and joining text.
Read more
Tag: natural language processing
UDPipe – multilingual linguistic annotation in R
UDPipe provides multilingual tokenisation, part-of-speech tagging, lemmatisation, dependency parsing, and keyword extraction in R.
Read more
Word Vectors – build and explore word embeddings in R
Word Vectors trains and explores word embeddings in R with word2vec models, nearest-neighbour searches and cosine similarity.
Read more
spacyr – R interface to the spaCy NLP library
spacyr connects R to spaCy for tokenisation, part-of-speech tagging, lemmatisation, named entity recognition and dependency parsing.
Read more
MITIE – named-entity and relation extraction toolkit
MITIE provides named-entity recognition, entity extraction and relation detection with trainable models and multilingual interfaces.
Read more
text2vec – text analysis and word embeddings in R
text2vec supports efficient text vectorisation, document-term matrices, word embeddings, similarity analysis, and topic modelling in R.
Read more
Moses – statistical machine translation system
Moses trains and decodes statistical machine translation models from parallel text, with phrase-based, hierarchical, and factored models.
Read more
TiMBL – Tilburg Memory-Based Learner
TiMBL implements memory-based classifiers for NLP, including weighted nearest-neighbour learning, decision trees, and model evaluation.
Read more
MeTA – text retrieval and data analysis toolkit
MeTA combines text tokenization, indexing, classification, ranking, topic models and linguistic processing in one research toolkit.
Read more
CRF++ – conditional random field sequence labelling toolkit
CRF++ provides trainable conditional random fields for sequence tagging, supporting feature templates, n-best output and probabilities.
Read more
BLLIP Parser – statistical constituency parser
BLLIP Parser analyses English sentence structure using a generative constituency parser and discriminative reranking models.
Read more
Colibri Core – efficient corpus pattern modelling
Colibri Core extracts n-grams, skipgrams and flexgrams from text corpora, builds compact pattern models, and computes pattern statistics.
Read more
Xapian – probabilistic information retrieval library
Xapian is an information retrieval library with ranked full-text search, stemming, spelling suggestions, synonyms and query expansion.
Read more
flair – simple framework for state-of-the-art NLP
flair is a very simple framework for state-of-the-art Natural Language Processing (NLP). The project is based on PyTorch 0.4+ and Python 3.6+.
Read more
PyTorch-NLP – library of neural network layers, text processing modules and datasets
PyTorch-NLP is a library of neural network layers, text processing modules and datasets designed to accelerate NLP research.
Read more
Snips NLU – Natural Language Understanding Python library
Snips NLU is a Natural Language Understanding python library that allows to parse sentences written in natural language.
Read more
Pytorch-Transformers – library of state-of-the-art pre-trained models for Natural Language Processing
PyTorch-Transformers is a library of state-of-the-art pre-trained models for Natural Language Processing (NLP).
Read more
NLP Architect – Deep Learning NLP/NLU library
NLP Architect is an open source Python library for exploring state-of-the-art deep learning topologies and techniques for NLP and NLU.
Read more
AllenNLP – Apache 2.0 NLP research library
AllenNLP is an Apache 2.0 NLP research library, built on PyTorch, for developing state-of-the-art deep learning models.
Read more
GluonNLP – Deep Learning for NLP
GluonNLP is a deep learning framework that enables easy text preprocessing, datasets loading and neural models. Free and open source software.
Read more