Natural Language Processing

Word Vectors – build and explore word embeddings in R

Word Vectors is a package for training and exploring word embedding models. Word embeddings represent words as numerical vectors, allowing relationships between terms to be examined using geometric and statistical methods.

The package focuses on word2vec and related vector-space representations. It provides tools for training models from text collections, importing pretrained representations and examining the resulting vectors. Researchers can use these facilities to identify words with similar meanings, investigate relationships between concepts and compare the position of terms within a learned vector space.

Word Vectors also introduces a VectorSpaceModel class intended to make embedding analysis more convenient than working directly with numerical matrices. Its facilities are particularly relevant to researchers investigating vocabulary, semantic relationships and historical changes in language.

This is free and open source software.

Key Features

  • Trains word2vec models from textual data.
  • Supports exploration of existing word embedding models.
  • Reads and writes the binary word2vec file format.
  • Imports pretrained word vectors for further analysis.
  • Provides a VectorSpaceModel class for working with vector representations.
  • Calculates cosine similarity between word vectors.
  • Identifies nearest neighbours in a learned vector space.
  • Supports vector projection for investigating semantic relationships.
  • Provides matrix operations useful for embedding analysis.
  • Supports selective loading of vector data to reduce memory requirements.
  • Offers cached calculations for selected vector operations.
  • Enables exploration of relationships between words using vector arithmetic.

Website: github.com/bmschmidt/wordVectors
Support:
Developer: Benjamin Schmidt
License: Apache License 2.0

Word Vectors is written in R. Learn R with our recommended free books and free tutorials.


Related Software

R Natural Language Processing Tools
tidytextText mining using dplyr, ggplot2, and other tidy tools
quantedaR package for Quantitative Analysis of Textual Data
text2vecFramework with API for text analysis and natural language processing
wordcloudCreate attractive word clouds
tmText Mining Infrastructure in R
srtringiFast and portable character string processing in R
StringrString manipulation in R
UDPipeTokenization, Tagging, Lemmatization and Dependency Parsing
tokenizersConvert natural language text into tokens
spacyrR wrapper around the Python spaCy package
Word VectorsBuild and explore embedding models
syuzhetExtraction of sentiment and sentiment-based plot arcs from text
textTinyRText processing for small or big data
sentimentrDictionary based sentiment analysis
textcleanCollection of tools to clean and normalize text
TALLExplore, model, and visualize textual data
corpustoolsVarious tools for analyzing text corpora
topicmodelsInterface to LDA and CTM models
textAnalyzing natural language with transformers-based large language models
RTextToolsAutomatic text classification via supervised learning

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted