Natural Language Processing

word2vec – train word embedding models in R

word2vec provides tools for training and using word embedding models directly from R. It implements techniques derived from the original word2vec approach, which learns numerical representations of words based on their surrounding textual context.

These representations allow relationships between terms to be investigated using vector operations. Words with similar meanings or usage patterns may occupy nearby positions in the embedding space.

The package is useful for researchers who want to build embedding models from their own corpora, examine semantic similarity, or incorporate word representations into wider text-mining workflows.

This is free and open source software.

Key Features

  • Trains continuous bag-of-words and skip-gram word embedding models.
  • Multi-threaded training supports processing larger text collections.
  • Accepts character vectors, tokenized text, and text files as training input.
  • Configurable embedding dimensions, training iterations, learning rates, and vocabulary frequency thresholds.
  • Extracts numerical embedding vectors for specified words.
  • Finds nearest neighbours in the embedding space using similarity calculations.
  • Supports word analogy operations through vector arithmetic.
  • Converts trained embeddings into matrices for further statistical processing.
  • Saves trained models and reloads them for subsequent use.
  • Imports compatible pretrained word2vec models created by other implementations.
  • Integrates with quanteda for training models from tokenized corpora.
  • Works with subword token representations produced by compatible tokenizers.
  • Supports downstream visualization using dimensionality reduction and plotting tools.

Website: github.com/bnosac/word2vec
Support:
Developer: BNOSAC
License: Apache License 2.0

word2vec is written in C++ and R. Learn C++ with our recommended free books and free tutorials. Learn R with our recommended free books and free tutorials.


Related Software

R Natural Language Processing Tools
tidytextText mining using dplyr, ggplot2, and other tidy tools
quantedaR package for Quantitative Analysis of Textual Data
text2vecFramework with API for text analysis and natural language processing
wordcloudCreate attractive word clouds
tmText Mining Infrastructure in R
srtringiFast and portable character string processing in R
StringrString manipulation in R
UDPipeTokenization, Tagging, Lemmatization and Dependency Parsing
tokenizersConvert natural language text into tokens
spacyrR wrapper around the Python spaCy package
Word VectorsBuild and explore embedding models
syuzhetExtraction of sentiment and sentiment-based plot arcs from text
textTinyRText processing for small or big data
sentimentrDictionary based sentiment analysis
textcleanCollection of tools to clean and normalize text
TALLExplore, model, and visualize textual data
corpustoolsVarious tools for analyzing text corpora
topicmodelsInterface to LDA and CTM models
textAnalyzing natural language with transformers-based large language models
RTextToolsAutomatic text classification via supervised learning

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted