Word Vectors is a package for training and exploring word embedding models. Word embeddings represent words as numerical vectors, allowing relationships between terms to be examined using geometric and statistical methods.
The package focuses on word2vec and related vector-space representations. It provides tools for training models from text collections, importing pretrained representations and examining the resulting vectors. Researchers can use these facilities to identify words with similar meanings, investigate relationships between concepts and compare the position of terms within a learned vector space.
Word Vectors also introduces a VectorSpaceModel class intended to make embedding analysis more convenient than working directly with numerical matrices. Its facilities are particularly relevant to researchers investigating vocabulary, semantic relationships and historical changes in language.
This is free and open source software.
Key Features
- Trains word2vec models from textual data.
- Supports exploration of existing word embedding models.
- Reads and writes the binary word2vec file format.
- Imports pretrained word vectors for further analysis.
- Provides a VectorSpaceModel class for working with vector representations.
- Calculates cosine similarity between word vectors.
- Identifies nearest neighbours in a learned vector space.
- Supports vector projection for investigating semantic relationships.
- Provides matrix operations useful for embedding analysis.
- Supports selective loading of vector data to reduce memory requirements.
- Offers cached calculations for selected vector operations.
- Enables exploration of relationships between words using vector arithmetic.
Website: github.com/bmschmidt/wordVectors
Support:
Developer: Benjamin Schmidt
License: Apache License 2.0
Word Vectors is written in R. Learn R with our recommended free books and free tutorials.
Related Software
| R Natural Language Processing Tools | |
|---|---|
| tidytext | Text mining using dplyr, ggplot2, and other tidy tools |
| quanteda | R package for Quantitative Analysis of Textual Data |
| text2vec | Framework with API for text analysis and natural language processing |
| wordcloud | Create attractive word clouds |
| tm | Text Mining Infrastructure in R |
| srtringi | Fast and portable character string processing in R |
| Stringr | String manipulation in R |
| UDPipe | Tokenization, Tagging, Lemmatization and Dependency Parsing |
| tokenizers | Convert natural language text into tokens |
| spacyr | R wrapper around the Python spaCy package |
| Word Vectors | Build and explore embedding models |
| syuzhet | Extraction of sentiment and sentiment-based plot arcs from text |
| textTinyR | Text processing for small or big data |
| sentimentr | Dictionary based sentiment analysis |
| textclean | Collection of tools to clean and normalize text |
| TALL | Explore, model, and visualize textual data |
| corpustools | Various tools for analyzing text corpora |
| topicmodels | Interface to LDA and CTM models |
| text | Analyzing natural language with transformers-based large language models |
| RTextTools | Automatic text classification via supervised learning |
Read our verdict in the software roundup.
LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |


Please read our Comment Policy before commenting.