UDPipe is a trainable natural language processing pipeline for analysing text. It combines tokenization, part-of-speech tagging, lemmatization and dependency parsing into a single system.
The software is language-independent and can be trained using annotated linguistic data in CoNLL-U format. It is closely associated with the Universal Dependencies project, which provides a common framework for representing grammatical structures across different languages.
UDPipe is intended for computational linguistics research, corpus annotation and applications requiring grammatical analysis of written text. It can process raw text using trained models or operate on partially annotated data, depending on the required processing stages.
This is free and open source software.
Key Features
- Automatic tokenization of raw text into words and punctuation tokens.
- Sentence segmentation for identifying sentence boundaries.
- Part-of-speech tagging using trained statistical models.
- Lemmatization to identify canonical word forms.
- Dependency parsing for analysing grammatical relationships between words.
- Language-independent processing using models trained from annotated corpora.
- Support for Universal Dependencies treebanks and the CoNLL-U annotation format.
- Train custom linguistic models using annotated training data.
- Pretrained models for a wide range of languages.
- Process complete linguistic annotation pipelines or selected individual stages.
- Work with input containing existing tokenization or grammatical annotations.
- Command-line interface for processing text files and corpora.
- Programming interfaces for C++, Python, Perl, Java and C#.
- REST web service for accessing linguistic processing functionality remotely.
- Suitable for automated corpus annotation and multilingual language analysis.
- Cross-platform support – runs on Linux, macOS, and Windows.
Website: github.com/ufal/udpipe
Support:
Developer: Institute of Formal and Applied Linguistics, Charles University
License: Mozilla Public License v2.0
UDPipe is written in C++. Learn C++ with our recommended free books and free tutorials.
Related Software
| C++ Natural Language Processing Tools | |
|---|---|
| text2vec | Framework with API for text analysis and natural language processing |
| Moses | Statistical machine translation system |
| TiMBL | Tilburg Memory-Based Learner |
| MITIE | MIT Information Extraction |
| MeTA | Modern C++ data sciences toolkit |
| Colibri Core | Efficient n-gram & skipgram modelling on text corpora |
| CRF++ | Yet Another CRF toolkit |
| BLLIP Parser | Statistical natural language parser |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.