Search

Tantivy – high-performance full-text search library

Tantivy is a full-text search engine library inspired by Apache Lucene. It provides the indexing and querying capabilities needed to incorporate sophisticated search functionality into applications.

Unlike standalone search servers, Tantivy is designed to be embedded within other software. Developers can use it to build document search systems, application search facilities, and specialized information retrieval services without implementing their own indexing infrastructure.

The library places considerable emphasis on search performance, efficient storage, and flexible query processing. It is particularly suitable for applications requiring fast indexing and retrieval across large collections of textual or structured information.

This is free and open source software.

Key Features

  • Full-text indexing and retrieval with BM25 relevance scoring.
  • Configurable tokenization, including stemming for multiple languages.
  • Supports Boolean queries, phrase searches, and a natural query syntax.
  • Incremental indexing allows documents to be added to existing indexes.
  • Multi-threaded indexing can accelerate the processing of large document collections.
  • Supports numeric, text, date, Boolean, IP address, and hierarchical facet fields.
  • Range queries for filtering documents according to field values.
  • Faceted search enables users to navigate collections through structured categories.
  • JSON fields support indexing and querying structured document contents.
  • Aggregation collectors provide histograms, statistical summaries, averages, and range buckets.
  • Configurable term frequencies and positional information during indexing.
  • Compressed document storage with support for LZ4 and Zstandard.
  • Memory-mapped index access for efficient retrieval.
  • Supports document deletion and subsequent reindexing.
  • Low startup overhead makes the library suitable for command-line utilities and embedded applications.
  • Cross-platform support – runs on Linux, macOS, and Windows.

Website: github.com/quickwit-oss/tantivy
Support:
Developer: Paul Masurel and contributors
License: MIT License

Tantivy is written in Rust. Learn Rust with our recommended free books and free tutorials.


Related Software

Search Engines for Big Data
ElasticSearchFlexible and powerful distributed RESTful search engine and analytics
SolrSearch engine server that uses Lucene
LuceneSearch engine library
QuickwitCloud-native search engine
MeiliSearchEasy to use and deploy search engine
OpenSearchEnterprise-grade search and observability suite
SphinxSearch engine designed with indexing database content in mind
XapianProbabilistic information retrieval library
TypesenseFast, typo-tolerant search engine
Manticore SearchEasy to use fast database for search
RediSearchQuery and indexing engine for Redis
ParadeDBPostgreSQL extension adding search and analytical capabilities to Postgres
VespaAI search platform
MroongaMySQL storage engine based on the Groonga search engine
PGroongaAdds a Groonga-powered index access method
GroongaFulltext search engine and column store

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted