sherpa-onnx is a speech processing toolkit that performs automatic speech recognition, speech synthesis and related audio analysis tasks without requiring an internet connection. It uses ONNX Runtime to execute machine learning models locally, providing a common inference framework for speech applications on desktop computers, servers and mobile devices.
The project supports both streaming and non-streaming speech recognition, allowing developers to choose between processing completed recordings and handling audio as it arrives. Beyond transcription, sherpa-onnx includes voice activity detection, speaker identification, speaker diarization, keyword spotting and speech enhancement. This makes it suitable for building transcription utilities, voice-controlled interfaces, meeting analysis tools and accessibility applications.
Its architecture separates speech processing functionality from the applications that use it. Developers can access the toolkit through native libraries and bindings for several programming languages, while networking components allow speech services to be exposed to other applications. Support for different inference backends helps accommodate hardware ranging from conventional CPUs to specialised accelerators.
This is free and open source software.
Key Features
- Perform automatic speech recognition entirely offline.
- Support streaming recognition for live audio input.
- Transcribe prerecorded audio using non-streaming recognition models.
- Generate speech from text using supported synthesis models.
- Identify individual speakers from their voice characteristics.
- Verify whether speech belongs to a particular speaker.
- Perform speaker diarization to identify who spoke and when.
- Detect speech segments using voice activity detection.
- Identify the spoken language in audio recordings.
- Recognise predefined keywords and wake words.
- Apply speech enhancement to improve noisy recordings.
- Separate different sound sources from mixed audio.
- Classify recordings using audio tagging models.
- Restore punctuation to compatible speech recognition output.
- Use ONNX Runtime to execute speech processing models.
- Support multiple recognition and synthesis model architectures.
- Expose speech processing through WebSocket servers and clients.
- Provide native APIs and bindings for application integration.
- Support selected hardware acceleration backends.
- Run speech processing locally without sending recordings to cloud services.
- Cross-platform support – runs on Linux, macOS, and Windows.
Website: github.com/k2-fsa/sherpa-onnx
Support:
Developer: sherpa-onnx contributors
License: Apache License 2.0
sherpa-onnx is written in C++ and Python . Learn C++ with our recommended free books and free tutorials. Learn Python with our recommended free books and free tutorials.
Related Software
| Speech Recognition Tools | |
|---|---|
| Whisper | Automatic speech recognition (system trained on 680,000 hours of data |
| whisper.cpp | Run Whisper locally with fast, efficient C/C++ speech recognition |
| Flashlight | Fast, flexible machine learning library written entirely in C++. |
| sherpa-onnx | Offline speech recognition for many platforms and languages |
| Kaldi | C++ toolkit designed for speech recognition researchers. |
| FunASR | Versatile speech recognition toolkit for real-world audio |
| faster-whisper | Faster Whisper transcription with reduced memory use |
| SpeechBrain | All-in-one conversational AI toolkit based on PyTorch |
| Handy | Offline speech-to-text application |
| ESPnet | End-to-End speech processing toolkit |
| PocketSphinx | Lightweight speech recognition for embedded and mobile use |
| deepspeech.pytorch | Implementation of DeepSpeech2 using Baidu Warp-CTC. |
| Epicenter | Transcription application with global speech-to-text functionality |
| Julius | Two-pass large vocabulary continuous speech recognition engine |
| Speech Note | Write notes, transcribe speech, translate text and read content aloud |
| aTrain | Private local transcription of recorded speech through a polished GUI |
| hyprwhspr | Native speech-to-text designed for Arch / Omarchy |
| Vocalinux | Local voice dictation through a clean desktop interface |
| ostt | Open Speech-to-Text |
| Simon | Flexible speech recognition software |
Read our verdict in the software roundup.
| Speech Tools | |
|---|---|
| Piper | Fast, local neural text to speech system |
| Bark | Transformer-based text-to-audio model. |
| sherpa-onnx | Speech-to-text and text-to-speech software |
| Coqui TTS | Offers pretrained models in more than 1,100 different languages |
| Dia | 1.6B parameter text to speech model |
| Tortoise | Multi-voice text-to-speech system trained with an emphasis on quality |
| Festival | General multi-lingual speech synthesis system |
| PraatSpeechAnalyser | Software for speech analysis and synthesis |
| Chatterbox | Family of text-to-speech models |
| Speech Note | Speech to Text, Text to Speech and Machine Translation |
| Mimic 3 | Lightweight Text to Speech engine |
| OrcaScreenReader | Scriptable screen reader |
| MeloTTS | High-quality multi-lingual text-to-speech library |
| Parler-TTS | Lightweight text-to-speech (TTS) model |
| Flite | Small, fast run time text to speech synthesis engine |
| RHVoice | Gives the visually impaired a synthesis voice with their screen reader |
| eSpeak NG | Continuation of the eSpeak project |
| eSpeak | Speech synthesizer using a formant synthesis method |
| Orpheus-TTS-FastAPI | High-performance self-hosted text-to-speech server |
| Gespeaker | GTK-based frontend for eSpeak |
| VoiceGen | Simple text-to-speech application |
| Glate | Google Translator and Text To Speech Service |
Read our verdict in the software roundup.
LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |


Please read our Comment Policy before commenting.