FunASR is an end-to-end speech recognition toolkit. It provides tools for building, training and deploying speech-processing systems for offline, streaming and edge use.
The project brings together automatic speech recognition, voice activity detection, punctuation restoration, speaker diarization, emotion recognition and audio-event detection within a common framework. It supports a range of model families, including Fun-ASR-Nano, SenseVoice, Paraformer and integrations for other speech models, with deployment options spanning local CPU or GPU inference, WebSocket streaming and API-based serving.
This is free and open source software.
Key Features
- Automatic speech recognition for offline files, batch workloads and low-latency streaming applications.
- Multilingual model support, with language coverage depending on the selected checkpoint.
- Voice activity detection for locating speech segments and removing non-speech regions before transcription.
- Punctuation models for turning raw recognition output into more readable transcriptions.
- Speaker diarization pipelines that combine speech segmentation with speaker identification models.
- Emotion recognition and audio-event detection through models such as SenseVoice and emotion2vec.
- Timestamp generation for applications that need time-aligned transcripts or subtitle production.
- Hotword support for improving recognition of selected names, terminology and other important vocabulary.
- Streaming recognition with models such as Paraformer and WebSocket-based real-time serving.
- Model training and fine-tuning facilities for adapting speech recognition systems to particular datasets or domains.
- CPU and GPU inference, with CUDA acceleration available for suitable PyTorch installations.
- vLLM integration for accelerating compatible models and processing larger inference workloads.
- OpenAI-compatible API server for integrating transcription into applications that already use familiar API conventions.
- Command-line tools for transcription, training, model export and server operation.
- Model zoo covering speech recognition, punctuation, voice activity detection, speaker processing and related audio tasks.
Website: github.com/modelscope/FunASR
Support:
Developer: Speech Lab of Alibaba Group
License: MIT License
FunASR is written in Python and C. Learn Python with our recommended free books and free tutorials. Learn C with our recommended free books and free tutorials.
Related Software
| Speech Recognition Tools | |
|---|---|
| Whisper | Automatic speech recognition (system trained on 680,000 hours of data |
| whisper.cpp | Run Whisper locally with fast, efficient C/C++ speech recognition |
| Flashlight | Fast, flexible machine learning library written entirely in C++. |
| sherpa-onnx | Offline speech recognition for many platforms and languages |
| Kaldi | C++ toolkit designed for speech recognition researchers. |
| FunASR | Versatile speech recognition toolkit for real-world audio |
| faster-whisper | Faster Whisper transcription with reduced memory use |
| SpeechBrain | All-in-one conversational AI toolkit based on PyTorch |
| Handy | Offline speech-to-text application |
| ESPnet | End-to-End speech processing toolkit |
| PocketSphinx | Lightweight speech recognition for embedded and mobile use |
| deepspeech.pytorch | Implementation of DeepSpeech2 using Baidu Warp-CTC. |
| Epicenter | Transcription application with global speech-to-text functionality |
| Julius | Two-pass large vocabulary continuous speech recognition engine |
| Speech Note | Write notes, transcribe speech, translate text and read content aloud |
| aTrain | Private local transcription of recorded speech through a polished GUI |
| hyprwhspr | Native speech-to-text designed for Arch / Omarchy |
| Vocalinux | Local voice dictation through a clean desktop interface |
| ostt | Open Speech-to-Text |
| Simon | Flexible speech recognition software |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.