faster-whisper is a reimplementation of OpenAI’s Whisper automatic speech recognition model built around CTranslate2, an inference engine optimized for Transformer models.
Its primary aim is to provide Whisper transcription with lower processing times and more efficient memory usage than the original PyTorch implementation while retaining equivalent recognition behaviour. It can run on CPUs or NVIDIA GPUs and supports several computation types, including INT8 quantization for systems where memory consumption is particularly important.
The library is aimed at developers who want to incorporate Whisper into Python applications rather than providing a standalone desktop interface. It handles model acquisition, audio decoding, language detection and segmented transcription through a concise Python API.
This is free and open source software.
Key Features
- Runs OpenAI Whisper models through the optimized CTranslate2 inference engine.
- CPU inference for systems without a supported discrete graphics processor.
- NVIDIA GPU execution using CUDA, cuBLAS and cuDNN libraries.
- INT8 quantization on CPU to reduce memory requirements and accelerate suitable workloads.
- INT8 and mixed computation modes for supported GPU inference configurations.
- FP16 execution for efficient transcription on compatible NVIDIA graphics hardware.
- Batched inference pipeline for increasing throughput when processing suitable workloads.
- Compatible with Distil-Whisper checkpoints designed for more efficient Whisper inference.
- Automatic language detection with a probability value returned alongside transcription information.
- Segment-level timestamps identifying the beginning and end of recognised passages.
- Optional word-level timestamps for applications requiring more precise timing information.
- Integrated Silero voice activity detection for filtering portions of recordings without speech.
- Voice activity detection parameters can be adjusted to suit different silence characteristics.
- Uses PyAV for audio decoding, avoiding a requirement for a separately installed FFmpeg executable.
- Automatically downloads corresponding converted models when a model size is specified.
- Can load CTranslate2 Whisper models directly from a local directory.
- Conversion utilities support original Whisper and compatible Transformers model checkpoints.
- Works with fine-tuned Whisper models after conversion to the CTranslate2 model format.
- Python generator-based transcription interface allows segments to be consumed progressively.
- Supports beam-search configuration and other decoding parameters exposed by the transcription API.
Website: github.com/SYSTRAN/faster-whisper
Support:
Developer: SYSTRAN
License: MIT License
faster-whisper is written in Python. Learn Python with our recommended free books and free tutorials.
Related Software
| Speech Recognition Tools | |
|---|---|
| Whisper | Automatic speech recognition (system trained on 680,000 hours of data |
| whisper.cpp | Run Whisper locally with fast, efficient C/C++ speech recognition |
| Flashlight | Fast, flexible machine learning library written entirely in C++. |
| sherpa-onnx | Offline speech recognition for many platforms and languages |
| Kaldi | C++ toolkit designed for speech recognition researchers. |
| FunASR | Versatile speech recognition toolkit for real-world audio |
| faster-whisper | Faster Whisper transcription with reduced memory use |
| SpeechBrain | All-in-one conversational AI toolkit based on PyTorch |
| Handy | Offline speech-to-text application |
| ESPnet | End-to-End speech processing toolkit |
| PocketSphinx | Lightweight speech recognition for embedded and mobile use |
| deepspeech.pytorch | Implementation of DeepSpeech2 using Baidu Warp-CTC. |
| Epicenter | Transcription application with global speech-to-text functionality |
| Julius | Two-pass large vocabulary continuous speech recognition engine |
| Speech Note | Write notes, transcribe speech, translate text and read content aloud |
| aTrain | Private local transcription of recorded speech through a polished GUI |
| hyprwhspr | Native speech-to-text designed for Arch / Omarchy |
| Vocalinux | Local voice dictation through a clean desktop interface |
| ostt | Open Speech-to-Text |
| Simon | Flexible speech recognition software |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.