whisper.cpp is a high-performance C/C++ implementation of OpenAI’s Whisper automatic speech recognition model.
The project is designed for efficient local inference without requiring the original Python and PyTorch software stack, making Whisper practical on systems ranging from conventional Linux desktops and servers to Raspberry Pi boards, mobile devices and WebAssembly environments. Its implementation builds on ggml and places considerable emphasis on portability, low runtime overhead and hardware-specific acceleration.
Users can run transcription entirely on the CPU or take advantage of several GPU and accelerator backends. Models are converted to ggml format, with quantization available when reduced memory consumption and storage requirements are important.
This is free and open source software.
Key Features
- High-performance local inference using OpenAI Whisper speech recognition models.
- Plain C and C++ implementation with a lightweight runtime architecture.
- CPU-only transcription without requiring a discrete graphics processor.
- Integer model quantization to reduce memory consumption and model file sizes.
- Mixed F16 and F32 precision for balancing computational efficiency and numerical requirements.
- AVX instruction support for accelerating inference on compatible x86 processors.
- ARM NEON and Accelerate framework optimizations for Apple Silicon systems.
- Metal backend for executing Whisper inference efficiently on Apple GPUs.
- Core ML support for running encoder inference on Apple’s Neural Engine.
- CUDA support using cuBLAS and custom kernels on NVIDIA GPUs.
- ROCm/HIP acceleration for supported AMD graphics hardware.
- Vulkan backend offering cross-vendor GPU acceleration on compatible hardware.
- OpenVINO integration for acceleration on supported Intel CPUs and GPUs.
- POWER VSX optimizations for POWER9 and POWER10 systems.
- Voice activity detection for identifying speech regions before transcription.
- C-style API suitable for embedding speech recognition into other applications.
- Command-line transcription utility with configurable models and inference options.
- Cross-platform support – runs on Linux, FreeBSD, Windows, macOS, Android, iOS and WebAssembly deployments.
- Runs on resource-constrained hardware including Raspberry Pi systems.
- Runtime design avoids memory allocations during inference once processing has started.
Website: github.com/ggml-org/whisper.cpp
Support:
Developer: ggml-org
License: MIT License
whisper.cpp is written in C++ and C. Learn C++ with our recommended free books and free tutorials. Learn C with our recommended free books and free tutorials.
Related Software
| Speech Recognition Tools | |
|---|---|
| Whisper | Automatic speech recognition (system trained on 680,000 hours of data |
| whisper.cpp | Run Whisper locally with fast, efficient C/C++ speech recognition |
| Flashlight | Fast, flexible machine learning library written entirely in C++. |
| sherpa-onnx | Offline speech recognition for many platforms and languages |
| Kaldi | C++ toolkit designed for speech recognition researchers. |
| FunASR | Versatile speech recognition toolkit for real-world audio |
| faster-whisper | Faster Whisper transcription with reduced memory use |
| SpeechBrain | All-in-one conversational AI toolkit based on PyTorch |
| Handy | Offline speech-to-text application |
| ESPnet | End-to-End speech processing toolkit |
| PocketSphinx | Lightweight speech recognition for embedded and mobile use |
| deepspeech.pytorch | Implementation of DeepSpeech2 using Baidu Warp-CTC. |
| Epicenter | Transcription application with global speech-to-text functionality |
| Julius | Two-pass large vocabulary continuous speech recognition engine |
| Speech Note | Write notes, transcribe speech, translate text and read content aloud |
| aTrain | Private local transcription of recorded speech through a polished GUI |
| hyprwhspr | Native speech-to-text designed for Arch / Omarchy |
| Vocalinux | Local voice dictation through a clean desktop interface |
| ostt | Open Speech-to-Text |
| Simon | Flexible speech recognition software |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.