KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI.
It’s a single self-contained distributable that builds off llama.cpp and adds many additional powerful features.
This is free and open source software.
Features include:
- Single file executable, with no installation required and no external dependencies.
- Runs on CPU or GPU, supports full or partial offloaded.
- LLM text generation (Supports all GGML and GGUF models, backwards compatibility with ALL past models).
- Image Generation (Stable Diffusion 1.5, SDXL, SD3, Flux).
- Speech-To-Text (Voice Recognition) via Whisper.
- Text-To-Speech (Voice Generation) via OuteTTS.
- Provides many compatible APIs endpoints for many popular webservices (KoboldCppApi OpenAiApi OllamaApi A1111ForgeApi ComfyUiApi WhisperTranscribeApi XttsApi OpenAiSpeechApi)
- Bundled KoboldAI Lite UI with editing tools, save formats, memory, world info, author’s note, characters, scenarios.
- Includes multiple modes (chat, adventure, instruct, storywriter) and UI Themes (aesthetic roleplay, classic writer, corporate assistant, messsenger).
- Supports loading Tavern Character Cards, importing many different data formats from various sites, reading or exporting JSON savefiles and persistent stories.
- Many other features including new samplers, regex support, websearch, RAG via TextDB and more.
- Ready-to-use binaries for Linux, macOS and Windows. It runs directly with Colab, Docker, also supports other platforms if self-compiled (like Android (via Termux) and Raspberry Pi).
Website: github.com/LostRuins/koboldcpp
Support:
Developer: LostRuins Concedo
License: GNU Affero General Public License v3.0
KoboldCpp is written in C++. Learn C++ with our recommended free books and free tutorials.
| Explore Linux | |
|---|---|
 | Best Free and Open Source Software - A huge collection of recommended free and open source software covering every major category. |
 | In-depth Linux Software Reviews - Detailed assessments of Linux software covering features, usability and overall quality. |
 | The Big List of Active Linux Distros - An extensive collection of actively developed Linux distributions. |
 | Open Source Alternatives - Alternatives to software and services from Google, Microsoft, Apple, Adobe, IBM, Autodesk, Oracle and others. |
 | Essential Linux System Tools - Indispensable utilities for monitoring, maintaining and managing Linux systems. |
 | Linux Productivity Tools - Useful utilities for improving productivity and streamlining everyday tasks. |
 | Alternatives to Popular CLI Tools - Modern alternatives to familiar command-line utilities supplied with Linux systems. |
 | Awesome Free Linux Game Tools - Tools, utilities and companion software that improve gaming on Linux. |
 | Machine Learning on Linux - Machine learning and deep learning software, self-hosted applications and practical tools. |
 | Saving Money with Linux - Practical ways to reduce electricity consumption and lower computing costs with Linux. |
 | Linux Candy - Fun, entertaining and sometimes delightfully quirky software from the lighter side of Linux. |
Please read our Comment Policy before commenting.