Gerbil is a desktop app to easily run Large Language Models locally.
This is free and open source software.
Features include:
- Run LLMs locally powered by KoboldCpp which itself is a highly modified fork of llama.cpp.
- Cross-platform desktop app – Native support for Linux (including Wayland), macOS, and Windows.
- Automatic updates – Download and keep your KoboldCpp binary up-to-date effortlessly.
- Smart process management – Prevents runaway background processes and system resource waste.
- Optimized performance – Automatically unpacks binaries for faster operation and reduced memory usage.
- Image generation support – Built-in presets for Flux and Chroma image generation workflows.
- SillyTavern integration – Seamlessly launch SillyTavern for advanced character interactions (requires Node.js).
- OpenWebUI integration – Launch OpenWebUI for a modern web-based chat interface (requires uv).
- Privacy-focused – Everything runs locally on your machine, no data sent to external servers.
Website: github.com/lone-cloud/gerbil
Support:
Developer: lone-cloud
License: GNU Affero General Public License v3.0
Gerbil is written in TypeScript. Learn TypeScript with our recommended free books and free tutorials.
| Explore Linux | |
|---|---|
 | Best Free and Open Source Software - A huge collection of recommended free and open source software covering every major category. |
 | In-depth Linux Software Reviews - Detailed assessments of Linux software covering features, usability and overall quality. |
 | The Big List of Active Linux Distros - An extensive collection of actively developed Linux distributions. |
 | Open Source Alternatives - Alternatives to software and services from Google, Microsoft, Apple, Adobe, IBM, Autodesk, Oracle and others. |
 | Essential Linux System Tools - Indispensable utilities for monitoring, maintaining and managing Linux systems. |
 | Linux Productivity Tools - Useful utilities for improving productivity and streamlining everyday tasks. |
 | Alternatives to Popular CLI Tools - Modern alternatives to familiar command-line utilities supplied with Linux systems. |
 | Awesome Free Linux Game Tools - Tools, utilities and companion software that improve gaming on Linux. |
 | Machine Learning on Linux - Machine learning and deep learning software, self-hosted applications and practical tools. |
 | Saving Money with Linux - Practical ways to reduce electricity consumption and lower computing costs with Linux. |
 | Linux Candy - Fun, entertaining and sometimes delightfully quirky software from the lighter side of Linux. |
Please read our Comment Policy before commenting.