large language model Archives

AI00 RWKV Server – inference API server for running RWKV language models

AI00 RWKV Server is an open source RWKV inference API server with Vulkan acceleration and OpenAI API compatibility.

llmfit is a terminal application that helps users find local large language models that are suitable for the hardware they already own.

Cherry Studio is a desktop client that supports multiple LLM providers, available on Linux, macOS, and Windows.

Shimmy is a 4.8MB single-binary that provides 100% OpenAI-compatible endpoints for GGUF models.

OWLEN is a Rust-powered, terminal-first interface for interacting with local large language models.

Gerbil is a desktop app to easily run Large Language Models locally. The software is powered by KoboldCpp, a fork of llama.cpp.

Gerbil lets you run LLMs locally powered by KoboldCpp which itself is a highly modified fork of llama.cpp.

Elelem is a simple LLM client that connects seamlessly with OpenAI API compatible services.

Ollama is software in an early stage of development that lets you run and chat with Llama 2 and other models.