Gerbil lets you run LLMs locally powered by KoboldCpp which itself is a highly modified fork of llama.cpp.
Read more
Tag: large language model
Elelem – versatile LLM client
Elelem is a simple LLM client that connects seamlessly with OpenAI API compatible services.
Read more
Machine Learning in Linux: Ollama – self-hosted Llama 2
Ollama is software in an early stage of development that lets you run and chat with Llama 2 and other models.
Read more