app.lonecloud.gerbil MIT AGPL-3.0-or-later Gerbil

A desktop app to easily run Large Language Models locally

Gerbil is a desktop app to easily run Large Language Models locally. Powered by KoboldCpp, it provides a clean cross-platform interface for downloading, managing, and running various language models locally while maintaining complete privacy and control over your data.

Core Features:

Run LLMs locally powered by KoboldCpp (highly modified fork of llama.cpp)
Cross-platform desktop app - Native support for Windows, macOS, and Linux (including Wayland)
Automatic updates - Download and keep your KoboldCpp binary up-to-date effortlessly
Smart process management - Prevents runaway background processes and system resource waste
Optimized performance - Automatically unpacks binaries for faster operation and reduced memory usage
Image generation support - Built-in presets for Flux and Chroma image generation workflows
SillyTavern integration - Seamlessly launch SillyTavern for advanced character interactions
OpenWebUI integration - Launch OpenWebUI for a modern web-based chat interface
Privacy-focused - Everything runs locally on your machine, no data sent to external servers

app.lonecloud.gerbil.desktop gerbil app.lonecloud.gerbil https://github.com/lone-cloud/gerbil/raw/main/media/screenshots/launch.png Model Launch Configuration https://github.com/lone-cloud/gerbil/raw/main/media/screenshots/download.png Download & Setup https://github.com/lone-cloud/gerbil/raw/main/media/screenshots/text-story.png Text Generation https://github.com/lone-cloud/gerbil/raw/main/media/screenshots/gen-img.png Image Generation https://github.com/lone-cloud/gerbil/raw/main/media/screenshots/sillytavern.png SillyTavern integration https://github.com/lone-cloud/gerbil/raw/main/media/screenshots/openwebui.png OpenWebUI integration https://github.com/lone-cloud/gerbil https://github.com/lone-cloud/gerbil/issues Network Chat Utility AI LLM Large Language Model Local Machine Learning Privacy KoboldCpp llama.cpp SillyTavern OpenWebUI Text Generation Image Generation lone-cloud