How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
Serge is a self-hosted web chat interface for running large language models locally using the llama.cpp inference engine. It loads GGUF-format model files directly on your own machine, removing the need for internet connectivity or external API keys, and streams responses to the browser in real time via WebSocket connections. The project is packaged for containerized deployment using Docker and Docker Compose, with a Traefik reverse proxy that handles HTTP and WebSocket routing along with automatic TLS certificate management. Ready-made Kubernetes manifests are also provided, enabling deploym
Shimmy is a local large language model inference engine and server that loads and serves GGUF formatted weights. It is distributed as a single binary runtime written in Rust, providing a standalone environment for running models without external runtime dependencies. The project utilizes WebGPU for hardware acceleration, allowing model compute kernels to execute across diverse graphics hardware through a standardized interface. It features a local server that implements an OpenAI-compatible API layer, enabling applications to interface with local models via standardized REST endpoints. Memor
SQL Chat is a Docker-deployed chat interface that translates natural language questions into SQL queries and executes them against connected databases. It uses a large language model to generate SQL from plain English instructions, supporting both querying and record modification through INSERT, UPDATE, and DELETE statements within the chat conversation flow. The application connects to MySQL, PostgreSQL, MSSQL, TiDB Cloud, and OceanBase databases through a unified driver abstraction layer, allowing users to interact with multiple database types from a single chat interface. Users provide the
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
The main features of nsarrazin/serge are: Dockerized LLM Chat Deployments, Local Chat Applications, GGUF Model Loaders, Self-Hosted AI Models, Private LLM Chat Interfaces, Dockerized LLM Servers, llama.cpp Backend Runners, LLM API Servers.
Open-source alternatives to nsarrazin/serge include: serge-chat/serge — Serge is a self-hosted web chat interface for running large language models locally using the llama.cpp inference… michael-a-kuykendall/shimmy — Shimmy is a local large language model inference engine and server that loads and serves GGUF formatted weights. It is… getstream/vision-agents. sqlchat/sqlchat — SQL Chat is a Docker-deployed chat interface that translates natural language questions into SQL queries and executes… we-promise/sure — Actual Budget is an open-source personal finance application that stores all financial data locally on the user's… eddycjy/go-gin-example — This project is a reference implementation and boilerplate for building RESTful services using the Gin web framework…
