How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
The main features of nsarrazin/serge are: Dockerized LLM Chat Deployments, Local Chat Applications, GGUF Model Loaders, Self-Hosted AI Models, Private LLM Chat Interfaces, Dockerized LLM Servers, llama.cpp Backend Runners, LLM API Servers.
Projects with overlapping indexed features include: serge-chat/serge — Serge is a self-hosted web chat interface for running large language models locally using the llama.cpp inference… michael-a-kuykendall/shimmy — Shimmy is a local large language model inference engine and server that loads and serves GGUF formatted weights. It is… getstream/vision-agents. sqlchat/sqlchat — SQL Chat is a Docker-deployed chat interface that translates natural language questions into SQL queries and executes… we-promise/sure — Actual Budget is an open-source personal finance application that stores all financial data locally on the user's… eddycjy/go-gin-example — This project is a reference implementation and boilerplate for building RESTful services using the Gin web framework…
Serge is a self-hosted web chat interface for running large language models locally using the llama.cpp inference engine. It loads GGUF-format model files directly on your own machine, removing the need for internet connectivity or external API keys, and streams responses to the browser in real time via WebSocket connections. The project is packaged for containerized deployment using Docker and Docker Compose, with a Traefik reverse proxy that handles HTTP and WebSocket routing along with automatic TLS certificate management. Ready-made Kubernetes manifests are also provided, enabling deploym
Shimmy is a local large language model inference engine and server that loads and serves GGUF formatted weights. It is distributed as a single binary runtime written in Rust, providing a standalone environment for running models without external runtime dependencies. The project utilizes WebGPU for hardware acceleration, allowing model compute kernels to execute across diverse graphics hardware through a standardized interface. It features a local server that implements an OpenAI-compatible API layer, enabling applications to interface with local models via standardized REST endpoints. Memor
SQL Chat is a Docker-deployed chat interface that translates natural language questions into SQL queries and executes them against connected databases. It uses a large language model to generate SQL from plain English instructions, supporting both querying and record modification through INSERT, UPDATE, and DELETE statements within the chat conversation flow. The application connects to MySQL, PostgreSQL, MSSQL, TiDB Cloud, and OceanBase databases through a unified driver abstraction layer, allowing users to interact with multiple database types from a single chat interface. Users provide the
