1 Repo
Awesome GitHub RepositoriesWeb Chat Interfaces
Browser-based chat UIs that use llama.cpp as the inference backend for local model interaction.
Distinct from llama.cpp Backend Runners: Distinct from llama.cpp Backend Runners: focuses on the web chat interface layer built on top of the backend runner, not the runner itself.
Explore 1 awesome GitHub repository matching devops & infrastructure · Web Chat Interfaces. Refine with filters or upvote what's useful.
Awesome Web Chat Interfaces GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- serge-chat/serge
serge-chat/serge
5,725Auf GitHub ansehenSerge is a self-hosted web chat interface for running large language models locally using the llama.cpp inference engine. It loads GGUF-format model files directly on your own machine, removing the need for internet connectivity or external API keys, and streams responses to the browser in real time via WebSocket connections. The project is packaged for containerized deployment using Docker and Docker Compose, with a Traefik reverse proxy that handles HTTP and WebSocket routing along with automatic TLS certificate management. Ready-made Kubernetes manifests are also provided, enabling deploym
Provides a browser-based chat interface that uses llama.cpp as the core inference engine for local model execution.
Sveltealpacadockerfastapi
