# lostruins/koboldcpp

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/lostruins-koboldcpp).**

9,511 stars · 616 forks · C++ · agpl-3.0 · fork

## Links

- GitHub: https://github.com/LostRuins/koboldcpp
- Homepage: https://github.com/LostRuins/koboldcpp/releases/latest
- awesome-repositories: https://awesome-repositories.com/repository/lostruins-koboldcpp.md

## Topics

`gemma` `ggml` `gguf` `koboldai` `koboldcpp` `language-model` `llama` `llamacpp` `llm` `mistral`

## Tags

### Part of an Awesome List

- [Inference Engines](https://awesome-repositories.com/f/awesome-lists/ai/inference-engines.md) — Easy-to-use GGUF model runner with integrated UI.
- [Large Language Models](https://awesome-repositories.com/f/awesome-lists/ai/large-language-models.md) — Easy-to-use text generation software for GGML-based models.
- [Model Deployment](https://awesome-repositories.com/f/awesome-lists/devops/model-deployment.md) — Listed in the “Model Deployment” section of the Llm Course awesome list.