awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
gpustack avatar

gpustack/llama-boxArchived

0
View on GitHub↗

Llama Box

LM inference server implementation based on *.cpp.

Features

  • Inference and Serving - Inference server implementation based on llama.cpp.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
  • Inference Engines - Inference server implementation based on local model runners.
  • 292 stars·29 forks·C++·MIT·11 views

    Star history

    Star history chart for gpustack/llama-boxStar history chart for gpustack/llama-box

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Projects sharing features with Llama Box

    These projects share indexed features with Llama Box. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • bentoml/openllmbentoml avatar

      bentoml/OpenLLM

      12,586View on GitHub↗

      OpenLLM is a framework for deploying, managing, and scaling open-source large language models

      Pythonbentomlfine-tuningllama
      View on GitHub↗12,586
    • alexrozanski/llamachatalexrozanski avatar

      alexrozanski/LlamaChat

      1,510View on GitHub↗

      Chat with your favourite LLaMA models in a native macOS app

      Swiftaillamallamacpp
      View on GitHub↗1,510
    • augustdev/enchantedAugustDev avatar

      AugustDev/enchanted

      5,967View on GitHub↗

      Enchanted is a privacy-focused, cross-platform chat frontend for interacting with self-hosted large language models on iOS and macOS. It serves as a native client for communicating with private model servers, specifically providing integration for the Ollama API. The application supports multimodal interactions, allowing users to combine text, image attachments, and voice prompts. It provides tools for local AI model management, including the ability to define persistent system prompts and switch between different models for specific tasks. The interface includes capabilities for rendering m

      Swift
      View on GitHub↗5,967
    • berriai/litellmBerriAI avatar

      BerriAI/litellm

      62,881View on GitHub↗

      LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model providers. It provides a standardized API interface that abstracts vendor-specific schemas, allowing developers to interact with diverse models through a single, consistent format. By acting as a central traffic management layer, it enables organizations to route, secure, and govern model interactions across multiple deployments. The platform distinguishes itself through its policy-driven architecture, which uses configuration-based routing to manage traffic distribution, load balanc

      Pythonai-gatewayanthropicazure-openai
      View on GitHub↗62,881
    Compare all 30 related projects→

    Frequently asked questions

    What does gpustack/llama-box do?

    LM inference server implementation based on *.cpp.

    What are the main features of gpustack/llama-box?

    The main features of gpustack/llama-box are: Inference and Serving, Inference Engines.

    Which projects share features with gpustack/llama-box?

    Projects with overlapping indexed features include: berriai/litellm — LiteLLM is a unified gateway and proxy server designed to centralize access to over one hundred language model… bigai-nlco/tokenswift — [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation. augustdev/enchanted — Enchanted is a privacy-focused, cross-platform chat frontend for interacting with self-hosted large language models on… bentoml/openllm — OpenLLM is a framework for deploying, managing, and scaling open-source large language models. alexrozanski/llamachat — Chat with your favourite LLaMA models in a native macOS app. bklieger-groq/g1 — g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains.