awesome-repositories.com
© 2026 Bringes Technology SRL·VAT RO45896025·hello@bringes.io
MCPSitemapPrivacyTerms
Command Line Inference Interfaces · Awesome GitHub Repositories

2 repos

Awesome GitHub RepositoriesCommand Line Inference Interfaces

Terminal-based interfaces that allow users to interact with and manage model inference servers directly from the command line.

Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Command Line Inference Interfaces. Refine with filters or upvote what's useful.

  1. Home
  2. Artificial Intelligence & ML
  3. Machine Learning
  4. Infrastructure
  5. Deployment & Serving
  6. Local and On-Device Inference
  7. Command Line Inference Interfaces

Awesome Command Line Inference Interfaces GitHub Repositories

Describe the repository you're looking for…
We'll search the best matching repositories with AI.
  • ggml-org/llama.cpp

    ggml-org/llama.cpp

    95,400GitHubView on GitHub↗

    Llama.cpp is an inference engine designed for the local execution of text-based and multimodal language models on consumer hardware. It provides a core environment for running models that process both text and image inputs, utilizing hardware-accelerated backends to optimize performance across diverse CPU and GPU archi

    C++ggml
  • infiniflow/ragflow

    infiniflow/ragflow

    73,425GitHubView on GitHub↗

    This project is a comprehensive retrieval-augmented generation platform designed for building, managing, and deploying knowledge-based AI applications. It provides a unified environment for organizing datasets, configuring conversational chat assistants, and developing autonomous agents that execute multi-step reasonin

    Pythonagentagenticagentic-ai

Explore sub-tags

  • OpenAI-Compatible Inference ServersAPI layers that expose retrieval and generation capabilities through standard interfaces for ecosystem interoperability.