awesome-repositories.com
© 2026 Bringes Technology SRL·VAT RO45896025·hello@bringes.io
MCPSitemapPrivacyTerms
Command Line Inference Interfaces · Awesome GitHub Repositories

2 repos

Awesome GitHub RepositoriesCommand Line Inference Interfaces

Terminal-based interfaces that allow users to interact with and manage model inference servers directly from the command line.

Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Command Line Inference Interfaces. Refine with filters or upvote what's useful.

  1. Home
  2. Artificial Intelligence & ML
  3. Artificial Intelligence & Machine Learning
  4. Model Inference Runtimes
  5. Command Line Inference Interfaces

Awesome Command Line Inference Interfaces GitHub Repositories

Describe the repository you're looking for…
We'll search the best matching repositories with AI.
  • ggml-org/llama.cpp

    ggml-org/llama.cpp

    95,400GitHubView on GitHub↗

    Llama.cpp is an inference engine designed for the local execution of text-based and multimodal language models on consumer hardware. It provides a core environment for running models that process both text and image inputs, utilizing hardware-accelerated backends to optimize performance across diverse CPU and GPU archi

    C++ggml
  • infiniflow/ragflow

    infiniflow/ragflow

    73,425GitHubView on GitHub↗

    This project is a comprehensive retrieval-augmented generation platform designed for building, managing, and deploying knowledge-based AI applications. It provides a unified environment for organizing datasets, configuring conversational chat assistants, and developing autonomous agents that execute multi-step reasonin

    Pythonagentagenticagentic-ai

Explore sub-tags

  • OpenAI-Compatible Inference ServersAPI layers that expose retrieval and generation capabilities through standard interfaces for ecosystem interoperability.