2 repos
Terminal-based interfaces that allow users to interact with and manage model inference servers directly from the command line.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Command Line Inference Interfaces. Refine with filters or upvote what's useful.
Llama.cpp is an inference engine designed for the local execution of text-based and multimodal language models on consumer hardware. It provides a core environment for running models that process both text and image inputs, utilizing hardware-accelerated backends to optimize performance across diverse CPU and GPU archi
This project is a comprehensive retrieval-augmented generation platform designed for building, managing, and deploying knowledge-based AI applications. It provides a unified environment for organizing datasets, configuring conversational chat assistants, and developing autonomous agents that execute multi-step reasonin