2 Repos
Base classes and abstractions for interacting with various language model providers.
Distinguishing note: Focuses on the base abstraction layer, distinct from specific model implementations.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Model Client Interfaces. Refine with filters or upvote what's useful.
DSPy is a declarative programming framework designed for building complex language model applications. It treats model interactions as modular, composable programs, allowing developers to define task logic through typed class schemas rather than relying on manually written prompts. By organizing workflows into hierarchical, reusable Python objects, the framework enables the construction of sophisticated AI systems that manage state and execution flow independently. The framework distinguishes itself through an automated optimization engine that iteratively refines prompt instructions and few-
Provides a base class for handling language model calls and managing provider-specific configurations.
ChatRWKV is an open-source frontend and GPU-accelerated inference engine designed for interacting with RWKV recurrent neural network language models. It provides a self-hosted web chat interface and a specialized client for generating human-like text using a linear-complexity architecture. The project utilizes a GPU-accelerated backend that employs custom CUDA kernels and dynamic model format conversion to increase processing speed and reduce memory overhead. It manages conversation history through state-based context management, updating a fixed-size hidden state to maintain a constant memor
Implements a specialized client interface for interacting with RWKV linear-complexity architectures.