1 repository
High-level Python libraries that wrap REST APIs for interacting with large language models.
Distinct from LLM Python Bindings: Distinct from low-level bindings by providing a complete SDK for API-based model interaction rather than just an inference engine wrapper.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · API Client SDKs. Refine with filters or upvote what's useful.
This is a Python SDK for interacting with large language models via API. It serves as a client library to generate text, process messages, and manage conversational states, while providing a specialized interface for connecting to models hosted across different cloud infrastructure providers. The SDK includes a tool-calling framework that maps Python functions to JSON schemas, allowing models to execute external tools. It also features a built-in token counting utility to estimate input size before transmission and a server-sent events client for receiving model tokens in real time. The libr
Serves as a comprehensive Python client library for interacting with large language models via API.