2 रिपॉजिटरी
Provides JavaScript and Python SDKs that wrap the HTTP API for building custom applications against a local inference engine.
Distinct from Python SDK Embeddings: Distinct from Python SDK Embeddings: adds JavaScript SDK support and focuses on HTTP API wrapping rather than in-process embedding.
Explore 2 awesome GitHub repositories matching artificial intelligence & ml · Multi-Language SDK Wrappers. Refine with filters or upvote what's useful.
Microsandbox is a runtime for creating and managing lightweight, hardware-isolated virtual machines — called sandboxes — that boot directly from standard OCI container images. Each sandbox runs as its own host process with a separate kernel, filesystem, and network stack, providing process-per-sandbox isolation. The project includes a command-line tool and multi-language SDKs (Rust, TypeScript, Python, Go) for programmatic lifecycle control, and it communicates with sandbox agents over Unix sockets using a CBOR-encoded protocol. What distinguishes Microsandbox is its combination of host-manag
Provides native SDKs wrapping the agent protocol into typed APIs for Rust, TypeScript, Python, and Go.
This project is a headless large language model inference engine and server manager designed for local deployments. It provides a developer toolkit and API gateway that allows for the management of model lifecycles and inference tasks without a graphical user interface. The system enables the deployment of model engines across different operating systems, cloud environments, or CI pipelines. It includes a command-line interface for bootstrapping development projects and automating the orchestration of loading and unloading model binaries based on specific workflow needs. The toolset covers i
Provides JavaScript and Python SDKs that wrap the HTTP API for building custom applications against the local inference engine.