1 个仓库
Awesome GitHub RepositoriesTool Argument Constraints
Forces model-generated tool call arguments to match a JSON Schema during decoding, preventing malformed output.
Distinct from Constrained Decoding: Distinct from general Constrained Decoding: focuses specifically on tool call argument schemas rather than arbitrary output formats.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Tool Argument Constraints. Refine with filters or upvote what's useful.
Awesome Tool Argument Constraints GitHub Repositories
用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
- ericlbuehler/mistral.rs
EricLBuehler/mistral.rs
6,597在 GitHub 上查看mistral.rs is an inference engine for large language models that runs locally and exposes models behind OpenAI and Anthropic-compatible APIs. It serves as a multi-model serving platform, capable of loading several models in a single server process with per-request routing and on-demand loading and unloading. The engine supports multimodal inference, processing text alongside images, video, audio, and speech inputs, and includes a quantized model deployment runtime that reduces memory use and speeds up inference on consumer hardware. The project distinguishes itself through an agentic tool exe
Enforces JSON Schema on tool call arguments during decoding to prevent malformed output.
Rustllmrustuqff
