1 Repo
Awesome GitHub RepositoriesQuantized Artifact Inspectors
Tools that examine, report on, or verify the contents and integrity of quantized model files.
Distinct from Quantization Evaluation: Distinct from Quantization Evaluation: focuses on file integrity and content inspection, not accuracy or perplexity measurement.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Quantized Artifact Inspectors. Refine with filters or upvote what's useful.
Awesome Quantized Artifact Inspectors GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- ericlbuehler/mistral.rs
EricLBuehler/mistral.rs
6,597Auf GitHub ansehenmistral.rs is an inference engine for large language models that runs locally and exposes models behind OpenAI and Anthropic-compatible APIs. It serves as a multi-model serving platform, capable of loading several models in a single server process with per-request routing and on-demand loading and unloading. The engine supports multimodal inference, processing text alongside images, video, audio, and speech inputs, and includes a quantized model deployment runtime that reduces memory use and speeds up inference on consumer hardware. The project distinguishes itself through an agentic tool exe
Examines, reports on, or verifies the contents and integrity of UQFF quantized model files.
Rustllmrustuqff
