EricLBuehler/mistral.rs

Features

• Artificial Intelligence - Fast LLM inference engine supporting multimodal models and quantization.
• Inference and Serving - High-speed inference engine for language models.
• Inference Engines - Fast and flexible inference engine for various models.