awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
mistralai avatar

mistralai/mistral-srcArchived

0
View on GitHub↗
10,821 stars·1,055 forks·Jupyter Notebook·Apache-2.0·27 viewsmistral.ai↗

Mistral Src

This project is a large language model inference library and framework designed to run models for text generation, problem solving, and coding assistance. It includes a multimodal framework for processing combined image and text inputs and a tool-use implementation that enables the execution of external functions based on model reasoning.

The system features a distributed GPU inference engine that spreads large model workloads across multiple graphics processors to increase processing speed and meet memory requirements. It also provides containerized model deployment through pre-packaged images and dependencies for serving inference engines in isolated environments.

The library covers a range of capabilities including multimodal input analysis, function calling integration, and fill-in-the-middle coding for predicting missing code segments. It further supports interactive model chat via a command-line interface for maintaining conversational sessions.

Features

  • AI Model Inference - Executes large language models to generate text, solve mathematical problems, and provide coding assistance.
  • Inference Libraries - Provides a programmatic library to load and execute large language models for text generation and problem solving.
  • Multimodal Frameworks - Ships a framework for processing combined image and text inputs to describe visual content and answer questions.
  • Distributed Model Execution - Spreads large model workloads across multiple GPUs to increase processing speed and memory capacity.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
  • Function Calling Interfaces - Provides interfaces that enable language models to execute external tools and API functions.
  • Large Language Models - Provides a programmatic interface for running Mistral models to generate text and solve problems.
  • Multimodal Inference Engines - Ships an engine capable of processing combined image and text inputs to describe visual content.
  • Model Inference Execution - Executes model weights through a processing pipeline to generate text completions and predictions.
  • Multi-GPU Inference Runtimes - Implements a runtime that distributes model execution across multiple GPUs using tensor parallelism to handle large model weights.
  • Multi-GPU Distribution - Employs techniques to split model parameters across multiple graphics cards to overcome memory limitations and increase speed.
  • Tensor Parallelism - Splits large model weight matrices across multiple GPUs to distribute memory load.
  • Tool-Use Function Mapping - Maps model-generated structured text to external API calls to extend capabilities beyond internal knowledge.
  • Multimodal Analysis Engines - Processes images and text together to describe visual content or answer questions about images.
  • Fill-In-Middle Sequence Masking - Adjusts attention masks to enable the prediction of missing tokens between two existing blocks of text.
  • Input Sequence Attentions - Calculates weighted relationships between tokens to determine the context for the next prediction.
  • Distribution-Based Sampling - Selects tokens from a probability distribution using temperature and top-p filtering.
  • Fill-In-The-Middle Coding - Predicts and inserts missing code segments within existing text blocks to assist with software development.
  • Code In-filling - Implements fill-in-the-middle techniques to predict and insert missing code segments within existing text blocks.
  • KV Cache Management - Manages key-value caches for transformer models to avoid redundant calculations during text generation.
  • Tool-Using Model Inference - Enables the model to reason about and trigger external function calls to extend capabilities beyond text generation.
  • Interactive Model Inference Sessions - Provides a command-line interface for maintaining interactive conversational sessions with models.
  • Model-to-Image Packaging - Provides utilities to create container images for serving high-performance inference engines.
  • Containerized Model Serving - Ships pre-packaged images and dependencies for serving inference engines in isolated container environments.
  • GPU Linear Algebra Libraries - Offloads matrix multiplications to specialized GPU kernels for high-throughput inference.
  • Foundation Models - High-performance language model engineered for efficiency.
  • Large Language Models - Reference implementation for Mistral model architectures.
  • Large Language Models (LLMs) - Listed in the “Large Language Models (LLMs)” section of the The Incredible Pytorch awesome list.
  • Star history

    Star history chart for mistralai/mistral-srcStar history chart for mistralai/mistral-src

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Frequently asked questions

    What does mistralai/mistral-src do?

    This project is a large language model inference library and framework designed to run models for text generation, problem solving, and coding assistance. It includes a multimodal framework for processing combined image and text inputs and a tool-use implementation that enables the execution of external functions based on model reasoning.

    What are the main features of mistralai/mistral-src?

    The main features of mistralai/mistral-src are: AI Model Inference, Inference Libraries, Multimodal Frameworks, Distributed Model Execution, Function Calling Interfaces, Large Language Models, Multimodal Inference Engines, Model Inference Execution.

    Which projects share features with mistralai/mistral-src?

    Projects with overlapping indexed features include: facebookresearch/llama — Llama is a large language model runtime and inference engine designed to load and execute autoregressive transformer… pytorch-labs/gpt-fast — gpt-fast is a PyTorch transformer inference engine designed for low-latency text generation. It functions as a… intel/ipex-llm — Intel XPU LLM Acceleration Library is a toolkit designed to accelerate large language model inference and finetuning… qwenlm/qwen — Qwen is a comprehensive framework for large language model development, serving, and deployment. It provides a… modeltc/lightllm — LightLLM is a high-performance serving framework for deploying and executing large language models. It functions as a… mistralai/mistral-inference — Mistral Inference is a library for running Mistral large language models on a GPU, generating text from prompts with…

    Projects sharing features with Mistral Src

    These projects share indexed features with Mistral Src. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • facebookresearch/llamafacebookresearch avatar

      facebookresearch/llama

      59,466View on GitHub↗

      Llama is a large language model runtime and inference engine designed to load and execute autoregressive transformer models. It enables the generation of natural language text completions from prompts using pretrained weights. The system features multi-GPU model parallelism, which distributes model weights and workloads across multiple graphics processors to support larger parameter counts. It also incorporates a content safety filter that uses classifiers to intercept and block unsafe inputs or outputs during the inference process. The project covers broad capabilities in distributed model

      Python
      View on GitHub↗59,466
    • pytorch-labs/gpt-fastpytorch-labs avatar

      pytorch-labs/gpt-fast

      6,225View on GitHub↗

      gpt-fast is a PyTorch transformer inference engine designed for low-latency text generation. It functions as a distributed GPU inference library, a quantized model runner, and a speculative decoding framework. The system utilizes a speculative decoding workflow where a small draft model predicts token sequences for verification by a larger model to accelerate generation. It supports quantized model execution to reduce memory footprint and implements tensor parallelism to split computations across multiple GPUs. The project includes a standardized evaluation harness to measure the accuracy an

      Python
      View on GitHub↗6,225
    • intel/ipex-llmintel avatar

      intel/ipex-llm

      8,836View on GitHub↗

      Intel XPU LLM Acceleration Library is a toolkit designed to accelerate large language model inference and finetuning on Intel CPUs, GPUs, and NPUs. It provides a distributed inference engine for scaling models across multiple accelerators, a multimodal model runtime for vision and speech tasks, and a low-bit model quantization tool for converting weights into INT4, FP8, and GGUF formats. The project features a parameter-efficient finetuning framework that enables model adaptation using QLoRA and DPO on Intel hardware. It distinguishes itself by providing specialized optimizations for Intel XP

      Python
      View on GitHub↗8,836
    • qwenlm/qwenQwenLM avatar

      QwenLM/Qwen

      22,014View on GitHub↗

      Qwen is a comprehensive framework for large language model development, serving, and deployment. It provides a complete ecosystem for transformer-based sequence modeling, offering base models alongside specialized tools for instruction-tuned alignment, fine-tuning, and long-context inference. The project is designed to support both research and production environments, enabling users to train, optimize, and host generative models locally or across distributed hardware. The framework distinguishes itself through its focus on high-performance serving and extensibility. It features a high-perfor

      Pythonchineseflash-attentionlarge-language-models
      View on GitHub↗22,014
    Compare all 30 related projects→