awesome-repositories.com
博客
MCP
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目MCP 服务器关于排名机制媒体报道
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

59 个仓库

Awesome GitHub RepositoriesModel Analysis

Frameworks for benchmarking model accuracy and speed while providing guidance on prompt engineering and generative consistency.

Explore 59 awesome GitHub repositories matching artificial intelligence & ml · Model Analysis. Refine with filters or upvote what's useful.

Awesome Model Analysis GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • unslothai/unslothunslothai 的头像

    unslothai/unsloth

    66,628在 GitHub 上查看↗

    Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade hardware. The platform distinguishes itself through hand-optimized kernels and automated computational graph techniques that maximize hardware throughput. It supports advanced training methodologies, including reinforcement learning for reasoning and efficient adapter-based fin

    Standardized benchmarking tests measure speed and accuracy to determine the optimal balance between performance and output quality.

    Pythonagentdeepseekdeepseek-r1
    在 GitHub 上查看↗66,628
  • aaif-goose/gooseaaif-goose 的头像

    aaif-goose/goose

    49,637在 GitHub 上查看↗

    Goose is an autonomous coding assistant and extensible AI agent framework designed to automate software development workflows. It functions as an orchestration engine that can install, execute, and test code, as well as manage local files and shell commands. The platform is model-agnostic, providing a flexible interface to connect with diverse cloud-based or self-hosted large language model providers. It distinguishes itself through a standardized context protocol for integrating external tools and extensions, and a recipe system that allows users to define and repeat complex, multi-step AI w

    Executes standardized tests across multiple provider and model combinations to compare performance data.

    Rust
    在 GitHub 上查看↗49,637
  • roboflow/supervisionroboflow 的头像

    roboflow/supervision

    44,437在 GitHub 上查看↗

    Supervision is a computer vision toolset for normalizing model outputs, managing datasets, and visualizing annotations. It provides a framework to convert predictions from various classification and detection models into a standardized data format to ensure interoperability across different computer vision pipelines. The library features a post-processor for filtering, counting, and tracking detected objects across image frames and video streams. It includes capabilities for large image tiling to improve the detection of small objects and tools for assigning persistent identities to objects t

    Evaluates computer vision model accuracy using standardized metrics like mean Average Precision and confusion matrices.

    Pythonclassificationcococomputer-vision
    在 GitHub 上查看↗44,437
  • lm-sys/fastchatlm-sys 的头像

    lm-sys/FastChat

    39,472在 GitHub 上查看↗

    FastChat is a training and serving platform for large language models that provides an integrated toolkit for fine-tuning, hosting, and benchmarking chatbots. It functions as an inference server capable of hosting multiple models and exposing them via a standardized API for chat applications. The platform distinguishes itself through a distributed model controller that manages worker nodes and routes requests across a hardware-agnostic inference layer supporting various accelerators. It includes a dedicated evaluation framework for assessing model quality using automated judges, multi-turn di

    Implements a benchmarking system for assessing response accuracy using multi-turn question sets and automated judges.

    Python
    在 GitHub 上查看↗39,472
  • google-research/google-researchgoogle-research 的头像

    google-research/google-research

    38,139在 GitHub 上查看↗

    This repository serves as a comprehensive research platform and toolkit for advancing machine learning, quantum computing, and large-scale scientific data analysis. It provides foundational frameworks for developing complex algorithmic systems, offering the necessary infrastructure for distributed training, computational graph execution, and high-performance model development. The project distinguishes itself by integrating specialized research domains with robust, privacy-preserving methodologies. It supports diverse scientific discovery through tools for quantum simulation, physics-informed

    Evaluates the performance of data-driven predictive models for weather, climate, and environmental events against standardized datasets.

    Jupyter Notebookaimachine-learningresearch
    在 GitHub 上查看↗38,139
  • google/mediapipegoogle 的头像

    google/mediapipe

    35,673在 GitHub 上查看↗

    MediaPipe is a cross-platform machine learning framework designed for building and deploying pipelines that process live and streaming media. It provides a system for connecting processing components into custom machine learning chains to analyze real-time audio and video streams. The framework includes a suite of pre-trained models for tasks such as hand, face, and pose tracking, along with tools for retraining and customizing these models with specific datasets. It also features a dedicated benchmarker for measuring the execution speed and accuracy of machine learning models directly within

    Ships tools to measure the execution speed and accuracy of machine learning models directly within a browser.

    C++
    在 GitHub 上查看↗35,673
  • facebookresearch/detectron2facebookresearch 的头像

    facebookresearch/detectron2

    34,548在 GitHub 上查看↗

    Detectron2 is a PyTorch computer vision framework and visual recognition platform designed for training and deploying models for object detection, image segmentation, and visual recognition. It provides a research-oriented environment for training complex vision models with multi-GPU acceleration. The project includes a specialized object detection library for identifying and locating multiple objects via bounding boxes, as well as an image segmentation toolkit for creating pixel-level masks through instance, semantic, and panoptic segmentation. Additionally, it features a human pose estimati

    Measures execution speed for data loading, training, and inference to determine system throughput.

    Python
    在 GitHub 上查看↗34,548
  • sgl-project/sglangsgl-project 的头像

    sgl-project/sglang

    29,079在 GitHub 上查看↗

    Sglang is a high-performance inference engine and serving system designed for large language and multimodal models. It provides a programmable interface for orchestrating complex generation workflows, enabling developers to coordinate multi-turn dialogues, tool invocations, and reasoning chains through a domain-specific language. The platform is built to support production-scale deployments, offering an OpenAI-compatible API that allows for integration with existing application ecosystems. The system distinguishes itself through a disaggregated architecture that separates compute-intensive pr

    Evaluates inference speed and output accuracy of deployed models across different hardware environments.

    Pythonattentionblackwellcuda
    在 GitHub 上查看↗29,079
  • liguodongiot/llm-actionliguodongiot 的头像

    liguodongiot/llm-action

    23,169在 GitHub 上查看↗

    This project is a comprehensive framework for the training, fine-tuning, and deployment of large language models. It functions as a distributed deep learning platform that enables users to scale model workflows across multiple hardware nodes while providing tools for model evaluation and performance benchmarking. The platform distinguishes itself by offering specialized utilities for model compression and weight transformation, allowing users to reduce memory footprints and latency through quantization and pruning. It supports the adaptation of large models for consumer-grade hardware, facili

    Measures model reasoning and instruction-following performance using standardized benchmarking frameworks.

    HTMLllmllm-inferencellm-serving
    在 GitHub 上查看↗23,169
  • deepseek-ai/deepseek-ocrdeepseek-ai 的头像

    deepseek-ai/DeepSeek-OCR

    22,498在 GitHub 上查看↗

    DeepSeek-OCR is a vision processing framework designed to convert image-based text into machine-readable tokens for large language models. It functions as a document inference pipeline that encodes visual data into compact representations, enabling automated optical character recognition and document analysis workflows. The system distinguishes itself through a high-throughput architecture that utilizes hardware-accelerated batch inference to process large volumes of visual data. It incorporates dynamic resolution scaling to manage the balance between visual detail and token consumption, ensu

    Provides automated performance and accuracy benchmarking for visual processing models.

    Python
    在 GitHub 上查看↗22,498
  • microsoft/unilmmicrosoft 的头像

    microsoft/unilm

    22,030在 GitHub 上查看↗

    This project is a comprehensive framework and toolkit for developing, optimizing, and deploying transformer-based models across multimodal, document intelligence, and natural language processing tasks. It provides a unified neural architecture that processes text, vision, audio, and document layout data through a shared set of weights, enabling researchers and developers to build foundational models that align cross-modal representations. The platform distinguishes itself through advanced training and inference strategies designed for large-scale deep learning. It incorporates specialized mec

    Runs standardized benchmarks on mathematical reasoning datasets to measure model accuracy and output quality.

    Pythonbeitbeit-3bitnet
    在 GitHub 上查看↗22,030
  • voltagent/awesome-claude-code-subagentsVoltAgent 的头像

    VoltAgent/awesome-claude-code-subagents

    21,906在 GitHub 上查看↗

    This project provides a framework for managing multi-agent systems, designed to automate complex software development, infrastructure, and business workflows. It functions as a multi-agent workflow orchestrator that routes tasks to domain-specific workers while maintaining state persistence and infrastructure automation. By leveraging large language models, the system decomposes high-level objectives into actionable plans, ensuring that complex operations are executed with consistency and reliability. The framework distinguishes itself through its hierarchical agent registry and policy-driven

    Validates model effectiveness through automated testing and accuracy benchmarks.

    Shellai-agent-frameworkai-agent-toolsai-agents
    在 GitHub 上查看↗21,906
  • qwenlm/qwenQwenLM 的头像

    QwenLM/Qwen

    21,294在 GitHub 上查看↗

    Qwen is a comprehensive framework for large language model development, serving, and deployment. It provides a complete ecosystem for transformer-based sequence modeling, offering base models alongside specialized tools for instruction-tuned alignment, fine-tuning, and long-context inference. The project is designed to support both research and production environments, enabling users to train, optimize, and host generative models locally or across distributed hardware. The framework distinguishes itself through its focus on high-performance serving and extensibility. It features a high-perfor

    Provides standardized evaluation scripts to benchmark model performance on reasoning, knowledge, and coding tasks.

    Pythonchineseflash-attentionlarge-language-models
    在 GitHub 上查看↗21,294
  • microsoft/onnxruntimemicrosoft 的头像

    microsoft/onnxruntime

    19,347在 GitHub 上查看↗

    This project is a cross-platform machine learning inference engine designed to execute pre-trained models across diverse operating systems and hardware environments. It functions as a standardized execution framework that manages the entire lifecycle of model inference, from loading and graph optimization to hardware-accelerated execution and generative sequence management. The runtime distinguishes itself through a highly modular architecture that decouples model logic from hardware-specific kernels. By utilizing an execution provider abstraction, it enables developers to offload computation

    Measures and compares the accuracy and latency of model inference across different execution environments and hardware backends to validate performance gains.

    C++ai-frameworkdeep-learninghardware-acceleration
    在 GitHub 上查看↗19,347
  • tensorflow/tfjstensorflow 的头像

    tensorflow/tfjs

    19,134在 GitHub 上查看↗

    TensorFlow.js is a JavaScript machine learning library used for training and deploying models in web browsers and server-side environments. It functions as a browser-based model trainer, a WebAssembly inference engine, and a WebGPU accelerated tensor library for low-level linear algebra. The project also includes a model converter to transform Python-based models into optimized formats for JavaScript execution. The library distinguishes itself through a pluggable backend architecture that allows mathematical operations to be executed via CPU, WebGL, or WebGPU. It supports the conversion of Py

    Provides standardized tests to measure the execution speed and accuracy of models.

    TypeScript
    在 GitHub 上查看↗19,134
  • ymcui/chinese-llama-alpacaymcui 的头像

    ymcui/Chinese-LLaMA-Alpaca

    18,944在 GitHub 上查看↗

    This project is a comprehensive toolkit for adapting large language models to the Chinese language, providing a specialized framework for fine-tuning, inference, and local deployment. It serves as a coordinated suite for language-specific adaptation, including tools for expanding tokenizers and implementing retrieval-augmented generation. The project distinguishes itself through a complete pipeline for model adaptation, featuring multilingual tokenizer expansion and a fine-tuning framework that supports instruction-based supervised training and adapter merging. It also includes a dedicated de

    Benchmarks language model accuracy using configurable parameters for chain-of-thought and few-shot prompting.

    Pythonalpacaalpaca-2large-language-models
    在 GitHub 上查看↗18,944
  • openai/evalsopenai 的头像

    openai/evals

    18,702在 GitHub 上查看↗

    Evals is a framework designed for automating, managing, and executing repeatable benchmarking suites to analyze the quality and performance of language models. It provides a platform for running standardized tests to measure model accuracy and track behavioral changes over time. The system distinguishes itself through a modular architecture that uses a standardized adapter layer to normalize inputs and outputs, allowing different models to be swapped and tested interchangeably. It supports the creation of custom benchmarks using proprietary data, enabling quality assurance on sensitive tasks

    Measures the accuracy and behavior of language models using standardized tests to identify performance changes.

    Python
    在 GitHub 上查看↗18,702
  • meta-llama/llama-cookbookmeta-llama 的头像

    meta-llama/llama-cookbook

    18,375在 GitHub 上查看↗

    This project is a collection of implementation guides, recipes, and developer resources for building applications with Llama models. It serves as a comprehensive kit for developing autonomous agents, establishing retrieval-augmented generation systems, and executing model fine-tuning. The resource provides specific patterns for multimodal workflows that process text, images, and audio. It includes specialized guidance on adapting pre-trained model weights for targeted tasks and implementing tool-calling orchestration to connect models with external APIs and functions. The codebase covers a b

    Llama runs throughput analysis and quality benchmarks to measure the efficiency of quantized models.

    Jupyter Notebookaifinetuninglangchain
    在 GitHub 上查看↗18,375
  • modelscope/ms-swiftmodelscope 的头像

    modelscope/ms-swift

    14,597在 GitHub 上查看↗

    This project is a comprehensive toolkit designed for the full lifecycle management of large language and multimodal models. It functions as a unified orchestrator that handles the entire development process, ranging from dataset preparation and supervised fine-tuning to advanced reinforcement learning alignment and production-ready inference deployment. The platform distinguishes itself through a specialized reinforcement learning library that supports complex optimization algorithms, including group relative policy optimization and leave-one-out techniques, to improve model instruction-follo

    The platform assesses model quality using standard evaluation backends to measure accuracy and performance on specific datasets and benchmarks.

    Pythondeepseek-r1embeddinggrpo
    在 GitHub 上查看↗14,597
  • dmlc/dgldmlc 的头像

    dmlc/dgl

    14,283在 GitHub 上查看↗

    DGL is a Python library for building and training graph neural networks. It functions as a graph message passing framework and a geometric deep learning tool, enabling the development of models that analyze graph-structured data. The library is designed for large-scale graph processing, utilizing distributed training and neighbor sampling to handle datasets with billions of edges. It provides specialized support for heterogeneous graph modeling, allowing for the representation of complex real-world entities with multiple node and edge types. Its capabilities cover a wide range of graph tasks

    Executes standardized benchmark suites to track execution time and accuracy across different hardware and versions.

    Pythondeep-learninggraph-neural-networks
    在 GitHub 上查看↗14,283
上一个123下一个
  1. Home
  2. Artificial Intelligence & ML
  3. Machine Learning
  4. Infrastructure
  5. Model Evaluation and Analysis
  6. Model Analysis

探索子标签

  • Model Performance Benchmarking2 个子标签Standardized tests to evaluate model speed and accuracy.