awesome-repositories.com
Blog
MCP
awesome-repositories.com

Descoperă cele mai bune repository-uri open source cu căutare AI.

ExploreazăCăutări recomandateAlternative open-sourceSoftware self-hostedBlogHartă site
ProiectServer MCPDespreCum realizăm clasamentulPresă
LegalConfidențialitateTermeni
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

8 repository-uri

Awesome GitHub RepositoriesModel Benchmarks

Automated suites for measuring machine learning model speed and accuracy.

Distinguishing note: Focuses on ML-specific performance metrics rather than general software testing.

Explore 8 awesome GitHub repositories matching testing & quality assurance · Model Benchmarks. Refine with filters or upvote what's useful.

Awesome Model Benchmarks GitHub Repositories

Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
  • aider-ai/aiderAvatar Aider-AI

    Aider-AI/aider

    46,305Vezi pe GitHub↗

    Aider is a command-line interface tool that enables large language models to directly edit, refactor, and manage source code within a local repository. It functions as an AI-powered coding assistant that integrates into the developer workflow, allowing users to apply code changes through natural language prompts while maintaining repository context and version control. The tool distinguishes itself through a specialized diff-based patching engine that parses model-generated search-and-replace blocks to modify specific file segments without rewriting entire files. It features a provider-agnost

    Evaluates models on their ability to follow instructions and perform code edits using standardized coding exercises.

    Pythonanthropicchatgptclaude-3
    Vezi pe GitHub↗46,305
  • open-mmlab/mmdetectionAvatar open-mmlab

    open-mmlab/mmdetection

    32,756Vezi pe GitHub↗

    This project is a modular research toolkit designed for developing, training, and evaluating deep learning models for object detection, segmentation, and video instance tracking. It provides a flexible training engine that manages complex neural network execution, including distributed training, custom lifecycle hooks, and weight optimization. The framework is built around a hierarchical configuration system that allows users to define architectures, data pipelines, and training hyperparameters through composable, inheritable files. The project distinguishes itself through its highly modular

    The project enables evaluating object detection and instance segmentation model robustness by testing performance against various image corruptions and severity levels using analysis scripts.

    Pythoncascade-rcnnconvnextdetr
    Vezi pe GitHub↗32,756
  • deepinsight/insightfaceAvatar deepinsight

    deepinsight/insightface

    29,002Vezi pe GitHub↗

    InsightFace is a comprehensive deep learning framework designed for face recognition, biometric identity verification, and feature extraction. It provides a specialized engine for one-to-one verification and one-to-many identification tasks, utilizing convolutional neural networks to transform raw image pixels into high-dimensional vector embeddings. The project includes a complete toolkit for detecting, aligning, and processing facial data to ensure consistent identity discrimination. Beyond core recognition, the platform distinguishes itself through an extensive model management and optimiz

    Comparing the accuracy and speed of different machine learning models to select the best solution for specific hardware constraints.

    Pythonage-estimationarcfaceface-alignment
    Vezi pe GitHub↗29,002
  • modular/modularAvatar modular

    modular/modular

    26,357Vezi pe GitHub↗

    Modular is a unified machine learning development platform designed for building, compiling, and deploying high-performance neural network models. It provides a comprehensive execution engine that supports both local and production-grade inference, enabling developers to manage the entire model lifecycle from initial architecture definition to scalable, containerized service deployment. The platform distinguishes itself through a hardware-agnostic runtime that abstracts diverse silicon architectures, allowing models to execute efficiently across varied compute environments. It includes a spec

    Provides automated tools to measure model speed and accuracy against defined datasets.

    Mojoailanguagemachine-learning
    Vezi pe GitHub↗26,357
  • elder-plinius/obliteratusAvatar elder-plinius

    elder-plinius/OBLITERATUS

    6,736Vezi pe GitHub↗

    Obliteratus is a weight ablation framework and refusal removal tool designed to identify and delete the internal representations responsible for content refusals in large language models without retraining. It functions as a circuit analysis suite that maps the geometric structure of model guardrails to isolate the specific layers and attention heads that enforce refusals. The project enables the removal of these behaviors through geometric projection, rank-1 adapter ablation for reversible modifications, and the application of steering vectors to alter behavior during inference. It includes

    Measures perplexity and refusal rates to ensure the model retains general capabilities after internal modification.

    Python
    Vezi pe GitHub↗6,736
  • kuangliu/pytorch-cifarAvatar kuangliu

    kuangliu/pytorch-cifar

    6,360Vezi pe GitHub↗

    This is a PyTorch-based training pipeline designed for reproducible image classification benchmarking on the CIFAR-10 dataset. It integrates GPU-accelerated computation, data augmentation, learning rate scheduling, and checkpointing to produce consistent accuracy measurements across multiple ResNet architectures. The project distinguishes itself by providing a fixed-architecture benchmark suite that trains a predefined set of ResNet variants, from ResNet18 through ResNet152, on CIFAR-10. It implements a step-based learning rate decay schedule at predetermined epochs to stabilize convergence,

    Reports the top-1 classification accuracy of multiple pre-configured architectures on the CIFAR-10 test set.

    Pythonpytorch
    Vezi pe GitHub↗6,360
  • nvidia/isaac-gr00tAvatar NVIDIA

    NVIDIA/Isaac-GR00T

    6,222Vezi pe GitHub↗

    Automatically tests model configurations to find the optimal performance and accuracy for a specific edge device.

    Jupyter Notebook
    Vezi pe GitHub↗6,222
  • khwang9883/mobilemodelsAvatar KHwang9883

    KHwang9883/MobileModels

    4,247Vezi pe GitHub↗

    MobileModels este o bază de date hardware pentru dispozitive mobile și un registru de identificare a modelelor. Servește ca o colecție structurată care mapează numele comerciale de marketing la numerele de model ale producătorului și la numele de cod hardware interne. Proiectul funcționează ca un director de variante hardware, distingând între diferite versiuni regionale și de operator ale aceluiași dispozitiv pentru diverse mărci. Include un tracker de bootloader și kernel pentru a monitoriza disponibilitatea lansărilor oficiale de cod sursă al kernel-ului și starea de deblocare a bootloader-ului. Registrul acoperă catalogarea hardware-ului mobil prin maparea identificatorilor de dispozitiv și analiza convențiilor de denumire ale producătorilor pentru a decoda numerele de model. Oferă o referință pentru legarea specificațiilor hardware și a SKU-urilor regionale de numele lor de cod de dezvoltare corespunzătoare.

    Displays detailed hardware component information, including model numbers and codenames, for system identification.

    Vezi pe GitHub↗4,247
  1. Home
  2. Testing & Quality Assurance
  3. Model Testing
  4. Model Benchmarks

Explorează sub-etichetele

  • Hardware-Specific1 sub-tagAutomatically tests model configurations to find the optimal performance and accuracy for a specific edge device. **Distinct from Model Benchmarks:** Distinct from Model Benchmarks: focuses on benchmarking for specific target hardware rather than general model evaluation.
  • Model Coherence EvaluationMeasurement of perplexity and response rates to ensure models retain general capabilities after modifications. **Distinct from Model Benchmarks:** Focuses on the linguistic and structural coherence of the model rather than standard ML accuracy benchmarks.