awesome-repositories.com
Blog
awesome-repositories.com

Descoperă cele mai bune repository-uri open source cu căutare AI.

ExploreazăCăutări recomandateAlternative open-sourceSoftware self-hostedBlogHartă site
ProiectDespreCum realizăm clasamentulPresăServer MCP
LegalConfidențialitateTermeni
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

25 repository-uri

Awesome GitHub RepositoriesModel Performance Analysis

Tools for evaluating model predictions, identifying error patterns, and diagnosing performance bottlenecks.

Distinguishing note: None of the candidates were relevant; this focuses on ML model diagnostic analysis rather than database identifiers or Lisp programming.

Explore 25 awesome GitHub repositories matching artificial intelligence & ml · Model Performance Analysis. Refine with filters or upvote what's useful.

Awesome Model Performance Analysis GitHub Repositories

Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
  • github/awesome-copilotAvatar github

    github/awesome-copilot

    35,119Vezi pe GitHub↗

    Awesome Copilot is a comprehensive framework for autonomous software development, providing the infrastructure to orchestrate multi-agent teams and automate complex coding workflows. It functions as a centralized platform for managing AI-driven development, enabling developers to deploy specialized agents that interact with local files, terminal commands, and external APIs to execute end-to-end software delivery tasks. The project distinguishes itself through its focus on governance and extensibility, offering a suite of security controls, policy-based execution guardrails, and audit trails t

    Runs parallel subagents to evaluate code through different lenses and aggregate findings into comprehensive reports.

    Pythonaigithub-copilothacktoberfest
    Vezi pe GitHub↗35,119
  • d2l-ai/d2l-enAvatar d2l-ai

    d2l-ai/d2l-en

    29,001Vezi pe GitHub↗

    This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex

    Diagnoses model performance issues by comparing training and validation error rates.

    Pythonbookcomputer-visiondata-science
    Vezi pe GitHub↗29,001
  • humansignal/label-studioAvatar HumanSignal

    HumanSignal/label-studio

    27,619Vezi pe GitHub↗

    Label Studio is a multi-modal data annotation platform designed to create and manage high-quality training datasets for machine learning. It functions as a self-hosted, containerized environment that supports secure, private deployments, including air-gapped configurations. The platform provides a centralized workspace for labeling diverse media types, such as images, text, audio, and time-series data, to support supervised and reinforcement learning workflows. The platform distinguishes itself through deep integration with machine learning backends, enabling active learning loops, automated

    Label Studio creates custom benchmarks and rubrics for side-by-side model comparisons and retrieval relevance grading.

    TypeScriptannotationannotation-toolannotations
    Vezi pe GitHub↗27,619
  • fincept-corporation/finceptterminalAvatar Fincept-Corporation

    Fincept-Corporation/FinceptTerminal

    26,900Vezi pe GitHub↗

    FinceptTerminal is a quantitative finance platform and financial engineering library designed for asset valuation, risk management, and fixed-income analytics. It provides a comprehensive suite for algorithmic trading and investment strategy automation, integrating specialized language model agents and node-based workflows to automate market research and alpha generation. The project distinguishes itself with a dedicated game theory analysis engine for calculating Nash equilibria and simulating strategic interactions in competitive markets. It also features a specialized credit risk modeling

    Computes FFO, NAV, and cap rates to evaluate the value of real estate investment trusts.

    C++bloomberg-terminalcontributions-welcomefinance
    Vezi pe GitHub↗26,900
  • letta-ai/lettaAvatar letta-ai

    letta-ai/letta

    21,168Vezi pe GitHub↗

    Letta is a framework for building, deploying, and managing autonomous AI agents that maintain persistent state across long-term interactions. It provides a comprehensive suite of primitives for defining agents with configurable personas, modular memory blocks, and tool-use capabilities, enabling them to retain user preferences and conversation history over extended sessions. The platform distinguishes itself through its advanced memory management and orchestration capabilities. It allows agents to autonomously update their own memory, perform retrieval-augmented generation, and coordinate com

    Tests identical agent configurations across different models to generate comparative performance metrics.

    Pythonaiai-agentsllm
    Vezi pe GitHub↗21,168
  • vibrantlabsai/ragasAvatar vibrantlabsai

    vibrantlabsai/ragas

    12,659Vezi pe GitHub↗

    Ragas is an evaluation framework designed to measure the performance of retrieval-augmented generation pipelines and autonomous agent workflows. It provides a comprehensive suite of tools for benchmarking system outputs, utilizing language models as automated judges to score performance against defined rubrics and reference data. By standardizing inputs, retrieved contexts, and generated responses into a unified schema, the project enables consistent analysis across complex AI applications. The framework distinguishes itself through its ability to generate synthetic test datasets from existin

    Provides tools for evaluating model predictions, identifying error patterns, and diagnosing performance bottlenecks.

    Pythonevaluationllmllmops
    Vezi pe GitHub↗12,659
  • nofxaios/nofxAvatar NoFxAiOS

    NoFxAiOS/nofx

    12,466Vezi pe GitHub↗

    NoFx is an autonomous trading platform designed to orchestrate financial workflows through artificial intelligence and multi-asset exchange connectivity. It functions as a comprehensive infrastructure for executing automated trading strategies, integrating language models for market analysis, and managing secure interactions across both centralized and decentralized financial platforms. The platform distinguishes itself through a multi-model strategy ensembling approach, which runs several artificial intelligence models in parallel to evaluate and select the most effective trading decisions b

    Evaluates and compares the performance of multiple AI models to identify optimal trading approaches.

    Goagentictradingaiai-trading
    Vezi pe GitHub↗12,466
  • voxel51/fiftyoneAvatar voxel51

    voxel51/fiftyone

    10,841Vezi pe GitHub↗

    FiftyOne este un instrument vizual pentru curarea, analizarea și gestionarea seturilor de date de imagini și video pentru antrenarea modelelor de machine learning. Acesta servește ca o platformă pentru identificarea erorilor de adnotare, rafinarea etichetelor de tip ground truth și evaluarea performanței modelelor de viziune prin compararea predicțiilor cu ground truth-ul pentru a identifica modurile de eșec. Sistemul funcționează ca o platformă de date containerizată care suportă colaborarea în echipă pe seturi de date vizuale la scară largă într-un mediu cloud. Include capabilități specializate pentru explorarea embedding-urilor de înaltă dimensiune pentru a descoperi clustere de date și a recupera mostre vizuale corespondente. Platforma acoperă o gamă largă de capabilități, inclusiv adnotarea datelor 2D și 3D, validarea calității seturilor de date și explorarea vizuală a datelor. Se integrează cu framework-uri de deep learning pentru a muta datele de la curare la antrenarea modelelor și utilizează un magazin de metadate bazat pe documente pentru a gestiona structurile seturilor de date.

    Evaluates model predictions against ground truth to diagnose error patterns and pinpoint samples for fine-tuning.

    Python
    Vezi pe GitHub↗10,841
  • facebookresearch/parlaiAvatar facebookresearch

    facebookresearch/ParlAI

    10,625Vezi pe GitHub↗

    ParlAI is a conversational AI research framework designed for training, evaluating, and sharing dialogue models using a unified interface for datasets and agents. It functions as a PyTorch-based training platform and a dialogue data collection system, providing a centralized model zoo for the distribution of versioned pretrained agents. The project distinguishes itself through a knowledge-grounded retrieval system that combines dense and sparse indexing to ground responses in external information. It also provides a comprehensive infrastructure for gathering human-AI interaction data via inte

    Uses specialized training methods to reduce contradictions and improve the coherence of chatbot responses.

    Python
    Vezi pe GitHub↗10,625
  • openvinotoolkit/openvinoAvatar openvinotoolkit

    openvinotoolkit/openvino

    10,414Vezi pe GitHub↗

    OpenVINO is an AI inference engine and model serving platform designed to execute optimized deep learning models across CPUs, GPUs, and NPUs through a unified API. It includes a model optimization toolkit for converting, quantizing, and compressing models from various frameworks, alongside a specialized generative AI runtime for large language models. The project distinguishes itself through a plugin-based hardware acceleration layer that maps neural network operations to vendor-specific drivers. It features advanced execution mechanisms such as continuous batching, speculative decoding, and

    OpenVINO collects performance measurement counters and graph information for each model layer to CSV and XML files.

    C++aicomputer-visiondeep-learning
    Vezi pe GitHub↗10,414
  • apachecn/interviewAvatar apachecn

    apachecn/Interview

    8,944Vezi pe GitHub↗

    This project is a comprehensive knowledge base and study resource designed for mastering technical interviews. It provides structured guides, roadmaps, and curricula focused on data structures, algorithms, system design, and frontend engineering to help candidates prepare for software engineering screenings. The repository distinguishes itself by offering a holistic approach to professional advancement. Beyond technical drills, it includes a career development handbook covering resume optimization, salary benchmarking, and strategic negotiation coaching. It also provides detailed methodologie

    Analyzes code and documentation from top-performing teams to understand advanced model validation techniques.

    Jupyter Notebookinterviewkaggleleetcode
    Vezi pe GitHub↗8,944
  • facebookresearch/slowfastAvatar facebookresearch

    facebookresearch/SlowFast

    7,377Vezi pe GitHub↗

    SlowFast is a PyTorch video understanding framework and spatiotemporal neural network library. It serves as a toolset for video action recognition, enabling the training and evaluation of models designed to classify complex activities and objects within video sequences. The framework is distinguished by its use of dual-pathway spatiotemporal sampling to capture both slow and fast motions. It supports self-supervised video learning for pre-training models on unlabeled data and employs multigrid spatiotemporal training to optimize learning across multiple spatial and temporal resolutions. The

    Provides tools for monitoring training progress and diagnosing model behavior via inference and visualization.

    Python
    Vezi pe GitHub↗7,377
  • greyhatguy007/machine-learning-specialization-courseraAvatar greyhatguy007

    greyhatguy007/Machine-Learning-Specialization-Coursera

    6,996Vezi pe GitHub↗

    This repository is a collection of implementation references and solved notebooks covering supervised, unsupervised, and reinforcement learning techniques. It provides practical guides for building predictive models, clustering algorithms, and autonomous agents. The project includes specific implementations for neural network architectures, such as multi-layer perceptrons for digit recognition, and recommender systems using collaborative and content-based filtering. It also features reinforcement learning systems that utilize deep Q-learning to optimize decision-making policies. The codebase

    Implements model performance analysis using bias-variance diagnostics and regularization to optimize accuracy.

    Jupyter Notebookandrew-ngandrew-ng-machine-learningcoursera
    Vezi pe GitHub↗6,996
  • mrdbourke/tensorflow-deep-learningAvatar mrdbourke

    mrdbourke/tensorflow-deep-learning

    5,914Vezi pe GitHub↗

    This is a comprehensive deep learning course delivered entirely through Jupyter Notebooks, designed to teach neural network construction using TensorFlow 2.x. The curriculum follows a sequential-model-first pedagogy, introducing the Sequential API before moving to functional and subclassing approaches, and covers the full spectrum of model building from regression and classification through convolutional neural networks, natural language processing, and time series forecasting. The course is structured around a checkpoint-based training workflow that saves the best model weights during traini

    Provides guidance on diagnosing common performance issues related to input shapes, datatypes, and loss functions.

    Jupyter Notebook
    Vezi pe GitHub↗5,914
  • mrdbourke/zero-to-mastery-mlAvatar mrdbourke

    mrdbourke/zero-to-mastery-ml

    5,839Vezi pe GitHub↗

    Acest proiect este un curriculum educațional de machine learning și o platformă de învățare livrată prin Jupyter Notebooks interactive. Servește drept ghid cuprinzător pentru stăpânirea toolkit-ului de data science Python, oferind tutoriale structurate pentru calcul numeric, manipularea datelor tabelare și vizualizarea statistică. Curriculum-ul include ghiduri specifice de implementare pentru Scikit-Learn și un curs practic despre TensorFlow pentru construirea, antrenarea și deployment-ul rețelelor neuronale și a modelelor de computer vision. Acoperă procesul end-to-end de construire a modelelor predictive, de la formularea inițială a problemei și categorizarea sarcinilor până la deployment-ul modelelor prin interfețe web interactive. Proiectul acoperă o suprafață largă de capabilități, inclusiv calcul numeric cu array-uri multidimensionale, analiză exploratorie a datelor și rutine de preprocesare a datelor. Oferă fluxuri de lucru detaliate pentru învățarea supervizată și nesupervizată, pipeline-uri de machine learning automatizat, optimizarea hiperparametrilor și evaluarea modelelor folosind metrici de clasificare și cross-validation. Conținutul educațional este organizat ca o serie de notebook-uri care intercalează codul Python cu explicații narative pentru a documenta fluxurile de lucru în data science.

    Provides methods to modify models and tune hyperparameters to enhance overall performance and efficiency.

    Jupyter Notebookdata-sciencedeep-learningmachine-learning
    Vezi pe GitHub↗5,839
  • pytorch/captumAvatar pytorch

    pytorch/captum

    5,652Vezi pe GitHub↗

    Captum is an open-source library for explaining model predictions by attributing them to input features, neurons, and layers using gradient-based and perturbation-based methods. It provides a modular framework for implementing, evaluating, and combining a range of explanation techniques, including gradient-based attribution, perturbation-based analysis, game-theoretic Shapley value approximation, and surrogate model explanations, with support for parallelization and noise stabilization. The library distinguishes itself through its breadth of attribution methods and its support for advanced in

    Reveals feature contributions to unexpected outputs for diagnosing model behavior.

    Python
    Vezi pe GitHub↗5,652
  • rafaelpadilla/object-detection-metricsAvatar rafaelpadilla

    rafaelpadilla/Object-Detection-Metrics

    5,098Vezi pe GitHub↗

    This project is an object detection evaluation library and benchmarking tool designed to calculate precision, recall, and average precision for computer vision models. It provides a suite of utilities for parsing bounding box coordinates from text files and calculating spatial overlap to determine detection accuracy. The toolkit features a command line interface for comparing ground truth files against model predictions. It includes a precision-recall curve generator to visualize the relationship between precision and recall across different confidence thresholds and an intersection over unio

    Calculates precision and recall metrics to evaluate how well a detection algorithm identifies objects.

    Pythonaverage-precisionbounding-boxesmean-average-precision
    Vezi pe GitHub↗5,098
  • chiphuyen/ml-interviews-bookAvatar chiphuyen

    chiphuyen/ml-interviews-book

    4,523Vezi pe GitHub↗

    This project is a collection of comprehensive guides and reference materials designed for technical interviews, machine learning system design, and professional development. It serves as a technical knowledge base and a career coaching manual, providing structured resources to help candidates navigate the machine learning hiring landscape. The resource distinguishes itself by offering detailed frameworks for comparing industry roles, analyzing company types, and planning long-term career progression. It provides specific guidance on evaluating employer organizational health, identifying resea

    Covers techniques for improving model performance as a core part of ML interview preparation.

    HTML
    Vezi pe GitHub↗4,523
  • ray-project/llm-numbersAvatar ray-project

    ray-project/llm-numbers

    4,310Vezi pe GitHub↗

    llm-numbers is a set of calculation tools and benchmarks used to predict hardware requirements, token usage, and operational costs across various model tiers. It provides a cost and resource calculator based on formulas and benchmarks to estimate tokens, GPU memory, and operational expenses for large language models. The project includes a hardware requirement planner for calculating the VRAM and GPU memory needed to host models based on parameter counts. It also features a token estimator that converts word counts into token estimates to predict API billing and context window usage, alongsid

    Analyzes model throughput gains from batching and evaluates the cost-benefit of fine-tuning versus base models.

    Vezi pe GitHub↗4,310
  • pytorch/executorchAvatar pytorch

    pytorch/executorch

    4,296Vezi pe GitHub↗

    ExecuTorch is a lightweight C++ runtime for deploying PyTorch models on mobile, embedded, and edge hardware. It provides an ahead-of-time compilation pipeline that exports, quantizes, and lowers model graphs into compact serialized programs, then executes them through a minimal runtime with hardware acceleration and on-device large language model inference capabilities. The project distinguishes itself through a hardware accelerator delegate system that partitions model subgraphs and offloads computation to specialized backends including NPUs, GPUs, and DSPs from Apple, Arm, Intel, MediaTek,

    Displays tabular summaries of runtime events including operator names, execution times, and delegation status.

    Pythondeep-learningembeddedgpu
    Vezi pe GitHub↗4,296
Înapoi12Înainte
  1. Home
  2. Artificial Intelligence & ML
  3. Model Performance Analysis

Explorează sub-etichetele

  • Model Performance Improvement3 sub-tag-uriModifies models to enhance their performance or efficiency beyond current levels. **Distinct from Model Performance Analysis:** Distinct from Model Performance Analysis: focuses on improving performance rather than just analyzing it.
  • Multi-Perspective Analysis ToolsSystems that run parallel subagents to evaluate code through multiple lenses and aggregate findings. **Distinct from Model Performance Analysis:** Distinct from Model Performance Analysis: focuses on multi-agent code evaluation rather than model diagnostic metrics.
  • Real Estate Investment Trust AnalyticsSpecialized valuation metrics for REITs including FFO and NAV. **Distinct from Model Performance Analysis:** Targeted at real estate trust valuation specifically, whereas model performance analysis is for ML diagnostics.
  • Runtime Event SummarizersTools that display tabular summaries of runtime events including operator names, execution times, and delegation status. **Distinct from Model Performance Analysis:** Distinct from Model Performance Analysis: focuses on runtime event summaries rather than general model prediction evaluation.
  • Top Performer AnalysisAnalysis of high-ranking implementation patterns and documentation to understand model validation and performance. **Distinct from Model Performance Analysis:** Specifically focuses on learning from the best-performing implementations rather than general diagnostic tool usage.