19 个仓库
Tools for generating graphical representations of model evaluation metrics, including confusion matrices and loss curves, to diagnose classification performance.
Distinguishing note: None of the candidates are related to machine learning model evaluation; they refer to messaging servers, linear algebra, or security.
Explore 19 awesome GitHub repositories matching artificial intelligence & ml · Model Performance Visualizations. Refine with filters or upvote what's useful.
This project is a collection of educational examples and code for implementing deep learning architectures using the PyTorch framework. It serves as a tutorial and implementation guide for building various neural network architectures for machine learning tasks. The project provides practical implementations for computer vision, including image classification and neural style transfer, as well as natural language processing examples for building sequence models and language predictors. It also covers generative models using adversarial and variational networks to synthesize or transform visua
Generates graphical representations of loss curves and gradients to diagnose model convergence.
This project is an educational platform and research toolkit designed to teach deep learning through a combination of mathematical theory, visual diagrams, and executable code. It provides a comprehensive environment for building, training, and evaluating neural networks, grounding complex concepts in interactive computational notebooks that allow for hands-on experimentation. The framework distinguishes itself by interleaving theoretical foundations—including linear algebra, calculus, and probability—with practical implementations across multiple industry-standard libraries. It supports flex
Generates comprehensive visualizations of model performance metrics, including loss curves and attention heatmaps.
FlameGraph is a performance profiling and visualization toolkit designed to identify bottlenecks in software execution. It functions as a processing engine that transforms raw stack trace samples into interactive, hierarchical diagrams. By representing aggregated execution frequency as nested rectangles, the tool allows developers to visualize hot code paths and analyze system behavior across both kernel and user-space environments. The project distinguishes itself through its ability to perform differential profile analysis, which highlights performance regressions or improvements by compari
Maps complex execution paths through hierarchical diagrams to identify bottlenecks and improve software stack performance.
PyCaret is a Python AutoML platform and MLOps lifecycle manager designed to automate machine learning workflows. It functions as a low-code environment that leverages a scikit-learn native engine to execute preprocessing, training, and evaluation for tabular data. The platform distinguishes itself as an LLM-powered ML copilot, using large language model agents to analyze datasets, design experiment configurations, and explain model results. It also serves as a Kubernetes ML orchestrator and model registry, enabling the versioning of trained pipelines and their promotion to production API endp
Generates diagnostic plots like ROC curves and confusion matrices to evaluate model behavior.
CatBoost is a gradient boosting machine learning library used to train decision tree ensembles for regression, classification, and ranking tasks. It functions as a high-performance framework that provides a categorical data processor for transforming non-numeric features, a distributed trainer for large-scale datasets, and GPU acceleration to speed up model construction. The library distinguishes itself through native handling of categorical data and text features, removing the need for manual encoding. It includes a specialized model interpretability tool that leverages SHAP values and featu
Generates graphical representations of the training process and model behavior to diagnose performance.
This is a scikit-learn automated machine learning framework designed to optimize model selection and hyperparameters. It functions as an automated model selector and hyperparameter optimization tool for classification and regression tasks, utilizing an automated ensemble builder to combine high-performing models for increased predictive accuracy. The system features a distributed search engine that uses Dask for parallel machine learning optimization across CPU cores or clusters. It implements a budget-based evaluation strategy through successive halving to prioritize promising model configur
Displays a ranked list of the best performing models discovered during the automation process.
OpenCompass is a comprehensive evaluation platform, benchmarking suite, and distributed model evaluator designed to measure the performance and accuracy of large language models. It provides a framework for benchmarking both open-source and API-based models against diverse datasets using standardized metrics and reproducible pipelines. The project features an automated judging framework that uses language models as judges to score and verify the quality of generated text. It includes a performance leaderboard system for comparing the relative capabilities of various models across industry-sta
Features a performance leaderboard system to compare the relative capabilities of open-source and proprietary models.
PostgresML is a machine learning database extension for PostgreSQL that integrates model training and inference directly into the database. It functions as an in-database AI platform and vector database, enabling the execution of large language models and natural language processing tasks on stored records without exporting data to external services. The system distinguishes itself by utilizing GPU acceleration to minimize latency during model predictions and employing a hybrid storage engine that maintains relational data alongside high-dimensional vectors. It allows for the building and fin
Ships a web-based interface for analyzing training data and visualizing model metrics to monitor accuracy.
ClearML is a comprehensive MLOps platform designed to manage the entire machine learning lifecycle. It functions as an experiment tracking tool, a data versioning system, and a pipeline orchestrator, while providing infrastructure for GPU cluster management and model serving. The platform is distinguished by its ability to handle hybrid-cloud compute scheduling and fractional GPU allocation, allowing multiple workloads to share a single hardware accelerator. It employs a metadata-based approach to data versioning, using virtual views to track large datasets and artifacts without duplicating r
Provides visual evaluation tools like confusion matrices and loss curves to analyze model accuracy and data distributions.
MMDetection3D is an open-source toolbox for 3D perception, providing a unified framework for detecting and segmenting objects in three-dimensional environments. It supports a range of core tasks including monocular 3D object detection from single camera images, LiDAR-based 3D object detection from raw point clouds, and multi-modal fusion that combines camera images with LiDAR data. The toolbox also covers point cloud semantic segmentation, assigning class labels to every point in a scan for scene understanding. The project distinguishes itself through a config-driven pipeline that orchestrate
Produce prediction files in the required format for submission to the nuScenes benchmark leaderboard.
该项目是使用 TensorFlow 框架构建和训练机器学习模型的指导教程集合。它提供了实现各种模型架构以解决数据预测和分析问题的实用演练和示例。 这些指南涵盖了前馈、卷积和循环神经网络的构建,以分析复杂的数据模式。它包括针对无监督学习的特定教程,例如去噪自动编码器和 word-to-vec 嵌入,以及用于训练生成对抗网络(GAN)以合成新数据样本的示例。 该内容还涉及模型管理,包括保存和恢复网络权重以持久化训练进度的说明。此外,它还涵盖了训练指标和计算图的可视化,以监控性能。
Includes tutorials for visualizing model performance metrics and computational graphs.
MMF is a modular framework for building, training, and evaluating vision-and-language models. It provides a configuration-driven experiment system where model, dataset, and training parameters are defined through composable YAML files, alongside a curated model zoo of pretrained checkpoints for state-of-the-art multimodal architectures. The framework includes a multimodal dataset loader that downloads, processes, and batches vision-and-language data, and a vision-language model trainer supporting distributed training, mixed precision, and checkpoint-based resumption. The framework distinguish
Generates JSON-formatted predictions for question answering challenge leaderboard submissions.
This is an interactive notebook-based course that teaches machine learning from Python fundamentals through deep learning and natural language processing. It uses real datasets and multiple frameworks within a structured, hands-on curriculum that combines concise explanations with executable code cells, built-in datasets, and embedded exercise checkpoints. Learning progresses through data preparation and exploration, classical machine learning workflows, computer vision with convolutional neural networks, and natural language processing with deep learning, all delivered as a cohesive progressi
Implements graphical representations of model evaluation metrics, such as loss curves and confusion matrices, to diagnose performance.
该项目是一个综合性教育计划和深度学习框架,旨在通过 Notebook 和代码示例教授 PyTorch 深度学习实践。它作为一个用于构建、训练和部署神经网络的高级库,充当模型训练编排器,协调 PyTorch 模型、优化器和损失函数。 该项目为计算机视觉、自然语言处理和表格数据预处理提供了专门的工具包。它通过高级训练控制脱颖而出,例如判别式学习率、用于自定义训练逻辑的双向回调系统,以及自动化设备放置和训练循环的高级学习器抽象。 该框架涵盖了广泛的能力面,包括自动化数据流水线构建、模型架构分析以及跨分类、回归和分割任务的性能评估。它还包括用于跨多个 GPU 进行分布式训练的工具、用于内存优化的混合精度训练,以及对医学影像数据的专门支持。 该项目以一系列 Jupyter Notebook 的形式交付。
Generates graphical representations of loss curves and metrics for analyzing model performance in a dashboard.
This project is a comprehensive deep reinforcement learning course and training platform. It provides a structured educational curriculum that combines theoretical lessons with hands-on tutorials to teach the implementation of neural networks and agent behavior. The platform integrates a model sharing hub where users can upload, download, and version trained machine learning models. It also features a benchmarking system that uses leaderboards to evaluate and compare agent performance against community standards. The educational experience is delivered through interactive notebooks and inclu
Includes ranked leaderboards to track and compare the efficiency of different trained agents.
这是一个关于使用 PyTorch 构建神经网络的综合教学资源和课程。它涵盖了深度学习的基本构建块,包括张量操作、自动微分以及模块化神经网络组件的构建。 该仓库是多个专业领域的参考指南。它提供了计算机视觉任务(如图像分类、目标检测和语义分割)的实现细节,以及涉及 Transformer、循环网络和生成模型的自然语言处理工作流。此外,它还包括生成式 AI 的参考资料,专门关注通过扩散模型和对抗网络进行图像合成。 材料延伸至模型优化和部署流水线。它涵盖了通过量化和将模型导出为 ONNX 和 TensorRT 等格式来减小模型大小并提高推理速度的技术。其他能力领域包括用于并行加载的数据工程、使用自定义指标的模型评估,以及开源大语言模型的部署。 该项目主要以一系列 Jupyter Notebook 的形式提供。
Includes tools for generating graphical representations of model evaluation metrics, such as confusion matrices and loss curves.
这是一个 TensorFlow 机器学习示例集合,为各种神经网络范式提供了参考实现。它涵盖了监督学习、无监督学习、强化学习和序列学习模型。 该仓库包含了专注于图像分类和排序的卷积神经网络实现,以及用于时间序列预测和序列到序列翻译的循环神经网络。此外,它还提供了通过奖励优化训练的强化学习智能体,以及用于数据聚类的自编码器和自组织映射等无监督学习技术。 其他功能涵盖了监督回归和分类、语义嵌入生成,以及用于序列数据建模的隐马尔可夫模型。该项目还包括用于张量操作管理和通过仪表板进行模型性能可视化的实用工具。 内容以一系列 Jupyter Notebook 的形式提供。
Includes utilities for visualizing model evaluation metrics, training curves, and computation graphs via dashboards.
Yellowbrick 是一个机器学习可视化库和模型诊断工具,旨在分析特征重要性、目标分布和模型误差指标。它作为一个视觉工具包,通过使用验证曲线和学习曲线来诊断欠拟合和过拟合。 该项目提供用于评估预测模型和无监督学习的专门套件。它通过肘部法和轮廓系数确定最佳聚类数量,并通过 ROC 曲线、混淆矩阵和残差图评估分类器和回归器的质量。 该库涵盖了几个高级能力领域,包括识别预测变量的特征工程分析、调整模型复杂度的超参数调优,以及识别有影响数据点的回归误差诊断。它还包括用于可视化高维数据和文本语料库的流形学习投影工具。 该工具与 Scikit-Learn API 集成,以使用标准的 fit 和 predict 方法。
Generates diagnostic plots for precision, recall, and error metrics to evaluate machine learning estimators.
SwanLab 是一个开源的机器学习实验跟踪平台和可观测性工具。它提供了一个集中式仪表盘,用于记录训练指标、超参数和硬件性能,以监控和分析 AI 模型训练过程。 该平台的特色在于其专注于自托管基础设施,允许用户通过 Docker 或 Kubernetes 部署私有实例,以实现安全的数据本地控制。它还包含用于迁移历史实验日志以及从 MLflow 等外部工具同步实时指标的专用实用程序。 该系统涵盖了广泛的功能,包括针对 3D 点云和音视频资产的多模态媒体记录、针对 GPU 和 CPU 的实时硬件性能监控,以及通过并排运行可视化进行的对比分析。它支持跨多 GPU 集群的分布式训练跟踪,并与 PyTorch Lightning、Ray、XGBoost 和 LightGBM 等框架集成。 管理工作通过基于 Web 的仪表盘和用于管理工作空间、项目及用户权限的命令行界面进行处理。
Renders training data through interactive charts and ROC curves to visually evaluate model performance.