1 repo
Awesome GitHub RepositoriesModel Benchmarking Suites
Tools for evaluating the accuracy, reasoning, and performance of machine learning models against standardized datasets.
Distinguishing note: Focuses on objective evaluation and comparison of model capabilities, distinct from general software testing.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Model Benchmarking Suites. Refine with filters or upvote what's useful.
Awesome Model Benchmarking Suites GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- jingyaogong/minimind
jingyaogong/minimind
39,663View on GitHubThis project is a comprehensive framework for the entire lifecycle of transformer-based language models, supporting everything from foundational pretraining to specialized deployment. It provides a modular toolkit for defining neural network architectures, managing data preparation pipelines, and executing training routines across various scales. The framework is designed to handle the full model development process, including supervised fine-tuning, behavioral alignment, and the integration of agentic capabilities. What distinguishes this framework is its focus on efficient training and adva
The framework includes benchmarking tools to evaluate model accuracy, reasoning capabilities, and general knowledge against objective datasets across various architectures and parameter sizes.
Pythonartificial-intelligencelarge-language-model
