4 مستودعات
Benchmarking tools for predictive models using expert-developed baselines and scientific datasets.
Distinct from Model Benchmarking: Distinct from general model benchmarking: focuses on scientific domain predictive models.
Explore 4 awesome GitHub repositories matching artificial intelligence & ml · Scientific Model Evaluators. Refine with filters or upvote what's useful.
This repository serves as a comprehensive research platform and toolkit for advancing machine learning, quantum computing, and large-scale scientific data analysis. It provides foundational frameworks for developing complex algorithmic systems, offering the necessary infrastructure for distributed training, computational graph execution, and high-performance model development. The project distinguishes itself by integrating specialized research domains with robust, privacy-preserving methodologies. It supports diverse scientific discovery through tools for quantum simulation, physics-informed
Evaluates predictive models across diverse domains by comparing results against established datasets.
Captum is an open-source library for explaining model predictions by attributing them to input features, neurons, and layers using gradient-based and perturbation-based methods. It provides a modular framework for implementing, evaluating, and combining a range of explanation techniques, including gradient-based attribution, perturbation-based analysis, game-theoretic Shapley value approximation, and surrogate model explanations, with support for parallelization and noise stabilization. The library distinguishes itself through its breadth of attribution methods and its support for advanced in
Ships tools to assess attribution reliability through sensitivity and consistency tests.
PaperBanana is an AI research visualization tool and framework designed to generate and refine high-resolution academic illustrations from conceptual and technical descriptions. It employs an automated generation pipeline that transforms scientific text and captions into publication-quality diagrams and plots. The system utilizes a multi-stage process consisting of retrieval-augmented planning, image synthesis, and a critic-based iterative refinement mechanism. This workflow allows for the adjustment of image details and the upscaling of visual outputs to 4K resolution. The project includes
Provides a set of metrics and tools for measuring the quality of AI-generated academic illustrations against ground-truth datasets.
Osim-rl is a research environment designed for the development and evaluation of reinforcement learning agents within physics-based musculoskeletal simulations. It provides a standardized interface that maps physiological state observations to muscle excitation control signals, enabling the study of human movement and biomechanics through iterative policy optimization. The framework distinguishes itself by integrating high-fidelity musculoskeletal modeling with tools for scientific benchmarking and reproducible experimentation. It allows researchers to define custom reward functions and adjus
Facilitates objective comparison of control policies against standardized metrics within a consistent and reproducible simulation framework.