1 repositorio
Awesome GitHub RepositoriesLanguage Model Math Evaluations
Measures language model accuracy on mathematical reasoning tasks by prompting step-by-step solving and comparing answers against ground truth.
Distinct from Mathematical Problem Solving Toolkits: Distinct from general Mathematical Problem Solving Toolkits: focuses on evaluating LLM math ability rather than providing interactive solvers.
Explore 1 awesome GitHub repository matching scientific & mathematical computing · Language Model Math Evaluations. Refine with filters or upvote what's useful.
Awesome Language Model Math Evaluations GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- openai/simple-evals
openai/simple-evals
4,354Ver en GitHubThis project is a language model evaluation framework and benchmarking tool designed to measure the accuracy and performance of models across diverse datasets. It provides a system for implementing model-based graders, running standardized tests for mathematical reasoning, coding, and factuality, and calculating quantified performance metrics such as precision, recall, F1 scores, and pass-at-k. The framework utilizes model-based grading and rubrics to validate response quality against expert-defined criteria. It includes a multi-model benchmarking loop and a model-agnostic API interface to co
Measures language model accuracy on mathematical reasoning tasks by prompting step-by-step solving and comparing answers against ground truth.
Python
