2 مستودعات
Benchmarks for evaluating the code generation and software development capabilities of models.
Explore 2 awesome GitHub repositories matching part of an awesome list · Programming Benchmarks. Refine with filters or upvote what's useful.
AlphaCodium is an LLM code generation framework and automated programming benchmark designed to solve programming problems through iterative generation and testing. It functions as an iterative code refinement system that improves the precision of generated code by comparing outputs against expected results and re-prompting the model. The project implements a flow engineering pipeline, using a structured sequence of prompting stages to refine code through a cycle of generation, evaluation, and correction. This approach allows the system to process programming datasets and measure the accuracy
Functions as a benchmark for processing programming datasets and measuring the accuracy of generated solutions.
Math24o: 高中奥林匹克数学竞赛测评集 High School Olympiad Mathematics Chinese Benchmark
Evaluates model proficiency in solving high school level mathematical problems.