2 Repos
Awesome GitHub RepositoriesCoding Benchmarks
Benchmarks specifically for software engineering and data science agents.
Explore 2 awesome GitHub repositories matching part of an awesome list · Coding Benchmarks. Refine with filters or upvote what's useful.
Awesome Coding Benchmarks GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- swe-bench/swe-bench
SWE-bench/SWE-bench
4,321Auf GitHub ansehenSWE-bench is an automated evaluation framework that tests large language models on real-world software engineering tasks. It measures how effectively models can generate and apply code patches that resolve actual GitHub issues, using a standardized dataset and scoring system built around Docker-based patch verification against original project test suites. The framework provides curated benchmark datasets spanning comprehensive, fast, verified, multilingual, and multimodal evaluation splits, allowing targeted assessment of model capabilities across different programming languages and issue ty
Benchmark for resolving real-world GitHub issues.
Pythonbenchmarklanguage-modelsoftware-engineering - thudm/datascibench
THUDM/DataSciBench
📃 DataSciBench GitHub Evaluation Data Website
Benchmark for data science-focused LLM agents.
Python
