2 रिपॉजिटरी
Awesome GitHub RepositoriesCoding Benchmarks
Benchmarks specifically for software engineering and data science agents.
Explore 2 awesome GitHub repositories matching part of an awesome list · Coding Benchmarks. Refine with filters or upvote what's useful.
Awesome Coding Benchmarks GitHub Repositories
AI के साथ बेहतरीन रिपॉजिटरी खोजें।हम AI का उपयोग करके सबसे सटीक रिपॉजिटरी खोजेंगे।
- swe-bench/swe-bench
SWE-bench/SWE-bench
4,321GitHub पर देखेंSWE-bench is an automated evaluation framework that tests large language models on real-world software engineering tasks. It measures how effectively models can generate and apply code patches that resolve actual GitHub issues, using a standardized dataset and scoring system built around Docker-based patch verification against original project test suites. The framework provides curated benchmark datasets spanning comprehensive, fast, verified, multilingual, and multimodal evaluation splits, allowing targeted assessment of model capabilities across different programming languages and issue ty
Benchmark for resolving real-world GitHub issues.
Pythonbenchmarklanguage-modelsoftware-engineering - thudm/datascibench
THUDM/DataSciBench
📃 DataSciBench GitHub Evaluation Data Website
Benchmark for data science-focused LLM agents.
Python
