1 repository
Awesome GitHub RepositoriesCross-Language Code Evaluations
Assesses language model performance on software issues spanning multiple programming languages.
Distinct from Multilingual Code Models: Distinct from Multilingual Code Models: focuses on evaluating cross-language code generation ability rather than the model identity itself.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Cross-Language Code Evaluations. Refine with filters or upvote what's useful.
Awesome Cross-Language Code Evaluations GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- swe-bench/swe-bench
SWE-bench/SWE-bench
4,321Vezi pe GitHubSWE-bench is an automated evaluation framework that tests large language models on real-world software engineering tasks. It measures how effectively models can generate and apply code patches that resolve actual GitHub issues, using a standardized dataset and scoring system built around Docker-based patch verification against original project test suites. The framework provides curated benchmark datasets spanning comprehensive, fast, verified, multilingual, and multimodal evaluation splits, allowing targeted assessment of model capabilities across different programming languages and issue ty
Evaluates language models on software issues across multiple programming languages.
Pythonbenchmarklanguage-modelsoftware-engineering
