1 repositorio
Awesome GitHub RepositoriesCross-Language Code Benchmarks
Tests language models on software issues spanning multiple programming languages.
Distinct from Multilingual Code Models: Distinct from Multilingual Code Models: focuses on benchmarking cross-language code generation rather than model training.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Cross-Language Code Benchmarks. Refine with filters or upvote what's useful.
Awesome Cross-Language Code Benchmarks GitHub Repositories
Encuentra los mejores repositorios con IA.Buscaremos los repositorios que mejor coincidan usando IA.
- swe-bench/swe-bench
SWE-bench/SWE-bench
4,321Ver en GitHubSWE-bench is an automated evaluation framework that tests large language models on real-world software engineering tasks. It measures how effectively models can generate and apply code patches that resolve actual GitHub issues, using a standardized dataset and scoring system built around Docker-based patch verification against original project test suites. The framework provides curated benchmark datasets spanning comprehensive, fast, verified, multilingual, and multimodal evaluation splits, allowing targeted assessment of model capabilities across different programming languages and issue ty
Tests language models on software issues across multiple programming languages.
Pythonbenchmarklanguage-modelsoftware-engineering
