1 مستودع
Awesome GitHub RepositoriesCross-Language Code Evaluations
Assesses language model performance on software issues spanning multiple programming languages.
Distinct from Multilingual Code Models: Distinct from Multilingual Code Models: focuses on evaluating cross-language code generation ability rather than the model identity itself.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Cross-Language Code Evaluations. Refine with filters or upvote what's useful.
Awesome Cross-Language Code Evaluations GitHub Repositories
اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
- swe-bench/swe-bench
SWE-bench/SWE-bench
4,321عرض على GitHubSWE-bench is an automated evaluation framework that tests large language models on real-world software engineering tasks. It measures how effectively models can generate and apply code patches that resolve actual GitHub issues, using a standardized dataset and scoring system built around Docker-based patch verification against original project test suites. The framework provides curated benchmark datasets spanning comprehensive, fast, verified, multilingual, and multimodal evaluation splits, allowing targeted assessment of model capabilities across different programming languages and issue ty
Evaluates language models on software issues across multiple programming languages.
Pythonbenchmarklanguage-modelsoftware-engineering
