# bigcode-project/bigcode-evaluation-harness

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/bigcode-project-bigcode-evaluation-harness).**

1,049 stars · 265 forks · Python · Apache-2.0

## Links

- GitHub: https://github.com/bigcode-project/bigcode-evaluation-harness
- awesome-repositories: https://awesome-repositories.com/repository/bigcode-project-bigcode-evaluation-harness.md

## Description

A framework for the evaluation of autoregressive code generation language models.

## Tags

### Part of an Awesome List

- [Model Evaluation and Benchmarking](https://awesome-repositories.com/f/awesome-lists/ai/model-evaluation-and-benchmarking.md) — Evaluation framework specifically for code generation models.
- [Evaluation Frameworks](https://awesome-repositories.com/f/awesome-lists/devtools/evaluation-frameworks.md) — Standardized framework for evaluating autoregressive code generation models.