awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
openai avatar

openai/human-eval

0
View on GitHub↗
3,263 stars·444 forks·Python·MIT·14 views

Human Eval

Code for the paper "Evaluating Large Language Models Trained on Code"

Features

  • Language Modeling - Evaluation framework for code-trained language models.
  • Model Evaluation and Benchmarking - Benchmark for functional correctness in code generation models.
  • Pre-training Research - Benchmark dataset and evaluation code for assessing functional correctness.
  • Tool Use And Integration - Benchmark for evaluating code synthesis and tool-use capabilities.

Star history

Star history chart for openai/human-evalStar history chart for openai/human-eval

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI

Projects sharing features with Human Eval

These projects share indexed features with Human Eval. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • locuslab/tcnlocuslab avatar

    locuslab/TCN

    4,525View on GitHub↗

    TCN is a deep learning sequence framework and library for building temporal convolutional networks. It provides a toolkit for implementing purely convolutional architectures to model sequential data as an alternative to recurrent neural networks. The project includes a sequence modeling benchmark suite designed to evaluate the accuracy and processing speed of architectures. This suite utilizes standardized tasks, including memory problems, digit classification, music, and language tasks, to quantify performance. The framework covers a range of structural components for sequence processing, s

    Python
    View on GitHub↗4,525
  • facebookresearch/parlaifacebookresearch avatar

    facebookresearch/ParlAI

    10,625View on GitHub↗

    ParlAI is a conversational AI research framework designed for training, evaluating, and sharing dialogue models using a unified interface for datasets and agents. It functions as a PyTorch-based training platform and a dialogue data collection system, providing a centralized model zoo for the distribution of versioned pretrained agents. The project distinguishes itself through a knowledge-grounded retrieval system that combines dense and sparse indexing to ground responses in external information. It also provides a comprehensive infrastructure for gathering human-AI interaction data via inte

    Python
    View on GitHub↗10,625
  • infrasys-ai/aiinfraInfrasys-AI avatar

    Infrasys-AI/AIInfra

    7,414View on GitHub↗
    Jupyter Notebookaiinfraaisystem
    View on GitHub↗7,414
  • open-mmlab/mmsegmentationopen-mmlab avatar

    open-mmlab/mmsegmentation

    9,860View on GitHub↗

    MMSegmentation is an open-source semantic segmentation toolbox built on PyTorch that provides a modular, configurable framework for building, training, evaluating, and deploying segmentation models. At its core, it offers a config-driven pipeline that assembles training, evaluation, and inference workflows by parsing hierarchical configuration files, with a modular component registry that enables plug-and-play composition of neural network modules, optimizers, datasets, and metrics. The framework supports the full model lifecycle through a unified runner interface that controls training, testi

    Pythondeeplabv3image-segmentationmedical-image-segmentation
    View on GitHub↗9,860
Compare all 30 related projects→

Frequently asked questions

What does openai/human-eval do?

Code for the paper "Evaluating Large Language Models Trained on Code"

What are the main features of openai/human-eval?

The main features of openai/human-eval are: Language Modeling, Model Evaluation and Benchmarking, Pre-training Research, Tool Use And Integration.

Which projects share features with openai/human-eval?

Projects with overlapping indexed features include: locuslab/tcn — TCN is a deep learning sequence framework and library for building temporal convolutional networks. It provides a… openai/simple-evals — This project is a language model evaluation framework and benchmarking tool designed to measure the accuracy and… facebookresearch/parlai — ParlAI is a conversational AI research framework designed for training, evaluating, and sharing dialogue models using… infrasys-ai/aiinfra. open-mmlab/mmsegmentation — MMSegmentation is an open-source semantic segmentation toolbox built on PyTorch that provides a modular, configurable… packtpublishing/llm-engineers-handbook — This project is an educational resource and engineering guide for building, deploying, and optimizing large language…