awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
allenai avatar

allenai/OLMo-Eval

0
View on GitHub↗

OLMo Eval

This project provides a unified workbench for evaluating language models throughout the model development loop.

Features

  • Evaluation Frameworks - Repository for evaluating open-source language models.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
33 stars·4 forks·Python·Apache-2.0·10 views

Star history

Star history chart for allenai/olmo-evalStar history chart for allenai/olmo-eval

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Frequently asked questions

What does allenai/olmo-eval do?

This project provides a unified workbench for evaluating language models throughout the model development loop.

What are the main features of allenai/olmo-eval?

The main features of allenai/olmo-eval are: Evaluation Frameworks.

Which projects share features with allenai/olmo-eval?

Projects with overlapping indexed features include: confident-ai/deepeval — Deepeval is a framework for testing and evaluating large language model applications. It provides a suite of tools for… cvs-health/uqlm — UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection. declare-lab/instruct-eval — This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on… eleutherai/lm-evaluation-harness — This project is a standardized framework for benchmarking large language models across a wide range of academic and… evalplus/evalplus — Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024. comet-ml/opik — Opik is an observability and evaluation platform designed for generative AI applications and agentic workflows. It…

Projects sharing features with OLMo Eval

These projects share indexed features with OLMo Eval. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • confident-ai/deepevalconfident-ai avatar

    confident-ai/deepeval

    13,733View on GitHub↗

    Deepeval is a framework for testing and evaluating large language model applications. It provides a suite of tools for executing automated regression tests, validating model output quality against defined standards, and tracing the execution of complex agent workflows. By integrating these capabilities into development pipelines, the platform ensures consistent performance and reliability throughout the software lifecycle. The platform distinguishes itself through its focus on programmatic validation and observability. It utilizes secondary language models to score output quality and employs

    Pythonevaluation-frameworkevaluation-metricsllm-evaluation
    View on GitHub↗13,733
  • cvs-health/uqlmcvs-health avatar

    cvs-health/uqlm

    1,169View on GitHub↗

    UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

    Python
    View on GitHub↗1,169
  • declare-lab/instruct-evaldeclare-lab avatar

    declare-lab/instruct-eval

    553View on GitHub↗

    This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

    Python
    View on GitHub↗553
  • comet-ml/opikcomet-ml avatar

    comet-ml/opik

    17,787View on GitHub↗

    Opik is an observability and evaluation platform designed for generative AI applications and agentic workflows. It provides a centralized environment for tracing execution flows, managing prompt templates, and monitoring production performance, allowing teams to gain visibility into complex model interactions and tool usage without requiring manual application code changes. The platform distinguishes itself through its integrated approach to the AI development lifecycle, combining distributed trace instrumentation with automated evaluation frameworks. It supports model-as-a-judge scoring, syn

    Pythonevaluationhacktoberfesthacktoberfest2025
    View on GitHub↗17,787
  • Compare all 30 related projects→