awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
beir-cellar avatar

beir-cellar/beir

0
View on GitHub↗
beir.ai↗

Beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Features

  • Model Evaluation and Benchmarking - Heterogeneous benchmark suite for information retrieval tasks.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
2,215 stars·247 forks·Python·Apache-2.0·15 views

Star history

Star history chart for beir-cellar/beirStar history chart for beir-cellar/beir

How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

Projects sharing features with Beir

These projects share indexed features with Beir. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
  • open-mmlab/mmsegmentationopen-mmlab avatar

    open-mmlab/mmsegmentation

    9,989View on GitHub↗

    MMSegmentation is an open-source semantic segmentation toolbox built on PyTorch that provides a modular, configurable framework for building, training, evaluating, and deploying segmentation models. At its core, it offers a config-driven pipeline that assembles training, evaluation, and inference workflows by parsing hierarchical configuration files, with a modular component registry that enables plug-and-play composition of neural network modules, optimizers, datasets, and metrics. The framework supports the full model lifecycle through a unified runner interface that controls training, testi

    Pythondeeplabv3image-segmentationmedical-image-segmentation
    View on GitHub↗9,989
  • facebookresearch/parlaifacebookresearch avatar

    facebookresearch/ParlAI

    10,625View on GitHub↗

    ParlAI is a conversational AI research framework designed for training, evaluating, and sharing dialogue models using a unified interface for datasets and agents. It functions as a PyTorch-based training platform and a dialogue data collection system, providing a centralized model zoo for the distribution of versioned pretrained agents. The project distinguishes itself through a knowledge-grounded retrieval system that combines dense and sparse indexing to ground responses in external information. It also provides a comprehensive infrastructure for gathering human-AI interaction data via inte

    Python
    View on GitHub↗10,625
  • infrasys-ai/aiinfraInfrasys-AI avatar

    Infrasys-AI/AIInfra

    8,556View on GitHub↗
    Jupyter Notebookaiinfraaisystem
    View on GitHub↗8,556
  • openai/simple-evalsopenai avatar

    openai/simple-evals

    4,695View on GitHub↗

    This project is a language model evaluation framework and benchmarking tool designed to measure the accuracy and performance of models across diverse datasets. It provides a system for implementing model-based graders, running standardized tests for mathematical reasoning, coding, and factuality, and calculating quantified performance metrics such as precision, recall, F1 scores, and pass-at-k. The framework utilizes model-based grading and rubrics to validate response quality against expert-defined criteria. It includes a multi-model benchmarking loop and a model-agnostic API interface to co

    Python
    View on GitHub↗4,695
Compare all 30 related projects→

Frequently asked questions

What does beir-cellar/beir do?

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

What are the main features of beir-cellar/beir?

The main features of beir-cellar/beir are: Model Evaluation and Benchmarking.

Which projects share features with beir-cellar/beir?

Projects with overlapping indexed features include: open-mmlab/mmsegmentation — MMSegmentation is an open-source semantic segmentation toolbox built on PyTorch that provides a modular, configurable… packtpublishing/llm-engineers-handbook — This project is an educational resource and engineering guide for building, deploying, and optimizing large language… infrasys-ai/aiinfra. facebookresearch/parlai — ParlAI is a conversational AI research framework designed for training, evaluating, and sharing dialogue models using… openai/simple-evals — This project is a language model evaluation framework and benchmarking tool designed to measure the accuracy and… datawhalechina/prompt-engineering-for-developers — This project is a technical curriculum and development guide focused on large language model prompt engineering,…