awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
THUDM avatar

THUDM/AgentBench

0
View on GitHub↗

AgentBench

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Features

  • Agent Benchmarks - Comprehensive benchmark for assessing language models as agents.

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Start searching with AI
  • Evaluation And Benchmarks - Comprehensive benchmark for evaluating LLM agents across diverse environments.
  • General Agent Benchmarks - Comprehensive evaluation of LLMs as agents.
  • Verification and CI Integration - Multi-environment agent benchmark with a structured evaluation pipeline.
  • Tool and API Benchmarks - Cross-environment benchmark spanning OS, databases, and web browsing.
  • 3,817 stars·297 forks·Python·Apache-2.0·27 views

    Star history

    Star history chart for thudm/agentbenchStar history chart for thudm/agentbench

    How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.

    Frequently asked questions

    What does thudm/agentbench do?

    A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

    What are the main features of thudm/agentbench?

    The main features of thudm/agentbench are: Agent Benchmarks, Evaluation And Benchmarks, General Agent Benchmarks, Verification and CI Integration, Tool and API Benchmarks.

    Which projects share features with thudm/agentbench?

    Projects with overlapping indexed features include: snap-stanford/mlagentbench — MLAgentBench is a suite of end-to-end Machine Learning (ML) experimentation tasks for benchmarking AI agents, where… rllm-org/rllm — rllm is an asynchronous reinforcement learning framework for training language agents. It provides a unified pipeline… microsoft/fara — FARA is a visual computer-use agent model that controls a browser by predicting screen coordinates for clicking,… eval-sys/mcpmark — MCPMark is a comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in… masworks/x-mas — [2025/05/23] See our preprint paper in ArXiv. gersteinlab/ml-bench — ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code…

    Projects sharing features with AgentBench

    These projects share indexed features with AgentBench. Shared tags can include platform or build tooling; verify the primary use case before treating a result as a replacement.
    • snap-stanford/mlagentbenchsnap-stanford avatar

      snap-stanford/MLAgentBench

      342View on GitHub↗

      MLAgentBench is a suite of end-to-end Machine Learning (ML) experimentation tasks for benchmarking AI agents, where the agent aims to take a given dataset and a machine learning task description and autonomously develop or improve an ML model. Paper: https://arxiv.org/abs/2310.03302

      Python
      View on GitHub↗342
    • rllm-org/rllmrllm-org avatar

      rllm-org/rllm

      5,912View on GitHub↗

      rllm is an asynchronous reinforcement learning framework for training language agents. It provides a unified pipeline that runs the same agent code for both evaluation and training, automatically capturing traces for gradient computation. The framework supports distributed reinforcement learning across multiple GPUs and nodes using pluggable backends, and executes agents in isolated sandboxes—either locally or in the cloud—for safe and scalable rollout collection. It trains agents built with LangGraph, SmolAgents, OpenAI Agents SDK, or custom frameworks without requiring core logic changes. T

      Pythonagent-frameworkagentic-workflowcoding-agent
      View on GitHub↗5,912
    • microsoft/faramicrosoft avatar

      microsoft/fara

      6,248View on GitHub↗

      FARA is a visual computer-use agent model that controls a browser by predicting screen coordinates for clicking, typing, and scrolling, without relying on DOM or accessibility trees. It is designed to automate multi-step web tasks such as searching, form filling, booking, and shopping by reasoning over visual state and decomposing tasks into sequential actions. The model uses a compact 7-billion-parameter decoder-only transformer that can run on consumer GPUs for low-latency on-device inference, or be deployed as a managed endpoint on Azure Foundry for cloud-based inference without local infr

      Pythonagentbrowser-usecomputer-use
      View on GitHub↗6,248
    • eval-sys/mcpmarkeval-sys avatar

      eval-sys/mcpmark

      472View on GitHub↗

      MCPMark is a comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in real-world MCP use.

      Python
      View on GitHub↗472
    Compare all 21 related projects→