awesome-repositories.com
Blog
MCP
awesome-repositories.com

Discover the best open-source repositories with AI-powered search.

ExploreCurated searchesOpen-source alternativesSelf-hosted softwareBlogSitemap
ProjectMCP serverAboutHow we rankPress
LegalPrivacyTerms
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
Back to thudm/agentbench

Projects sharing features with AgentBench

21 open-source projects similar to thudm/agentbench, ranked by shared indexed features. Tags may describe platforms or build tools rather than the same primary purpose. Check each project’s use case, license, and deployment requirements before treating it as a replacement.

  • snap-stanford/mlagentbenchsnap-stanford avatar

    snap-stanford/MLAgentBench

    342View on GitHub↗

    MLAgentBench is a suite of end-to-end Machine Learning (ML) experimentation tasks for benchmarking AI agents, where the agent aims to take a given dataset and a machine learning task description and autonomously develop or improve an ML model. Paper: https://arxiv.org/abs/2310.03302

    Python
    View on GitHub↗342
  • rllm-org/rllmrllm-org avatar

    rllm-org/rllm

    5,912View on GitHub↗

    rllm is an asynchronous reinforcement learning framework for training language agents. It provides a unified pipeline that runs the same agent code for both evaluation and training, automatically capturing traces for gradient computation. The framework supports distributed reinforcement learning across multiple GPUs and nodes using pluggable backends, and executes agents in isolated sandboxes—either locally or in the cloud—for safe and scalable rollout collection. It trains agents built with LangGraph, SmolAgents, OpenAI Agents SDK, or custom frameworks without requiring core logic changes. T

    Pythonagent-frameworkagentic-workflowcoding-agent
    View on GitHub↗5,912
  • microsoft/faramicrosoft avatar

    microsoft/fara

    6,248View on GitHub↗

    FARA is a visual computer-use agent model that controls a browser by predicting screen coordinates for clicking, typing, and scrolling, without relying on DOM or accessibility trees. It is designed to automate multi-step web tasks such as searching, form filling, booking, and shopping by reasoning over visual state and decomposing tasks into sequential actions. The model uses a compact 7-billion-parameter decoder-only transformer that can run on consumer GPUs for low-latency on-device inference, or be deployed as a managed endpoint on Azure Foundry for cloud-based inference without local infr

    Pythonagentbrowser-usecomputer-use
    View on GitHub↗6,248

AI search

Explore more awesome repositories

Describe what you need in plain English — the AI ranks thousands of curated open-source projects by relevance.

Find more with AI search
  • facebookresearch/mlgymfacebookresearch avatar

    facebookresearch/MLGym

    604View on GitHub↗

    MLGym A New Framework and Benchmark for Advancing AI Research Agents

    Python
    View on GitHub↗604
  • gersteinlab/ml-benchgersteinlab avatar

    gersteinlab/ML-Bench

    315View on GitHub↗

    ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code (https://arxiv.org/abs/2311.09835)

    Python
    View on GitHub↗315
  • masworks/x-masMASWorks avatar

    MASWorks/X-MAS

    35View on GitHub↗

    2025/05/23 See our preprint paper in ArXiv.

    Python
    View on GitHub↗35
  • microsoft/smartplaymicrosoft avatar

    microsoft/SmartPlay

    145View on GitHub↗

    SmartPlay is a benchmark for Large Language Models (LLMs). Uses a variety of games to test various important LLM capabilities as agents. SmartPlay is designed to be easy to use, and to support future development of LLMs.

    Python
    View on GitHub↗145
  • modelscope/mcpbenchmodelscope avatar

    modelscope/MCPBench

    251View on GitHub↗

    The evaluation benchmark on MCP servers

    Python
    View on GitHub↗251
  • multiagentbench/marbleMultiagentBench avatar

    MultiagentBench/MARBLE

    52View on GitHub↗

    Now the official Code for MultiagentBench has been moved to MARBLE

    Python
    View on GitHub↗52
  • open-compass/gtaopen-compass avatar

    open-compass/GTA

    153View on GitHub↗

    NeurIPS 2024 D&B GTA: A Benchmark for General Tool Agents & arXiv 2026 GTA-2

    Python
    View on GitHub↗153
  • openai/mle-benchopenai avatar

    openai/mle-bench

    1,316View on GitHub↗
    Python
    View on GitHub↗1,316
  • promptfoo/promptfoopromptfoo avatar

    promptfoo/promptfoo

    10,529View on GitHub↗

    Promptfoo is an evaluation framework designed for testing, benchmarking, and red-teaming language models and agentic workflows. It provides a unified environment to run prompts against multiple providers, allowing developers to systematically validate model outputs against objective assertions, semantic similarity metrics, and custom grading rubrics. The platform distinguishes itself through a provider-agnostic execution layer and a stateful orchestrator capable of simulating multi-turn conversations and complex tool-use trajectories. It includes a dedicated adversarial mutation pipeline that

    TypeScriptcici-cdcicd
    View on GitHub↗10,529
  • ruc-gsai/yulan-swarmintellRUC-GSAI avatar

    RUC-GSAI/YuLan-SwarmIntell

    34View on GitHub↗

    Figure 1: Natural Swarm Intelligence Inspiration and SwarmBench Tasks.

    Python
    View on GitHub↗34
  • sentrux/sentruxsentrux avatar

    sentrux/sentrux

    3,341View on GitHub↗

    Real-time architectural sensor that helps AI agents close the feedback loop, enabling recursive self-improvement of code quality. Pure Rust.

    Rust
    View on GitHub↗3,341
  • shadcn-ui/lintshadcn-ui avatar

    shadcn-ui/lint

    3,337View on GitHub↗

    An agent-first linter for Tailwind design systems. Write design system rules that agents can verify.

    TypeScript
    View on GitHub↗3,337
  • vaquarkhan/mcp-test-harnessvaquarkhan avatar

    vaquarkhan/mcp-test-harness

    10View on GitHub↗

    a Testing framework for MCP servers

    Python
    View on GitHub↗10
  • wack/slcrwack avatar

    wack/slcr

    26View on GitHub↗

    An open standard for agent-native software requirements.

    Rust
    View on GitHub↗26
  • agiresearch/openagiagiresearch avatar

    agiresearch/OpenAGI

    2,269View on GitHub↗

    OpenAGI: When LLM Meets Domain Experts

    Python
    View on GitHub↗2,269
  • xlang-ai/osworldxlang-ai avatar

    xlang-ai/OSWorld

    2,584View on GitHub↗

    OSWorld is an evaluation framework and multimodal agent benchmark designed to test the ability of large language models to complete complex tasks within virtualized operating system environments. It provides a virtualized desktop sandbox and a virtual machine orchestrator to deploy, snapshot, and reset cloud-based desktops, ensuring reproducible test states for AI agent interactions. The system distinguishes itself by providing an OS-level action space that translates model decisions into mouse clicks, keyboard inputs, and system commands. It employs a standardized interface to integrate vari

    Pythonagentartificial-intelligencebenchmark
    View on GitHub↗2,584
  • chchenhui/mlrbenchchchenhui avatar

    chchenhui/mlrbench

    30View on GitHub↗

    NeurIPS 2025 D&B Track MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research

    Python
    View on GitHub↗30
  • eval-sys/mcpmarkeval-sys avatar

    eval-sys/mcpmark

    472View on GitHub↗

    MCPMark is a comprehensive, stress-testing MCP benchmark designed to evaluate model and agent capabilities in real-world MCP use.

    Python
    View on GitHub↗472