How this analysis was created: This summary and feature list are AI-generated from collected project material and can contain mistakes. Stars, license and language are imported from GitHub. Inclusion does not mean that we have tested or audited this project. Check the source documentation for any feature you depend on. Learn more on our About page.
Now the official Code for MultiagentBench has been moved to MARBLE
The main features of multiagentbench/marble are: General Agent Benchmarks.
Projects with overlapping indexed features include: agiresearch/openagi — OpenAGI: When LLM Meets Domain Experts. facebookresearch/mlgym — MLGym A New Framework and Benchmark for Advancing AI Research Agents. masworks/x-mas — [2025/05/23] See our preprint paper in ArXiv. ruc-gsai/yulan-swarmintell — Figure 1: Natural Swarm Intelligence Inspiration and SwarmBench Tasks. thudm/agentbench — A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24).
OpenAGI: When LLM Meets Domain Experts
MLGym A New Framework and Benchmark for Advancing AI Research Agents
Figure 1: Natural Swarm Intelligence Inspiration and SwarmBench Tasks.