5 Repos
Evaluation environments for tool-augmented and API-driven agents.
Explore 5 awesome GitHub repositories matching part of an awesome list · Tool and API Benchmarks. Refine with filters or upvote what's useful.
DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.
Comprehensive benchmark for tool-augmented LLMs.
🛠️ The official repository for code and data of ToolQA dataset. ToolQA is a open-source dataset specifically designed for evaluations on tool-augmented large language models (LLMs). This repo provides the dataset, the corresponding data generation code, and the implementations of baselines on…
Dataset for question answering using external tools.
ToolBench, an evaluation suite for LLM tool manipulation capabilities.
Benchmark for tool manipulation capabilities.
Code for paper "Enhancing Open-Domain Task-Solving Capability of LLMs via Autonomous Tool Integration from GitHub", presented at Proceedings of ACL 2025.
Autonomous tool integration for task-solving.
🌐 Dataset Website | 📃 Paper | 🙋 Welcome Contribution | 📜 License
Benchmark for deciding tool usage and selection.