How this analysis was created: This summary and feature list were written by an AI model that read the project's README and public documentation pages. Each feature links to the documentation it came from; stars, license and language come straight from the GitHub API. The model does not read the source code, and the analysis is refreshed when the project is re-analysed. Learn more on our About page.
This code aims to convert a valid SPARQL query into a (or many) natural language questions. The incentive is to create a good dataset for QA system training, and achieve a scale which helps Neural Network based QA Systems too. We do this mostly by converting the query into a pseudo natural…
VAKRA (eValuating API and Knowledge Retrieval Agents using multi-hop, multi-source dialogues) is a tool-grounded, executable benchmark designed to evaluate how well AI agents reason end-to-end in enterprise-like settings.
Mintaka is a complex, natural, and multilingual question answering (QA) dataset composed of 20,000 question-answer pairs elicited from MTurk workers and annotated with Wikidata question and answer entities. Full details on the Mintaka dataset can be found in our paper:…
🧩Task Examples
The main features of graphrag-bench/graphrag-benchmark are: Benchmarks and Evaluation, Evaluation Benchmarks.
Open-source alternatives to graphrag-bench/graphrag-benchmark include: asknowqa/lc-quad — This code aims to convert a valid SPARQL query into a (or many) natural language questions. The incentive is to create… dki-lab/grailqa — This repository is structured as follows:. ibm/vakra — VAKRA (eValuating API and Knowledge Retrieval Agents using multi-hop, multi-source dialogues) is a tool-grounded,… irenezihuili/cgprompt — This is the GitHub repo for the paper submission. jaylzhou/graphrag — If you find our work helpful, please kindly cite our paper. amazon-science/mintaka — Mintaka is a complex, natural, and multilingual question answering (QA) dataset composed of 20,000 question-answer…
