What are the best open-source alternatives to GraphRAG Benchmark?

Question 1

Accepted Answer

13 open-source projects similar to graphrag-bench/graphrag-benchmark, ranked by shared features. Top picks: amazon-science/mintaka, asknowqa/lc-quad, dki-lab/grailqa, ibm/vakra, irenezihuili/cgprompt, jaylzhou/graphrag, jerryzhao-z/simple-question-answering-with-memory-networks, jiho283/factkg, liu-rj/polyg, petergpt/bullshit-benchmark.

Question 2

Is amazon-science/mintaka a good alternative to GraphRAG Benchmark?

Accepted Answer

Mintaka is a complex, natural, and multilingual question answering (QA) dataset composed of 20,000 question-answer pairs elicited from MTurk workers and annotated with Wikidata question and answer entities. Full details on the Mintaka dataset can be found in our paper:…

Question 3

Is asknowqa/lc-quad a good alternative to GraphRAG Benchmark?

Accepted Answer

This code aims to convert a valid SPARQL query into a (or many) natural language questions. The incentive is to create a good dataset for QA system training, and achieve a scale which helps Neural Network based QA Systems too. We do this mostly by converting the query into a pseudo natural…

Question 4

Is dki-lab/grailqa a good alternative to GraphRAG Benchmark?

Accepted Answer

This repository is structured as follows:

Question 5

Is ibm/vakra a good alternative to GraphRAG Benchmark?

Accepted Answer

VAKRA (eValuating API and Knowledge Retrieval Agents using multi-hop, multi-source dialogues) is a tool-grounded, executable benchmark designed to evaluate how well AI agents reason end-to-end in enterprise-like settings.

Question 6

Is irenezihuili/cgprompt a good alternative to GraphRAG Benchmark?

Accepted Answer

This is the GitHub repo for the paper submission.

Question 7

Is jaylzhou/graphrag a good alternative to GraphRAG Benchmark?

Accepted Answer

If you find our work helpful, please kindly cite our paper.

Question 8

Is jerryzhao-z/simple-question-answering-with-memory-networks a good alternative to GraphRAG Benchmark?

Accepted Answer

Create the SETTINGS.json file in the root of the project containing settings from the SETTINGS.json.example. One have to specify location of all datasets and other local configuration information.

Question 9

Is jiho283/factkg a good alternative to GraphRAG Benchmark?

Accepted Answer

We introduce a new dataset, FactKG: Fact Verification via Reasoning on Knowledge Graphs. It consists of 108k natural language claims with five types of reasoning: One-hop, Conjunction, Existence, Multi-hop, and Negation. Furthermore, FactKG contains various linguistic patterns, including…

Question 10

Is liu-rj/polyg a good alternative to GraphRAG Benchmark?

Accepted Answer

PolyG: Adaptive Graph Traversal for Diverse GraphRAG Questions

Question 11

Is petergpt/bullshit-benchmark a good alternative to GraphRAG Benchmark?

Accepted Answer

BullshitBench v2

Open-source alternatives to GraphRAG Benchmark

amazon-science/mintaka

AskNowQA/LC-QuAD

dki-lab/GrailQA

IBM/vakra

IreneZihuiLi/CGPrompt

Open-source alternatives to GraphRAG Benchmark

amazon-science/mintaka

AskNowQA/LC-QuAD

dki-lab/GrailQA

IBM/vakra

IreneZihuiLi/CGPrompt

JayLZhou/GraphRAG

Jerryzhao-z/simple-question-answering-with-memory-networks

jiho283/FactKG

Liu-rj/PolyG

petergpt/bullshit-benchmark

qhjqhj00/MemoRAG

yixuantt/MultiHop-RAG

yuyuz/MetaQA