SimpleQuestionsWikidata[1] is a version of the SimpleQuestions dataset mapped to Wikidata.
This dataset can be downloaded via the link.
| Model / System | Year | Precision | Recall | F1 | Language | Reported by |
|---|---|---|---|---|---|---|
| Rigel-Baseline | 2021 | 73.4 | - | - | EN | Oliya et al. |
| Rigel-ER | 2021 | 70.1 | - | - | EN | Oliya et al. |
| KBQA-Adapter | 2021 | 72.0 | - | - | EN | Oliya et al. |
| Model / System | Year | Precision | Recall | F1 | Language | Reported by |
|---|---|---|---|---|---|---|
| Rigel-E2E | 2021 | 68.2 | - | - | EN | Oliya et al. |
| Text2Graph (MEKER Wikidata5m) | 2022 | - | - | 61.81 ± 0.13 | EN | Chekalina et al. |
| MemNN | 2015 | 61.6 | - | - | EN | Oliya et al. |
| STaG-QA_pre [1] | 2021 | 60.2 | 63.2 | 61.7 | EN | Ravishankar et al. |
| STaG-QA [2] | 2021 | 59.4 | 62.7 | 60.1 | EN | Ravishankar et al. |
| Text2Graph (PTBG (TransE) Wikidata5m) | 2022 | - | - | 59.97 ± 0.15 | EN | Chekalina et al. |
| SYGMA [3] | 2021 | 42 | 55 | 44 | EN | Neelam S et al |
| KEQA (TransE FB5M) | 2022 | - | - | 40.48 ± 0.10 | EN | Chekalina et al. |
| GETT-QA [4] | 2023 | 76.1 ± 0.2 | - | - | EN | Banerjee et al. |
- [1] wikidata 03/2020.
- [2] wikidata 03/2020.
- [3] wikidata version not stated.
- [4] With truncated KG embeddings.
[1] Diefenbach, Dennis, Thomas Tanon, Kamal Singh, and Pierre Maret. Question answering benchmarks for wikidata. In ISWC 2017. 2017.