Skip to content

Releases: stair-lab/kg-gen

MINE Eval expanded

23 Nov 20:19
d0359a1

Choose a tag to compare

results

uses kggen with gpt-5-nano, and gpt-oss-20b with multiple levels of reasoning + openie and graphrag options

MINE Eval (deduplication) Scikit Learn vs Faiss

28 Oct 04:44
d300032

Choose a tag to compare

comparison
============================================================
SUMMARY STATISTICS
============================================================
faiss                                    scikit-learn
Mean:                                    36.93 70.47
Median:                                  40.00 73.33
Std Dev:                                 17.72 20.36
Min:                                      0.00 13.33
Max:                                     73.33 100.00
============================================================

scikit-learn vs faiss - Average difference: 33.53%
Better cases in scikit-learn: 90
Better cases in faiss: 6
Equal cases: 4
============================================================

#69 #62

WikiQA KGGen Dataset

06 Oct 06:19
52251f4

Choose a tag to compare

MINE dataset and evaluations

26 Sep 04:58
5017384

Choose a tag to compare

This files were organized into a single dataset that allows to rerun evaluations, keeping this just as a backup and history.

Should use https://huggingface.co/datasets/josancamon/kg-gen-MINE-evaluation-dataset.

answers.json = generated_queries instead, this was a bad name