From ba873efb88c1e4a70a9b402f84c7a89a8e71db07 Mon Sep 17 00:00:00 2001 From: Christina Lohr Date: Tue, 6 Oct 2020 11:42:58 +0200 Subject: [PATCH] Update README.md --- README.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index eb86d41..4af23bb 100644 --- a/README.md +++ b/README.md @@ -92,9 +92,9 @@ Florian Borchert, Christina Lohr, Luise Modersohn, Thomas Langer, Markus Follman * `data/outData/output-xmi` * This JCoRe pipeline is dervived of the JULIE Lab own [jcore-pipeline-modules](https://github.com/JULIELab/jcore-pipeline-modules) (see also https://zenodo.org/record/4066619#.X3sPVS8Rp-U) -# Evaluation +# Evaluation of Annotations -To calculate precision and recall between automatically created annotations and the human annotated data run: - -* `pip install bratutils` -* `python src/main/python/umls_evaluation.py ` +* To calculate the inter-annotator-agreement between human annotators follow the instructions of [bratiaa](https://github.com/kldtz/bratiaa) +* To calculate precision and recall between automatically created annotations and the human annotated data run: + * `pip install bratutils` + * `python src/main/python/umls_evaluation.py `