Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
chlor authored Oct 6, 2020
1 parent 1e9f8c1 commit ba873ef
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -92,9 +92,9 @@ Florian Borchert, Christina Lohr, Luise Modersohn, Thomas Langer, Markus Follman
* `data/outData/output-xmi`
* This JCoRe pipeline is dervived of the JULIE Lab own [jcore-pipeline-modules](https://github.com/JULIELab/jcore-pipeline-modules) (see also https://zenodo.org/record/4066619#.X3sPVS8Rp-U)

# Evaluation
# Evaluation of Annotations

To calculate precision and recall between automatically created annotations and the human annotated data run:

* `pip install bratutils`
* `python src/main/python/umls_evaluation.py <path to gold annotations> <path to automatic annotations>`
* To calculate the inter-annotator-agreement between human annotators follow the instructions of [bratiaa](https://github.com/kldtz/bratiaa)
* To calculate precision and recall between automatically created annotations and the human annotated data run:
* `pip install bratutils`
* `python src/main/python/umls_evaluation.py <path to gold annotations> <path to automatic annotations>`

0 comments on commit ba873ef

Please sign in to comment.