Skip to content

Commit 10aa03e

Browse files
committed
updated readme
1 parent 2a4d84c commit 10aa03e

1 file changed

Lines changed: 9 additions & 8 deletions

File tree

README.md

Lines changed: 9 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,13 @@
1-
# pie
1+
2+
# PIE: A Framework for Joint Learning of Sequence Labelling Tasks
3+
4+
PIE was primarily conceived to make experimentation on sequence labelling of variation-rich languages easy and user-friendly. PIE has been tested mostly for Lemmatization but other SoTA accuracies from other tasks like POS have been reproduced (cf. Plank et al ). PIE is *highly* configurable both in terms of input preprocessing and model definition, in principle not requiring users to write any code (instead experiments are defined with json files). It is highly modular and therefore easy to extend. It includes transductive lemmatization as an additional sequence labelling task and, finally, it is reasonably fast.
5+
6+
Documentation is work in progress and it will improve over the following months, for now the best is to check `pie/default_settings.json` which explains all input parameters and shows a full example of a config file.
7+
8+
Model description and evaluation results are also in preparation.
29

310
- Future work:
411
- Add GRL regularization on domain/source labels (which seems to help POS [https://arxiv.org/pdf/1805.06093.pdf](here: Table 1&2). We can use file names, or derive appropriate labels from file names.
5-
- Train both linear and char-level decoders.
6-
- Fine-tune threshold on dev data to see when to pick which output.
712
- Implement a mixture-model to learn to decide whether to retrieve a lemma from the cache or go and generate it one character at a time [https://arxiv.org/pdf/1609.07843.pdf](similar to this paper).
8-
- Morphology: people seem to just run same kind of linear classifier (one per label)
9-
- In what sense is POS not a morphology-label like NUM, TENSE, etc...
10-
- Fine-grain error analyses:
11-
- classify lemmatas based on edit-distance with the source (different bins, show accuracy per bin)
12-
- does contextual information help for lemmatization (compare to a baseline where decoding is done char-level but unconditionally, compare to linear decoding baseline without contextual information)?
13+

0 commit comments

Comments
 (0)