Skip to content

Commit df35aa1

Browse files
Add joint (lemma, POS) frequency ranking option
Measured on the SBLGNT: joint frequency improves POS agreement (76.2% -> 77.8%) but lowers top-1 lemma accuracy (92.9% -> 91.9%), so it is off by default. The lemma-frequency table now also carries per-POS counts.
1 parent 691fc1b commit df35aa1

5 files changed

Lines changed: 16472 additions & 8 deletions

File tree

‎python/README.md‎

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -90,9 +90,14 @@ Ranking adds ~6 points of top-1 lemma accuracy over Morpheus's native order,
9090
out of domain. The lower numbers on the `grc_proiel_lg` subset reflect the noise
9191
in that (machine-generated) reference more than Morpheus itself.
9292

93-
A POS-bigram Viterbi tagger (`tagger.py`) was also built and measured; with the
94-
bundled model it **does not beat** frequency-only ranking (92.9% vs 93.0%), so it
95-
is off by default. It needs a learned emission model (P(lemma | tag)) to pay off.
93+
Two contextual approaches were built and measured but do **not** beat plain
94+
frequency ranking, so both are off by default:
95+
96+
- a POS-bigram Viterbi tagger (`tagger.py`, `--tagger`): 92.9% vs 93.0%;
97+
- joint (lemma, POS) frequency (`--joint`): 91.9% top-1 but 77.8% POS (vs 76.2%).
98+
99+
They need a *learned* emission model (P(lemma | tag)) and a proper tagger to pay
100+
off; the bundled hand-built model is not enough.
96101

97102
## Known limitations
98103

0 commit comments

Comments
 (0)