Something went wrong on our end
metrics_table.md 4.50 KiB
DAN evaluation
Split | CER (HTR-NER) | CER (HTR) | WER (HTR-NER) | WER (HTR) | WER (HTR no punct) | NER |
---|---|---|---|---|---|---|
train | 18.89 | 21.05 | 26.67 | 26.67 | 26.67 | 7.14 |
val | 8.82 | 11.54 | 50.0 | 50.0 | 50.0 | 0.0 |
test | 2.78 | 3.33 | 14.29 | 14.29 | 14.29 | 0.0 |
Nerval evaluation
train
tag | predicted | matched | Precision | Recall | F1 | Support |
---|---|---|---|---|---|---|
Surname | 2 | 2 | 100.0 | 100.0 | 100.0 | 2 |
Patron | 2 | 0 | 0.0 | 0.0 | 0 | 1 |
Operai | 2 | 2 | 100.0 | 100.0 | 100.0 | 2 |
Louche | 2 | 1 | 50.0 | 50.0 | 50.0 | 2 |
Koala | 2 | 2 | 100.0 | 100.0 | 100.0 | 2 |
Firstname | 2 | 2 | 100.0 | 100.0 | 100.0 | 2 |
Chalumeau | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Batiment | 2 | 2 | 100.0 | 100.0 | 100.0 | 2 |
All | 15 | 12 | 80.0 | 85.71 | 82.76 | 14 |
val
tag | predicted | matched | Precision | Recall | F1 | Support |
---|---|---|---|---|---|---|
Surname | 1 | 0 | 0.0 | 0.0 | 0 | 1 |
Patron | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Operai | 1 | 0 | 0.0 | 0.0 | 0 | 1 |
Louche | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Koala | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Firstname | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Chalumeau | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Batiment | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
All | 8 | 6 | 75.0 | 75.0 | 75.0 | 8 |
test
tag | predicted | matched | Precision | Recall | F1 | Support |
---|---|---|---|---|---|---|
Surname | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Louche | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Koala | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Firstname | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
Chalumeau | 1 | 0 | 0.0 | 0.0 | 0 | 1 |
Batiment | 1 | 1 | 100.0 | 100.0 | 100.0 | 1 |
All | 6 | 5 | 83.33 | 83.33 | 83.33 | 6 |
5 worst prediction(s)
Image name | WER | Alignment between ground truth - prediction |
---|---|---|
2c242f5c-e979-43c4-b6f2-a6d4815b651d.png | 50.0 | ⓈA ⒻCharles Ⓑ11 ⓁP ⒸC ⓀF ⓄA Ⓟ14331 |
Ⓢd ⒻCharles Ⓑ11 ⓁP ⒸC ⓀF Ⓞd Ⓟ14 31 | ||
0dfe8bcd-ed0b-453e-bf19-cc697012296e.png | 26.67 | ⓈTemplié ⒻMarcelle Ⓑ93 ⓁJ Ⓚch ⓄE dachyle------- |
ⓈTemplié ⒻMarcelle Ⓑ93 ⓁS Ⓚch ⓄE dactylo Ⓟ18376 | ||
ffdec445-7f14-4f5f-be44-68d0844d0df1.png | 14.29 | ⓈNaudin ⒻMarie Ⓑ53 ⓁS ⒸV ⓀBelle mère |
ⓈNaudin ⒻMarie Ⓑ53 ⓁS Ⓒv ⓀBelle mère | ||
0a56e8b3-95cd-4fa5-a17b-5b0ff9e6ea84.png | 12.5 | ⓈBellisson ⒻGeorges Ⓑ91 ⓁP ⒸM ⓀCh ⓄPlombier Ⓟ-------12241 |
ⓈBellisson ⒻGeorges Ⓑ91 ⓁP ⒸM ⓀCh ⓄPlombier ⓅPatron?12241 |