Skip to content
Snippets Groups Projects

DAN evaluation

Split CER (HTR-NER) CER (HTR) WER (HTR-NER) WER (HTR) WER (HTR no punct) NER
train 18.89 21.05 26.67 26.67 26.67 7.14
val 8.82 11.54 50.0 50.0 50.0 0.0
test 2.78 3.33 14.29 14.29 14.29 0.0

Nerval evaluation

train
tag predicted matched Precision Recall F1 Support
Surname 2 2 100.0 100.0 100.0 2
Patron 2 0 0.0 0.0 0 1
Operai 2 2 100.0 100.0 100.0 2
Louche 2 1 50.0 50.0 50.0 2
Koala 2 2 100.0 100.0 100.0 2
Firstname 2 2 100.0 100.0 100.0 2
Chalumeau 1 1 100.0 100.0 100.0 1
Batiment 2 2 100.0 100.0 100.0 2
All 15 12 80.0 85.71 82.76 14
val
tag predicted matched Precision Recall F1 Support
Surname 1 0 0.0 0.0 0 1
Patron 1 1 100.0 100.0 100.0 1
Operai 1 0 0.0 0.0 0 1
Louche 1 1 100.0 100.0 100.0 1
Koala 1 1 100.0 100.0 100.0 1
Firstname 1 1 100.0 100.0 100.0 1
Chalumeau 1 1 100.0 100.0 100.0 1
Batiment 1 1 100.0 100.0 100.0 1
All 8 6 75.0 75.0 75.0 8
test
tag predicted matched Precision Recall F1 Support
Surname 1 1 100.0 100.0 100.0 1
Louche 1 1 100.0 100.0 100.0 1
Koala 1 1 100.0 100.0 100.0 1
Firstname 1 1 100.0 100.0 100.0 1
Chalumeau 1 0 0.0 0.0 0 1
Batiment 1 1 100.0 100.0 100.0 1
All 6 5 83.33 83.33 83.33 6

5 worst prediction(s)

Image name WER Alignment between ground truth - prediction
2c242f5c-e979-43c4-b6f2-a6d4815b651d.png 50.0 ⓈA ⒻCharles Ⓑ11 ⓁP ⒸC ⓀF ⓄA Ⓟ14331
Ⓢd ⒻCharles Ⓑ11 ⓁP ⒸC ⓀF Ⓞd Ⓟ14 31
0dfe8bcd-ed0b-453e-bf19-cc697012296e.png 26.67 ⓈTemplié ⒻMarcelle Ⓑ93 ⓁJ Ⓚch ⓄE dachyle-------
ⓈTemplié ⒻMarcelle Ⓑ93 ⓁS Ⓚch ⓄE dactylo Ⓟ18376
ffdec445-7f14-4f5f-be44-68d0844d0df1.png 14.29 ⓈNaudin ⒻMarie Ⓑ53 ⓁS ⒸV ⓀBelle mère
ⓈNaudin ⒻMarie Ⓑ53 ⓁS Ⓒv ⓀBelle mère
0a56e8b3-95cd-4fa5-a17b-5b0ff9e6ea84.png 12.5 ⓈBellisson ⒻGeorges Ⓑ91 ⓁP ⒸM ⓀCh ⓄPlombier Ⓟ-------12241
ⓈBellisson ⒻGeorges Ⓑ91 ⓁP ⒸM ⓀCh ⓄPlombier ⓅPatron?12241