Evaluate pure HTR metric
When we are evaluating a HTR+NER model, we are usually interested in CER/WER without NER tokens (HTR) and with NER tokens (HTR+NER).
The current evaluation manager automatically removes tokens and only compute pure HTR metric.
We need to do just like *_no_punct metrics and simply compute both values.
We introduce two new supported metric names:
- cer_no_tokens, (= call format with remove_token=True, this is a new parameter that triggers the regex.)
- wer_no_tokens (= call format with remove_token=True, this is a new parameter that triggers the regex.)
Edited by Yoann Schneider