Skip to content
Snippets Groups Projects
Commit ef07d298 authored by Solene Tarride's avatar Solene Tarride
Browse files

Fix tests

parent 230d6cb0
No related branches found
No related tags found
1 merge request!287Support subword and word language models
This commit is part of merge request !287. Comments created here will be created in the context of that merge request.
Hide whitespace changes
Inline Side-by-side
Showing
with 0 additions and 1 deletion
tests/test_extract.py
+ 0
− 1
View file @ ef07d298
......@@ -654,7 +654,6 @@ def test_extract(
"▁" if t.isspace() else t for t in sorted(list(expected_charset))
]
expected_language_tokens.append("◌")
expected_language_tokens.append("⁇")
assert (output / "language_model" / "tokens.txt").read_text() == "\n".join(
expected_language_tokens
)
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment