Move the unknown token replacement step to download
parent
aa4721fd
No related branches found
No related tags found
Showing
- .gitattributes 0 additions, 1 deletion.gitattributes
- dan/datasets/download/__init__.py 21 additions, 0 deletionsdan/datasets/download/__init__.py
- dan/datasets/download/images.py 127 additions, 2 deletionsdan/datasets/download/images.py
- dan/datasets/download/utils.py 136 additions, 0 deletionsdan/datasets/download/utils.py
- dan/datasets/extract/__init__.py 1 addition, 13 deletionsdan/datasets/extract/__init__.py
- dan/datasets/extract/arkindex.py 9 additions, 128 deletionsdan/datasets/extract/arkindex.py
- dan/datasets/extract/exceptions.py 0 additions, 9 deletionsdan/datasets/extract/exceptions.py
- dan/datasets/extract/utils.py 2 additions, 132 deletionsdan/datasets/extract/utils.py
- docs/usage/datasets/download.md 37 additions, 6 deletionsdocs/usage/datasets/download.md
- docs/usage/datasets/extract.md 0 additions, 4 deletionsdocs/usage/datasets/extract.md
- tests/__init__.py 52 additions, 1 deletiontests/__init__.py
- tests/data/extraction/split.json 9 additions, 9 deletionstests/data/extraction/split.json
- tests/test_download.py 313 additions, 38 deletionstests/test_download.py
- tests/test_extract.py 20 additions, 324 deletionstests/test_extract.py
Loading