DataImport errors

Save repository import errors and list them with context and Git links

mentioned in merge request frontend!23 (merged)

added 13 commits

• 6222e254 - 1 commit from branch master
• 939ebd9a - Add DataImportFailure API view
• 06686b7a - Add DataImportFailure model
• 47759cc2 - Migration
• 5b1d1967 - Template view and URLs
• b199664a - Store match errors in TEI parser
• 44c41237 - DataImportFailure serializer
• e770f401 - Create DataImportFailures with match errors
• 72dc513d - Probably bad implementation of read_file_range
• a37bf668 - Add revision to DataImportSerializer
• b74fe003 - Add failures view template
• 99e0f2c3 - Fixes
• 2ac8f528 - Fix flake8

Compare with previous version

added 14 commits

• 2ac8f528...28b2dd1a - 2 commits from branch master
• edaaf291 - Add DataImportFailure API view
• 0027ec01 - Add DataImportFailure model
• 9bb4506f - Migration
• 5fe84c99 - Template view and URLs
• 3ae2135b - Store match errors in TEI parser
• 4db4f1d4 - DataImportFailure serializer
• 288417a8 - Create DataImportFailures with match errors
• a06c96a9 - Probably bad implementation of read_file_range
• b20f220b - Add revision to DataImportSerializer
• bbf7e1ab - Add failures view template
• e0e4cd2a - Fixes
• 71da6730 - Fix flake8

Compare with previous version

added 16 commits

• 71da6730...ea8057ea - 4 commits from branch master
• f16515a9 - Add DataImportFailure API view
• ad9bea50 - Add DataImportFailure model
• 8bddfa74 - Migration
• 1b392538 - Template view and URLs
• 417cca70 - Store match errors in TEI parser
• d414d353 - DataImportFailure serializer
• c9674a64 - Create DataImportFailures with match errors
• 3825374b - Probably bad implementation of read_file_range
• 44e921ab - Add revision to DataImportSerializer
• ac331158 - Add failures view template
• 13c3f051 - Fixes
• 6068a72d - Fix flake8

Compare with previous version

added 1 commit

• c757babb - Use a regex to strip the clone directory

Compare with previous version

resolved all discussions

added 18 commits

• c757babb...e67ded96 - 2 commits from branch master
• 69135a7e - Add DataImportFailure API view
• 302046c9 - Add DataImportFailure model
• 4df1de10 - Migration
• 4fa8cfc2 - Template view and URLs
• 575abadb - Store match errors in TEI parser
• 716a7373 - DataImportFailure serializer
• b3a3b19f - Create DataImportFailures with match errors
• 626cf992 - Probably bad implementation of read_file_range
• 6a4eb150 - Add revision to DataImportSerializer
• 1554f9ab - Add failures view template
• ecca5fa8 - Fixes
• 425a1613 - Fix flake8
• b514f21c - Use a regex to strip the clone directory
• d6497c0f - Use namedtuple for match errors
• b301f8d3 - Missing parser comment
• 37597975 - Move ElementLightSerializer to serializers.light and fix circular import

Compare with previous version

added 1 commit

• 38da364c - Make revision read-only on import serializer

Compare with previous version

resolved all discussions

added 1 commit

• 9cd60bc2 - Add ssh tunnel

Compare with previous version

added 1 commit

• 2d02bdc5 - Add ordering to failures

Compare with previous version

added 26 commits

• 2d02bdc5...c62d91d1 - 5 commits from branch master
• 5c56d1d7 - Add DataImportFailure API view
• 0d285b54 - Add DataImportFailure model
• d9c739c1 - Migration
• ece7202c - Template view and URLs
• cf5ffd90 - Store match errors in TEI parser
• 7102d853 - DataImportFailure serializer
• 58ed75ea - Create DataImportFailures with match errors
• 86983641 - Probably bad implementation of read_file_range
• 6c401271 - Add revision to DataImportSerializer
• d7183eea - Add failures view template
• c0bae9a5 - Fixes
• a9b654b6 - Fix flake8
• fee1708a - Use a regex to strip the clone directory
• 74cb3e17 - Use namedtuple for match errors
• 918a278a - Missing parser comment
• 788ab134 - Move ElementLightSerializer to serializers.light and fix circular import
• 775f4c78 - Make revision read-only on import serializer
• 8afbd2ba - Add ssh tunnel
• cd212170 - Add ordering to failures
• 12a171f3 - Move Redis mocking to a mixin
• f761a734 - Test workflow creation, configuration and startup

Compare with previous version

added 1 commit

• 9efbd9d8 - Add git dependency on GitLab CI

Compare with previous version

added 4 commits

• 03b6ed68 - Move failure creation to TeiParser
• baf2b0c3 - Test ImportFailures view
• fb712176 - Test TeiParser failures saving
• 6c93f69e - Fixes

Compare with previous version

added 3 commits

• 13fc3fb9 - Fixes
• cdada6fa - Move save_failures to DataImport
• 71dd7246 - Update tests

Compare with previous version

resolved all discussions

added 1 commit

• 2e545b22 - Nits

Compare with previous version

resolved all discussions

approved this merge request

added 1 commit

• e2127e5f - Fix XML line attribute

Compare with previous version

added 1 commit

• 3a4c0154 - Unit test for _match_error

Compare with previous version

added 1 commit

• 8b1780b8 - Assert against constant

Compare with previous version

enabled an automatic merge when the pipeline for 8b1780b8 succeeds

added 36 commits

• 3a4c0154...d50a05d8 - 4 commits from branch master
• 138f0d79 - Add DataImportFailure API view
• 93771263 - Add DataImportFailure model
• ab51039d - Migration
• bfe191b7 - Template view and URLs
• 8c975b9d - Store match errors in TEI parser
• 90a491b7 - DataImportFailure serializer
• c8ad35ce - Create DataImportFailures with match errors
• 6970bc60 - Probably bad implementation of read_file_range
• 50eab08b - Add revision to DataImportSerializer
• 9e21476f - Add failures view template
• f93877d6 - Fixes
• 6dfc4616 - Fix flake8
• e508a42f - Use a regex to strip the clone directory
• 0fd332db - Use namedtuple for match errors
• b11ddce7 - Missing parser comment
• 223c1313 - Move ElementLightSerializer to serializers.light and fix circular import
• 3e384c4e - Make revision read-only on import serializer
• a90cf0e2 - Add ssh tunnel
• 6e4d4123 - Add ordering to failures
• 1e9e14b7 - Move Redis mocking to a mixin
• 82eb8f48 - Test workflow creation, configuration and startup
• 7239dc97 - Add git dependency on GitLab CI
• bd3fb428 - Move failure creation to TeiParser
• 7985e9d9 - Test ImportFailures view
• 27598296 - Test TeiParser failures saving
• 486a20b2 - Fixes
• c0a9853e - Fixes
• 90c23e36 - Move save_failures to DataImport
• 88377925 - Update tests
• 1abb13c4 - Nits
• 5a8bca54 - Fix XML line attribute
• 80777c16 - Unit test for _match_error

Compare with previous version

Codecov Report

No coverage uploaded for pull request base (master@e508a42). Click here to learn what that means. The diff coverage is 94.44%.

@@            Coverage Diff            @@
##             master      #73   +/-   ##
=========================================
  Coverage          ?   57.95%           
=========================================
  Files             ?      116           
  Lines             ?     4621           
  Branches          ?        0           
=========================================
  Hits              ?     2678           
  Misses            ?     1943           
  Partials          ?        0

Impacted Files	Coverage Δ
arkindex/dataimport/views.py	87.5% <ø> (ø)
arkindex/dataimport/api.py	74.28% <ø> (ø)
arkindex/documents/serializers/light.py	100% <100%> (ø)
arkindex/documents/tests/test_tei.py	100% <100%> (ø)
arkindex/documents/serializers/elements.py	100% <100%> (ø)
arkindex/dataimport/tests/test_imports.py	100% <100%> (ø)
arkindex/documents/tests/test_tasks.py	100% <100%> (ø)
arkindex/project/tests/__init__.py	100% <100%> (ø)
arkindex/dataimport/serializers.py	95.06% <100%> (ø)
arkindex/dataimport/tasks.py	26.01% <50%> (ø)
... and 2 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update e508a42...8b1780b. Read the comment docs.

merged

mentioned in commit 578c6f0d