Page search

Add a new ElasticSearch index to search for transcriptions inside pages and refactor parts of the search code

To be merged with frontend!32 (merged)

added 12 commits

• 9de5440a...777f50bc - 10 commits from branch master
• 83eed647 - Add page index
• 00e25f78 - Add page indexing task

Compare with previous version

added 7 commits

• 5368e1c3 - Use SearchAPIMixin for IIIF search
• 6097dd7a - Page search ES template
• 98a63470 - Update URLs and templates
• aa950a2a - Page search serializer
• 86acb69c - Page search API and mixin fixes
• 11900e3e - Post process for pages search
• c321dd6d - Update unit tests

Compare with previous version

added 17 commits

• c321dd6d...e5af9020 - 3 commits from branch master
• ff50ca5a - Add page index
• 78bcb440 - Add page indexing task
• f8452c9f - Use SearchAPIMixin for IIIF search
• 5327b450 - Page search ES template
• e2543596 - Update URLs and templates
• 9ddcdc01 - Page search serializer
• a62f071b - Page search API and mixin fixes
• 098a45f5 - Post process for pages search
• 210a11fe - Update unit tests
• 5a706d8e - Fix sorting
• 1f3399a0 - Simple page details view
• d05095b1 - Merge search templates into one
• e57c67ad - ACL filtering on Django views
• 6495383f - Fixes

Compare with previous version

unmarked as a Work In Progress

added 16 commits

• 6495383f...332400d6 - 2 commits from branch master
• 13dc9c4f - Add page index
• 18f971dc - Add page indexing task
• fae8fdda - Use SearchAPIMixin for IIIF search
• ca4f4f30 - Page search ES template
• bc011602 - Update URLs and templates
• f7cce442 - Page search serializer
• 61799640 - Page search API and mixin fixes
• 4533f356 - Post process for pages search
• ca132be5 - Update unit tests
• b4d5c753 - Fix sorting
• cd518a1e - Simple page details view
• 86f0b26e - Merge search templates into one
• a590330c - ACL filtering on Django views
• da386468 - Fixes

Compare with previous version

added 17 commits

• da386468...892c9533 - 2 commits from branch master
• be4bdf83 - Add page index
• 5569054a - Add page indexing task
• 10b6910a - Use SearchAPIMixin for IIIF search
• ba30f1d1 - Page search ES template
• ffc7184a - Update URLs and templates
• b35e5324 - Page search serializer
• f95b5969 - Page search API and mixin fixes
• 876eb903 - Post process for pages search
• b4373f0a - Update unit tests
• 0cdec4e6 - Fix sorting
• c08e7aa2 - Simple page details view
• a725f2c7 - Merge search templates into one
• bc4feb84 - ACL filtering on Django views
• 1b3f412d - Fixes
• 22979279 - Remove title from backend template

Compare with previous version

mentioned in merge request frontend!32 (merged)

changed the description

added 17 commits

• 22979279...9b8f4305 - 2 commits from branch master
• d12c0ec9 - Add page index
• 07fa8cd8 - Add page indexing task
• ac5d80d2 - Use SearchAPIMixin for IIIF search
• 16bea64f - Page search ES template
• 4ae568c6 - Update URLs and templates
• d567317d - Page search serializer
• a9254cbc - Page search API and mixin fixes
• 61d2375a - Post process for pages search
• 4680d56e - Update unit tests
• d7e5e20e - Fix sorting
• 8a9e4279 - Simple page details view
• 425fa680 - Merge search templates into one
• 4e4abeb2 - ACL filtering on Django views
• 438cc8d2 - Fixes
• 616cf357 - Remove title from backend template

Compare with previous version

added 3 commits

• e0d018d1 - Move corpus ID outside of nested index
• d1bd584a - Update search template
• 98fa96fe - Update unit tests

Compare with previous version

Codecov Report

Merging #101 into master will decrease coverage by 0.02%. The diff coverage is 73.17%.

@@            Coverage Diff            @@
##           master    #101      +/-   ##
=========================================
- Coverage   63.83%   63.8%   -0.03%     
=========================================
  Files         156     156              
  Lines        6058    6139      +81     
=========================================
+ Hits         3867    3917      +50     
- Misses       2191    2222      +31

Impacted Files	Coverage Δ
arkindex/documents/models.py	39.25% <0%> (-0.07%)
arkindex/project/settings.py	0% <0%> (ø)
arkindex/documents/management/commands/reindex.py	0% <0%> (ø)
arkindex/documents/views.py	0% <0%> (ø)
arkindex/documents/tests/test_search.py	100% <100%> (ø)
arkindex/documents/serializers/search.py	100% <100%> (ø)
arkindex/documents/api/search.py	100% <100%> (ø)
arkindex/project/mixins.py	80.59% <100%> (+3.81%)
arkindex/project/api_v1.py	100% <100%> (ø)
arkindex/documents/urls.py	71.42% <100%> (ø)
... and 5 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update d08859d...87e5697. Read the comment docs.

added 1 commit

• 2599c7a8 - Pass score filtering to ES templates

Compare with previous version

added 22 commits

• 2599c7a8...f1615924 - 2 commits from branch master
• eac63427 - Bump to 0.8.3~dev
• dd08bfc7 - Add page index
• 73c90251 - Add page indexing task
• afdb62f1 - Use SearchAPIMixin for IIIF search
• 5be66813 - Page search ES template
• 09de12ab - Update URLs and templates
• da50280f - Page search serializer
• 63bb4c40 - Page search API and mixin fixes
• 0ecf41ba - Post process for pages search
• 1b4c5d34 - Update unit tests
• 5fcdeee2 - Fix sorting
• 64971f76 - Simple page details view
• 7d9025a3 - Merge search templates into one
• f64487d3 - ACL filtering on Django views
• 6a3970ad - Fixes
• 0462cc95 - Remove title from backend template
• 2a4a3ac6 - Move corpus ID outside of nested index
• 983a7aaa - Update search template
• 8f640872 - Update unit tests
• 9d7db836 - Pass score filtering to ES templates

Compare with previous version

added 25 commits

• 9d7db836...ec7c46ff - 5 commits from branch master
• af2c60a4 - Bump to 0.8.4~dev
• f00e2ecd - Add page index
• 96a6346b - Add page indexing task
• abb5e20a - Use SearchAPIMixin for IIIF search
• e94eedc1 - Page search ES template
• face59a1 - Update URLs and templates
• 5a393e76 - Page search serializer
• f90fdc71 - Page search API and mixin fixes
• 9692236f - Post process for pages search
• 87af9a6e - Update unit tests
• e294999b - Fix sorting
• 1922bc92 - Simple page details view
• 29d3a6b2 - Merge search templates into one
• cf829058 - ACL filtering on Django views
• 86f4be2c - Fixes
• 542e8401 - Remove title from backend template
• 76d08e4a - Move corpus ID outside of nested index
• 9863a5ef - Update search template
• 54dad25a - Update unit tests
• e1bd2372 - Pass score filtering to ES templates

Compare with previous version

added 22 commits

• e1bd2372...d08859d7 - 2 commits from branch master
• 2861955b - Bump to 0.8.4~dev
• 7e70bd22 - Add page index
• f301016a - Add page indexing task
• 78090857 - Use SearchAPIMixin for IIIF search
• 7d4c3219 - Page search ES template
• e5f132ff - Update URLs and templates
• 5cd242f0 - Page search serializer
• d888083c - Page search API and mixin fixes
• 305fc2da - Post process for pages search
• 738f445f - Update unit tests
• 58bda210 - Fix sorting
• ac0d00d3 - Simple page details view
• d962ccdc - Merge search templates into one
• daa11265 - ACL filtering on Django views
• 593eae08 - Fixes
• 85d4f4be - Remove title from backend template
• 54bbf467 - Move corpus ID outside of nested index
• 65ee4195 - Update search template
• 959e4559 - Update unit tests
• 87e5697d - Pass score filtering to ES templates

Compare with previous version

mentioned in commit 6e5d3639

merged