Skip to content

When deleting a corpus, element types may still be referenced on processes

Refs https://redmine.teklia.com/issues/4982

Some corpus on demo instance cannot be deleted because an element type is referenced on process (type is deleted before process).

rk-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,118 [DEBUG] Performing Job...
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,141 [INFO] Deleting <Corpus: Demo printed French>
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,160 [INFO] Deleted 0 AllowedMetaData
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,165 [INFO] Deleted 0 CorpusWorkerVersion
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,173 [INFO] Deleted 0 ProcessElement
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,181 [INFO] Deleted 0 ProcessElement
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,187 [INFO] Deleted 0 Process_files
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,192 [INFO] Deleted 0 Process_files
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,235 [INFO] Deleted 0 WorkerActivity
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,247 [INFO] Deleted 0 WorkerActivity
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,251 [INFO] Deleted 0 DataFile
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,257 [INFO] Deleted 0 MetaData
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,261 [INFO] Deleted 0 EntityLink
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,264 [INFO] Deleted 0 EntityRole
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,268 [INFO] Deleted 0 TranscriptionEntity
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,386 [INFO] Deleted 0 TranscriptionEntity
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,391 [INFO] Deleted 0 Entity
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,396 [INFO] Deleted 0 EntityType
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,408 [INFO] Deleted 0 Classification
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,414 [INFO] Deleted 0 Transcription
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,422 [INFO] Deleted 0 ElementPath
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,439 [INFO] Deleted 0 Selection
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,443 [INFO] Deleted 0 Element
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,448 [DEBUG] Job c8a66293-e3c5-4864-89ee-5f81646b689a raised an exception.
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,454 [DEBUG] Handling failed execution of job c8a66293-e3c5-4864-89ee-5f81646b689a
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,458 [DEBUG] Handling exception for c8a66293-e3c5-4864-89ee-5f81646b689a.
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | 2023-10-25 12:37:22,458 [ERROR] [Job c8a66293-e3c5-4864-89ee-5f81646b689a]: exception raised while executing (arkindex.documents.tasks.corpus_delete)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | Traceback (most recent call last):
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     return self.cursor.execute(sql, params)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | psycopg2.errors.ForeignKeyViolation: update or delete on table "documents_elementtype" violates foreign key constraint "process_process_folder_type_id_34fb751c_fk_documents" on table "process_process"
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | DETAIL:  Key (id)=(8c6b886e-a9a2-4c58-adcc-04240527e585) is still referenced from table "process_process".
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | The above exception was the direct cause of the following exception:
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | Traceback (most recent call last):
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/rq/worker.py", line 1428, in perform_job
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     rv = job.perform()
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/rq/job.py", line 1278, in perform
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     self._result = self._execute()
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/rq/job.py", line 1315, in _execute
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     result = self.func(*self.args, **self.kwargs)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/share/arkindex/documents/tasks.py", line 89, in corpus_delete
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 1155, in _raw_delete
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     cursor = query.get_compiler(using).execute_sql(CURSOR)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1398, in execute_sql
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     cursor.execute(sql, params)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/sentry_sdk/integrations/django/__init__.py", line 616, in execute
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     return real_execute(self, sql, params)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 67, in execute
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     return self._execute_with_wrappers(
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     return executor(sql, params, many, context)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     with self.db.wrap_database_errors:
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/utils.py", line 91, in __exit__
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     raise dj_exc_value.with_traceback(traceback) from exc_value
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |   File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 89, in _execute
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |     return self.cursor.execute(sql, params)
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | django.db.utils.IntegrityError: update or delete on table "documents_elementtype" violates foreign key constraint "process_process_folder_type_id_34fb751c_fk_documents" on table "process_process"
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    | DETAIL:  Key (id)=(8c6b886e-a9a2-4c58-adcc-04240527e585) is still referenced from table "process_process".
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |
ark-worker-high.1.0w106i8wysf9@arkindex-demo-web02    |