Skip to content

Use a worker for file imports

Same as #1795 (closed), but for file imports this time. The file import task is being ported to a worker: arkindex/workers/import/file#2 (closed) This is the only remaining usage of tasks.

  • Add a file_import option to arkindex/system_workers.yml through the config parser in update_system_workers, and set it to registry.gitlab.teklia.com/arkindex/workers/import/file:0.1.0
  • Remove the file import worker creation from the bootstrap command
  • Update ProcessBuilder.build_files so that it works similarly to build_s3: When no worker run exists with the file import worker version, no model version and no configuration, create it.
  • Remove ProcessBuilder._create_fake_worker_run
  • Remove WorkerVersionManager.imports_version
  • Make image a required argument in ProcessBuilder._build_task
  • Remove the ARKINDEX_TASKS_IMAGE setting