Support ZIP archives during ceph ingestion

Bastien Abadie
2023-07-11T11:44:24Z

Refs https://gitlab.com/teklia/requests/-/issues/836

We can get ZIP files directly uploaded on ceph buckets by clients, and this implies a dance between several people at Teklia to get the zip file detected, unarchived, re-uploaded as unique files.

The ceph ingestion could do a pre-processing step that looks for all ZIP files (and only zip, no tar) in the bucket, download them, unarchive them locally, then publishes all the resulting files on the bucket.

The normal ingestion would then behave as currently, but would have access to all these new files (ignoring the ZIP archives).