Skip to content

Add an option for maximum retries on all S3 requests

Erwan Rouchet requested to merge s3-max-retries into release-1.7.0

Closes #1877 (closed)

This can make the flood problems mentioned in frontend!1802 (merged) worse, since this affects every single S3 request including those made by RetrieveTask.

Merely shutting down MinIO locally will not trigger the retries because the standard retry mode ignores EndpointConnectionError, so to test locally, you need to mess with Traefik.

Add this to traefik.toml:

[experimental]
  [experimental.plugins]
    [experimental.plugins.noop]
      moduleName = "github.com/traefik-contrib/noop"
      version = "v0.1.0"

Then add those labels in docker/docker-compose.services.yml:

services:
  # ...
  minio:
    # ...
    labels:
      # ...
      traefik.http.routers.minio.middlewares: gandalf
      traefik.http.middlewares.gandalf.plugin.noop.responseCode: 502

Now accessing MinIO always returns HTTP 502 and Boto will keep retrying.

Edited by Erwan Rouchet

Merge request reports

Loading