Oliver Bertuch (Oct 13 2024 at 11:46): Oliver Bertuch (Oct 13 2024 at 11:46):The current code for direct up/download to S3 uses presigned URLs (a part of the S3 protocol) and requires a public accessible S3. In our institution we don't have that - the S3 is tucked away and not available to the outside. I've been thinking about using SeaweedFS or Minio as a front, using the internal (read: PB huge) S3 as a storage tier for them. Now yesterday I've stumbled upon https://blog.nginx.org/blog/using-nginx-as-object-storage-gateway and am wondering if this would be a better solution to this. It might need code in Dataverse to make the redirects use the proxy, but that sounds doable. I suppose the setup is way less complicated and way less maintenance than a tiered approach. Thoughts? Experiences?
Johannes D (Oct 15 2024 at 05:18):Hey Oliver, thanks for sharing. Sadly, I have no experience with a S3-proxy but I'm interested in your results.
Last updated: Nov 01 2025 at 14:11 UTC