Stream: troubleshooting

Topic: Multipart upload broken after v6.7 for S3 compatible storage

view this post on Zulip Bikram (Jun 18 2026 at 17:37):

We use Openstack swift with S3 emulation and connect Dataverse with S3 connector.
Server-side S3 multipart upload broke in v6.7 during the AWS SDK v1→v2 migration. v6.6 used the v1 TransferManager (auto-multipart); v6.7 switched S3AccessIO.savePath() to the v2 S3TransferManager.uploadFile() on an S3AsyncClient built without multipartEnabled(true), so uploads are single-part and fail above 5 GiB on any S3 backend with a 5 GiB object cap (we hit it on OpenStack Swift s3api). Still present through v6.10.

Last updated: Aug 18 2026 at 08:27 UTC