Stream: community

Topic: zip upload limit with direct upload/dvwebloader


view this post on Zulip Deirdre Kirmis (Sep 09 2024 at 19:19):

If uploading a zip file using dvwebloader with direct upload configured on the store (or any method with direct upload) .. does the limit of 1000 per zip file still exist? I don't think so because of chunking, and I created a zip file with 1500 files and it uploaded them all, but just checking because I never remember :grinning_face_with_smiling_eyes:

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 09 2024 at 20:02):

I'm pretty sure that limit doesn't apply because direct upload doesn't unzip files: https://guides.dataverse.org/en/6.3/developers/big-data-support.html#features-that-are-disabled-if-s3-direct-upload-is-enabled

view this post on Zulip Deirdre Kirmis (Sep 09 2024 at 20:53):

thanks .. i found that page too but it didn't specifically say "there is no limit on number of files" so .. well .. you know me! gotta ask! :sweat_smile:

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 09 2024 at 20:56):

What do you have https://guides.dataverse.org/en/6.3/installation/config.html#zipuploadfileslimit set to?

view this post on Zulip Deirdre Kirmis (Sep 09 2024 at 21:32):

we don't have it set

view this post on Zulip Deirdre Kirmis (Sep 09 2024 at 21:33):

we do have :ZipDownloadLimit set though

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 09 2024 at 21:55):

Ok, like those docs said, it defaults to 1000. So yeah, I think you've proven it. :grinning:

view this post on Zulip Deirdre Kirmis (Sep 09 2024 at 22:09):

well, i was trying to prove that there isn't a limit when using direct upload .. my zip file with 1500 files in it uploaded okay

view this post on Zulip Deirdre Kirmis (Sep 09 2024 at 22:13):

we have a user who is about to upload zip files with like 4500 files in them and just wanted to verify before hand that he wasn't going to run into issues with a file # limit .. i didn't see a specific indication that there wasn't one, but was assumed (as you said) that it "chunks" since it doesn't unzip


Last updated: Nov 01 2025 at 14:11 UTC