Stream: troubleshooting

Topic: Range header on dataset download

view this post on Zulip Jan Range (Oct 17 2024 at 10:40):

Does Downloading All Files in a Dataset support the Range header?

view this post on Zulip Jan Range (Oct 17 2024 at 10:41):

Same for Multiple File (“bundle”) download

view this post on Zulip Philip Durbin 🚀 (Oct 17 2024 at 11:09):

Huh, I don't think so. You want to download part of a zip file?

view this post on Zulip Jan Range (Oct 17 2024 at 11:28):

Thanks for the info! I am asking, because I have implemented a resume function for data file downloads and I was wondering if the same would be possible for entire datasets or bundles

view this post on Zulip Philip Durbin 🚀 (Oct 17 2024 at 12:23):

Hmm, good question. Worth an issue, I'd say!

view this post on Zulip Philip Durbin 🚀 (Oct 17 2024 at 12:23):

And I'm looking forward to trying out your resume function some day!

view this post on Zulip Jan Range (Oct 17 2024 at 14:31):

Done :raised_hands:

view this post on Zulip Jan Range (Oct 17 2024 at 14:32):

Close to pushing the new functionality to the repo. Will notify you once it is there :grinning_face_with_smiling_eyes:

view this post on Zulip Jan Range (Oct 17 2024 at 14:35):

Demo

view this post on Zulip Philip Durbin 🚀 (Oct 17 2024 at 19:37):

Very cool! I shared it in IQSS Slack. Do you want it on DataverseTV? :grinning: :television:

view this post on Zulip Jan Range (Oct 18 2024 at 10:53):

Happy to share it on Dataverse TV :smile:

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 10:57):

Great, I stubbed something out. Please see https://dataverse.org/dataversetv

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 10:57):

Maybe you can help me with the description :grinning:

view this post on Zulip Jan Range (Oct 18 2024 at 10:58):

Currently in a meeting and will send you a description once finished :smile:

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 10:58):

Also, I'm linking to https://dataverse.zulipchat.com/#narrow/channel/378866-troubleshooting/topic/Range.20header.20on.20dataset.20download/near/477458786 for now for the video. It's not the best UX. From there you have to download it. But better than nothing.

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 10:58):

meetings :rolling_eyes:

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 11:00):

I guess I could link to https://dataverse.zulipchat.com/user_uploads/53090/kdqPrwWMVSq_6ODpXvmJNtsB/Bildschirmaufnahme-2024-10-17-um-16.34.13.mov but it's basically the same. The video is downloaded instead of showing in the browser :thinking:

view this post on Zulip Jan Range (Oct 18 2024 at 16:10):

Let me see, we could upload it to Drive to get a preview. Maybe somewhere in the PyDataverseWG?

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 16:10):

Sure! Good idea.

view this post on Zulip Jan Range (Oct 18 2024 at 16:28):

Here is the description:

This demonstration showcases the new DVCLI feature that enables resumable downloads. By utilizing the Range header, downloads can be paused and resumed at any point, making it particularly beneficial when dealing with large files and experiencing technical interruptions that cause the download to stop. This feature will be available in an upcoming release of DVCLI.

view this post on Zulip Jan Range (Oct 18 2024 at 16:30):

And here is the link to the video on Drive:

https://drive.google.com/file/d/1toNejVgxCOwgxOZ172sPhUdpASpqOeQ7/view?usp=share_link

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 16:36):

Screenshot 2024-10-18 at 12.36.32 PM.png

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 16:36):

All set, thanks!

view this post on Zulip Jan Range (Oct 18 2024 at 16:37):

Looks great, thanks! :raised_hands:

view this post on Zulip Philip Durbin 🚀 (Oct 18 2024 at 16:37):

At the end you should say, "I'm Jan Range, inventor of the Range header."

view this post on Zulip Jan Range (Oct 18 2024 at 16:37):

:joy::joy::joy:

Last updated: Oct 30 2025 at 06:21 UTC