Stream: community

Topic: Production examples of trusted remote store?

view this post on Zulip Lubov McKone (Jan 08 2026 at 14:49):

Hello all! Here at Hopkins we are working with a research group who is interested in trusted remote store. We're hoping to show them an example to illustrate how it works from a user's perspective. I've combed through the Google Group and Zulip, but haven't been able to find a live DOI utilizing remote store for file storage. Can anyone point me to a production dataset that is utilizing it? Thank you!

view this post on Zulip Philip Durbin 🚀 (Jan 08 2026 at 14:50):

There was a pretty recent example (or at least discussion) here: https://groups.google.com/g/dataverse-community/c/3faRy2l9iUc/m/z8gupidiCQAJ

view this post on Zulip Lubov McKone (Jan 08 2026 at 14:52):

I was hopeful about this one! Unfortunately it doesn't look like that DOI is live at the moment

view this post on Zulip Philip Durbin 🚀 (Jan 08 2026 at 14:53):

Actually, @César Ferreira posted that after first posting this: #troubleshooting > trusted remote storage

view this post on Zulip Philip Durbin 🚀 (Jan 08 2026 at 14:54):

@César Ferreira is there a DOI you can show us?

view this post on Zulip César Ferreira (Jan 08 2026 at 16:21):

Not yet, I am still adding files to a dataset. I am using fake DOIs so it might not be the best example for a production DOI, but once I finish adding all the files and the dataset is published I can share the link to the dataset. It might take a while for that since I have 110k files and I could only add about 20k until now.

view this post on Zulip Lubov McKone (Jan 08 2026 at 19:05):

@César Ferreira Thank you, that would be great!

view this post on Zulip Philip Durbin 🚀 (Jan 08 2026 at 19:10):

@César Ferreira 110k files in a single dataset? We can start a new topic for this but I wouldn't recommend so many. Please see https://guides.dataverse.org/en/6.9/admin/big-data-administration.html#avoiding-many-files

view this post on Zulip Lubov McKone (Jan 08 2026 at 20:05):

Oh yes, we actually tried that once ourselves and found the limit to be 20k

view this post on Zulip César Ferreira (Jan 09 2026 at 10:08):

Then it should be better to return to the previous topic because this is the smallest dataset I am trying to create. This one has 1454 Sentinel 2 products, each one with about 50 files, and I have datasets with more than 10k products.

Last updated: Jan 09 2026 at 14:18 UTC