Stream: community

Topic: migration to Harvard Dataverse


view this post on Zulip Xiaolan Qiu (Oct 31 2024 at 16:08):

Hello everyone, we currently use Dataverse NC for dataset deposits, but received notification last month that, starting in February 2025, our researchers will no longer be allowed to deposit datasets there. We are considering directing our researchers to use Harvard Dataverse as an alternative. However, for datasets already preserved in Dataverse NC that have existing DOIs, assigning a new DOI through migration to Harvard Dataverse would lead to duplicate DOIs, which we want to avoid.

Do you have any suggestions on handling these datasets to maintain DOI integrity? Thank you!

view this post on Zulip Philip Durbin ๐Ÿš€ (Oct 31 2024 at 17:41):

Well, researchers at the University of Virginia (UVA) mostly use https://dataverse.lib.virginia.edu but there are some datasets in Harvard Dataverse as well.

We created a harvesting "set" in Harvard Dataverse so that these datasets could be harvested to https://dataverse.lib.virginia.edu/dataverse/uvaharvard

So maybe Dataverse NC would be willing to create a set for you. And maybe Harvard Dataverse would create a "client" to pull those datasets into your collection.

view this post on Zulip Philip Durbin ๐Ÿš€ (Oct 31 2024 at 17:53):

Ah, I see you asked at https://groups.google.com/g/dataverse-community/c/5sO4B4YBT-E/m/-nDdSKk6BAAJ too. I hope you don't mind that I replied here.

view this post on Zulip Xiaolan Qiu (Oct 31 2024 at 17:56):

Thank you so much for your help!

view this post on Zulip Xiaolan Qiu (Nov 01 2024 at 16:58):

@Philip Durbin ๐Ÿ‰

Hi Philip, thank you for your suggestions. I like your idea of creating a harvesting โ€œsetโ€ to facilitate easy data transfer between Dataverse instances. My institution prioritizes Open Science Framework (OSF) that we already subscribe to and asked us to deposit data in OSF. Do you know whether the harvesting โ€œsetโ€ works for OSF as well? Thanks!

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 17:35):

Are you asking if OSF supports harvesting? Specifically, do they support OAI-PMH? I don't know. :thinking:

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 17:39):

I just asked at https://groups.google.com/g/openscienceframework/c/FMxj_vbZB4I/m/UzEaM5j0BgAJ

view this post on Zulip Xiaolan Qiu (Nov 01 2024 at 17:58):

Yes. For the datasets stored in UNC Dataverse, is it possible to migrate them to OSF using the harvesting 'sets' you mentioned?

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:04):

I wouldn't use the term "migrated" for what I'm talking about.

I'm talking about harvesting the metadata from one system to another. The actual data remains in the original system. The metadata is available in the other system so that it can be discovered there, but the user will be redirected to the original system to download data.

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:04):

Does that make sense?

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:05):

Also, do you mean UNC instead of NC? I just got the same email, I think. :grinning:

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:11):

OSF got back to me already. They have implemented the server side such that a client can harvest from https://share.osf.io/oai-pmh/?verb=ListRecords&metadataPrefix=oai_dc&set=io.osf

I'm asking if they also support the client side. That is, can OSF harvest from Dataverse, or DataCite, or Zenodo, etc.?

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:13):

Although... maybe I'm turned around. @Xiaolan Qiu are you saying you have a bunch of datasets in OSF already and now you want to harvest them into Harvard Dataverse?

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:13):

I wonder if @Sherry Lake has tried harvesting from OSF into her installation of Dataverse.

view this post on Zulip Sherry Lake (Nov 01 2024 at 18:14):

@Philip Durbin ๐Ÿ‰ I think @Xiaolan Qiu means from UNC Dataverse to OSF.

Checking on that.

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:18):

Ok, but were you already aware of that OAI-PMH URL from OSF?

view this post on Zulip Sherry Lake (Nov 01 2024 at 18:28):

I was not. Haven't had any need for OAI-PMH. I assume it's new because of GREI. They have done a lot of enhancements because of GREI - all were needed.

Oh... just tested the Dataverse addon w/ OSF, doesn't work with UVA's Dataverse anymore, or with demo.dataverse.org.... but it doesn't work in a different way - for demo.datavere.org, it lists files, but then says "Requested Dataverse file does not exist with version latest-published" when you try to view a file.

All that used to work, including with UVA Dataverse.

But I think the add-on is only listing the file names and "gets" them from Dataverse when you want to view them (or it is supposed to).

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:31):

Bummer. New topic, please! :heart:

view this post on Zulip Xiaolan Qiu (Nov 01 2024 at 18:37):

@Philip Durbin ๐Ÿ‰ We already stored data in UNC Dataverse (Dataverse NC Docks), and are requesting to use OSF because UNC will not allow us to deposit data in their Dataverse starting Feb 1, 2025. Sorry for the confusion brought to you. UNC Dataverse will continue preserving our data, so it's OK to leave the data there, and harvest them from OSF. Thank you for your help!

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 18:40):

Ok, we're still in the "migration to Harvard Dataverse" thread but now we're switching to talking about maybe harvesting datasets from UNC Dataverse into OSF? Is that right?

view this post on Zulip Xiaolan Qiu (Nov 01 2024 at 18:53):

Yes. :big_smile:

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 19:05):

Ok, you'll probably want to reach out to OSF support for that.

view this post on Zulip Philip Durbin ๐Ÿš€ (Nov 01 2024 at 20:14):

But if you change your mind and want to use Harvard Dataverse, we're here for you. :grinning:


Last updated: Nov 01 2025 at 14:11 UTC