OAI endpoint only delivers 10 results · community

Stream: community

Topic: OAI endpoint only delivers 10 results

Asbjørn Skødt (Feb 10 2026 at 11:48):

Hi
We have noticed the OAI-PMH harvesting endpoint only delivers 10 results.
Are we doing something wrong?

See these examples:
https://demo.dataverse.deic.dk/oai?verb=ListRecords&metadataPrefix=dataverse_json
https://dataverse.no/oai?verb=ListRecords&metadataPrefix=dataverse_json
https://dataverse.harvard.edu/oai?verb=ListRecords&metadataPrefix=dataverse_json

The normal OAI-PMH behaviour is to return a limited number of results at a time (10 in the main Dataverse and Demo Dataverse cases, and 100 in most other instances).
You need to keep requesting the next batch of results (another 10, then the next 10, and so on).
At the end of the page you can see the resumption token (this value will change):

<resumptionToken completeListSize="94" cursor="0">b2Zmc2V0OjoxMHxwcmVmaXg6OmRhdGF2ZXJzZV9qc29u</resumptionToken>

So, next oai command to request another 10 results should be:
https://demo.dataverse.deic.dk/oai?verb=ListRecords&resumptionToken=b2Zmc2V0OjoxMHxwcmVmaXg6OmRhdGF2ZXJzZV9qc29u

Asbjørn Skødt (Feb 10 2026 at 12:17):

We understand.
Thank you so much.

Oliver Bertuch (Feb 11 2026 at 14:10):

Making this a tad more complete: if you as an installation want to return larger amounts of records at a time, you can change the MPCONFIG based setting "dataverse.oai.server.maxrecords" to whatever value you like. It defaults to 10.

Oliver Bertuch (Feb 11 2026 at 14:11):

A word of caution: depending on the amount of exported data, this may blow up in your face if too large. Especially datasets with lots of variables and files may be dangerous.