Stream: troubleshooting

Topic: Number of Metadatablocks limit

oussama Zoubia (UKK) (Jan 05 2026 at 11:25):

Hi all, I hope you're doing well,
just have one question regarding the metadata block number, is there a limit to how many metadata can we have ? cauz in our case we are testing with a large number (currently at 42 with many fields) and we are hitting a header too large issue from dataverse, I tried many of the workarounds:

• increasing the header from both solr and dataverse (tried with env variables, as well as a custom jetty.xml file for solr), env variable from dataverse side..
• switched to http1..
  nothing seems to fix the issue :/
  thank you and best regards.
  Oussama

Philip Durbin 🚀 (Jan 05 2026 at 12:11):

You've changed requestHeaderSize already (docs)? To what value?

Do the logs indicated how big the header is?

oussama Zoubia (UKK) (Jan 05 2026 at 12:20):

I've set it to 1024000 in the solr container:

• SOLR_OPTS=-Dsolr.jetty.request.header.size=1024000 -Dsolr.jetty.response.header.size=1024000
  it doesn't show how long the header is, but it's a long string,
  the exact error is :

Could not hpack encode GET{u=http://solr:8983/solr/collection1/select?q=*.....

ps :
I deployed dataverse with Docker, and im using version v6.6 for dataverse and 9.8.0 for solr.

Philip Durbin 🚀 (Jan 05 2026 at 14:28):

Ok, so 100 times the number we recommend in the docs. That should be enough!

Do you want to go ahead and open an issue at https://github.com/IQSS/dataverse/issues ?

oussama Zoubia (UKK) (Jan 05 2026 at 16:12):

thank you Philip for the replies.
even setting that to a larger value couldn't solve the issue, the only work around I could find was removing some of the older blocks,
I just create an issue for the error.
best.
oussama.

Philip Durbin 🚀 (Jan 05 2026 at 16:24):

Thanks! I edited the issue to add a link to this topic in Zulip.

oussama Zoubia (UKK) (Jan 06 2026 at 11:10):

Thanks, Philip. I just have one additional general question:

If the problem with this header is caused by the large number of searchable items, then logically, limiting or decreasing the number should make the header smaller or make it work. However, it didn’t work for me (unless I did it incorrectly).

Philip Durbin 🚀 (Jan 06 2026 at 13:07):

Right, but how are you decreasing the number of searchable items? I'm pretty sure that number is determined by how many fields are available in the database (that were added by loading a metadata block tsv file, I mean).

Philip Durbin 🚀 (Jan 06 2026 at 13:57):

... which is probably a bug

Last updated: Jan 09 2026 at 14:18 UTC