Stream: dev

Topic: Solr 9 upgrade #9260

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 15:57):

I'm having trouble with the Solr 9 upgrade (#9260). As I mentioned in standup. Some of our custom Dataverse fields (45 of them) are showing up in http://localhost:8983/solr/collection1/schema/fields but some aren't such as fileTypeGroupFacet.

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 15:58):

If I push what I have so far, would someone else like to try? I asked in standup but no one had heard of this problem.

view this post on Zulip Oliver Bertuch (Aug 15 2023 at 15:59):

Yes please push. Can't look right now, but maybe later

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 16:08):

Ok, I just pushed to https://github.com/IQSS/dataverse/tree/9260-solr9

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 16:18):

I also set up a test runner at https://github.com/pdurbin/dataverse-api-test-runner/actions/workflows/solr9.yml

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 16:18):

I kicked off a run but it's the first one so it might not get very far: https://github.com/pdurbin/dataverse-api-test-runner/actions/runs/5869283955

view this post on Zulip Oliver Bertuch (Aug 15 2023 at 16:25):

We probably need to push the develop image once... An update ye olde branches

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 17:40):

Never fear, in that solr9 workflow I'm building the base and app images.

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 17:42):

It's showing the same errors I'm seeing on my laptop. I guess that's somewhat reassuring, in a weird way.

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 17:42):

Lots of SearchIT failures, for example.

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 20:50):

Less blocked. Making progress.

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 20:51):

Adding this was key: <schemaFactory class="ClassicIndexSchemaFactory"/>

view this post on Zulip Oliver Bertuch (Aug 15 2023 at 22:27):

I should mention (again) that I do have XSLTs for solrconfig.xml.

view this post on Zulip Philip Durbin 🚀 (Aug 15 2023 at 22:41):

The current error is "possible analysis error" https://github.com/IQSS/dataverse/commit/df0046961851ef8a1d0a511382f9c01a4703b41e

view this post on Zulip Philip Durbin 🚀 (Aug 16 2023 at 15:12):

Ok, I gave up the approach I was taking in https://github.com/IQSS/dataverse/tree/9260-solr9 where I tried to start from vanilla config files from Solr 9.3.0. All sort of problems.

view this post on Zulip Philip Durbin 🚀 (Aug 16 2023 at 15:13):

I just created a new branch and https://github.com/IQSS/dataverse/pull/9787 with a different approach: simply copy over our 8.11.1 config files as is.

view this post on Zulip Philip Durbin 🚀 (Aug 16 2023 at 15:13):

The main change that was needed was here: https://github.com/IQSS/dataverse/pull/9787/commits/10cb29440f52a19d745e9bae300580d7b6bf6402

view this post on Zulip Philip Durbin 🚀 (Aug 16 2023 at 15:13):

"fix XSLTResponseWriter namespace and enable scripting module"

view this post on Zulip Philip Durbin 🚀 (Aug 16 2023 at 15:14):

SearchIT passed for me locally. I just switched the branch on my runner and fired off the full API test suite: https://github.com/pdurbin/dataverse-api-test-runner/actions/runs/5880587423

Last updated: Nov 01 2025 at 14:11 UTC