Hansen C. (May 02 2024 at 13:31): Hansen C. (May 02 2024 at 13:31):After upgrading to version 6.2, I got zero dataverse and dataset under dataverse/root/ on the web. But "curl http://localhost:8080/api/admin/index" gives the right number of dataverses and datasets. What could be the reason? Please help. Thanks!
Philip Durbin 🚀 (May 02 2024 at 13:31):Anything in server.log?
Hansen C. (May 02 2024 at 13:46):It says "4 dataverses and 10 datasets indexed. index all took 2639 milliseconds. Solr index was not cleared before indexing." Does that mean I need to clear it before indexing after upgrading?
Hansen C. (May 02 2024 at 13:53):The log file is pretty long with the activities from yesterday. I also see this "[2024-05-01T17:14:03.144-0400] [Payara 6.2023.8] [INFO] [] [edu.harvard.iq.dataverse.search.SearchServiceBean] [tid: _ThreadID=90 _ThreadName=http-thread-pool::jk-connector(1)] [timeMillis: 1714598043144] [levelValue: 800] [[
Search Syntax Error: Error from server at http://...:8983/solr/collection1: undefined field: "license"]]"
luddaniel (May 02 2024 at 13:54):Hansen C. said:
It says "4 dataverses and 10 datasets indexed. index all took 2639 milliseconds. Solr index was not cleared before indexing." Does that mean I need to clear it before indexing after upgrading?
if it's not done, yes you need curl http://localhost:8080/api/admin/index/clear before curl http://localhost:8080/api/admin/index
luddaniel (May 02 2024 at 13:56):In production consider https://guides.dataverse.org/en/latest/admin/solr-search-index.html#reindex-in-place
curl -X DELETE http://localhost:8080/api/admin/index/timestamps
curl http://localhost:8080/api/admin/index/continue
to avoid blank home page
Hansen C. (May 02 2024 at 14:05):Done it. Got this: {"status":"OK","data":{"availablePartitionIds":[0],"args":{"numPartitions":1,"partitionIdToProcess":0},"message":"indexAllOrSubset has begun of 4 dataverses and 10 datasets."}}
But still not records.
luddaniel (May 02 2024 at 14:05):Hansen C. said:
The log file is pretty long with the activities from yesterday. I also see this "[2024-05-01T17:14:03.144-0400] [Payara 6.2023.8] [INFO] [] [edu.harvard.iq.dataverse.search.SearchServiceBean] [tid: _ThreadID=90 _ThreadName=http-thread-pool::jk-connector(1)] [timeMillis: 1714598043144] [levelValue: 800] [[
Search Syntax Error: Error from server at http://...:8983/solr/collection1: undefined field: "license"]]"
This one, I suspect you didn't Run the update-fields.sh script (step 8)
luddaniel (May 02 2024 at 14:06):it must be done before reindexing, some SOLR fields are missing
Hansen C. (May 02 2024 at 14:07):Isn't step 8 optional? I am not using custom or experimental metadata blocks.
luddaniel (May 02 2024 at 14:07):You are right
luddaniel (May 02 2024 at 14:07):Have you update the default schema.xml ? * wget https://raw.githubusercontent.com/IQSS/dataverse/v6.2/conf/solr/9.3.0/schema.xml
luddaniel (May 02 2024 at 14:08):Because it looks like you are missing <field name="license" type="string" stored="true" indexed="true" multiValued="false"/> in your solr
luddaniel (May 02 2024 at 14:08):And SOLR restart/reload after
Hansen C. (May 02 2024 at 14:09):Yes. I updated schema.xml and did solr restart a couple of times.
luddaniel (May 02 2024 at 14:10):Search Syntax Error: Error from server at http://*.*.*.*:8983/solr/collection1: undefined field: "license"]]" is really clear, your SOLR didn't have the update
Hansen C. (May 02 2024 at 14:10):Let me check again to be sure.
luddaniel (May 02 2024 at 14:11):Check Solr Logs maybe ~ http://localhost:8983/solr/#/~logging
Philip Durbin 🚀 (May 02 2024 at 14:24):Sorry, I was in a container meeting. #containers > weekly meeting
Philip Durbin 🚀 (May 02 2024 at 14:25):Yes, it sounds like "license" is missing from your schema.xml. Thanks, @luddaniel
Hansen C. (May 02 2024 at 14:29):Temporarily lost access to the DB server. I will check the file and log and report back to you. Thank you both so much for your help!
Philip Durbin 🚀 (May 02 2024 at 14:30):This is more of a Solr thing than a DB thing, but sure. :grinning:
Hansen C. (May 02 2024 at 14:39):I am not sure how problematic it is, but our solr is running on our DB server. I will check the solr files.
Philip Durbin 🚀 (May 02 2024 at 14:48):Oh, I see. We've done that in the past (before we moved our database to AWS RDS.) Should be fine.
Hansen C. (May 02 2024 at 17:46):Hi Philip and Daniel, It turns out that I forgot to point solr to solr9.3.0, it was still running 8.11.1. Issue was solved after changing the path to solr. Thank you so much for directing me to schema.xml as the source of problem and sorry for wasting your time on my silly mistakes. Best, Hansen
Philip Durbin 🚀 (May 02 2024 at 17:57):No worries! Others have seen that error about the license field being missing. I'm glad you're all set.
Notification Bot (May 02 2024 at 17:57):Philip Durbin has marked this topic as resolved.
Last updated: Oct 30 2025 at 06:21 UTC