Jan Range (Jan 15 2025 at 17:57): Jan Range (Jan 15 2025 at 17:57):I wanted to setup a fresh instance of Dataverse using the latest develop branch, but I am stuck at the Payara page. I have used the following command to set it up:
mvn -Pct clean package docker:start
Do you have advice how to fix this?
Philip Durbin 🚀 (Jan 15 2025 at 18:33):Hmm, first, I always use docker:run and I'm not sure what the difference is.
Philip Durbin 🚀 (Jan 15 2025 at 18:35):Since you want a clean start, I would suggest rm -rf docker-dev-volumes
See also https://guides.dataverse.org/en/6.5/container/dev-usage.html where we document this. Or https://guides.dataverse.org/en/6.5/container/running/demo.html#deleting-data-and-starting-over but the directory has a different name.
Jan Range (Jan 15 2025 at 19:30):Thanks @Philip Durbin ☃️ - Will try it :smile:
Jan Range (Jan 21 2025 at 14:49):I was able to fix it, at least for a short time. Using the develop branch has led to the backend not properly starting. So I checked the v6.5 tag and voila it worked.
I did restart the containers and now I am running into the same problem again. Tried other tags, but neither of them worked. In between those I have deleted images and dev-volumes, but that did not help.
Looking at the logs I received a couple of Severe errors, but I have no clue what the issue is. Do you have an idea, how I could fix this? Running on an M3Pro with Docker Desktop. Attached the logs
Philip Durbin 🚀 (Jan 21 2025 at 14:55):Uh oh, the dreaded ConfigCheckService
Philip Durbin 🚀 (Jan 21 2025 at 14:55):When you see this, you should always scroll up to see what it's complaining about.
Philip Durbin 🚀 (Jan 21 2025 at 14:56):"No PID providers configured"
Philip Durbin 🚀 (Jan 21 2025 at 14:56):"No default PID provider configured"
Philip Durbin 🚀 (Jan 21 2025 at 14:57):Strange. You're using docker-compose-dev.yml from the root of the repo, right?
Jan Range (Jan 21 2025 at 14:57):Thanks for the heads up! I've been using the vanilla docker compose of v6.5 and mvn
Jan Range (Jan 21 2025 at 14:57):Yes, I have not modified it
Philip Durbin 🚀 (Jan 21 2025 at 14:59):Before you mentioned using this:
mvn -Pct clean package docker:start
Instead, have you tried this?
mvn -Pct clean package docker:run
Philip Durbin 🚀 (Jan 21 2025 at 14:59):I don't know if it makes a difference.
Jan Range (Jan 21 2025 at 15:02):Tried both of them, but it did not make a difference. I sweeped my docker installation and am trying again with a fresh installation. Maybe there are some Docker-related issues.
Philip Durbin 🚀 (Jan 21 2025 at 15:03):Is using the 6.5 tag for now an ok workaround?
Jan Range (Jan 21 2025 at 15:04):Using the tag did not work either. Worked for a short period and then it was broken again. I suspect it is something with my system or setup.
Philip Durbin 🚀 (Jan 21 2025 at 15:04):Oh, I see. Hmm.
Philip Durbin 🚀 (Jan 21 2025 at 15:05):Did you restart Docker? I'm grasping at straws here. :sweat_smile:
Philip Durbin 🚀 (Jan 21 2025 at 15:05):I might need to call for reinforcements. Someone like 
@Oliver Bertuch
Jan Range (Jan 21 2025 at 15:05):Yes, did restart a couple of times and also my machine. Did not help unfortunately. I hope re-installation of Docker helps
Jan Range (Jan 21 2025 at 15:13):Fresh docker instance did not help. Maybe I need to restart my machine again
Philip Durbin 🚀 (Jan 21 2025 at 15:15):Do you want to try the "demo and eval" compose file? It uses a different PID provider (Permalinks): https://github.com/IQSS/dataverse/pull/11108
Philip Durbin 🚀 (Jan 21 2025 at 15:16):Or do you need certain functionality in the dev compose file, such as S3?
Philip Durbin 🚀 (Jan 21 2025 at 15:16):I'm just trying to get you unblocked.
Jan Range (Jan 21 2025 at 15:16):I need the S3 functionality unfortunately
Philip Durbin 🚀 (Jan 21 2025 at 15:17):ok
Philip Durbin 🚀 (Jan 21 2025 at 15:17):Each time is it complaining about PID providers?
Jan Range (Jan 21 2025 at 15:18):I am puzzled to why it worked for a short period and then stopped working. One last instance I could try is to use a different platform and switch to amd64
Philip Durbin 🚀 (Jan 21 2025 at 15:18):yeah, very strange
Jan Range (Jan 21 2025 at 15:20):Trying v6.3 now. That was the last version I've been using most of the time
Jan Range (Jan 21 2025 at 22:45):Tried downgrading docker desktop and cycled through all 6.x release, but without success. Keep running into the same issues :frown:
Philip Durbin 🚀 (Jan 22 2025 at 12:25):I'm running into my own problems but I started a new topic for that: #containers > Docker trouble on macOS 15 
Jan Range (Jan 22 2025 at 19:16):Updating macOS did not solve the problem :frown:
Philip Durbin 🚀 (Jan 22 2025 at 19:56):No problems with your Docker, right?
Philip Durbin 🚀 (Jan 22 2025 at 19:57):Should we do a quick call?
Jan Range (Jan 22 2025 at 19:57):Haven't run into issues with other containers. Could it help if I send you the logs?
Philip Durbin 🚀 (Jan 22 2025 at 19:58):Well, the logs still complain about the PID provider, right? Or do they vary?
Jan Range (Jan 22 2025 at 19:58):I am currently with my friends, but a call tomorrow would be awesome :smile:
Jan Range (Jan 22 2025 at 19:58):If that works for you
Philip Durbin 🚀 (Jan 22 2025 at 19:58):You could join the container meeting if you like :smile: #containers > weekly meeting
Jan Range (Jan 22 2025 at 19:59):Sounds great, will join
Philip Durbin 🚀 (Jan 22 2025 at 19:59):Great. I already had your issue on the agenda :crazy:
Don Sizemore (Jan 23 2025 at 15:12):@Jan Range when you encounter this trouble, what \pid\ jvm-options make it into domain.xml?
Philip Durbin 🚀 (Jan 24 2025 at 13:57):https://github.com/gdcc/dataverse-action is still working, right?
Jan Range (Feb 01 2025 at 12:23):Sorry, I've been sick until recently :frown:
Jan Range (Feb 01 2025 at 12:23):@Philip Durbin ☃️ yes the action still works. That's why I am a bit puzzled.
Jan Range (Feb 01 2025 at 12:23):@Don Sizemore thanks for the hint, will look into this!
Jan Range (Feb 26 2025 at 21:45):I am still struggling to run the containers :frown:
@Don Sizemore seems like the PID option does not appear in domain.xml. I have attached the file and the container log.
Tried re-installing Docker, Java and down to DV 6.1, but nothing really helped. I think my system has turned against me :sob:
What puzzles me is that the GH Action works perfectly fine, and I guess yours too @Philip Durbin ☃️ although we are on the same OS. There seems to be a tiny thing that is causing these issues, but its the needle in the haystack :grinning:
Philip Durbin 🚀 (Feb 26 2025 at 22:02):Bah, so frustrating. Maybe you and I can get on a Zoom call sometime to troubleshoot this. But not now. I'm going home for the day. :person_running_facing_right:
Jan Range (Feb 26 2025 at 22:44):Sounds great! Would Friday work for you? I am on the road tomorrow
Jan Range (Feb 26 2025 at 23:10):I managed to resolve the issue! I'm unsure what triggered it, but the Java version of mvn was misaligned with my global JDK 17. At one point, it seems to have switched to JDK 23, and this has caused the issue. I changed it back to JDK 17, and now it works perfectly :raised_hands:
Notification Bot (Feb 26 2025 at 23:11):Jan Range has marked this topic as resolved.
Philip Durbin 🚀 (Feb 26 2025 at 23:11):Phew! Glad to hear!
Jan Range (Feb 26 2025 at 23:24):Finally, so happy :heart_eyes:
Philip Durbin 🚀 (May 12 2025 at 18:38):@Omer M Fahim just had a similar problem. Got a new laptop. Installed the latest Java. Got errors like "No PID providers configured" and "No default PID provider configured". I'm having him try the correct, older version of Java (17).
It would be nice to have this "fail fast", if you will. Show immediately that a different version of Java is required.
Notification Bot (May 12 2025 at 19:20):Philip Durbin ☀️ has marked this topic as unresolved.
Philip Durbin 🚀 (May 12 2025 at 19:20):Ok, I made a draft PR: enforce Java 17 (no higher) #11487
@Oliver Bertuch please take a look! :heart:
Oliver Bertuch (Jun 04 2025 at 12:40):@Philip Durbin I reverted your commit and fixed the root cause - when introducing auto-services, we missed a config bit for the compile plugin. Took the liberty to push into your PR branch.
Philip Durbin 🚀 (Jun 04 2025 at 13:17):"When using Java 21 (Temurin LTS), I cannot reproduce the issue. Works!"
This is odd because I was testing with 21.0.4-tem.
When you say "works" do you mean that Dataverse was completely up and working?
I see @Leo Andreev already approved the PR, by the way.
Philip Durbin 🚀 (Jun 04 2025 at 13:21):This is a case where I probably should have opened an issue (or asked @Omer M Fahim to, since him hitting the bug prompted me to take a look). That way, we could close my PR as the wrong fix and have a new PR from you as the right one.
Oliver Bertuch (Jun 04 2025 at 13:22):Yeah it worked without a flaw on 21 for me 
Oliver Bertuch (Jun 04 2025 at 13:23):I suspect there was some kind of change in JDK 23 how to deal with annotation processors.
Philip Durbin 🚀 (Jun 04 2025 at 13:23):But I'm using 21.
Oliver Bertuch (Jun 04 2025 at 13:24):However, now it's setup properly and doesn't come back to bite us again when we move on to newer JDKs.
Philip Durbin 🚀 (Jun 04 2025 at 13:24):Should we change (in the dev guide)
"First, install Java 17, Maven, and Docker."
to
"First, install Java 17+, Maven, and Docker."
?
Oliver Bertuch (Jun 04 2025 at 13:25):I'm happy with whatever. My only concern is to ship it ASAP :see_no_evil:
Philip Durbin 🚀 (Jun 04 2025 at 13:25):I thought we were locked to 17
Oliver Bertuch (Jun 04 2025 at 13:25):Why would we?
Philip Durbin 🚀 (Jun 04 2025 at 13:26):because of all the problems @Jan Range and @Omer M Fahim had :smile:
Oliver Bertuch (Jun 04 2025 at 13:26):We're just making sure to compile it with support for 17 and should be good to go
Oliver Bertuch (Jun 04 2025 at 13:26):Ha!
Philip Durbin 🚀 (Jun 04 2025 at 13:26):that I was able to reproduce on 21
Philip Durbin 🚀 (Jun 04 2025 at 13:26):I mean, poor Jan suffered for weeks!
Oliver Bertuch (Jun 04 2025 at 13:26):So if I run mvn clean compile on 21, all three files are generated.
mvn --version
Apache Maven 3.9.6 (bc0240f3c744dd6b6ec2920b3cd08dcc295161ae)
Maven home: /home/obertuch/.sdkman/candidates/maven/current
Java version: 21.0.7, vendor: Eclipse Adoptium, runtime: /home/obertuch/.sdkman/candidates/java/21.0.7-tem
Default locale: de_DE, platform encoding: UTF-8
OS name: "linux", version: "6.14.9-200.fc41.x86_64", arch: "amd64", family: "unix"
ls -la target/classes/META-INF/services
insgesamt 12
drwxr-xr-x. 1 obertuch obertuch 278 4. Jun 15:25 .
drwxr-xr-x. 1 obertuch obertuch 264 4. Jun 15:25 ..
-rw-r--r--. 1 obertuch obertuch 423 4. Jun 15:25 edu.harvard.iq.dataverse.pidproviders.PidProviderFactory
-rw-r--r--. 1 obertuch obertuch 488 4. Jun 15:25 io.gdcc.spi.export.Exporter
-rw-r--r--. 1 obertuch obertuch 64 4. Jun 15:25 org.eclipse.microprofile.config.spi.ConfigSourceProvider
should I try it? on develop?
Philip Durbin 🚀 (Jun 04 2025 at 13:27):or do we not care?
Oliver Bertuch (Jun 04 2025 at 13:28):Maybe try the fix? :see_no_evil:
Philip Durbin 🚀 (Jun 04 2025 at 13:28):ha, from from enforce-java-17 branch :smile:
Philip Durbin 🚀 (Jun 04 2025 at 13:32):% mvn --version
Apache Maven 3.9.8 (36645f6c9b5079805ea5009217e36f2cffd34256)
Maven home: /Users/PDurbin/.sdkman/candidates/maven/current
Java version: 21.0.4, vendor: Eclipse Adoptium, runtime: /Users/PDurbin/.sdkman/candidates/java/21.0.4-tem
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "15.5", arch: "aarch64", family: "mac"
After mvn clean compile:
% ls -la target/classes/META-INF/services
total 24
drwxr-xr-x 5 PDurbin staff 160 Jun 4 09:31 .
drwxr-xr-x 9 PDurbin staff 288 Jun 4 09:31 ..
-rw-r--r-- 1 PDurbin staff 423 Jun 4 09:31 edu.harvard.iq.dataverse.pidproviders.PidProviderFactory
-rw-r--r-- 1 PDurbin staff 488 Jun 4 09:31 io.gdcc.spi.export.Exporter
-rw-r--r-- 1 PDurbin staff 64 Jun 4 09:31 org.eclipse.microprofile.config.spi.ConfigSourceProvider
Jan Range said:
At one point, it seems to have switched to JDK 23
No suffering because of JDK 21 for Jan :smiley_cat:
Philip Durbin 🚀 (Jun 04 2025 at 13:33):Hmm, I wonder what Omer was on.
Oliver Bertuch (Jun 04 2025 at 13:33)::ship: :ship: :ship: :ship: it!
Philip Durbin 🚀 (Jun 04 2025 at 13:35):dev_bootstrap> Done, your instance has been configured for development. Have a nice day!
Philip Durbin 🚀 (Jun 04 2025 at 13:36):I'm looking at this PR: Upgrade to Java 17 #9764
Philip Durbin 🚀 (Jun 04 2025 at 13:36):It looks like a lot of our CI is still on Java 17.
Philip Durbin 🚀 (Jun 04 2025 at 13:36):So maybe I'll update the dev guide to say 17+ but explain that the CI uses 17.
Oliver Bertuch (Jun 04 2025 at 13:36):IIRC all of it
Oliver Bertuch (Jun 04 2025 at 13:37):Maybe keep it at 17.
Oliver Bertuch (Jun 04 2025 at 13:37):Less moving parts
Philip Durbin 🚀 (Jun 04 2025 at 13:37):yeah?
Oliver Bertuch (Jun 04 2025 at 13:37):Let folks use what is proven to work
Oliver Bertuch (Jun 04 2025 at 13:37):But unblock if they want to try...
Oliver Bertuch (Jun 04 2025 at 13:38):That way we might learn about bumps in the road when we go for a newer version
Philip Durbin 🚀 (Jun 04 2025 at 13:38):Jan and Omer would have been on 21 or 23 or whatever. That's what we want?
Oliver Bertuch (Jun 04 2025 at 13:39):Maybe Omer should switch to 17 for QA. It should be safe to use newer versions, but there's no guarantee. Fun game of whack-a-mole.
Oliver Bertuch (Jun 04 2025 at 13:39):Eventually we'll need to upgrade anyway. 17 EOL is not far away. https://endoflife.date/eclipse-temurin
Oliver Bertuch (Jun 04 2025 at 13:41):My suggestion would be to start migrating to a newer Java version when we migrate to Jakarta EE 11. That might be Temurin 25 LTS by the time.
Oliver Bertuch (Jun 04 2025 at 13:42):EE 11 will be enforcing Java 17 and recommending 21. https://jakartaee.github.io/platform/jakartaee11/JakartaEE11ReleasePlan But there are some real nice features in the newer Java versions... :smiley:
Oliver Bertuch (Jun 04 2025 at 13:42):Maybe some day we'll do a grand refactoring and make use of that...
Philip Durbin 🚀 (Jun 04 2025 at 13:45):I made a little doc change: https://github.com/IQSS/dataverse/pull/11487/commits/c27c57b93df8624402ad49f5a1f89da07dbd2243
Oliver Bertuch (Jun 04 2025 at 13:46):Reads good to me :smile_cat:
Oliver Bertuch (Jun 04 2025 at 13:47):Do these two little PRs now count as fast trackable as they have docs? :smiling_devil:
Philip Durbin 🚀 (Jun 04 2025 at 13:48):Sorry, what's the second PR?
Oliver Bertuch (Jun 04 2025 at 13:49):https://github.com/IQSS/dataverse/pull/11547 (no Zulip topic, shame!)
Notification Bot (Jun 04 2025 at 13:50):Oliver Bertuch has marked this topic as resolved.
Philip Durbin 🚀 (Jun 04 2025 at 13:53):Ah, @Leo Andreev approved that one too. :smile:
Last updated: Oct 30 2025 at 05:14 UTC