Stream: dev

Topic: fast redeploy with docker compose

Philip Durbin 🚀 (Nov 04 2025 at 20:56):

  dataverse:
    container_name: "dataverse"
    hostname: dataverse
    build:
      dockerfile: ./dataverse/Dockerfile
      args:
        - BASE_VERSION=${BASE_VERSION:-6.6-noble}
        - DATAVERSE_WAR_URL=${DATAVERSE_WAR_URL:-https://github.com/IQSS/dataverse/releases/download/v6.6/dataverse-6.6.war}
        - USER_ID=${USER_ID:-1000}
        - GROUP_ID=${GROUP_ID:-1000}

From @Eryk Kulikowski at https://github.com/libis/rdm-integration/blob/bca3826674a426522fdd75437b0e4ff54234f6e6/docker-compose.yml#L66

Oliver Bertuch (Nov 07 2025 at 09:57):

What I like most in that repo: the modularized approach to setup. @Eryk Kulikowski this would be good to have in upstream, too!

Philip Durbin 🚀 (Nov 07 2025 at 11:33):

Absolutely. That compose file was something we only touched on during tech hours but I'd love to hear more.

Eryk Kulikowski (Nov 07 2025 at 11:57):

I just opened a PR that might be interesting for the upstream repo: https://github.com/IQSS/dataverse/pull/11961

It adds fast-redeploy scripts for container-based development that reduce iteration time from ~54s to ~12s (4.5x faster). The workflow uses exploded WAR deployment with incremental compilation and Payara's asadmin deploy --force for hot redeployment without container restarts.

Key features:

• Three scripts: dev-start-frd.sh (setup), dev-frd.sh (iterate), dev-down-frd.sh (shutdown)
• Zero infrastructure changes, completely optional
• Works with any editor (not IDE-dependent)

This could be a good topic for tech hours - we could discuss what developer workflow improvements would be valuable to include in the mainstream Dataverse repo.

Philip Durbin 🚀 (Nov 07 2025 at 11:58):

@Eryk Kulikowski THANK YOU!

Philip Durbin 🚀 (Nov 07 2025 at 11:58):

And yes, I'd love to hear from other developers any tips and tricks to speed up development!

Oliver Bertuch (Nov 10 2025 at 09:39):

@Eryk Kulikowski I really like what you did in your PR! Thanks for testing out all of this stuff and looking into making it work!

Oliver Bertuch (Nov 10 2025 at 09:39):

I have a few suggestions and maybe we should discuss them here in chat or during the next containerization meeting.

Oliver Bertuch (Nov 10 2025 at 09:58):

Braindump / Notes to self:

• Once upon a time we wanted to start a docker-related directory /docker/... in the repo. Maybe this is the perfect opportunity to kickstart it?
• I don't see much in there that wouldn't be possible with the Maven plugins. We should try to align both ways.
• I hear you on the persistence.xml bit - it's been a long standing issue to get rid of that and have devs use Flyway properly.
• For the memory: thinking about using an environment variable instead of the override file. Usable from Maven and compose CLI and doesn't need a wrapper script just to activate the override file.
• Cargo Plugin Remote?, cargo.glassfish.deploy.arg.force
• Watch Background Job?
• DMP Watch Mode - may need fixes for our situation
• https://docs.docker.com/compose/how-tos/file-watch
• Move away from DMP to run things? https://github.com/chonton/compose-maven-plugin

Philip Durbin 🚀 (May 26 2026 at 13:44):

Eryk Kulikowski said:

I just opened a PR that might be interesting for the upstream repo: https://github.com/IQSS/dataverse/pull/11961

@Eryk Kulikowski sorry, I'm only just trying this! I'm running into some problems, unfortunately. Can you please take a look at my comment at https://github.com/IQSS/dataverse/pull/11961/changes#r3304062417 ? Thanks!

Philip Durbin 🚀 (May 26 2026 at 13:48):

Actually, you know what, I tried it again and it worked!

Philip Durbin 🚀 (May 26 2026 at 13:54):

Merged! Thanks, @Eryk Kulikowski! :heart:

Philip Durbin 🚀 (May 26 2026 at 19:35):

@Eryk Kulikowski I'm already using your scripts! I love them! Thanks again!

Philip Durbin 🚀 (May 27 2026 at 20:46):

I used it all day today. It's great!

Philip Durbin 🚀 (May 27 2026 at 20:47):

The IDE methods are much more fiddly. You have to update each class individually.

Philip Durbin 🚀 (May 27 2026 at 20:48):

With Eryk's method you can edit a bunch of files and not think hard about which one you edited. You can just run the script and BOOM, the new code is deployed.

Oliver Bertuch (May 28 2026 at 14:18):

Cool! Still wondering if we can make it a bit more aligned, more intuitive to use for folks new to this kind of stuff. It might seem strange to people to run these scripts.

Philip Durbin 🚀 (May 28 2026 at 14:24):

As a command line junkie, I find them quite natural! :smile: :tada:

Last updated: May 30 2026 at 06:18 UTC