Stream: community

Topic: Best Practices for Dataverse Server Management & Upgrades


view this post on Zulip Amandha Wingert Barok (Jul 23 2025 at 19:58):

Hi everyone!

I’m Amandha, a software engineer at FIU working on a research project called EnviStor. One of our goals is to publish datasets via Dataverse, and I’ve recently become responsible for managing our Dataverse server.

I’ve been learning a lot on the fly — working with an existing Payara setup, reading the documentation, and trying to understand upgrade procedures, configuration files, etc. While I’m making progress, I don’t yet feel confident handling the server on my own and would really appreciate any guidance or tips from those with more experience.

Are there any good resources (guides, checklists, best practices, etc.) focused more on the system administration/configuration side of Dataverse? I saw there are some training resources for end users, but nothing focused on managing Payara, deployment processes, or troubleshooting in production environments.

Also, if anyone here has experience upgrading Dataverse between versions (we’re going from 6.0 to 6.7), I’d love to hear how you handled it, especially any lessons learned or things to watch out for.

Thanks in advance! I’m excited to learn and contribute as I go. :blush:

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:04):

Welcome! Do you have some sort of staging server to experiment on? If not, I'd suggest running Dataverse on your laptop (or a server) using Docker. https://guides.dataverse.org/en/6.7/container/running/demo.html#quickstart is the place to start but because of a little issue (#11661) we're fixing, there's currently an extra step, changing "latest" to "6.7-noble" like this:

% diff compose.yml.orig compose.yml
8c8
<     image: gdcc/dataverse:latest
---
>     image: gdcc/dataverse:6.7-noble

This would allow you to experiment with Dataverse configuration and get familiar with running Dataverse in a throwaway environment.

view this post on Zulip Amandha Wingert Barok (Jul 23 2025 at 20:13):

Yes! We do have a dev server (dataversedev.fiu.edu) where I’ve been testing things like version upgrades and web styling before touching production.

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:15):

Ah, that's great.

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:16):

@Don Richards for upgrading, do you think @Amandha Wingert Barok should try the scripts you added in https://github.com/gdcc/dataverse-recipes/pull/14 ? (I know you're adding more in https://github.com/gdcc/dataverse-recipes/pull/25 )

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:19):

@Amandha Wingert Barok there's a somewhat recent thread about upgrading at https://groups.google.com/g/dataverse-community/c/PppxdDwSO98/m/j6HxnJPkDQAJ you might want to look through.

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:19):

Generally speaking, upgrading is a pain in the butt, I'm afraid. :grimacing:

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:20):

As we say at https://guides.dataverse.org/en/6.7/installation/upgrading.html the official way to upgrade is to step through each and every release.

But that said, we have a clever community that has come up with some unsupported shortcuts. :smile:

/me looks at @Oliver Bertuch

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:21):

It might come down to your tolerance for risk, I guess. :sweat_smile:

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:24):

Philip Durbin 🚀 said:

Amandha Wingert Barok there's a somewhat recent thread about upgrading at https://groups.google.com/g/dataverse-community/c/PppxdDwSO98/m/j6HxnJPkDQAJ you might want to look through.

Shoot, I'm realizing that no one replied to that last message by @Bethany Seeger. :doh: How's the upgrade going, Bethany? :sweat_smile:

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:27):

@Amandha Wingert Barok in terms of deployment process, we assume that you (or your predecessor) have installed Dataverse at some point by following the Installation Guide. Then, for deploying new releases, you should look to the release notes for the next version. Since you're on 6.0 you'd look for "upgrade instructions" in the release notes for the next version, which is 6.1: https://github.com/IQSS/dataverse/releases/tag/v6.1

view this post on Zulip Bethany Seeger (Jul 23 2025 at 20:35):

Hi @Philip Durbin 🚀 we have a dev server that our devops engineer was able to use @Oliver Bertuch's scripts to upgrade from 5.14 to 6.6. We are still testing out the upgraded system. Looks very promising!

view this post on Zulip Philip Durbin 🚀 (Jul 23 2025 at 20:53):

orly

view this post on Zulip Amandha Wingert Barok (Jul 24 2025 at 13:59):

Philip Durbin 🚀 said:

Amandha Wingert Barok in terms of deployment process, we assume that you (or your predecessor) have installed Dataverse at some point by following the Installation Guide. Then, for deploying new releases, you should look to the release notes for the next version. Since you're on 6.0 you'd look for "upgrade instructions" in the release notes for the next version, which is 6.1: https://github.com/IQSS/dataverse/releases/tag/v6.1

Thank you for the tips! Should I update version per version? For example, 6.0 to 6.1, then 6.1 to 6.2 and so on instead of jumping from 6.0 to 6.7?

view this post on Zulip Philip Durbin 🚀 (Jul 24 2025 at 14:00):

Yes, that's the supported way, the recommended way. It's the way we do it for Harvard Dataverse. (We always upgrade shortly after each release.)

view this post on Zulip Amandha Wingert Barok (Jul 24 2025 at 14:02):

Ok! I will make sure to be aware as soon as the release is available. Do we receive any kind of notification for each new version?

view this post on Zulip Oliver Bertuch (Jul 24 2025 at 14:02):

There are announcements here, on the Google Group and you can have Github send you a notification for a new release.

view this post on Zulip Philip Durbin 🚀 (Jul 24 2025 at 14:04):

Plus the blog. See https://guides.dataverse.org/en/6.7/developers/making-releases.html#announce-the-release-on-the-dataverse-blog and the entries below for where we announce, most recently handled in https://github.com/IQSS/dataverse-pm/issues/379

view this post on Zulip Amandha Wingert Barok (Jul 24 2025 at 14:05):

Thank you, Oliver and Philip!

view this post on Zulip Don Richards (Jul 24 2025 at 15:48):

I'm currently trying to polish the upgrade script for 6.6 now. And I'm starting on 6.7 ASAP since we need to update it anyways.


Last updated: Nov 01 2025 at 14:11 UTC