Stream: containers

Topic: โœ” Running frontend container


view this post on Zulip Thomas van Erven (Sep 21 2023 at 12:41):

I had a request from DANS management to start checking out the separated node frontend for Dataverse. Is there an alpha/dev release version/tag we should check out, or is this too soon?

view this post on Zulip Thomas van Erven (Sep 21 2023 at 12:42):

(Too soon is a perfectly valid answer - we're eager, but quality takes time : ) )

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 21 2023 at 13:16):

It's not too soon but please check out this fix you need to bump the version of Solr: https://github.com/IQSS/dataverse-frontend/pull/176

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 21 2023 at 13:17):

I have this on the agenda to talk about in 15 minutes: https://ct.gdcc.io :big_smile:

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 21 2023 at 13:17):

It works for me now but I should confirm with @Ellen K that it's working for her now. She's the one who noticed the problem.

view this post on Zulip Thomas van Erven (Sep 21 2023 at 13:27):

Excellent, I'm joining, though I'm in public and won't be able to speak so much. I can type though.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 13:39):

Have you had a chance to try it? I'm curious if you bump into https://github.com/IQSS/dataverse-frontend/issues/178 or not.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 13:41):

Just about to start on that as last item on Friday : )

view this post on Zulip Thomas van Erven (Sep 22 2023 at 14:33):

Hit some problems with getting packages:

npm ERR! 403 403 Forbidden - GET https://npm.pkg.github.com/download/@IQSS/dataverse-client-javascript/2.0.0-pr80.378cc1e/2361fc91f5e8618751025871e860062307b1adf4 - Permission permission_denied: The token provided does not match expected scopes.
npm ERR! 403 In most cases, you or one of your dependencies are requesting
npm ERR! 403 a package version that is forbidden by your security policy, or
npm ERR! 403 on a server you do not have access to.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 14:33):

I've created a fine grained token for testing purposes, all permissions.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 14:36):

Sorry, sorry, I forgot https://github.com/IQSS/dataverse-frontend/issues/152 is still open. read:packages should be enough. If you'd like to make a PR to update the README, please be my guest!

view this post on Zulip Thomas van Erven (Sep 22 2023 at 14:36):

Much obliged, I'll try instructions there : )

view this post on Zulip Thomas van Erven (Sep 22 2023 at 14:48):

Yeap, got past it. It's running, going to figure out how to get to certain pages now : )

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 14:48):

Oh! You have /spa for example?

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 14:49):

To see how to pass a DOI to the spa, I recommend watching https://github.com/IQSS/dataverse-frontend#demo-videos

view this post on Zulip Thomas van Erven (Sep 22 2023 at 14:57):

Yeap, that works too. I'm going to read the code, check what pages/routes are available. Looks great already though : )

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 14:59):

Cool, so you were able to create a dataset in the old UI and see it in the new UI?

view this post on Zulip Thomas van Erven (Sep 22 2023 at 14:59):

Yeap, absolutely.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:01):

Fantastic. What image tag did you use? This:

./run-env.sh <dataverse_image_tag>

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:01):

Currently running off alpha, but I used npm start to get things working locally. I ran the backend in a different shell.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:02):

Oh, ok, so you didn't use that run-env script.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:02):

Nope, just ran em separated. I can run them together if you'd like, I'm sure.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:03):

Would you mind trying that script? It's documented in the README. I'm trying to reproduce https://github.com/IQSS/dataverse-frontend/issues/179

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:03):

No problem, lemme kill the other stack real quick.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:04):

Thanks! Oh and please make sure to pull from develop to pick up https://github.com/IQSS/dataverse-frontend/pull/176

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:05):

I'm on develop, no worries.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:06):

Great. I only mention it because it was only merged 45 minutes ago. :big_smile:

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:13):

INFO - Setting up Dataverse on image tag alpha...
INFO - Removing current environment if exists...
INFO - Running docker containers...
[+] Running 1/1
 โœ˜ dev_dataverse Error                                                                                                                                                                   0.9s
Error response from daemon: manifest unknown

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:13):

Suspect I'm seeing some login problems with ghcr.io; I've used the same token with package permissions separetely and I'm logged in via CLI with that one.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:17):

Ah, this is an image thing. The alpha image is on Docker Hub but not GHCR. We plan to document what to pass as an image better in https://github.com/IQSS/dataverse-frontend/issues/177

Can you please try this tag?

 ./run-env.sh 9692-files-api-extension-display-data

That's the one I just tested with in https://github.com/IQSS/dataverse-frontend/issues/179 where I put some output. (Works on my machine.)

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:18):

Yeap, that one pulls and it's starting up.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:19):

Cool, it theory any recent tag from https://github.com/orgs/gdcc/packages/container/package/dataverse should work.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:19):

The idea is the frontend devs typically won't want alpha. They'll want unmerged code that adds a new API or whatever.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:33):

Yeap, she runs. I can access the spa page as well on port 8000

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:33):

Mac has become successfully airborne at this point though

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:33):

Nice! Ha! Would you be able to leave a note at https://github.com/IQSS/dataverse-frontend/issues/179 ?

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:33):

Secretly hoping it'll melt and I can get something better : o )

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:34):

ha

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:34):

you're on linux, right?

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:34):

Will do

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:34):

I'm not unfortunately. I'm on Mac.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:34):

I would love to be on Linux. I miss it.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:34):

Gotcha, well so am I and Ellen. So it's a good test. :big_smile:

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:35):

I sometimes miss Linux. :stuck_out_tongue_wink:

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:40):

Reading the issue; not sure how to access dataverse though. I'm just getting the payara page. Checking the logging.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:41):

Gonna restart container real quick.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:43):

Oh, it needs time.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:43):

I think the timeout is 5 minutes.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:43):

So please give configbaker a few minutes to do its thing.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:44):

Nah, no worries there; it errored out on my end, likely because my CPU was at 95% and it timed out.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:45):

yikes

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:46):

Yeah, seeing the Payara page is normal for the first minute at least, before the war file deploys and configbaker configures everything.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:47):

Running a cleanup, then retrying.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:47):

awesome, much appreciated

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:51):

Creating a dataverse works fine.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:52):

Great. Please do leave a comment in that issue, if you don't mind.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:53):

Oliver suspects a race condition. Ellen's laptop is quite fast.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 15:54):

Already did. If it's a race condition, I had the opposite. Getting container up took too long that configbaker had a timeout.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:58):

Wow, so 5 minutes wasn't enough. :grimacing:

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:58):

Please feel free to bump up that value in a PR if you like.

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 15:59):

Ha, your comment is great. Thanks!

view this post on Zulip Thomas van Erven (Sep 22 2023 at 16:00):

Nah, that's a laptop problem. If anything - I have a perfect reason to ask for something better now.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 16:00):

This topic can be resolved, btw; I have something to showcase : )

view this post on Zulip Notification Bot (Sep 22 2023 at 16:00):

Thomas van Erven has marked this topic as resolved.

view this post on Zulip Thomas van Erven (Sep 22 2023 at 16:01):

Much obliged for your help!

view this post on Zulip Philip Durbin ๐Ÿš€ (Sep 22 2023 at 16:01):

Sure! Thanks for all the testing!

view this post on Zulip Oliver Bertuch (Sep 22 2023 at 16:05):

Note that sometimes this high CPU load comes from GC calls. Might be neat to Monitor them. Or just try again with some more RAM for DV. 2GB is definitively a close call in some scenarios

view this post on Zulip Oliver Bertuch (Sep 22 2023 at 16:06):

(Gc calls originating from JVM trying to free some memory on the heap before finally failing)


Last updated: Oct 30 2025 at 05:14 UTC