Stream: troubleshooting

Topic: deploying dataverse.war failed


view this post on Zulip Su Sa (Jan 18 2024 at 10:13):

Hey everybody. I already obened a conversation here https://groups.google.com/g/dataverse-community/c/wL6Q2bsvw04/m/4KDBFk1IAgAJ?utm_medium=email&utm_source=footer but it is hard to find the reason, why the deployment failed. Maybe it is better in zulip.
Short summary: In the console I entered python3 install.py. Everthing worked fine and when it tryed to deploy the dataverse.war file I got this output
'No response from Domain Admin Server after 600 seconds.
The command is either taking too long to complete or the server has failed.
Please see the server log files for command status.
Command deploy failed.
Failed to deploy the application!'
But then when I look into the payara admin console I see the deployed dataverse war. But I cannot open localhost:8080. What happend there?
Can anybody help me?
server.log
2024-01-12_14h07_18.png
2024-01-12_14h06_34.png

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 12:34):

Hi! Thanks for joining.

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 12:34):

What do you get if you go to http://localhost:8080/api/info/version ?

view this post on Zulip Su Sa (Jan 18 2024 at 12:39):

{
"status": "OK",
"data": {
"version": "6.0",
"build": "1512-366fd41"
}
}

view this post on Zulip Su Sa (Jan 18 2024 at 12:41):

ah, hi philip, its you. cool

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 12:41):

Ok, so the war file has definitely been deployed.

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 12:42):

How about http://localhost:8080/api/metadatablocks ?

view this post on Zulip Su Sa (Jan 18 2024 at 12:42):

yes I also think so. but so console say it wasn't deployed

view this post on Zulip Su Sa (Jan 18 2024 at 12:43):

{
"status": "OK",
"data": []
}

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 12:43):

Ok, that's bad. It should have a lot of data, like this: https://demo.dataverse.org/api/metadatablocks

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 12:44):

How attached are you to this installation? Can we throw it away and start again?

view this post on Zulip Su Sa (Jan 18 2024 at 12:46):

yes, thats no problem. we can install everything from the beginning

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 12:48):

Great. What flavor of Linux are you using? Rocky? Ubuntu?

view this post on Zulip Su Sa (Jan 18 2024 at 12:53):

neither nor I use debian

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:00):

Ok. RHEL/Rocky is the preferred distro but Ubuntu/Debian should work.

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:02):

I suspect that the bootstrap wasn't successful

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:02):

These are the recommended steps for a fresh reinstall: https://guides.dataverse.org/en/6.0/installation/installation-main.html#fresh-reinstall

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:03):

I've seen exactly this behaviour with @Jutta Schnabel's deployment

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:03):

Well, this is not in containers.

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:03):

WAR successfully deployed (themed 404 error and /api/info), but nothing else works

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:03):

True, but the symptoms are the same

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:03):

Maybe not the reason

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:04):

yeah

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:04):

I've been trying to get more output. To see what is going wrong.

view this post on Zulip Su Sa (Jan 18 2024 at 13:05):

https://guides.dataverse.org/en/6.0/installation/installation-main.html#fresh-reinstall i do this for more than 5 times

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:06):

Probably the result is not going to be a different one then :wink:

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:06):

Could you provide a server.log and output from the installer from one of the attempts?

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:06):

That would be really helpful in trying to corner reasons why things blow up

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:07):

(If these filenames and things mean nothing to you, let us know - happy to explain more)

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:08):

One of the five server.log's is above.

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:09):

I've been trying to get output from the terminal and setup logs: https://guides.dataverse.org/en/6.0/installation/intro.html#information-to-send-to-support-when-installation-fails

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:09):

Installer log would be perfect - if some of the scripts fail, that might not be visible from the Payara logs

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:09):

gotta bike through the ice... back soon

view this post on Zulip Oliver Bertuch (Jan 18 2024 at 13:09):

Break a leg!

view this post on Zulip Su Sa (Jan 18 2024 at 13:12):

yes that would be no problem. I converted the server.log to fine should i return that?

view this post on Zulip Su Sa (Jan 18 2024 at 13:13):

what ist 'output from the installer from one of the attempts?'

view this post on Zulip Su Sa (Jan 18 2024 at 13:16):

'The scripts/api/setup-all.*.log files left behind by the installer.' this files are not genered. if I look into the install.py i can see, that this files will be genereted after deploying of the war. I thing its not generedet because it interrupt the installing process before it will generate this files.

view this post on Zulip Su Sa (Jan 18 2024 at 13:26):

I got an error when I tried to drop the database
'psql: Error: Connection to server failed on socket '/var/run/postgresql/.s.PGSQL.5432': FATAL: Peer authentication failed for user 'dvnapp''

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 13:55):

Hmm, I wonder if the database was ever created. If not, there's nothing to drop.

view this post on Zulip Su Sa (Jan 18 2024 at 14:00):

ok, how can i check it?

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:03):

[postgres@ip-172-31-5-10 ~]$ psql
psql (13.9)
Type "help" for help.

postgres=# \l
                                  List of databases
   Name    |  Owner   | Encoding |   Collate   |    Ctype    |   Access privileges
-----------+----------+----------+-------------+-------------+-----------------------
 dvndb     | postgres | UTF8     | en_US.UTF-8 | en_US.UTF-8 | =Tc/postgres         +
           |          |          |             |             | postgres=CTc/postgres+
           |          |          |             |             | dvnuser=CTc/postgres
 postgres  | postgres | UTF8     | en_US.UTF-8 | en_US.UTF-8 |
 template0 | postgres | UTF8     | en_US.UTF-8 | en_US.UTF-8 | =c/postgres          +
           |          |          |             |             | postgres=CTc/postgres
 template1 | postgres | UTF8     | en_US.UTF-8 | en_US.UTF-8 | =c/postgres          +
           |          |          |             |             | postgres=CTc/postgres
(4 rows)

postgres=#

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:03):

Something like that. ^^

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:03):

The database is called "dvndb".

view this post on Zulip Su Sa (Jan 18 2024 at 14:04):

yes i check it. but I saw this before

view this post on Zulip Su Sa (Jan 18 2024 at 14:04):

but now nothing happen. Only this error appears.

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:05):

Can you drop the "dvndb" database using the "postgres" user instead of the "dvnapp" user?

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:06):

Also, apologies, but I need to run a meeting soon. You're welcome to join if you like: #containers > weekly meeting

view this post on Zulip Su Sa (Jan 18 2024 at 14:07):

no problem. then we go on later.

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:08):

Also, even if the setup log files can't be found, you see output on your terminal, right? When you run install.py.

view this post on Zulip Su Sa (Jan 18 2024 at 14:11):

yes i see

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:11):

Can you please share that output?

view this post on Zulip Su Sa (Jan 18 2024 at 14:13):

yes now it says performing database setup
Admin database connectivity succeeds.
PostgreSQL version: 13
Looks like the user already exists. Continuing.
Couldn't create database or database already exists.

view this post on Zulip Su Sa (Jan 18 2024 at 14:13):

now something went wrong with the database

view this post on Zulip Su Sa (Jan 18 2024 at 14:16):

ok, I think we have to go on tomorow. I have to pick up my kids.....

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 18 2024 at 14:20):

Sounds good. I'm taking a day off tomorrow but I'm happy to help on Monday.

view this post on Zulip Su Sa (Jan 22 2024 at 09:26):

Good morning. A miracle has happened. I deleted the database manually and the install.py could run throught to the end. I tried a lot to delete the dvndb but there was no way. Both the dnvapp and the postgres were not allowed to delete the dvndb. I disable all the access restrictions on localhost connections in the pg_hba.conf.

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 22 2024 at 12:06):

... and now everything is working? You can log into Dataverse? You can create a dataset?

view this post on Zulip Su Sa (Jan 23 2024 at 09:48):

No, unfortunately not yet. I can log into Dataverse, but then I see this errors.
2024-01-23_10h46_41.png

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 23 2024 at 12:09):

Did you install Solr? Is it running? Can you query Solr outside of Dataverse?

view this post on Zulip Su Sa (Jan 23 2024 at 13:18):

yes i istalled it. and it seems to be not running
image.png

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 23 2024 at 13:44):

What if you curl http://localhost:8983/solr/collection1/schema/fields ? What do you get?

view this post on Zulip Su Sa (Jan 23 2024 at 13:52):

ERR_CONNECTION_REFUSED

view this post on Zulip Su Sa (Jan 23 2024 at 13:53):

the site is not availabe

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 23 2024 at 14:16):

Hmm, sounds like we need to fix Solr. I assume you've tried stopping and starting it again. Maybe reinstall it?

view this post on Zulip Su Sa (Jan 24 2024 at 12:32):

hmmm, yes something went wrong with my solr
I started and stoped it but the when I asked for the status the solr is offline
How can I reinstall it?

view this post on Zulip Su Sa (Jan 24 2024 at 12:36):

image.png

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 24 2024 at 13:26):

I would stop it, rm -rf the directory, and then try again: https://guides.dataverse.org/en/6.1/installation/prerequisites.html#solr

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 24 2024 at 13:28):

At this point, I'd feel remiss if I didn't point out you could let Ansible install Dataverse for you. Please see https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible#quickstart

It was created and is maintained by @Don Sizemore and we use it all the time in our continuous integration (CI) testing.

view this post on Zulip Su Sa (Jan 24 2024 at 14:08):

image.png

view this post on Zulip Su Sa (Jan 24 2024 at 14:11):

shit don't work. I remove everything and make it new. but same result

view this post on Zulip Su Sa (Jan 24 2024 at 14:13):

yes, i see ansible. mybe thats a good idea.

view this post on Zulip Su Sa (Jan 24 2024 at 14:21):

ha, i got it. yyyeeeeaaaahhhh. I have to change the jetty host to 0.0.0.0. but what I do not do was to delete the comment out. small cause big effect

view this post on Zulip Su Sa (Jan 24 2024 at 14:23):

so next step I try to upload some datas

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 24 2024 at 14:26):

Shoot, the jetty 0.0.0.0 thing. That's a definite gotcha. @Don Sizemore let us know about it.

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 24 2024 at 14:28):

... and fixed it in this PR: document localhost-only behavior of Solr-9.3.0 and later #10037

view this post on Zulip Su Sa (Jan 26 2024 at 12:43):

is there a way to figure out why I cannot upload some datas?

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 26 2024 at 13:29):

Oh! Sounds like you're making progress. You can create a dataset at least?

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 26 2024 at 13:30):

Which files can be uploaded? Which can't?

view this post on Zulip Su Sa (Jan 26 2024 at 13:33):

Yes, a little bit. :P I can creat a dataverse but I cannot uplaod datasets

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 26 2024 at 13:33):

What do you see in server.log?

view this post on Zulip Su Sa (Jan 26 2024 at 13:36):

Where is it hidden again?

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 26 2024 at 13:36):

https://guides.dataverse.org/en/6.1/admin/troubleshooting.html#finding-the-payara-log-file

view this post on Zulip Su Sa (Jan 26 2024 at 13:37):

ah glassfish domain 1. I got it

view this post on Zulip Su Sa (Jan 26 2024 at 13:43):

ha, now its available... crazy. I tried to uplaod it yesterday but the page was frozen. Now the dataset is available.... confusing but great

view this post on Zulip Su Sa (Jan 26 2024 at 13:45):

there is no new server log since last week friday

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 26 2024 at 13:45):

not perfect but great to hear! :tada:

view this post on Zulip Su Sa (Jan 26 2024 at 13:45):

yes, I have to play a litte bit and observe the theme

view this post on Zulip Philip Durbin ๐Ÿš€ (Jan 26 2024 at 13:55):

Well, please keep the questions coming. And please start a new topic (here in Zulip) as needed.


Last updated: Oct 30 2025 at 05:14 UTC