Carlos Soto Mendoza (Jan 25 2024 at 12:55): Carlos Soto Mendoza (Jan 25 2024 at 12:55):Hi, mi name is Carlos Soto of Universidad de Talca, Chile
We need install dataverse, but i had a several difficults to do it, mi principal question is if existis a step by step manual or some video with te process.
Best Regards.
Philip Durbin 🚀 (Jan 25 2024 at 12:56):Hi! Have you tried Ansible? https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible#quickstart
Carlos Soto Mendoza (Jan 25 2024 at 12:57):[Citando…]
Hi, not yet, but I'll take a look at it soon. I'll tell you how it goes with this. Thanks.
Carlos Soto Mendoza (Jan 25 2024 at 13:28):i have this message in installation process
TASK [dataverse : install java-nnn-openjdk and other packages for RedHat/Rocky] ****************************
fatal: [localhost]: FAILED! => {"changed": false, "failures": ["No package python38 available."], "msg": "Failed to install some of the specified packages", "rc": 1, "results": []}
NO MORE HOSTS LEFT *************************************
PLAY RECAP *****************************************
localhost : ok=6 changed=2 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Philip Durbin 🚀 (Jan 25 2024 at 13:49):No Python 3.8... interesting. What version of RHEL/Rocky are you using?
Carlos Soto Mendoza (Jan 25 2024 at 14:13):I use, RHEL 9
Carlos Soto Mendoza (Jan 25 2024 at 14:13):The ansible allow me install in other OS, for example Debian ?
Philip Durbin 🚀 (Jan 25 2024 at 14:18):Hmm, I'm pretty sure RHEL 9 is the one @Don Sizemore keeps mentioning as not working yet.
Philip Durbin 🚀 (Jan 25 2024 at 14:18):I think Debian will work. Not sure. Is RHEL 8 an option for you?
Don Sizemore (Jan 25 2024 at 15:10):RHEL9 should be fine (there's an Ansible branch for that, not yet merged because of the end-to-end test suite)
Don Sizemore (Jan 25 2024 at 15:10):Debian 11 is supported; there's a half-way done Debian 12 branch, contributions welcome there.
Philip Durbin 🚀 (Jan 25 2024 at 15:29):Awesome, thanks @Don Sizemore ! I think I found it: https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/tree/243_rocky_9
Philip Durbin 🚀 (Jan 25 2024 at 15:29):@Carlos Soto Mendoza you could try the branch above if you like.
Philip Durbin 🚀 (Jan 25 2024 at 15:30):And here's the issue about RHEL/Rocky 9 support: https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/issues/243
Carlos Soto Mendoza (Jan 25 2024 at 16:13):thanks, i test with the new links, and tell you more.
Philip Durbin 🚀 (Jan 25 2024 at 16:37):Perfect, thanks.
Philip Durbin 🚀 (Jan 25 2024 at 16:44):@Don Sizemore I just created this issue about the end to end tests failing on Rocky 9: API tests failing on Rocky 9 #10271
Carlos Soto Mendoza (Jan 29 2024 at 11:30):image.png
Finally I mounted a RHEL 8 to do the installation and when running the commands I got this error.
Don Sizemore (Jan 29 2024 at 12:05):Carlos Soto Mendoza said:
image.png
Finally I mounted a RHEL 8 to do the installation and when running the commands I got this error.
Dataverse-Ansible is primarily used and tested on Rocky Linux (and I'm plunking away at a Debian 12 branch). Don't remember how Red Hat handles those repository subscriptions, but it sounds like rhsm_repository may have been renamed.
Carlos Soto Mendoza (Jan 29 2024 at 12:13):ok, so to install in RHEL ? how to do it?, the step by step publish in Dataverse site It hasn't given me results. Or do you recommend doing it in Rocky Linux? If so, what version do you recommend?
Don Sizemore (Jan 29 2024 at 13:06):@Carlos Soto Mendoza if you would like to figure out how to correct that repo name on the current RHEL8 and report back, that would be great. You're welcome to try Rocky, particularly if you don't want to spend the money on a RHEL license.
Carlos Soto Mendoza (Jan 31 2024 at 02:45):image.png
Dears, i mounted Rocky Linux and i obtain the same error, please help
Don Sizemore (Jan 31 2024 at 12:17):Carlos Soto Mendoza said:
image.png
Dears, i mounted Rocky Linux and i obtain the same error, please help
looks like Rocky calls it "powertools" https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/blob/develop/tasks/rserve.yml#L19 but if you're seeing that error, you're likely still on RedHat and not Rocky?
Carlos Soto Mendoza (Jan 31 2024 at 12:18):I'm on rocky linux
Carlos Soto Mendoza (Jan 31 2024 at 12:19):
Philip Durbin 🚀 (Jan 31 2024 at 12:23):Just a thought... as an experiment what if for rserve you change install=true to false? https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/blob/develop/defaults/main.yml#L388
Carlos Soto Mendoza (Jan 31 2024 at 12:28):Where in the installation code should I do this? I'm installing with these commands.
$ git clone https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible.git dataverse
$ ansible-playbook --connection=local -v -i dataverse/inventory dataverse/dataverse.pb -e "@dataverse/defaults/main.yml"
Philip Durbin 🚀 (Jan 31 2024 at 12:39):You'd use your favorite editor like this: vi dataverse/defaults/main.yml
Don Sizemore (Jan 31 2024 at 12:40):on lines 13 and 19 of rserve.yml, Ansible tests for RedHat vs. Rocky. either that test is returning a false-positive, or you're still running RHEL?
Don Sizemore (Jan 31 2024 at 12:41):you can test with
$ rpm -q redhat-release
or
$ rpm -q rocky-release
Carlos Soto Mendoza (Jan 31 2024 at 12:45):hi, send the result
image.png
Philip Durbin 🚀 (Jan 31 2024 at 12:54):Rocky 9. Interesting.
Don Sizemore (Jan 31 2024 at 13:02):@Carlos Soto Mendoza unless you specifically need Rserve installed, you might just set rserve.enabled=false in your group_vars file? IQSS is considering doing away with in entirely.
Philip Durbin 🚀 (Jan 31 2024 at 13:43):Right, that's the same as flipping it to false in main.yml, right?
Carlos Soto Mendoza (Jan 31 2024 at 14:50):this changes, do before run de ansible command right?
Philip Durbin 🚀 (Jan 31 2024 at 14:55):Right, to prevent RServe from being installed.
Carlos Soto Mendoza (Jan 31 2024 at 15:09):image.png
i realize the changes in main.yml, i put rserve in false, but i continue get the same message
Philip Durbin 🚀 (Jan 31 2024 at 16:15):It's weird that rserve.yml is still in that error. I would think that changing rserve to false would mean that file isn't used at all.
Carlos Soto Mendoza (Jan 31 2024 at 16:22):image.png
i found group vars folder, but i dont know how file i have change.
Carlos Soto Mendoza (Jan 31 2024 at 16:25):look in all files in the group_vars folder, and in all of them, rserve is in false.
Philip Durbin 🚀 (Jan 31 2024 at 16:27):We might need to wait for more input from Don.
Don Sizemore (Jan 31 2024 at 20:00):I just spun up Dataverse 6.1 on Rocky 9, with Rserve enabled, and the switches steered me correctly:
TASK [dataverse : Rocky 9 calls it crb] ****************************************
changed: [default] => {"changed": true, "cmd": "dnf config-manager --enable crb", "delta": "0:00:00.150832", "end": "2024-01-31 19:45:02.464736", "msg": "", "rc": 0, "start": "2024-01-31 19:45:02.313904", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
Huh, so what is it? :thinking:
Don Sizemore (Jan 31 2024 at 20:05):I can also try with Rocky 8 and Rserve enabled, but I don't have a RHEL image to test on.
Don Sizemore (Jan 31 2024 at 20:06):I'm also in a place that I welcome some amount of troubleshooting, when it's not my particular use case?
Carlos Soto Mendoza (Feb 01 2024 at 01:05):I appreciate the answers, what can I do now? I need to install Dataverse in the shortest period of time possible, do you have any tips or manuals to help me in this process? Should I have something pre-installed? Or is it enough that the system is recently installed and updated?
Philip Durbin 🚀 (Feb 01 2024 at 02:57):Just to review, you've tried dataverse-ansible on RHEL 9 and Rocky 9, right? And it's not working. We should change something. Do you want to try Rocky 8? Do you want to try a traditional installation by following the guide? If it's a demo (not production), do you want to try my half-baked Docker instructions?
Carlos Soto Mendoza (Feb 01 2024 at 10:48):I tried on RHEL 8 and 9, I also tried on Rocky 8 and 9. On each of the systems it gives me the same error. I have all 4 virtual machines up and in all of them I get the same message. Regarding the official guide, I try to follow the step by step, but it gives me errors, there are several points in the prerequisites that are not clear to me.
Don Sizemore (Feb 01 2024 at 12:23):I'm afraid I'm unable to reproduce the problem is reported using Rocky 9; I can try again using Rocky 8 today. Again, Rserve is an optional component, not heavily used by Dataverse, and may always be installed at a later date.
Carlos Soto Mendoza (Feb 01 2024 at 12:43):I understand, as I said, I tried on all 4 machines, RHEL 8 and 9, Rocky 8 and 9, the message is the same, even though in the main.yml, I explicitly say that rserve does not install it, it does not take that change and returns me to give the same message. Is there any other easy way to install Dataverse. Unfortunately I am up against the deadline and I have to have it installed as soon as possible.
Don Sizemore (Feb 01 2024 at 13:12):As Phil suggested there are experimental Docker containers which should work well for a prototype. The Global Dataverse Community Consortium also offers paid installation support.
Philip Durbin 🚀 (Feb 01 2024 at 13:17):I'd like to suggest that we next try a traditional installation on Rocky 8 and try to figure out where the guides are confusing: https://guides.dataverse.org/en/6.1/installation/prerequisites.html
Carlos Soto Mendoza (Feb 01 2024 at 13:40):Don, how do I access that paid installation? What will its value be?
Philip, I will try again to do the traditional installation and I will tell you which parts I do not understand well.
Don Sizemore (Feb 01 2024 at 14:36):@Carlos Soto Mendoza You can e-mail jonathan_crabtree@unc.edu and ask about a paid installation. We're happy to help here as well, but we can't easily see what's on your servers.
Don Sizemore (Feb 02 2024 at 12:11):@Carlos Soto Mendoza one thing I did notice - in the example above, you're including the -e statement before the playbook name? that's straight from the README and that used to work, but something may have changed over the years. try putting the .pb part last in your command?
Carlos Soto Mendoza (Feb 05 2024 at 12:22):Hello Don, i get this message to put the .pb part at last
image.png
Don Sizemore (Feb 05 2024 at 12:36):Carlos Soto Mendoza said:
Hello Don, i get this message to put the .pb part at last
image.png
looks like you forgot your -e in front of "@..."?
Carlos Soto Mendoza (Feb 05 2024 at 13:39):thank you Don, i get again the first error
image.png
Don Sizemore (Feb 05 2024 at 13:41):@Carlos Soto Mendoza to my reading, that means that dataverse/defaults/main.yml contains rserve.install = true which is the default: https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/blob/develop/defaults/main.yml#L388 Are you certain you're pointing at the correct group variables file?
Carlos Soto Mendoza (Feb 05 2024 at 13:45):I have mi dataverse directory in
image.png
and this is my main.yml
image.png
Don Sizemore (Feb 05 2024 at 14:45):Rserve.yaml only gets included when that variable is true: https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/blob/develop/tasks/main.yml#L26 so you're picking up a different group vars file somewhere.
Philip Durbin 🚀 (Feb 05 2024 at 14:54):So strange. Would more eyes on this help? Maybe @Péter Pallinger would spot something I'm not seeing.
Carlos Soto Mendoza (Feb 05 2024 at 14:55):I will look to see if I have another main.yml file on my machine.
Philip Durbin 🚀 (Feb 05 2024 at 14:58):Great. It sounds like groups vars could also be a factor, though.
Carlos Soto Mendoza (Feb 05 2024 at 15:08):here the all files main.yml on mi system
image.png
Carlos Soto Mendoza (Feb 05 2024 at 15:13):i was more especific and i get the same error
image.png
Philip Durbin 🚀 (Feb 05 2024 at 15:21):You're running Rocky 8, right?
Carlos Soto Mendoza (Feb 05 2024 at 15:22):yes
Philip Durbin 🚀 (Feb 05 2024 at 15:44):It's so strange that it says RHEL8. Don keeps mentioning "group vars". Are you familiar with that?
Carlos Soto Mendoza (Feb 05 2024 at 17:52):No, I'm not familiar with that.
But I think it means that my main.yml file is hosted somewhere else. I checked and from what I saw my file is in the right place
Philip Durbin 🚀 (Feb 05 2024 at 19:00):Right, or at least some config is being picked up from some other file.
Philip Durbin 🚀 (Feb 05 2024 at 19:23):Is it possible that the quickstart is out of date? That a new version of Rocky 8 or Ansible broke it? @Deirdre Kirmis have you tried it recently?
Deirdre Kirmis (Feb 05 2024 at 19:48):it's been a while, but I did an install a few months ago on rocky 8 and got the same error .. so I believe I set the rserve install to false and did the installation manually.
Deirdre Kirmis (Feb 05 2024 at 19:49):but it seems like I used the script since then and the last time i did it, it worked .. i can try it again if that would help
Deirdre Kirmis (Feb 05 2024 at 19:51):that is in the defaults/main.yml .. set "install: false" on the rserve task
Deirdre Kirmis (Feb 05 2024 at 19:52):oh ha that's what don said .. i need to read back farther
Philip Durbin 🚀 (Feb 05 2024 at 19:52):Oh? You got the same error?
Philip Durbin 🚀 (Feb 05 2024 at 19:53):And setting rserve=false worked? I wonder why isn't not working for Carlos. :thinking:
Deirdre Kirmis (Feb 05 2024 at 19:57):oh, also I think at one point i did also have to edit the rserve.yml file in /tasks and change powertools to PowerTools .. i may have done that to get it to run without skipping it
Deirdre Kirmis (Feb 05 2024 at 19:58):or the other way around .. omg i'm not helping at all .. i had to do something with that line
Deirdre Kirmis (Feb 05 2024 at 19:58):no sorry "powertools" is correct for rocky .. i've done this in RHEL and had to change it there
Deirdre Kirmis (Feb 05 2024 at 19:58):just ignore me
Philip Durbin 🚀 (Feb 05 2024 at 19:59):ha
Philip Durbin 🚀 (Feb 05 2024 at 20:00):@Deirdre Kirmis how easy would it be for you to try the ansible quickstart on a fresh installation of rocky 8, just to confirm it works for you?
Deirdre Kirmis (Feb 05 2024 at 20:00):for sure .. i will spin up a rocky 8 instance and run it and see what happens
Philip Durbin 🚀 (Feb 05 2024 at 20:02):Thank you!
Deirdre Kirmis (Feb 05 2024 at 20:04):it might take a little bit as I have a meeting for about an hour
Philip Durbin 🚀 (Feb 05 2024 at 20:05):No rush! Thanks!
Deirdre Kirmis (Feb 05 2024 at 21:39):okay so I launched a rocky linux 8 instance and installed git and ansible, then cloned the repo .. the only thing I changed in main.yml (in /defaults) was I added the public_fqdn in the apache section .. then ran it as is for a completely local installation ..
.. it failed on the rserve task trying to install "DescTools" so I changed the main.yml to "install.false" on the rserve task .. after that it ran without a hitch ..
.. trying to determine why rserve failed .. not sure where it is glitching in the script ..
Deirdre Kirmis (Feb 05 2024 at 21:48):i commented out the "install R modules" command in the rserve.yml file and ran the rserve install and it all went through .. but .. the modules aren't installed, so i think generating that list is where it is going wrong
Philip Durbin 🚀 (Feb 05 2024 at 21:51):Ok, so setting rserve=false worked. You were able to skip installing rserve. But what is @Deirdre Kirmis doing differently than @Carlos Soto Mendoza ? This is driving me crazy! :mind_blown:
Deirdre Kirmis (Feb 05 2024 at 21:53):make sure you are editing the main.yml that is in /root/dataverse/defaults/ and not the one in /root/dataverse/tasks
Carlos Soto Mendoza (Feb 05 2024 at 21:54):@Deirdre Kirmis we can talk by direct messages?, you can help me ? please this take me much time
Deirdre Kirmis (Feb 05 2024 at 21:55):change this section
rserve-set-false.jpg
Deirdre Kirmis (Feb 05 2024 at 21:55):but set it to false :-)
Carlos Soto Mendoza (Feb 05 2024 at 21:55):I sure i edit the file in defaults, i do it in rocky 8 and 9, also in rhel 8 and 9. it was by i use virtual box ?
Carlos Soto Mendoza (Feb 05 2024 at 21:58):yes i send you mi configuration, step by step
image.png
the line code was:
cd dataverse/defaults
nano main.yml
Deirdre Kirmis (Feb 05 2024 at 22:00):oh yea, okay i was looking at the image right above this, it looked like you were editing the /tasks one .. yes for sure dm me and I'll try to help if i can
Carlos Soto Mendoza (Feb 05 2024 at 22:01):thanks
Deirdre Kirmis (Feb 05 2024 at 22:01):i'll post results of whatever we find here
Deirdre Kirmis (Feb 05 2024 at 23:10):well, definitely the command is not using the group vars for some reason .. he tried recloning and starting all over, making sure the rserve task is disabled, and running the ansible script as is .. we also tried many variations of that .. putting the extra vars first, in the middle, last, nothing seemed to change .. also tried just commenting out the whole rserve section in /tasks/main.yml .. but then it just stopped on another section .. maybe something with vagrant/virtualbox? idk
Philip Durbin 🚀 (Feb 06 2024 at 03:39):@Deirdre Kirmis thanks so much for testing. You said "launch an instance". Is that an EC2 instance? I'm just trying to figure out what's different.
Don Sizemore (Feb 06 2024 at 12:04):If he's launching Vagrant with the VirtualBox plugin, the group_vars file to edit is vagrant.yml, but he said he was cloning the repo manually?
Don Sizemore (Feb 06 2024 at 12:17):you could try passing it --extra-vars instead of -e, though they should be inter-changeable. my initial suggestion was to see what the RHEL8 Rserve repo may have changed to, and report back? per some documentation I found, for RHEL8 it's codeready-builder-for-rhel-8-x86_64-rpm, for RHEL9 codeready-builder-for-rhel-9-$(arch)-rpms
Philip Durbin 🚀 (Feb 06 2024 at 12:30):Hmm, I think I'd like to see rserve=false take effect. (We haven't seen that for Carlos yet, have we? I'm losing track.) Should we ask him to change vagrant.yml?
Deirdre Kirmis (Feb 06 2024 at 14:52):sorry, just got back to work .. yes, i am using aws ec2 instance .. he did mention that he is using vagrant/virtualbox .. i read about vagrant doing weird things with the group vars but not super familiar .. i can launch dataverse in virtualbox today and see what happens
Philip Durbin 🚀 (Feb 06 2024 at 14:55):That would be amazing. If it's not too much trouble.
Deirdre Kirmis (Feb 06 2024 at 15:00):yes, will do after the community meeting
Don Sizemore (Feb 06 2024 at 15:15):to my reading, he was cloning the repo inside the virtual machine. if you're using vagrant, you want tests/group_vars/vagrant.yml — though according to the docs I saw https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/blob/develop/tasks/rserve.yml#L15 is attempting to add the correct repo
Carlos Soto Mendoza (Feb 06 2024 at 19:43):In summary, what do you suggest I do?
Philip Durbin 🚀 (Feb 06 2024 at 19:45):Well, a quick thing you could try is editing vagrant.yml to see if changing rserve=false has an effect.
Carlos Soto Mendoza (Feb 06 2024 at 19:46):in vagrant.yml Rserve its in false
image.png
Philip Durbin 🚀 (Feb 06 2024 at 19:46):I'm also wondering how you plan to run Dataverse in production. As an AWS EC2 instance? (That's what we do at Harvard Dataverse.).
Philip Durbin 🚀 (Feb 06 2024 at 19:46):Basically, I'm interested in you trying something other than VirtualBox.
Carlos Soto Mendoza (Feb 06 2024 at 19:46):No we mount Dataverse in a local server trought a virtual machine management witch vSphere
Philip Durbin 🚀 (Feb 06 2024 at 19:47):Ok, so VMWare.
Philip Durbin 🚀 (Feb 06 2024 at 19:47):(It's been a while.)
Philip Durbin 🚀 (Feb 06 2024 at 19:48):What would you spin up in vSphere? Rocky 8? Is that a possiblity?
Carlos Soto Mendoza (Feb 06 2024 at 19:49):yes rocky 8 or Rhel 8 or 9, we have the license.
Philip Durbin 🚀 (Feb 06 2024 at 19:53):Ok. Do you want to try Rocky 8 in vSphere?
Deirdre Kirmis (Feb 06 2024 at 19:58):sorry all i'm finally running the install in virtualbox .. had a few meetings this morning and struggled with getting the networking correct for rocky, but it is running now .. i'm not using vagrant, though, just have VB installed in windows so may not be a comparable test
Philip Durbin 🚀 (Feb 06 2024 at 20:00):Running like, fully working? Dataverse is up in VirtualBox?
Deirdre Kirmis (Feb 06 2024 at 20:01):sorry it is still running the install of dataverse-ansible .. seems to be going okay but now just bombed on the rserve part .. going to edit the vars file and restart it .. if it runs that means it is seeing that file I think
Carlos Soto Mendoza (Feb 06 2024 at 20:04):I also only have virtual box installed on Windows, I don't know what Vagrant is about, but I don't remember using it, just a clean installation of Rocky in VB on Windows
Deirdre Kirmis (Feb 06 2024 at 20:06):yea, set install:false on rserve task in /defaults/main.yml and ran the install again and it all went fine and completed .. dataverse app is running ..
.. i think there may be something with what don was saying related to how vagrant is seeing the group vars file .. i just don't use vagrant much so not sure .. would be great if carlos could try installing in vsphere .. pretty sure i've had dataverse running okay there before we moved to aws
Deirdre Kirmis (Feb 06 2024 at 20:07):ie install using the installer directly on vmware
Carlos Soto Mendoza (Feb 06 2024 at 20:09):OK, how is that process? Do I build the Rocky machine in VSphere? and I run the ansible code?
Deirdre Kirmis (Feb 06 2024 at 20:14):yes, you have to download the iso file from here and upload it to vsphere and then create the VM specifying that OS/file.. once the VM is ready, SSH into it, update the OS, install git and ansible (i install epel-release as well) and then clone the repo; edit the dataverse/defaults/main.yml and disable the rserve task and then run the installer using the format given
Deirdre Kirmis (Feb 06 2024 at 20:14):haha that's all!
Carlos Soto Mendoza (Feb 06 2024 at 20:14):thank you i do it already
Deirdre Kirmis (Feb 06 2024 at 20:16):you may have to set up all the networking in vsphere .. not sure how your org has that all configured
Philip Durbin 🚀 (Feb 06 2024 at 20:57):@Deirdre Kirmis so it works in VirtualBox for you? And EC2? Basically, it works everywhere for you! You're good luck! :shamrock:
Deirdre Kirmis (Feb 06 2024 at 21:12):haha i'm special! :grinning_face_with_smiling_eyes: just kidding .. yes it works in aws and in virtualbox
.. i was thinking .. I wonder if the "connection=local" might be the issue with trying to install with vagrant? basically i don't know exactly how he is using vagrant to do the virtualbox install, but i believe vagrant is running on his local machine, right .. and he connects into the VB? maybe "connection=local" is confusing things? idk just guessing ?
Deirdre Kirmis (Feb 06 2024 at 21:19):sorry i'm not a vagrant user although i probably should be
Don Sizemore (Feb 07 2024 at 12:10):connection=local allows Ansible to SSH to itself, _if_ you're running the playbook on the same machine (which is the default). if you're installing in vagrant, the group_vars file to edit is tests/group_vars/vagrant.yml. if you're not in vagrant, you want to edit defaults/main.yml
Deirdre Kirmis (Feb 07 2024 at 13:47):right, sorry, i use connection=local for the normal install but haven't worked in vagrant so wasn't sure .. ignore me
Don Sizemore (Feb 07 2024 at 19:46):I'm swinging back around to my Rocky 9 Dataverse-Ansible branch today. So far, so good:
ASK [dataverse : install rserve] **********************************************
ok: [default] => {
"msg": "##### BEGIN RSERVE INSTALLATION #####"
}
TASK [dataverse : ensure EPEL is installed] ************************************
ok: [default] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []}
TASK [dataverse : RHEL8/9 need codeready-builder] ******************************
skipping: [default] => {"changed": false, "skip_reason": "Conditional result was False"}
TASK [dataverse : Rocky 8 needs powertools] ************************************
skipping: [default] => {"changed": false, "skip_reason": "Conditional result was False"}
TASK [dataverse : Rocky 9 calls it crb] ****************************************
changed: [default] => {"changed": true, "cmd": "dnf config-manager --enable crb", "delta": "0:00:00.146132", "end": "2024-02-07 19:45:02.949208", "msg": "", "rc": 0, "start": "2024-02-07 19:45:02.803076", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
TASK [dataverse : install base packages] ***************************************
Rserve is happy on Rocky 9.
Philip Durbin 🚀 (Feb 07 2024 at 19:52):Good to hear!
Don Sizemore (Feb 07 2024 at 20:16):I disabled integration tests on Rocky 9 (heh), but a basic build of develop and installation of Rserve succeeded.
Philip Durbin 🚀 (Feb 07 2024 at 20:17):Nice
Philip Durbin 🚀 (Feb 07 2024 at 20:17):I love it when stuff works :grinning:
Carlos Soto Mendoza (Feb 07 2024 at 22:15):Finally, I pulled up an instance of Rocky 8 from VSphere, and it gave me the same problem. Is there something I'm missing, something I'm doing wrong?
Captura-de-pantalla-2024-02-07-a-las-19.13.53.png
Don Sizemore (Feb 08 2024 at 12:08):@Carlos Soto Mendoza RHEL8 may well require a subscription for CRB, and you may or may not have it. It is unclear to me why your Rocky instances are seen by Ansible as RedHat instances, since my local images follow the correct path.
Philip Durbin 🚀 (Feb 08 2024 at 12:15):That's the puzzle to me... why does Carlos see messages about RHEL from Ansible when he's using Rocky. It doesn't make any sense.
Philip Durbin 🚀 (Feb 08 2024 at 12:16):@Carlos Soto Mendoza let me know if you'd like to try a traditional installation. Like we talked about, I can try to help you if our documentation is confusing: https://guides.dataverse.org/en/6.1/installation
Carlos Soto Mendoza (Feb 08 2024 at 23:58):Indeed I will have to do that, I will start trying it as soon as possible, since it has taken me a long time and I have my supervisors on top of this, demanding that it be installed
Don Sizemore (Feb 15 2024 at 14:45):@Carlos Soto Mendoza I found a missing switch in an unexpected case of my Rocky 9 branch - do a git pull and try it now?
Carlos Soto Mendoza (Feb 26 2024 at 11:02):Hi Don, I'll try it right away, I was on vacation for a few days but I'm back to resume the project.
Carlos Soto Mendoza (Feb 26 2024 at 11:23):
Hello Don, I continue to receive the same error.
Don Sizemore (Feb 26 2024 at 12:05):Hi Carlos, I found that condition (running RHEL/Rocky8 in the RHEL/Rocky9 branch) and corrected for it: https://github.com/GlobalDataverseCommunityConsortium/dataverse-ansible/commit/8b0b2e1872e1611121d2465fabef756e3ac67697
The RHEL/Rocky9 branch is merged with develop; you can either do a git pull in that Dataverse-Ansible branch, or switch to develop and be certain it's current?
Carlos Soto Mendoza (Feb 26 2024 at 12:21):Don, what tests am I doing on Rocky 8, do I ride a Rocky 9 to continue with the tests?
Philip Durbin 🚀 (Feb 26 2024 at 13:30):@Carlos Soto Mendoza which commit are you on? When you do git log.
Carlos Soto Mendoza (Feb 27 2024 at 15:01):Hi
image.png
Don Sizemore (Feb 27 2024 at 15:36):@Carlos Soto Mendoza looks like you're back on RHEL. Do you have s3.enabled set to true?
Philip Durbin 🚀 (Feb 27 2024 at 20:08):The git log output looks good. It's the latest code.
Carlos Soto Mendoza (Feb 28 2024 at 02:04):Don, where do I see the s3.enabled thing?
Carlos Soto Mendoza (Feb 28 2024 at 11:24):Don, i look in main.yml and the s3.enabled is in false
Carlos Soto Mendoza (Feb 28 2024 at 15:15):Hello, I am doing the installation step by step and when installing postgresql I have the following error.
image.png
Philip Durbin 🚀 (Feb 28 2024 at 16:36):Hmm, it seems like something happened in January: https://yum.postgresql.org/news/pgdg-rpm-repo-gpg-key-update/
Philip Durbin 🚀 (Feb 28 2024 at 16:37):Which version of RHEL or Rocky are you on? I think you want one of these:
RHEL / Rocky / AlmaLinux 9 - x86_64 : dnf --disablerepo=* -y install https://download.postgresql.org/pub/repos/yum/reporpms/EL-9-x86_64/pgdg-redhat-repo-latest.noarch.rpm
RHEL / Rocky / AlmaLinux 8 - x86_64 : dnf --disablerepo=* -y install https://download.postgresql.org/pub/repos/yum/reporpms/EL-8-x86_64/pgdg-redhat-repo-latest.noarch.rpm
Carlos Soto Mendoza (Feb 28 2024 at 18:11):thanks im working on Rocky 8
Philip Durbin 🚀 (Feb 28 2024 at 18:13):Sure. Did that dnf command help?
Carlos Soto Mendoza (Feb 28 2024 at 18:15):[image.png](/user_uploads/53090/nUy9BLtgvhKtF2j5OO_jHqnv/image.png
get the same error.
Carlos Soto Mendoza (Feb 28 2024 at 18:16):
Don Sizemore (Feb 28 2024 at 18:23):yeah, PGDG updated their signing keys. there are instruction at https://yum.postgresql.org/news/rocky-9-8-llvm-repo-is-available/
Carlos Soto Mendoza (Feb 28 2024 at 18:32):thanks i look that
Philip Durbin 🚀 (Feb 28 2024 at 18:33):Oh. Sorry for leading you wrong! :sweat_smile:
Carlos Soto Mendoza (Feb 28 2024 at 18:37):
In the link, I am asked to execute these lines of code, but when I execute them I get the GPG Signature error
Carlos Soto Mendoza (Feb 28 2024 at 18:38):Philip. don't worry i am very greatful with your help, and your time.
Don Sizemore (Feb 28 2024 at 18:44):@Carlos Soto Mendoza update the pgdg repo RPM with --nogpgcheck then mv .rpmnew on top of the repo file in /etc/yum.repos.d/
Carlos Soto Mendoza (Feb 28 2024 at 18:52):ok i do this..
image.png
wich are the next step ?
Philip Durbin 🚀 (Feb 29 2024 at 02:15):yum makecache
Philip Durbin 🚀 (Feb 29 2024 at 02:16):then
Philip Durbin 🚀 (Feb 29 2024 at 02:16):yum install -y postgresql13-server
Philip Durbin 🚀 (Feb 29 2024 at 02:16):I think. According to https://guides.dataverse.org/en/6.1/installation/prerequisites.html#installing-postgresql
Carlos Soto Mendoza (Feb 29 2024 at 12:19):image.png
sure, i follow the others steps, but i get the same problem
Don Sizemore (Feb 29 2024 at 12:42):@Carlos Soto Mendoza when you upgraded the RPM, it wrote a .rpmnew file in /etc/yum.repos.d. You have to move that file on top of the old postgres.repo file.
Philip Durbin 🚀 (Feb 29 2024 at 12:56):I would do what Don says! :grinning:
Carlos Soto Mendoza (Feb 29 2024 at 15:19):image.png
i do what Don says, and i get this message
Philip Durbin 🚀 (Feb 29 2024 at 15:34):No hay? It can't find it? Does it have a different name? Can you list the possible package names from that yum repo you added?
Carlos Soto Mendoza (Feb 29 2024 at 15:41):image.png
I already saw the error, when I run the --nogpgcheck command, it does not install any package inside yum.repos.d
Don Sizemore (Feb 29 2024 at 16:08):@Carlos Soto Mendoza the pgdg-redhat-repo RPM writes out a file called pgdg-redhat-all.repo:
$ rpm -ql pgdg-redhat-repo
/etc/pki/rpm-gpg
/etc/pki/rpm-gpg/RPM-GPG-KEY-PGDG
/etc/yum.repos.d/pgdg-redhat-all.repo
Oh, and that /etc/yum.repos.d/pgdg-redhat-all.repo file is missing on Carlos's box?
Carlos Soto Mendoza (Feb 29 2024 at 17:54):Don, i send you the result of my rpm -ql
image.png
Don Sizemore (Feb 29 2024 at 17:56):@Carlos Soto Mendoza remove the pgdg RPM, and reinstall it.
Carlos Soto Mendoza (Feb 29 2024 at 18:08):Ready, but the version of postgre is:
image.png
Don Sizemore (Feb 29 2024 at 18:09):That RPM just installs the coordinates for the Postgres RPM repository. Have you installed Postgres?
Carlos Soto Mendoza (Feb 29 2024 at 18:12):As I understand these steps that I am following are to install postgre, I am following the step by step of the installation manual, now I install postgre but in version 10, is that a problem or can I continue with the installation
Philip Durbin 🚀 (Feb 29 2024 at 18:30):Huh, can you do which psql?
Don Sizemore (Feb 29 2024 at 20:32):@Carlos Soto Mendoza you shouldn't be able to install version 10 using the repo, I think 12 is the minimum available these days. We test on 13 but you should be fine in 12.
Don Sizemore (Mar 02 2024 at 12:51):@Carlos Soto Mendoza correction: Dataverse uses the free version of FlyWay, which only supports Postgres versions which haven't reached EOL. According to their website, the minimum is now 12.
Carlos Soto Mendoza (Mar 05 2024 at 14:17):Hello, I tell you, I finally set up a virtual machine with RHEL 9, I was able to install postgre 13 without problems. I have been advancing with the prerequisites and now it tells me that I must have a dvinstall.zip file and it gives me the link to download it, I go to the link, which is this: https://github.com/IQSS/dataverse/releases, but no find the dvinstall.zip file to download
Philip Durbin 🚀 (Mar 05 2024 at 14:18):It's under "assets":
Screenshot-2024-03-05-at-8.18.19-AM.png
Carlos Soto Mendoza (Mar 05 2024 at 14:27):thanks
Carlos Soto Mendoza (Mar 05 2024 at 14:29):image.png
sorry i dont get the folder asset
Philip Durbin 🚀 (Mar 05 2024 at 15:00):How about at https://github.com/IQSS/dataverse/releases/tag/v6.1 ? At the bottom
Carlos Soto Mendoza (Mar 05 2024 at 15:01):Sorry my friend, i look in a wrong place, I already have the file
Carlos Soto Mendoza (Mar 05 2024 at 21:06):image.png
I have the following doubt with this step. Where do I download solr.service from?
Philip Durbin 🚀 (Mar 05 2024 at 21:07):Please try clicking the red text.
Carlos Soto Mendoza (Mar 05 2024 at 21:09):thanks
Carlos Soto Mendoza (Mar 05 2024 at 21:36):image.png
i have this problem when i try install jq, i try too with the epel option, but it doesn't work either
Philip Durbin 🚀 (Mar 05 2024 at 21:40):Huh. Is our documentation out of date? Did the URL change?
Philip Durbin 🚀 (Mar 05 2024 at 21:43):Please install from https://jqlang.github.io/jq/
Don Sizemore (Mar 05 2024 at 21:58):@Carlos Soto Mendoza @Philip Durbin looks like jq is available through appstream these days.
Philip Durbin 🚀 (Mar 05 2024 at 22:08):@Carlos Soto Mendoza thanks for letting us know and @Don Sizemore thanks for opening #10355
Carlos Soto Mendoza (Mar 05 2024 at 22:19):thanks i try trough jqlang.github.io and i tell you in case of success or problems
Don Sizemore (Mar 05 2024 at 22:19):@Philip Durbin I'm working on updating the docs but github.io is down =(
Carlos Soto Mendoza (Mar 05 2024 at 22:20):image.png
i try with dnf install jq and the machine response me that jq its already install :)
Carlos Soto Mendoza (Mar 05 2024 at 22:21):image.png
i work in RHEL 9
Carlos Soto Mendoza (Mar 07 2024 at 12:52):image.png
Friends, I tell you that ImageMagick is not available to be installed in RHEL 8 or 9 directly from yum or dnf. so that they update it step by step. I will try to install
Philip Durbin 🚀 (Mar 07 2024 at 12:55):Hmm, I know Don and I talked about it a bit here: support GraphicsMagick #8014
Philip Durbin 🚀 (Mar 07 2024 at 12:55):I'm not sure what the latest is.
Philip Durbin 🚀 (Mar 07 2024 at 12:56):You can probably skip it for now and circle back to it later. It just means you won't have thumbnail images.
Carlos Soto Mendoza (Mar 07 2024 at 12:56):aaaa ok. thank you i skip this step, and continue
Carlos Soto Mendoza (Mar 07 2024 at 12:57):i have other question, install R is mandatory?
Philip Durbin 🚀 (Mar 07 2024 at 12:57):no
Carlos Soto Mendoza (Mar 07 2024 at 12:59):In the steps I am missing are installing R, Rserve, Counter Processor and Geolite. Apart from R, what else is not neces
Carlos Soto Mendoza (Mar 07 2024 at 13:00):is not necessary to install?
Philip Durbin 🚀 (Mar 07 2024 at 13:34):All of those are not required.
Carlos Soto Mendoza (Mar 07 2024 at 13:38):I already finished the prerequisites and I have dvinstall unzipped in /tmp/, what is the next step? It's not clear to me with the manual
Philip Durbin 🚀 (Mar 07 2024 at 13:41):As https://guides.dataverse.org/en/6.1/installation/prerequisites.html#next-steps say, you should go to https://guides.dataverse.org/en/6.1/installation/installation-main.html
Carlos Soto Mendoza (Mar 07 2024 at 13:41):I am actually on that link, what is not clear to me is what command I should use to run the installer
Carlos Soto Mendoza (Mar 07 2024 at 13:42):
Philip Durbin 🚀 (Mar 07 2024 at 13:42):The version for developers is shorter. You could try that: https://guides.dataverse.org/en/6.1/developers/classic-dev-env.html#run-the-dataverse-software-installer-script
Philip Durbin 🚀 (Mar 07 2024 at 13:42):Shorter and probably more clear. :sweat_smile:
Carlos Soto Mendoza (Mar 07 2024 at 13:44):If I understand correctly, based on the last link you shared with me, should I clone the repository and not use the dvinstall folder?
Carlos Soto Mendoza (Mar 07 2024 at 13:56):
Philip Durbin 🚀 (Mar 07 2024 at 15:32):No, no, please use the version in the dvinstaller.zip you downloaded.
Carlos Soto Mendoza (Mar 07 2024 at 15:50):image.png
thanks Philip, i do using the version in the dvinstaller, but, i get this message
Carlos Soto Mendoza (Mar 07 2024 at 15:53):Can I send the screenshots at each installation step to know what I have to add and not make mistakes?
Philip Durbin 🚀 (Mar 07 2024 at 15:57):Sure, that's fine.
Philip Durbin 🚀 (Mar 07 2024 at 15:57):Is PostgreSQL running? Can you connect to it outside of Dataverse?
Don Sizemore (Mar 07 2024 at 16:26):@Carlos Soto Mendoza Dataverse's installer likes to be the postgres admin. You have to temporarily set authentication to trust in pg_hba.conf per the guide, or grant the postgres admin user a password and the ability to log in via localhost.
Philip Durbin 🚀 (Mar 07 2024 at 16:28):Right, that pg_hba.conf step is here: https://guides.dataverse.org/en/6.1/installation/prerequisites.html#configuring-database-access-for-the-dataverse-installation-and-the-dataverse-software-installer
Carlos Soto Mendoza (Mar 07 2024 at 16:28):image.png
this is mi pg_hba.conf file
Carlos Soto Mendoza (Mar 07 2024 at 16:31):i change replication for all and ident for trust, i run the install.py again and tell you more
Philip Durbin 🚀 (Mar 07 2024 at 16:31):Sounds good.
Philip Durbin 🚀 (Mar 07 2024 at 16:32):You might also want to try to connect to PostgreSQL outside of Dataverse. With psql, for example.
Philip Durbin 🚀 (Mar 07 2024 at 16:32):Maybe you need listen_addresses='*'. I don't know.
Carlos Soto Mendoza (Mar 07 2024 at 18:08):I think I've completed the installation correctly, but when trying to navigate to localhost:8080, the virtual machine stopped responding, so I had to shut it down. Now, upon restarting, I don't know how to check if Dataverse is running or how to bring it back up to access the software again.
Don Sizemore (Mar 07 2024 at 19:26):@Carlos Soto Mendoza did you download the systemd unit file for payara?
Carlos Soto Mendoza (Mar 08 2024 at 14:56):Hello Don, sorry, are you referring to the installation of Payara from the manual? If so, did I do it according to what the manual indicates?
Don Sizemore (Mar 08 2024 at 15:37):@Carlos Soto Mendoza you were asking whether Payara is launched after a system reboot. Did you follow the steps in https://guides.dataverse.org/en/latest/installation/prerequisites.html#launching-payara-on-system-boot ?
Carlos Soto Mendoza (Mar 08 2024 at 15:39):From what I read, this paragraph is informative, it does not indicate that something should be done.
"Launching Payara on System Boot
The Dataverse Software installation script will start Payara if necessary, but you may find the following scripts helpful to launch Payara start automatically on boot. They were originally written for Glassfish but have been adjusted for Payara.
This Systemd file may be serve as a reference for systems using Systemd (such as RHEL/derivative or Debian 10, Ubuntu 16+)
This init script may be useful for RHEL/derivative or Ubuntu >= 14 if you’re using a Payara service account, or
This Payara init script may be helpful if you’re just going to run Payara as root (not recommended).
It is not necessary for Payara to be running before you execute the Dataverse Software installation script; it will start Payara for you.
Please note that you must run Payara in an English locale. If you are using something like LANG=de_DE.UTF-8, ingest of tabular data will fail with the message “RoundRoutines:decimal separator no in right place”.
Also note that Payara may utilize more than the default number of file descriptors, especially when running batch jobs such as harvesting. We have increased ours by adding ulimit -n 32768 to our Payara init script. On operating systems which use systemd such as RHEL/derivative, file descriptor limits may be increased by adding a line like LimitNOFILE=32768 to the systemd unit file. You may adjust the file descriptor limits on running processes by using the prlimit utility:"
Don Sizemore (Mar 08 2024 at 15:52):the Dataverse installer indeed launches Payara, but does nothing to ensure that Payara starts on system boot. you likely want the payara.service systemd file linked in the text you sent.
Carlos Soto Mendoza (Mar 08 2024 at 16:20):I am reviewing the configuration again, and in this part it is how to install payara, I followed it to the letter, but it is not clear to me when the installation of it is executed, or how to check that it is installed, please help:
Install Payara
Payara 6.2023.8 or higher is required.
To install Payara, run the following commands:
cd /usr/local
sudo curl -O -L https://nexus.payara.fish/repository/payara-community/fish/payara/distributions/payara/6.2023.8/payara-6.2023.8.zip
sudo unzip payara-6.2023.8.zip
sudo chown -R $USER /usr/local/payara6
If nexus.payara.fish is ever down for maintenance, Payara distributions are also available from https://repo1.maven.org/maven2/fish/payara/distributions/payara/
Carlos Soto Mendoza (Mar 08 2024 at 17:00):Dears, thank you for all your help, i do it.
image.png
Carlos Soto Mendoza (Mar 08 2024 at 17:00):I will be eternally grateful for all the time you invested in me.
Philip Durbin 🚀 (Mar 08 2024 at 17:00)::tada:
Philip Durbin 🚀 (Mar 08 2024 at 17:01):Good job!
Last updated: Oct 30 2025 at 05:14 UTC