Irods server updates

[dometto]

No description provided.

[chStaiger]

This somehow goes wrong.
Although the host name is irodstrainiu11.researchcloudde.src.surf-hosted.nl the irods config files always mention irodstrainiu11-researchcloudde-src-surf-hosted-nl

[dometto]

This is indeed very odd. I've added a task to debug, we can see if the various fqdn's passed to the playbook and role are ok. One thing I'm wondering about is if the hostname of the machine is updated by cloud init at some point, which means that we're passing the old name to the playbook or something.

06a6401

If you could try launching a new machine (catalog item "iRODS Server Training" or "Training Server", I forget! 😄 ), you can checkout the contents of /root/irods_debug.tx (NB.tx not .txt, I made a typo) and see if everything is alright there! No rush of course.

[chStaiger]

Somehow the server name is still an issue.
Although the hostname is the fqdn, the logs and the irods (server) configuration files still mention the fqdn where all . are replaced with ,.
That also happens in the journalctl:

Mar 25 07:09:51 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsDelayServer[11602]:

Mar 25 07:24:06 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsDelayServer[11602]: {"log_category":"delay_server","log_level":"error","log_message":"iRODS Exception:\n    file: /irods_source/lib/core/src/client_connection.cpp\n    function: void irods::experimental::client_connection::only_connect(const std::string &, const int, const fully_qualified_username &)\n    line: 181\n    code: -303000 (USER_RODS_HOSTNAME_ERR)\n    message:\n        _rcConnect: setRhostInfo failed\n\nstack trace:\n--------------\n 0# irods::stacktrace::dump[abi:cxx11]() const in /lib/libirods_common.so.5.0.2\n 1# irods::exception::assemble_full_display_what() const in /lib/libirods_common.so.5.0.2\n 2# irods::exception::what() const in /lib/libirods_common.so.5.0.2\n 3# main in /usr/sbin/irodsDelayServer\n 4#>
Mar 25 07:24:09 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsServer[11583]: {"log_category":"legacy","log_level":"error","log_message":"getaddrinfo_with_retry address resolution timeout [irodstrainiu11-researchcloudde-src-surf-hosted-nl] [ai_flags: [0] ai_family: [2] ai_socktype: [0] ai_protocol: [0]]","server_host":"irodstrainiu11-researchcloudde-src-surf-hosted-nl","server_pid":11583,"server_timestamp":"2026-03-25T06:24:09.528Z","server_type":"server","server_zone":"tempZone"}
Mar 25 07:24:09 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsServer[11583]: {"log_category":"legacy","log_level":"error","log_message":"_rcConnect: setRhostInfo error, IRODS_HOST is probably not set correctly status = -303000 USER_RODS_HOSTNAME_ERR","server_host":"irodstrainiu11-researchcloudde-src-surf-hosted-nl","server_pid":11583,"server_timestamp":"2026-03-25T06:24:09.528Z","server_type":"server","server_zone":"tempZone"}
Mar 25 07:24:09 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsServer[11583]: {"log_category":"server","log_level":"error","log_message":"migrate_and_launch_delay_server: USER_RODS_HOSTNAME_ERR: _rcConnect: setRhostInfo failed\n\n\n","server_host":"irodstrainiu11-researchcloudde-src-surf-hosted-nl","server_pid":11583,"server_timestamp":"2026-03-25T06:24:09.528Z","server_type":"server","server_zone":"tempZone"}
Mar 25 07:24:51 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsServer[11583]: {"log_category":"legacy","log_level":"error","log_message":"getaddrinfo_with_retry address resolution timeout [irodstrainiu11-researchcloudde-src-surf-hosted-nl] [ai_flags: [0] ai_family: [2] ai_socktype: [0] ai_protocol: [0]]","server_host":"irodstrainiu11-researchcloudde-src-surf-hosted-nl","server_pid":11583,"server_timestamp":"2026-03-25T06:24:51.264Z","server_type":"server","server_zone":"tempZone"}
Mar 25 07:24:51 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsServer[11583]: {"log_category":"legacy","log_level":"error","log_message":"_rcConnect: setRhostInfo error, IRODS_HOST is probably not set correctly status = -303000 USER_RODS_HOSTNAME_ERR","server_host":"irodstrainiu11-researchcloudde-src-surf-hosted-nl","server_pid":11583,"server_timestamp":"2026-03-25T06:24:51.264Z","server_type":"server","server_zone":"tempZone"}
Mar 25 07:24:51 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsServer[11583]: {"log_category":"server","log_level":"error","log_message":"migrate_and_launch_delay_server: USER_RODS_HOSTNAME_ERR: _rcConnect: setRhostInfo failed\n\n\n","server_host":"irodstrainiu11-researchcloudde-src-surf-hosted-nl","server_pid":11583,"server_timestamp":"2026-03-25T06:24:51.264Z","server_type":"server","server_zone":"tempZone"}
Mar 25 07:25:06 irodstrainiu11.researchcloudde.src.surf-hosted.nl irodsDelayServer[11602]: {"log_category":"legacy","log_level":"error","log_message":"getaddrinfo_with_retry address resolution timeout [irodstrainiu11-researchcloudde-src-surf-hosted-nl] [ai_flags: [0] ai_family: [2] ai_socktype: [0] ai_protocol: [0]]","server_host":"irodstrainiu11-researchcloudde-src-surf-hosted-nl","server_pid":11602,"server_timestamp":"2026-03-25T06:25:06.804Z","server_type":"delay_server","server_zone":"tempZone"}

[dometto]

@chStaiger while I am on holiday you could try to disentable the v4 and v5 config templates. At the moment I based my version of the v5 template on Ton's v4 template. That means there are probably many duplicate settings in there, that used to be supported in 4 but are no longer in 5. You could try to find a schema for v4 and fix the v5 template in that way. Or just start with a v5 template of course!

That will probably make the situation with the hostname easier to debug.

You can debug by trying to pass different values for workspace_fqdn to the playbook, if you're running this manually on a workspace. Steps:

1. Activate the /etc/src/venv/src-venv venv so you have ansible
2. From the root of this repository (your fork presumably) ansible-playbook -i localhost, -c local -vv -e "workspace_fqdn=myfqdn playbooks/irods_server.yml