Arvados

Updates at 74de89b - branch 21666-provision-test-improvement
Tested at test-provision-ubuntu2004: #829

Updated the run-tests.sh script so that it first launches a arvados-client diagnostics test. I figured that running a complete workflow has its value too, so I just took advantage of the fact that run-tests.sh already has all the necessary credentials to run diagnostics.

The test above failed because the pipeline was run against 2.7.2 that has the issue that was fixed at #21657. I didn't run the test-provision pipeline against latest development because it would fail for other reasons that are going to be worked on in #21524.

Rebased against latest main at fd79eec

Ubuntu 20.04 test: test-provision-ubuntu2004: #836
Debian 11 test: test-provision-debian11: #666

arvados-client diagnostics failed in the same way on both tests above: "health check: arvados-git-httpd: MISSING: no InternalURLs configured"

Ran arvados-server check on api.tordo and it seems we have some kind of bug that makes this check to fail:

# arvados-server check
WARN[2024-04-22T14:48:51.413534949Z] deprecated or unknown config entry: Clusters.tordo.Workbench.MultiSiteSearch
WARN[2024-04-22T14:48:51.413613550Z] deprecated or unknown config entry: Clusters.tordo.Workbench.SecretKeyBase
arvados-git-httpd: MISSING: no InternalURLs configured
outdated config: arvados-controller+http://localhost:8003: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: arvados-api-server+http://localhost:8004: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: arvados-dispatch-cloud+http://tordo.arvadosapi.com:9006: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: keepstore+http://keep0.tordo.arvadosapi.com:25107: config file (sha256 d88cf7a6e35fa6a9b849b40649390cc93e3d65c448da319bf6d5b64dcaad1cf2) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: arvados-ws+http://localhost:8005: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: keep-balance+http://tordo.arvadosapi.com:9005: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
health check failed

jutro also fails this check. As arvados-git-httpd will get removed on #15397, we should wait for it to be merged.

Rebased against latest main at 5398cf1

Ubuntu 20.04 test: test-provision-ubuntu2004: #852
Debian 11 test: test-provision-debian11: #682

Lucas Di Pentima wrote in #note-14:

Rebased against latest main at 5398cf1

Thanks. I propose a small update to the help message in d16438225776930232f9aae1c8a364c303afb449. If that looks good to you, this looks good to me.