Project

General

Profile

Actions

Feature #21666

open

provision.sh uses arvados-client diagnostics instead of run-test.sh

Added by Peter Amstutz 20 days ago. Updated 5 days ago.

Status:
In Progress
Priority:
Normal
Assigned To:
Category:
Deployment
Story points:
-

Description

The test-provision jenkins jobs should be running the diagnostics instead of or in addition to the hasher workflow test.


Subtasks 1 (1 open0 closed)

Task #21677: Review 21666-provision-test-improvementNewPeter AmstutzActions

Related issues

Blocked by Arvados - Bug #21657: `arvados-client diagnostics` fails trying to introspect OCIv2 Docker imageResolvedTom CleggActions
Blocked by Arvados - Feature #15397: Declutter the APIIn ProgressTom CleggActions
Actions #1

Updated by Peter Amstutz 20 days ago

  • Status changed from New to In Progress
Actions #2

Updated by Peter Amstutz 20 days ago

  • Status changed from In Progress to New
  • Category set to Deployment
  • Subject changed from Provision.sh uses arvados-client diagnostics instead of run-test.sh to provision.sh uses arvados-client diagnostics instead of run-test.sh
  • Tracker changed from Bug to Feature
Actions #3

Updated by Peter Amstutz 20 days ago

  • Blocked by Bug #21657: `arvados-client diagnostics` fails trying to introspect OCIv2 Docker image added
Actions #4

Updated by Lucas Di Pentima 19 days ago

  • Assigned To set to Lucas Di Pentima
Actions #5

Updated by Peter Amstutz 19 days ago

  • Description updated (diff)
Actions #6

Updated by Lucas Di Pentima 18 days ago

  • Status changed from New to In Progress
Actions #7

Updated by Lucas Di Pentima 13 days ago

Updates at 74de89b - branch 21666-provision-test-improvement
Tested at test-provision-ubuntu2004: #829

Updated the run-tests.sh script so that it first launches a arvados-client diagnostics test. I figured that running a complete workflow has its value too, so I just took advantage of the fact that run-tests.sh already has all the necessary credentials to run diagnostics.

The test above failed because the pipeline was run against 2.7.2 that has the issue that was fixed at #21657. I didn't run the test-provision pipeline against latest development because it would fail for other reasons that are going to be worked on in #21524.

Actions #8

Updated by Lucas Di Pentima 7 days ago

Rebased against latest main at fd79eec

Ubuntu 20.04 test: test-provision-ubuntu2004: #836
Debian 11 test: test-provision-debian11: #666

Actions #9

Updated by Lucas Di Pentima 7 days ago

arvados-client diagnostics failed in the same way on both tests above: "health check: arvados-git-httpd: MISSING: no InternalURLs configured"

Actions #10

Updated by Lucas Di Pentima 7 days ago

Ran arvados-server check on api.tordo and it seems we have some kind of bug that makes this check to fail:

# arvados-server check
WARN[2024-04-22T14:48:51.413534949Z] deprecated or unknown config entry: Clusters.tordo.Workbench.MultiSiteSearch
WARN[2024-04-22T14:48:51.413613550Z] deprecated or unknown config entry: Clusters.tordo.Workbench.SecretKeyBase
arvados-git-httpd: MISSING: no InternalURLs configured
outdated config: arvados-controller+http://localhost:8003: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: arvados-api-server+http://localhost:8004: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: arvados-dispatch-cloud+http://tordo.arvadosapi.com:9006: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: keepstore+http://keep0.tordo.arvadosapi.com:25107: config file (sha256 d88cf7a6e35fa6a9b849b40649390cc93e3d65c448da319bf6d5b64dcaad1cf2) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: arvados-ws+http://localhost:8005: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
outdated config: keep-balance+http://tordo.arvadosapi.com:9005: config file (sha256 c7910043d56e5b6db597bd677d41990c8126f6502b126ce7d798a3322cf5db30) does not match latest version with timestamp 2024-03-27T15:29:22Z
health check failed
Actions #11

Updated by Lucas Di Pentima 7 days ago

Actions #12

Updated by Lucas Di Pentima 7 days ago

jutro also fails this check. As arvados-git-httpd will get removed on #15397, we should wait for it to be merged.

Actions #13

Updated by Peter Amstutz 5 days ago

  • Target version changed from Development 2024-04-24 sprint to Development 2024-05-08 sprint
Actions

Also available in: Atom PDF