Bug #18385

arvados-server config-dump | arvados-server config-check -config=- spurious warnings

Added by Ward Vandewege 2 months ago. Updated 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

This was observed on ce8i5 as part of keepstore-on-the-compute-node testing in #18320 (the `keepstore.txt` file listed the about below as warnings). We reproduced it with `arvados-server config-dump | arvados-server config-check`:

arvados-server config-dump | arvados-server config-check -config=-
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d2asv4.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d2asv4.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e4asv4.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e4asv4.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e8asv4.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e8asv4.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e2asv4.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e2asv4.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a1v2.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a1v2.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a2v2.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a2v2.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a4v2.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a4v2.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d4asv4.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d4asv4.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d8asv4.Scratch" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d8asv4.Name" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.Users.NewInactiveUserNotificationRecipients.REDACTED@curii.com" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.Users.NewUserNotificationRecipients.REDACTED@curii.com" 
time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.Collections.ManagedProperties.responsible_person_uuid.Value" 

All of these warnings are wrong. The keys are not invalid, and none of the InstanceType definitions have a `Name` or `Scratch` field defined.

Note that running `arvados-server config-check` by itself produces no output, as expected. The problem must be in the output generated by config-dump, e.g. this is the `InstanceTypes` section:

    InstanceTypes:
      a1v2:
        AddedScratch: 0
        IncludedScratch: 10000000000
        Name: a1v2
        Preemptible: false
        Price: 0.043
        ProviderType: Standard_A1_v2
        RAM: 2147483648
        Scratch: 10000000000
        VCPUs: 1
      a2v2:
        AddedScratch: 0
        IncludedScratch: 20000000000
        Name: a2v2
        Preemptible: false
        Price: 0.091
        ProviderType: Standard_A2_v2
        RAM: 4294967296
        Scratch: 20000000000
        VCPUs: 2
...

The actual config file has:

    InstanceTypes:
      a1v2:
        ProviderType: Standard_A1_v2
        VCPUs: 1
        RAM: 2GiB
        IncludedScratch: 10GB
        Price: 0.043
      a2v2:
        ProviderType: Standard_A2_v2
        VCPUs: 2
        RAM: 4GiB
        IncludedScratch: 20GB
        Price: 0.091
...

Here's the `config-dump` output for the other keys that generate warnings:

      ManagedProperties:
        responsible_person_uuid:
          Function: original_owner
          Protected: true
          Value: null
...
      NewInactiveUserNotificationRecipients:
        REDACTED@curii.com: {}
      NewUserNotificationRecipients:
        REDACTED@curii.com: {}

Related issues

Related to Arvados - Support #18320: Run chr19 WGS test on ce8i5 to test compute-local keepstoreResolved

History

#1 Updated by Ward Vandewege 2 months ago

  • Description updated (diff)

#2 Updated by Ward Vandewege 2 months ago

  • Related to Support #18320: Run chr19 WGS test on ce8i5 to test compute-local keepstore added

#3 Updated by Ward Vandewege 2 months ago

  • Description updated (diff)

Also available in: Atom PDF