Arvados

Bug #18385

Updated by Ward Vandewege about 3 years ago

This was observed E.g. on ce8i5 as part of keepstore-on-the-compute-node testing in #18320 (the `keepstore.txt` file listed the about below as warnings). We reproduced it with `arvados-server config-dump | arvados-server config-check`: ce8i5: 

 <pre> 
 arvados-server config-dump | arvados-server config-check -config=- 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d2asv4.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d2asv4.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e4asv4.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e4asv4.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e8asv4.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e8asv4.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e2asv4.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.e2asv4.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a1v2.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a1v2.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a2v2.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a2v2.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a4v2.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.a4v2.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d4asv4.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d4asv4.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d8asv4.Scratch" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.InstanceTypes.d8asv4.Name" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.Users.NewInactiveUserNotificationRecipients.REDACTED@curii.com" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.Users.NewUserNotificationRecipients.REDACTED@curii.com" 
 time="2021-11-16T20:57:41Z" level=warning msg="deprecated or unknown config entry: Clusters.ce8i5.Collections.ManagedProperties.responsible_person_uuid.Value" 
 </pre> 

 All of these warnings are wrong. The keys are not invalid, and none of the InstanceType definitions have a `Name` or `Scratch` field defined. 

 Note that running `arvados-server config-check` by itself produces no output, as expected. The problem must be in the output generated by config-dump, e.g. this is the `InstanceTypes` section: 

 <pre> 
     InstanceTypes: 
       a1v2: 
         AddedScratch: 0 
         IncludedScratch: 10000000000 
         Name: a1v2 
         Preemptible: false 
         Price: 0.043 
         ProviderType: Standard_A1_v2 
         RAM: 2147483648 
         Scratch: 10000000000 
         VCPUs: 1 
       a2v2: 
         AddedScratch: 0 
         IncludedScratch: 20000000000 
         Name: a2v2 
         Preemptible: false 
         Price: 0.091 
         ProviderType: Standard_A2_v2 
         RAM: 4294967296 
         Scratch: 20000000000 
         VCPUs: 2 
 ... 
 </pre> 

 The actual config file has: 

 <pre> 
     InstanceTypes: 
       a1v2: 
         ProviderType: Standard_A1_v2 
         VCPUs: 1 
         RAM: 2GiB 
         IncludedScratch: 10GB 
         Price: 0.043 
       a2v2: 
         ProviderType: Standard_A2_v2 
         VCPUs: 2 
         RAM: 4GiB 
         IncludedScratch: 20GB 
         Price: 0.091 
 ... 
 </pre> 

 Here's the `config-dump` output for the other keys that generate warnings: 

 <pre> 
       ManagedProperties: 
         responsible_person_uuid: 
           Function: original_owner 
           Protected: true 
           Value: null 
 ... 
       NewInactiveUserNotificationRecipients: 
         REDACTED@curii.com: {} 
       NewUserNotificationRecipients: 
         REDACTED@curii.com: {} 
 </pre>

Back