Bug #19127
Updated by Ward Vandewege almost 2 years ago
Observed on Arvados 2.4.0 on pirca, e.g. pirca-xvhdp-m1mdkxyqugein4m
These warnings get logged in the container logs under these circumstances:
Config:
<pre>
Containers:
PreemptiblePriceFactor: 1
LocalKeepLogsToContainerLog: errors
</pre>
Warnings:
<pre>
2022-05-11T19:12:59.961853108Z starting keepstore on http://localhost:42569
2022-05-11T19:12:59.961889139Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c52xlarge.Scratch","time":"2022-05-11T19:12:59.374860700Z"}
2022-05-11T19:12:59.961898898Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c52xlarge.Name","time":"2022-05-11T19:12:59.374935708Z"}
2022-05-11T19:12:59.961908852Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c54xlarge.Name","time":"2022-05-11T19:12:59.374964424Z"}
2022-05-11T19:12:59.961918521Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c54xlarge.Scratch","time":"2022-05-11T19:12:59.374988872Z"}
2022-05-11T19:12:59.961927672Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g52xlarge.preemptible.Name","time":"2022-05-11T19:12:59.375745729Z"}
2022-05-11T19:12:59.961935857Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g52xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.375953678Z"}
2022-05-11T19:12:59.961957863Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g54xlarge.Name","time":"2022-05-11T19:12:59.376123687Z"}
2022-05-11T19:12:59.961964834Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g54xlarge.Scratch","time":"2022-05-11T19:12:59.376285332Z"}
2022-05-11T19:12:59.961973470Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.inf16xlarge.preemptible.Name","time":"2022-05-11T19:12:59.376450316Z"}
2022-05-11T19:12:59.961980428Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.inf16xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.376619218Z"}
2022-05-11T19:12:59.961989254Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5large.Scratch","time":"2022-05-11T19:12:59.376796323Z"}
2022-05-11T19:12:59.961998393Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5large.Name","time":"2022-05-11T19:12:59.376989255Z"}
2022-05-11T19:12:59.962004546Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g58xlarge.preemptible.Name","time":"2022-05-11T19:12:59.377145316Z"}
2022-05-11T19:12:59.962012511Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g58xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.377301156Z"}
2022-05-11T19:12:59.962034722Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge_extradisk.Name","time":"2022-05-11T19:12:59.377478606Z"}
2022-05-11T19:12:59.962043258Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge_extradisk.Scratch","time":"2022-05-11T19:12:59.377632135Z"}
2022-05-11T19:12:59.962078491Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c54xlarge.preemptible.Name","time":"2022-05-11T19:12:59.377820339Z"}
2022-05-11T19:12:59.962102477Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c54xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.377991277Z"}
2022-05-11T19:12:59.962109769Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m52xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.378155300Z"}
2022-05-11T19:12:59.962117943Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m52xlarge.preemptible.Name","time":"2022-05-11T19:12:59.378307037Z"}
2022-05-11T19:12:59.962124702Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5large.preemptible.Scratch","time":"2022-05-11T19:12:59.378462819Z"}
2022-05-11T19:12:59.962134576Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5large.preemptible.Name","time":"2022-05-11T19:12:59.378615162Z"}
2022-05-11T19:12:59.962146387Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge_extradisk.preemptible.Name","time":"2022-05-11T19:12:59.378769767Z"}
2022-05-11T19:12:59.962155085Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge_extradisk.preemptible.Scratch","time":"2022-05-11T19:12:59.378926964Z"}
2022-05-11T19:12:59.962161833Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.t3small.Name","time":"2022-05-11T19:12:59.379080403Z"}
2022-05-11T19:12:59.962183550Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.t3small.Scratch","time":"2022-05-11T19:12:59.379286475Z"}
2022-05-11T19:12:59.962190470Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c52xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.379332414Z"}
2022-05-11T19:12:59.962204018Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c52xlarge.preemptible.Name","time":"2022-05-11T19:12:59.379378580Z"}
2022-05-11T19:12:59.962211510Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g52xlarge.Name","time":"2022-05-11T19:12:59.379405404Z"}
2022-05-11T19:12:59.962219782Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g52xlarge.Scratch","time":"2022-05-11T19:12:59.379426468Z"}
2022-05-11T19:12:59.962227280Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m54xlarge.Scratch","time":"2022-05-11T19:12:59.379448616Z"}
2022-05-11T19:12:59.962237904Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m54xlarge.Name","time":"2022-05-11T19:12:59.379467450Z"}
2022-05-11T19:12:59.962260826Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5large.preemptible.Scratch","time":"2022-05-11T19:12:59.379512398Z"}
2022-05-11T19:12:59.962269791Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5large.preemptible.Name","time":"2022-05-11T19:12:59.379537204Z"}
2022-05-11T19:12:59.962276352Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g54xlarge.preemptible.Name","time":"2022-05-11T19:12:59.379558744Z"}
2022-05-11T19:12:59.962285306Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g54xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.379578922Z"}
2022-05-11T19:12:59.962293162Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m54xlarge.preemptible.Name","time":"2022-05-11T19:12:59.379622906Z"}
2022-05-11T19:12:59.962308322Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m54xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.379646674Z"}
2022-05-11T19:12:59.962315887Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g5xlarge.Name","time":"2022-05-11T19:12:59.379668849Z"}
2022-05-11T19:12:59.962339655Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g5xlarge.Scratch","time":"2022-05-11T19:12:59.379712975Z"}
2022-05-11T19:12:59.962346432Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g5xlarge.preemptible.Name","time":"2022-05-11T19:12:59.379738887Z"}
2022-05-11T19:12:59.962359248Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g5xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.379758653Z"}
2022-05-11T19:12:59.962364123Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5large.Name","time":"2022-05-11T19:12:59.379780002Z"}
2022-05-11T19:12:59.962381293Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5large.Scratch","time":"2022-05-11T19:12:59.379833750Z"}
2022-05-11T19:12:59.962388598Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.t3small.preemptible.Name","time":"2022-05-11T19:12:59.379855657Z"}
2022-05-11T19:12:59.962396513Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.t3small.preemptible.Scratch","time":"2022-05-11T19:12:59.379905486Z"}
2022-05-11T19:12:59.962417432Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.inf16xlarge.Name","time":"2022-05-11T19:12:59.379930223Z"}
2022-05-11T19:12:59.962427236Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.inf16xlarge.Scratch","time":"2022-05-11T19:12:59.379955265Z"}
2022-05-11T19:12:59.962434348Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.379976380Z"}
2022-05-11T19:12:59.962444912Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge.preemptible.Name","time":"2022-05-11T19:12:59.379997807Z"}
2022-05-11T19:12:59.962452483Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5xlarge.Scratch","time":"2022-05-11T19:12:59.380044466Z"}
2022-05-11T19:12:59.962460825Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5xlarge.Name","time":"2022-05-11T19:12:59.380099065Z"}
2022-05-11T19:12:59.962468509Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5xlarge.preemptible.Name","time":"2022-05-11T19:12:59.380150390Z"}
2022-05-11T19:12:59.962494344Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.c5xlarge.preemptible.Scratch","time":"2022-05-11T19:12:59.380172697Z"}
2022-05-11T19:12:59.962502201Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g58xlarge.Name","time":"2022-05-11T19:12:59.380194002Z"}
2022-05-11T19:12:59.962511181Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.g58xlarge.Scratch","time":"2022-05-11T19:12:59.380238818Z"}
2022-05-11T19:12:59.962518448Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m52xlarge.Name","time":"2022-05-11T19:12:59.380263034Z"}
2022-05-11T19:12:59.962526997Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m52xlarge.Scratch","time":"2022-05-11T19:12:59.380282939Z"}
2022-05-11T19:12:59.962534002Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge.Scratch","time":"2022-05-11T19:12:59.380326160Z"}
2022-05-11T19:12:59.962543591Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.InstanceTypes.m5xlarge.Name","time":"2022-05-11T19:12:59.380349136Z"}
2022-05-11T19:12:59.962550634Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.Users.UserNotifierEmailBcc.info@curii.com","time":"2022-05-11T19:12:59.380390762Z"}
2022-05-11T19:12:59.962573121Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.Users.NewUserNotificationRecipients.playground@curii.com","time":"2022-05-11T19:12:59.380438381Z"}
2022-05-11T19:12:59.962592406Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.Users.NewUserNotificationRecipients.sysadmin+PIRCA@curii.com","time":"2022-05-11T19:12:59.380458961Z"}
2022-05-11T19:12:59.962601848Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.Users.NewInactiveUserNotificationRecipients.playground@curii.com","time":"2022-05-11T19:12:59.380487479Z"}
2022-05-11T19:12:59.962610289Z {"level":"warning","msg":"deprecated or unknown config entry: Clusters.pirca.Users.NewInactiveUserNotificationRecipients.sysadmin+PIRCA@curii.com","time":"2022-05-11T19:12:59.380541614Z"}
2022-05-11T19:12:59.962622666Z {"ClusterID":"pirca","PID":1682,"level":"info","msg":"keepstore 2.4.0 (go1.17.1) starting, pid 1682","time":"2022-05-11T19:12:59.391936777Z"}
2022-05-11T19:12:59.962646332Z {"ClusterID":"pirca","PID":1682,"level":"info","msg":"started volume pirca-nyw5e-000000000000000 (s3-bucket:\"pirca-nyw5e-000000000000000-volume\"), ReadOnly=false","time":"2022-05-11T19:12:59.392114368Z"}
2022-05-11T19:12:59.962663470Z {"ClusterID":"pirca","Listen":"127.0.0.1:42569","PID":1682,"Service":"keepstore","URL":"http://localhost:42569/","level":"info","msg":"listening","time":"2022-05-11T19:12:59.538837708Z"}
2022-05-11T19:12:59.961214904Z using local keepstore process (pid 1682) at http://localhost:42569, writing logs to keepstore.txt in log collection
2022-05-11T19:13:02.946896108Z crunch-run 2.4.0 (go1.17.1) started
2022-05-11T19:13:02.947553420Z crunch-run process has uid=0(root) gid=0(root) groups=0(root)
2022-05-11T19:13:02.947571669Z Executing container 'pirca-dz642-mufa2uvwonyri0s' using docker runtime
2022-05-11T19:13:02.947581564Z Executing on host 'ip-10-254-254-115'
2022-05-11T19:13:03.054213584Z container token "v2/pirca-gj3su-07dfbqhvkvb9ksh/2nms9f8otf3x4jcfqd6h79eycble41tf6ynfeactoyb8r032st/pirca-dz642-mufa2uvwonyri0s"
...
</pre>