Bug #16723
closed[a-d-c] flaky test "Error: container completed twice"
Description
See e.g. developer-run-tests-remainder: #2092 /consoleFull, full text below:
16:47:59 ---------------------------------------------------------------------- 16:47:59 FAIL: dispatcher_test.go:111: DispatcherSuite.TestDispatchToStubDriver 16:47:59 16:47:59 time="2020-08-15T20:47:57.179005509Z" level=info msg="loaded initial instance list" N=0 16:47:59 time="2020-08-15T20:47:57.179613103Z" level=info msg="FixStaleLocks starting." 16:47:59 time="2020-08-15T20:47:57.179638112Z" level=info msg="FixStaleLocks finished (25.216µs), starting scheduling." 16:47:59 time="2020-08-15T20:47:57.181445597Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000040 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181480067Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000120 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181496865Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000100 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181512561Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000140 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181524908Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000080 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181566826Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000060 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181582562Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000020 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181597172Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000200 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181611506Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000160 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181639695Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.181750154Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000180 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181781137Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000179 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.181803283Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000159 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181818294Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000079 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181832841Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000139 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.181847754Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000099 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181868298Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000199 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181890166Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000119 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181903620Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000039 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.181921898Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000059 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.181937265Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000138 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181954332Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000098 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.181971124Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000018 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.181988509Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000178 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.182004089Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000078 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182020560Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000118 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182035970Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000198 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182049849Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000038 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182084746Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000037 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182112449Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000137 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182128108Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000177 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182142348Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000097 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.182157339Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000017 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182171760Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000197 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182197524Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000057 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182211989Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000096 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182226397Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000036 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182242502Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000076 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182258190Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000056 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182277222Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000136 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182292552Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000196 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182313323Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000156 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182330560Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000176 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182349197Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000115 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182362971Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000175 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182377499Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000095 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182390795Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000015 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182405161Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000035 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182419104Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000075 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182435539Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000195 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182452454Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000155 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182466434Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000135 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182482294Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000194 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182497914Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000034 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.182510746Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000054 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182546002Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000094 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182565227Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000134 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182580320Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000174 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182594562Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000114 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182607229Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000193 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.182628391Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000033 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182642917Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000153 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182657209Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000093 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182670785Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000073 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.182684117Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000133 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182700260Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000173 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182710746Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000013 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182726317Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000053 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.182741169Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000113 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182758145Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000012 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182775709Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000172 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182789363Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000192 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182801390Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000152 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182814830Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000112 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182830268Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000052 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182846100Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000132 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182866155Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000092 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.182876037Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000071 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182883352Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000131 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.182891934Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000111 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.182899923Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000091 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.183587419Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.183776308Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000191 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.183804203Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000011 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.183821957Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000171 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.183853259Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000151 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.183877043Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000070 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.183892958Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000110 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.183919950Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000010 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.183940384Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000030 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.183961210Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000170 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.183977663Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000090 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.183996903Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000190 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.184016362Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000150 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.184033250Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000129 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.184054562Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000049 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.184076965Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000169 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.184097394Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000109 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.184124473Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000029 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.184144423Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000089 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.184161223Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000069 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.184181833Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000189 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.184202667Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000009 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.184229613Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000148 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.184248313Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000068 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.184270097Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000168 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.184290196Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000008 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.184305560Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000128 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.184329876Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000088 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.184427154Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000028 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.184455271Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000007 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.184485498Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000027 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.184509889Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000147 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.184535366Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000087 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.184561309Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000047 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.184583117Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000187 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.184606484Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000126 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185185214Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000066 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.185236600Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000146 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.185259449Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000086 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185275459Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000106 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.185310664Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000145 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.185327894Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000005 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185344766Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000085 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185364164Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000125 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185379620Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000124 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.185402581Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000144 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.185422348Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000184 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.185439319Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.185520275Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000164 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.185554680Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000004 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.185568418Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.185580475Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.185597204Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000083 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.185614942Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000123 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.185641260Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000043 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.185663429Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.185684721Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000182 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185715542Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000022 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185731742Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000062 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185747392Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185764743Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.185780379Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185801356Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185818486Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.185835120Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.186524490Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000087 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.186560342Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000067 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.186576679Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000007 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.186594853Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000127 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.186612197Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000146 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.186635503Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000106 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.186655278Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000026 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.186672106Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000186 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.186693158Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000105 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.186709138Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000025 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.186725921Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000185 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.186741913Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000145 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.186758662Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000125 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.186773686Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000045 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.186788092Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000065 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.186798459Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.186874794Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000085 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.186894352Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000165 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.186908677Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000024 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.186922852Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000104 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.186936450Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000084 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.186949920Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000144 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.186965192Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000164 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.186979119Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000064 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.186992307Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000184 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.187002650Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000004 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187032656Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000124 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187046945Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000044 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187060150Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.187073532Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000043 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.187087528Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000083 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.187120590Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.187141405Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.187153065Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.187162073Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000123 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187172292Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000003 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187185868Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.187198689Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000163 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.187211756Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000042 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187224365Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000102 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187239290Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000162 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187254568Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000182 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187270157Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000022 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187285375Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000002 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.187300942Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000142 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187317000Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000062 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187330342Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000082 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.187368616Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000122 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.187384092Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.187398891Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.187415798Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.187430210Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.187444292Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187457600Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187474819Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187491140Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.187504200Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.187519621Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.188812875Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.192091749Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.193025781Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-1bf98be2a9d78d73 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.203177464Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.205422282Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.206874877Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.209284468Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.210739742Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.217025399Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.219350386Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.219380736Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.190661535 +0000 UTC m=+0.019495969" 16:47:59 time="2020-08-15T20:47:57.220092789Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-45a6e3cafccae224 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.220884634Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.220902665Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.190937393 +0000 UTC m=+0.019771817" 16:47:59 time="2020-08-15T20:47:57.223171000Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.224215606Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.226080843Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-2e4fa459169873f5 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.228399358Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.233280340Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.235403671Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.237431883Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.227029896 +0000 UTC m=+0.055864311" 16:47:59 time="2020-08-15T20:47:57.238074252Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.238773046Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.239352144Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.241241070Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.195485428 +0000 UTC m=+0.024319895" 16:47:59 time="2020-08-15T20:47:57.241397311Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.241411584Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.207587257 +0000 UTC m=+0.036421725" 16:47:59 time="2020-08-15T20:47:57.244327539Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-36d467a4af63e58d InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.244857077Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.245288841 +0000 UTC m=+0.074123262" 16:47:59 time="2020-08-15T20:47:57.244901095Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="394.209µs" ResumeAt="2020-08-15 20:47:57.245288841 +0000 UTC m=+0.074123262" 16:47:59 time="2020-08-15T20:47:57.246931115Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.248035707Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.251649805Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-76a780ea967cd710 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.252743963Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.255382946Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.256749091Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.256930524Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-1bf98be2a9d78d73 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.256946870Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-1bf98be2a9d78d73 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.209655881 +0000 UTC m=+0.038490321" 16:47:59 time="2020-08-15T20:47:57.259138944Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.261602293Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-af2560383d17909 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.261902556Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.261937562Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.204287991 +0000 UTC m=+0.033122446" 16:47:59 time="2020-08-15T20:47:57.263857692Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.263875231Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.203339589 +0000 UTC m=+0.032174012" 16:47:59 time="2020-08-15T20:47:57.268004546Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-1e503382be14186f InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.280061129Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1e925507c051e18a InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.280228682Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.281008647 +0000 UTC m=+0.109843060" 16:47:59 time="2020-08-15T20:47:57.280280546Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="734.179µs" ResumeAt="2020-08-15 20:47:57.281008647 +0000 UTC m=+0.109843060" 16:47:59 time="2020-08-15T20:47:57.280727153Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.281008647 +0000 UTC m=+0.109843060" 16:47:59 time="2020-08-15T20:47:57.280754848Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="257.276µs" ResumeAt="2020-08-15 20:47:57.281008647 +0000 UTC m=+0.109843060" 16:47:59 time="2020-08-15T20:47:57.280975598Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-1bf98be2a9d78d73 InstanceType=type8 error="Process exited with status 2" stderr="cannot fork\n" stdout= 16:47:59 time="2020-08-15T20:47:57.281469122Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.281499200Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.285571288Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.290216005Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.290520653Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.290546064Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.216767195 +0000 UTC m=+0.045601635" 16:47:59 time="2020-08-15T20:47:57.290736033Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.291181597 +0000 UTC m=+0.120016030" 16:47:59 time="2020-08-15T20:47:57.290763741Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="421.146µs" ResumeAt="2020-08-15 20:47:57.291181597 +0000 UTC m=+0.120016030" 16:47:59 time="2020-08-15T20:47:57.291739506Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.291757547Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.219113401 +0000 UTC m=+0.047947852" 16:47:59 time="2020-08-15T20:47:57.292787058Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.293001596Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.293017932Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.216916337 +0000 UTC m=+0.045750829" 16:47:59 time="2020-08-15T20:47:57.293870694Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.296763374Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.296801677Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.280917045 +0000 UTC m=+0.109751568" 16:47:59 time="2020-08-15T20:47:57.298526101Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-346e5f29ae10a901 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.299553332Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.300713331Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.304866319Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.310214026Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-685f325712f4128d InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.310274825Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.283000722 +0000 UTC m=+0.111835157" 16:47:59 time="2020-08-15T20:47:57.314144122Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.314918007Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.314972176 +0000 UTC m=+0.143806594" 16:47:59 time="2020-08-15T20:47:57.314964243Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="15.408µs" ResumeAt="2020-08-15 20:47:57.314972176 +0000 UTC m=+0.143806594" 16:47:59 time="2020-08-15T20:47:57.315150306Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.315206474Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.309563799 +0000 UTC m=+0.138398231" 16:47:59 time="2020-08-15T20:47:57.315362217Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.315386954Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.282704849 +0000 UTC m=+0.111539300" 16:47:59 time="2020-08-15T20:47:57.315721891Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.317243777Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.317638467Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.322965501Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.323037722Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.324438208Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.324786366Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.32539678 +0000 UTC m=+0.154231201" 16:47:59 time="2020-08-15T20:47:57.324817711Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="583.572µs" ResumeAt="2020-08-15 20:47:57.32539678 +0000 UTC m=+0.154231201" 16:47:59 time="2020-08-15T20:47:57.325664700Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.329954617Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.330784728Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.310408284 +0000 UTC m=+0.139242731" 16:47:59 time="2020-08-15T20:47:57.334804677Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.334830803Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:57.241202999 +0000 UTC m=+0.070037448" 16:47:59 time="2020-08-15T20:47:57.338569028Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-601900fb4ffbf3a9 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.339424617Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.339444692Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.30065837 +0000 UTC m=+0.129492822" 16:47:59 time="2020-08-15T20:47:57.342984585Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-505ce263e2d6a9ce InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.343146557Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.343182141Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.339990285 +0000 UTC m=+0.168824704" 16:47:59 time="2020-08-15T20:47:57.343218097Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.339990285 +0000 UTC m=+0.168824704" 16:47:59 time="2020-08-15T20:47:57.343245576Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.339990285 +0000 UTC m=+0.168824704" 16:47:59 time="2020-08-15T20:47:57.344097078Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.344120970Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.344137565Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.346388741Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.348072785Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.355795027Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.356155593Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.351884348 +0000 UTC m=+0.180718793" 16:47:59 time="2020-08-15T20:47:57.356697291Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.357639400Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.357664040Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.328924901 +0000 UTC m=+0.157759406" 16:47:59 time="2020-08-15T20:47:57.357799640Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.357911820Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.357926101Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.255480084 +0000 UTC m=+0.084314558" 16:47:59 time="2020-08-15T20:47:57.357807028Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.358165119Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 ProbeStart="2020-08-15 20:47:57.265925086 +0000 UTC m=+0.094759510" 16:47:59 time="2020-08-15T20:47:57.358441626Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.358456107Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.323681316 +0000 UTC m=+0.152515762" 16:47:59 time="2020-08-15T20:47:57.358910484Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.358934920Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.248911511 +0000 UTC m=+0.077745966" 16:47:59 time="2020-08-15T20:47:57.359459382Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.359495794Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.260241411 +0000 UTC m=+0.089075862" 16:47:59 time="2020-08-15T20:47:57.363772449Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-32560c7a67588a74 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.364965485Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-53b7a0ff70658b94 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.365127177Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.365932929 +0000 UTC m=+0.194767349" 16:47:59 time="2020-08-15T20:47:57.365154844Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="781.678µs" ResumeAt="2020-08-15 20:47:57.365932929 +0000 UTC m=+0.194767349" 16:47:59 time="2020-08-15T20:47:57.366023646Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.367562084Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.370926717Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.371166321Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-cc3f10e0f212551 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.372996915Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.373951524Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.330746514 +0000 UTC m=+0.159580955" 16:47:59 time="2020-08-15T20:47:57.374266493Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.380062219Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.388956104Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.389001356Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-1a44786139efcca InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.389567504Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-69c93fb09f6c47ac InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.392328221Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=162.701947ms Instance=stub-providertype8-1bf98be2a9d78d73 InstanceType=type8 Since="2020-08-15 20:47:57.193043348 +0000 UTC m=+0.021877775" State=booting 16:47:59 time="2020-08-15T20:47:57.392371275Z" level=info msg="boot failed" Address= Duration=162.701947ms Instance=stub-providertype8-1bf98be2a9d78d73 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.355745287 +0000 UTC m=+0.184579722" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.392428852Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:57.284001033 +0000 UTC m=+0.112835471" 16:47:59 time="2020-08-15T20:47:57.392556272Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1bb55397b4926431 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.392724677Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.392740740Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 ProbeStart="2020-08-15 20:47:57.280426976 +0000 UTC m=+0.109261442" 16:47:59 time="2020-08-15T20:47:57.397146744Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.397256603Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.397328000Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.395304369 +0000 UTC m=+0.224138783" 16:47:59 time="2020-08-15T20:47:57.397409497Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.396672657Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.399291060Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.268085049 +0000 UTC m=+0.096919454" 16:47:59 time="2020-08-15T20:47:57.401730758Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.402313854Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-1bf98be2a9d78d73 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.409473979Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2e4fa459169873f5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.409496395Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2e4fa459169873f5 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.260299677 +0000 UTC m=+0.089134108" 16:47:59 time="2020-08-15T20:47:57.409847394Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.409864023Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.358619097 +0000 UTC m=+0.187453534" 16:47:59 time="2020-08-15T20:47:57.409865750Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.420014752Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.420058218Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:57.346246943 +0000 UTC m=+0.175081366" 16:47:59 time="2020-08-15T20:47:57.422819976Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.423366750Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.313687365 +0000 UTC m=+0.142521808" 16:47:59 time="2020-08-15T20:47:57.423718752Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.424210038Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.424228898Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.392777551 +0000 UTC m=+0.221612008" 16:47:59 time="2020-08-15T20:47:57.424529141Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.425198501Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-1e503382be14186f InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.425217271Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-1e503382be14186f InstanceType=type2 ProbeStart="2020-08-15 20:47:57.346156761 +0000 UTC m=+0.174991249" 16:47:59 time="2020-08-15T20:47:57.425372047Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.425371750Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.425408182Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 ProbeStart="2020-08-15 20:47:57.334930193 +0000 UTC m=+0.163764640" 16:47:59 time="2020-08-15T20:47:57.425551012Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.425628069Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:57.397911611 +0000 UTC m=+0.226746080" 16:47:59 time="2020-08-15T20:47:57.427683054Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-2018fa6e04f9ce92 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.432381621Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.432407103Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.409195127 +0000 UTC m=+0.238029580" 16:47:59 time="2020-08-15T20:47:57.432414122Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.358619097 +0000 UTC m=+0.187453534" 16:47:59 time="2020-08-15T20:47:57.432468855Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.432487041Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.227039 Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.432526535Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-6054502fc5d6d268 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:57.432633349Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-76a780ea967cd710 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.432658148Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-76a780ea967cd710 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.358921091 +0000 UTC m=+0.187755515" 16:47:59 time="2020-08-15T20:47:57.433499871Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=169.243704ms Instance=stub-providertype3-af2560383d17909 InstanceType=type3 Since="2020-08-15 20:47:57.261635649 +0000 UTC m=+0.090470095" State=booting 16:47:59 time="2020-08-15T20:47:57.433531851Z" level=info msg="boot failed" Address= Duration=169.243704ms Instance=stub-providertype3-af2560383d17909 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.430879338 +0000 UTC m=+0.259713799" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.433616085Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1e925507c051e18a InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.433715368Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1e925507c051e18a InstanceType=type4 ProbeStart="2020-08-15 20:47:57.355871874 +0000 UTC m=+0.184706298" 16:47:59 time="2020-08-15T20:47:57.434163998Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.434186065Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.435341899Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-76a780ea967cd710 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.358921091 +0000 UTC m=+0.187755515" 16:47:59 time="2020-08-15T20:47:57.435367405Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-76a780ea967cd710 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.435386437Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.183713 Instance=stub-providertype6-76a780ea967cd710 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.435418406Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype6-76a780ea967cd710 InstanceType=type6 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:57.436233736Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.436413539Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.438276510Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-3e5ddb0efd7a84af InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.438876760Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.439236727 +0000 UTC m=+0.268071156" 16:47:59 time="2020-08-15T20:47:57.438926075Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="326.282µs" ResumeAt="2020-08-15 20:47:57.439236727 +0000 UTC m=+0.268071156" 16:47:59 time="2020-08-15T20:47:57.438995868Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.439236727 +0000 UTC m=+0.268071156" 16:47:59 time="2020-08-15T20:47:57.439016252Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="223.668µs" ResumeAt="2020-08-15 20:47:57.439236727 +0000 UTC m=+0.268071156" 16:47:59 time="2020-08-15T20:47:57.441295954Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.441588385Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.439236727 +0000 UTC m=+0.268071156" 16:47:59 time="2020-08-15T20:47:57.442328418Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.442348822Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.309346167 +0000 UTC m=+0.138180600" 16:47:59 time="2020-08-15T20:47:57.442489367Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype2-1e503382be14186f InstanceType=type2 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.443126851Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-6054502fc5d6d268 16:47:59 time="2020-08-15T20:47:57.443241422Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-76a780ea967cd710 16:47:59 time="2020-08-15T20:47:57.443366948Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-af2560383d17909 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.443662268Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.443684614Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.443705096Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.444599899Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.444926447Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.445560591 +0000 UTC m=+0.274395003" 16:47:59 time="2020-08-15T20:47:57.444954170Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="609.967µs" ResumeAt="2020-08-15 20:47:57.445560591 +0000 UTC m=+0.274395003" 16:47:59 time="2020-08-15T20:47:57.445202816Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.445220235Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.435220976 +0000 UTC m=+0.264055404" 16:47:59 time="2020-08-15T20:47:57.450697488Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-2e4fa459169873f5 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.260299677 +0000 UTC m=+0.089134108" 16:47:59 time="2020-08-15T20:47:57.450728838Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-2e4fa459169873f5 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.450747380Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.222969 Instance=stub-providertype8-2e4fa459169873f5 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.451323632Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.451342629Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:57.436927589 +0000 UTC m=+0.265762028" 16:47:59 time="2020-08-15T20:47:57.451468116Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-1e925507c051e18a InstanceType=type4 ProbeStart="2020-08-15 20:47:57.355871874 +0000 UTC m=+0.184706298" 16:47:59 time="2020-08-15T20:47:57.451488879Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-1e925507c051e18a InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.451505594Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.171409 Instance=stub-providertype4-1e925507c051e18a InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.454650519Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.454671982Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.343277027 +0000 UTC m=+0.172111463" 16:47:59 time="2020-08-15T20:47:57.454844577Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.454857392Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.439048627 +0000 UTC m=+0.267883057" 16:47:59 time="2020-08-15T20:47:57.455742493Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.455759327Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 ProbeStart="2020-08-15 20:47:57.365914024 +0000 UTC m=+0.194748492" 16:47:59 time="2020-08-15T20:47:57.456245563Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.456308720Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.456324423Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.459066979Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1e925507c051e18a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.459280483Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-6054502fc5d6d268 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.459303468Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-2e4fa459169873f5 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.459326104Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-76a780ea967cd710 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.459506994Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.461092141Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.467142437Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.467166325Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.432924929 +0000 UTC m=+0.261759373" 16:47:59 time="2020-08-15T20:47:57.469547585Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-945fcdd893a310f InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.471276147Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.472128180Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.473406041Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:35857" IdleBehavior=run Instance=stub-providertype6-5d214064018153da InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.473877701Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-74ea42afc12d154e InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.476366566Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.460352487 +0000 UTC m=+0.289186908" 16:47:59 time="2020-08-15T20:47:57.476684636Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.435220976 +0000 UTC m=+0.264055404" 16:47:59 time="2020-08-15T20:47:57.476711368Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.476729235Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.293050 Instance=stub-providertype8-380704bb7b4d7c03 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.476759403Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=200.343138ms Instance=stub-providertype4-36d467a4af63e58d InstanceType=type4 Since="2020-08-15 20:47:57.244346212 +0000 UTC m=+0.073180634" State=booting 16:47:59 time="2020-08-15T20:47:57.476782315Z" level=info msg="boot failed" Address= Duration=200.343138ms Instance=stub-providertype4-36d467a4af63e58d InstanceType=type4 ProbeStart="2020-08-15 20:47:57.444689321 +0000 UTC m=+0.273523772" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.476812764Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-36d467a4af63e58d InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:57.476961828Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.444759076 +0000 UTC m=+0.273593516" 16:47:59 time="2020-08-15T20:47:57.477100895Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.467060471 +0000 UTC m=+0.295894889" 16:47:59 time="2020-08-15T20:47:57.477212857Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.467060471 +0000 UTC m=+0.295894889" 16:47:59 time="2020-08-15T20:47:57.477287637Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.467060471 +0000 UTC m=+0.295894889" 16:47:59 time="2020-08-15T20:47:57.477482662Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.478083360Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.478104854Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.478126054Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000162 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.478156657Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000042 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.478181176Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.478201472Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.479986738Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.481996640Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.483061292Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.482960262 +0000 UTC m=+0.311794695" 16:47:59 time="2020-08-15T20:47:57.484563083Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.486497950Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-54a888203391860a InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.492951266Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.492988313Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=251.247801ms Instance=stub-providertype8-4d65822107fcfd52 InstanceType=type8 Since="2020-08-15 20:47:57.181677142 +0000 UTC m=+0.010511572" State=booting 16:47:59 time="2020-08-15T20:47:57.497114086Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.487222646 +0000 UTC m=+0.316057057" 16:47:59 time="2020-08-15T20:47:57.497217301Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-179a1d40367517c6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.497283198Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.491410489 +0000 UTC m=+0.320244908" 16:47:59 time="2020-08-15T20:47:57.497848018Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-356aeee5fdde63b1 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.497913489Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.497932657Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.473980664 +0000 UTC m=+0.302815087" 16:47:59 time="2020-08-15T20:47:57.498366506Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.498389983Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.374004816 +0000 UTC m=+0.202839268" 16:47:59 time="2020-08-15T20:47:57.499312728Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-36d467a4af63e58d 16:47:59 time="2020-08-15T20:47:57.499428576Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-4d65822107fcfd52 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.499445407Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-380704bb7b4d7c03 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.500860669Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.500885229Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.500938068Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.504140822Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.504161377Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 ProbeStart="2020-08-15 20:47:57.420873381 +0000 UTC m=+0.249707855" 16:47:59 time="2020-08-15T20:47:57.504379115Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.504395699Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 ProbeStart="2020-08-15 20:47:57.431500748 +0000 UTC m=+0.260335179" 16:47:59 time="2020-08-15T20:47:57.507830872Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.507864025Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.432088955 +0000 UTC m=+0.260923461" 16:47:59 time="2020-08-15T20:47:57.509139989Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-7aa585e696d511e1 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.512008125Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.515695719Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.466971093 +0000 UTC m=+0.295805528" 16:47:59 time="2020-08-15T20:47:57.515715139Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-685f325712f4128d InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.515762589Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-685f325712f4128d InstanceType=type8 ProbeStart="2020-08-15 20:47:57.441804574 +0000 UTC m=+0.270639011" 16:47:59 time="2020-08-15T20:47:57.516372445Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:45677" IdleBehavior=run Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.516438202Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-36d467a4af63e58d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.518084910Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.518105135Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.421932175 +0000 UTC m=+0.250766653" 16:47:59 time="2020-08-15T20:47:57.518908606Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.519886634 +0000 UTC m=+0.348721057" 16:47:59 time="2020-08-15T20:47:57.518938730Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="952.009µs" ResumeAt="2020-08-15 20:47:57.519886634 +0000 UTC m=+0.348721057" 16:47:59 time="2020-08-15T20:47:57.519355039Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.519374063Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 ProbeStart="2020-08-15 20:47:57.441985463 +0000 UTC m=+0.270819920" 16:47:59 time="2020-08-15T20:47:57.519707184Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.520585561Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.520725090Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.521546881 +0000 UTC m=+0.350381300" 16:47:59 time="2020-08-15T20:47:57.520752560Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="797.648µs" ResumeAt="2020-08-15 20:47:57.521546881 +0000 UTC m=+0.350381300" 16:47:59 time="2020-08-15T20:47:57.520883643Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.521160535Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.431507079 +0000 UTC m=+0.260341498" 16:47:59 time="2020-08-15T20:47:57.521305098Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.521380994Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.519886634 +0000 UTC m=+0.348721057" 16:47:59 time="2020-08-15T20:47:57.521426380Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.519886634 +0000 UTC m=+0.348721057" 16:47:59 time="2020-08-15T20:47:57.521465628Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.519886634 +0000 UTC m=+0.348721057" 16:47:59 time="2020-08-15T20:47:57.523759084Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.523840028Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.524506787Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.524529186Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.524652421Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.530443005Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.530464437Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.530007464 +0000 UTC m=+0.358841920" 16:47:59 time="2020-08-15T20:47:57.531026506Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.530007464 +0000 UTC m=+0.358841920" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:57.536173001Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.536436661Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.536452102Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.42094784 +0000 UTC m=+0.249782282" 16:47:59 time="2020-08-15T20:47:57.546312720Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.546336888Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.456482569 +0000 UTC m=+0.285317002" 16:47:59 time="2020-08-15T20:47:57.548280325Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=192.402014ms Instance=stub-providertype3-601900fb4ffbf3a9 InstanceType=type3 Since="2020-08-15 20:47:57.338591403 +0000 UTC m=+0.167425840" State=booting 16:47:59 time="2020-08-15T20:47:57.548319419Z" level=info msg="boot failed" Address= Duration=192.402014ms Instance=stub-providertype3-601900fb4ffbf3a9 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.53099342 +0000 UTC m=+0.359827854" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.548367743Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.524909863 +0000 UTC m=+0.353744268" 16:47:59 time="2020-08-15T20:47:57.548476827Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.548494080Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 ProbeStart="2020-08-15 20:47:57.536967702 +0000 UTC m=+0.365802143" 16:47:59 time="2020-08-15T20:47:57.548533175Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-505ce263e2d6a9ce InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.548546228Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-505ce263e2d6a9ce InstanceType=type6 ProbeStart="2020-08-15 20:47:57.467006537 +0000 UTC m=+0.295840974" 16:47:59 time="2020-08-15T20:47:57.550390269Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.550454460Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.552916725Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.552946649Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:57.50397696 +0000 UTC m=+0.332811401" 16:47:59 time="2020-08-15T20:47:57.554109062Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.554392702Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype3-601900fb4ffbf3a9 16:47:59 time="2020-08-15T20:47:57.556196758Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.561244578Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.543129355 +0000 UTC m=+0.371963800" 16:47:59 time="2020-08-15T20:47:57.562912375Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-74ea42afc12d154e InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.562933395Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-74ea42afc12d154e InstanceType=type4 ProbeStart="2020-08-15 20:47:57.503881566 +0000 UTC m=+0.332716033" 16:47:59 time="2020-08-15T20:47:57.562980692Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.562994029Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 ProbeStart="2020-08-15 20:47:57.437918279 +0000 UTC m=+0.266752725" 16:47:59 time="2020-08-15T20:47:57.563555547Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 ProbeStart="2020-08-15 20:47:57.423333098 +0000 UTC m=+0.252167572" 16:47:59 time="2020-08-15T20:47:57.563607224Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-fbb2a14ccdd7af InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.564108384Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-505ce263e2d6a9ce InstanceType=type6 ProbeStart="2020-08-15 20:47:57.467006537 +0000 UTC m=+0.295840974" 16:47:59 time="2020-08-15T20:47:57.564134996Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-505ce263e2d6a9ce InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.564154046Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.221022 Instance=stub-providertype6-505ce263e2d6a9ce InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.564181987Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.556660564 +0000 UTC m=+0.385494995" 16:47:59 time="2020-08-15T20:47:57.564206658Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.556660564 +0000 UTC m=+0.385494995" 16:47:59 time="2020-08-15T20:47:57.564224544Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.556660564 +0000 UTC m=+0.385494995" 16:47:59 time="2020-08-15T20:47:57.564242128Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.556660564 +0000 UTC m=+0.385494995" 16:47:59 time="2020-08-15T20:47:57.564260753Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.556660564 +0000 UTC m=+0.385494995" 16:47:59 time="2020-08-15T20:47:57.564282780Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=178.998424ms Instance=stub-providertype8-346e5f29ae10a901 InstanceType=type8 Since="2020-08-15 20:47:57.298549857 +0000 UTC m=+0.127384283" State=booting 16:47:59 time="2020-08-15T20:47:57.564308838Z" level=info msg="boot failed" Address= Duration=178.998424ms Instance=stub-providertype8-346e5f29ae10a901 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.477548278 +0000 UTC m=+0.306382707" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.564338412Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.564356936Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.555326962 +0000 UTC m=+0.384161409" 16:47:59 time="2020-08-15T20:47:57.564371554Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000100 Instance=stub-providertype4-1408d2ac22c4d294 PID=1 16:47:59 time="2020-08-15T20:47:57.564418378Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-5254827163240d09 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.565175521Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.565119705 +0000 UTC m=+0.393954127" 16:47:59 time="2020-08-15T20:47:57.565253975Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-2195baf7d30e4b85 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.565614076Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000100 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.565657063Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.565678193Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.51484549 +0000 UTC m=+0.343679957" 16:47:59 time="2020-08-15T20:47:57.566994386Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.568835536Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.568896184Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.569112535Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1bb55397b4926431 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.569384746Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.569732608Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.569839182Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.570035667Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-cc3f10e0f212551 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.572270154Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-1e503382be14186f InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.572438426Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.572536373Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.556660564 +0000 UTC m=+0.385494995" 16:47:59 time="2020-08-15T20:47:57.572593678Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-346e5f29ae10a901 16:47:59 time="2020-08-15T20:47:57.572792968Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-601900fb4ffbf3a9 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.572804698Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-505ce263e2d6a9ce WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.572815873Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-74ea42afc12d154e InstanceType=type4 ProbeStart="2020-08-15 20:47:57.503881566 +0000 UTC m=+0.332716033" 16:47:59 time="2020-08-15T20:47:57.572828940Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-74ea42afc12d154e InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.572838764Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.098935 Instance=stub-providertype4-74ea42afc12d154e InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.572862179Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-685f325712f4128d InstanceType=type8 ProbeStart="2020-08-15 20:47:57.441804574 +0000 UTC m=+0.270639011" 16:47:59 time="2020-08-15T20:47:57.572873188Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-685f325712f4128d InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.572890771Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.262631 Instance=stub-providertype8-685f325712f4128d InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.572902541Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-1e503382be14186f InstanceType=type2 ProbeStart="2020-08-15 20:47:57.563523923 +0000 UTC m=+0.392358351" 16:47:59 time="2020-08-15T20:47:57.572933193Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 ProbeStart="2020-08-15 20:47:57.51796225 +0000 UTC m=+0.346796693" 16:47:59 time="2020-08-15T20:47:57.573158157Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:57.554467254 +0000 UTC m=+0.383301679" 16:47:59 time="2020-08-15T20:47:57.573184268Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.553024321 +0000 UTC m=+0.381858798" 16:47:59 time="2020-08-15T20:47:57.573258084Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1bb55397b4926431 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.491083564 +0000 UTC m=+0.319917993" 16:47:59 time="2020-08-15T20:47:57.573499039Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.573511531Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.573532141Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.573542714Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.573551734Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.573560459Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.573569057Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.573577734Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.574131684Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.574153025Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000162 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.574169846Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.574872528Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.52472672 +0000 UTC m=+0.353561128" 16:47:59 time="2020-08-15T20:47:57.574917121Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 ProbeStart="2020-08-15 20:47:57.474035529 +0000 UTC m=+0.302869964" 16:47:59 time="2020-08-15T20:47:57.574940235Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.56347122 +0000 UTC m=+0.392305661" 16:47:59 time="2020-08-15T20:47:57.575853545Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-cc3f10e0f212551 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.47991457 +0000 UTC m=+0.308748998" 16:47:59 time="2020-08-15T20:47:57.580959580Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.581097886Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.581689734 +0000 UTC m=+0.410524156" 16:47:59 time="2020-08-15T20:47:57.581133114Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="560.714µs" ResumeAt="2020-08-15 20:47:57.581689734 +0000 UTC m=+0.410524156" 16:47:59 time="2020-08-15T20:47:57.581246194Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.581689734 +0000 UTC m=+0.410524156" 16:47:59 time="2020-08-15T20:47:57.581274603Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="425.685µs" ResumeAt="2020-08-15 20:47:57.581689734 +0000 UTC m=+0.410524156" 16:47:59 time="2020-08-15T20:47:57.582549931Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-1bb55397b4926431 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.491083564 +0000 UTC m=+0.319917993" 16:47:59 time="2020-08-15T20:47:57.582594250Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-1bb55397b4926431 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.582624771Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.190050 Instance=stub-providertype4-1bb55397b4926431 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.582784628Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.582800866Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:57.477391691 +0000 UTC m=+0.306226116" 16:47:59 time="2020-08-15T20:47:57.583605842Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.583786162Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000100 ExitCode=1 Instance=stub-providertype4-1408d2ac22c4d294 PID=1 16:47:59 time="2020-08-15T20:47:57.584986588Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1bb55397b4926431 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.585013896Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-74ea42afc12d154e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.585027003Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-685f325712f4128d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.585040722Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-346e5f29ae10a901 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.585094637Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.585792229Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.585820491Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000162 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.585830849Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.585852950Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.580368753 +0000 UTC m=+0.409203201" 16:47:59 time="2020-08-15T20:47:57.585866521Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.586070476Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.586083748Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.581938689 +0000 UTC m=+0.410773174" 16:47:59 time="2020-08-15T20:47:57.586227545Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-cc3f10e0f212551 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.47991457 +0000 UTC m=+0.308748998" 16:47:59 time="2020-08-15T20:47:57.586248682Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-cc3f10e0f212551 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.586264388Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.215079 Instance=stub-providertype6-cc3f10e0f212551 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.587036947Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.588158239Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-173e5e6e09d0c910 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.589058645Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.589118996 +0000 UTC m=+0.417953416" 16:47:59 time="2020-08-15T20:47:57.589083552Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="38.786µs" ResumeAt="2020-08-15 20:47:57.589118996 +0000 UTC m=+0.417953416" 16:47:59 time="2020-08-15T20:47:57.589830974Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.592319758Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.594195136Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype2-1e503382be14186f InstanceType=type2 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.596596721Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-6d7acf370641dfb5 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.596983315Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.597061659Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.597952728 +0000 UTC m=+0.426787149" 16:47:59 time="2020-08-15T20:47:57.597083543Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="872.519µs" ResumeAt="2020-08-15 20:47:57.597952728 +0000 UTC m=+0.426787149" 16:47:59 time="2020-08-15T20:47:57.597213631Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000100 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:57.597255046Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-342d505ec67aabc0 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.597336396Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=295.494212ms Instance=stub-providertype2-1e503382be14186f InstanceType=type2 Since="2020-08-15 20:47:57.26802971 +0000 UTC m=+0.096864139" State=booting 16:47:59 time="2020-08-15T20:47:57.597900571Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.597923215Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.599361638Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.599393155Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=277.773642ms Instance=stub-providertype6-760b0d22050143a6 InstanceType=type6 Since="2020-08-15 20:47:57.246953072 +0000 UTC m=+0.075787486" State=booting 16:47:59 time="2020-08-15T20:47:57.599433941Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.599921563Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-cc3f10e0f212551 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.601572930Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.602645497Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000100 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:57.602750490Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.604468623Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.604896748Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.605420334 +0000 UTC m=+0.434254752" 16:47:59 time="2020-08-15T20:47:57.604937685Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="486.966µs" ResumeAt="2020-08-15 20:47:57.605420334 +0000 UTC m=+0.434254752" 16:47:59 time="2020-08-15T20:47:57.606767180Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.607688642Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.609158635Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-79ae05bf7c9a40b8 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.610518932Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-1e503382be14186f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.610561309Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-760b0d22050143a6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.611311488Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-877a649ba141d44 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.612982571Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-2f8cdfe5e2e4da00 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.617639236Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.617657292Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-736888b427bce82c InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.619910638Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=197.588337ms Instance=stub-providertype6-32560c7a67588a74 InstanceType=type6 Since="2020-08-15 20:47:57.36380183 +0000 UTC m=+0.192636261" State=booting 16:47:59 time="2020-08-15T20:47:57.619947270Z" level=info msg="boot failed" Address= Duration=197.588337ms Instance=stub-providertype6-32560c7a67588a74 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.561390164 +0000 UTC m=+0.390224598" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.620563904Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000100 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.620739369Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-69c93fb09f6c47ac InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.620758731Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-69c93fb09f6c47ac InstanceType=type8 ProbeStart="2020-08-15 20:47:57.572957378 +0000 UTC m=+0.401791801" 16:47:59 time="2020-08-15T20:47:57.620766903Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.620769026Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.583274607 +0000 UTC m=+0.412109048" 16:47:59 time="2020-08-15T20:47:57.623064814Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.623086516Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:57.59654029 +0000 UTC m=+0.425374739" 16:47:59 time="2020-08-15T20:47:57.623525481Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.623542166Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 ProbeStart="2020-08-15 20:47:57.606921267 +0000 UTC m=+0.435755723" 16:47:59 time="2020-08-15T20:47:57.623894988Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000100 State=Complete 16:47:59 time="2020-08-15T20:47:57.626486341Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-32560c7a67588a74 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.627334192Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.627355976Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.597162374 +0000 UTC m=+0.425996801" 16:47:59 time="2020-08-15T20:47:57.627529775Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.628890312Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-7694a644db212264 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.629184425Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.629730099 +0000 UTC m=+0.458564513" 16:47:59 time="2020-08-15T20:47:57.629227065Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="515.26µs" ResumeAt="2020-08-15 20:47:57.629730099 +0000 UTC m=+0.458564513" 16:47:59 time="2020-08-15T20:47:57.630884088Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-44482319682c1dde InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.631608492Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.631899136Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.549328391 +0000 UTC m=+0.378162834" 16:47:59 time="2020-08-15T20:47:57.632246470Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=388.624797ms Instance=stub-providertype8-45a6e3cafccae224 InstanceType=type8 Since="2020-08-15 20:47:57.220116662 +0000 UTC m=+0.048951099" State=booting 16:47:59 time="2020-08-15T20:47:57.632553593Z" level=info msg="boot failed" Address= Duration=388.624797ms Instance=stub-providertype8-45a6e3cafccae224 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.608741457 +0000 UTC m=+0.437575896" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.633060015Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.633082410Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.637501169Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-20ec2d5fb4589140 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.637734227Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.637829404Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 ProbeStart="2020-08-15 20:47:57.608937911 +0000 UTC m=+0.437772343" 16:47:59 time="2020-08-15T20:47:57.638544942Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.642055684Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-1b357407fecc269 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.643201662Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-45a6e3cafccae224 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.643273837Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-581092e28026dcd InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.648377680Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.648398540Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.616266929 +0000 UTC m=+0.445101415" 16:47:59 time="2020-08-15T20:47:57.648440792Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.648452518Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.575626466 +0000 UTC m=+0.404460920" 16:47:59 time="2020-08-15T20:47:57.648551576Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.648646966Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.649513181 +0000 UTC m=+0.478347612" 16:47:59 time="2020-08-15T20:47:57.648672476Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="844.166µs" ResumeAt="2020-08-15 20:47:57.649513181 +0000 UTC m=+0.478347612" 16:47:59 time="2020-08-15T20:47:57.648760869Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.649513181 +0000 UTC m=+0.478347612" 16:47:59 time="2020-08-15T20:47:57.648777806Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="738.323µs" ResumeAt="2020-08-15 20:47:57.649513181 +0000 UTC m=+0.478347612" 16:47:59 time="2020-08-15T20:47:57.649639376Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.649712669Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 PID=2 16:47:59 time="2020-08-15T20:47:57.650743575Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.656106747Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:45085" IdleBehavior=run Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.657426920Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-60d469ad5e42a3e1 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.658368521Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.659131081Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.622920995 +0000 UTC m=+0.451755477" 16:47:59 time="2020-08-15T20:47:57.662751584Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.662773989Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.623924685 +0000 UTC m=+0.452759115" 16:47:59 time="2020-08-15T20:47:57.664090021Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.664172946Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.622793322 +0000 UTC m=+0.451627771" 16:47:59 time="2020-08-15T20:47:57.664866911Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-7e35102d2344f95c InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.665854146Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-69c93fb09f6c47ac InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.665885251Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=183.336695ms Instance=stub-providertype8-69c93fb09f6c47ac InstanceType=type8 Since="2020-08-15 20:47:57.389620669 +0000 UTC m=+0.218455106" State=booting 16:47:59 time="2020-08-15T20:47:57.665921495Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-69c93fb09f6c47ac InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:57.665964736Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.666020583Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-65157426e50ec28b InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.666779132Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.667011253Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.666992915 +0000 UTC m=+0.495827334" 16:47:59 time="2020-08-15T20:47:57.667744641Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.668951296Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.668983148Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.633745287 +0000 UTC m=+0.462579712" 16:47:59 time="2020-08-15T20:47:57.669315190Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.671236232Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 PID=2 State=Locked 16:47:59 time="2020-08-15T20:47:57.676277494Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.676487001Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-69c93fb09f6c47ac 16:47:59 time="2020-08-15T20:47:57.676818548Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.679036851Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-69c93fb09f6c47ac InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:57.679082905Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.679420530Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-4192214612966204 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.680009828Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 ProbeStart="2020-08-15 20:47:57.552116763 +0000 UTC m=+0.380951205" 16:47:59 time="2020-08-15T20:47:57.680890142Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-cae54ddc325f819 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.682399775Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.682422531Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 ProbeStart="2020-08-15 20:47:57.633701836 +0000 UTC m=+0.462536279" 16:47:59 time="2020-08-15T20:47:57.684019522Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.684050274Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.684171158Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-50d4397dca20e3f9 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.684253940Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.642586402 +0000 UTC m=+0.471420863" 16:47:59 time="2020-08-15T20:47:57.684295658Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 ProbeStart="2020-08-15 20:47:57.635442314 +0000 UTC m=+0.464276770" 16:47:59 time="2020-08-15T20:47:57.684563267Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.687525259Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-69c93fb09f6c47ac 16:47:59 time="2020-08-15T20:47:57.687978329Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=385.740951ms Instance=stub-providertype8-207403def63a5b6f InstanceType=type8 Since="2020-08-15 20:47:57.223196967 +0000 UTC m=+0.052031392" State=booting 16:47:59 time="2020-08-15T20:47:57.688814623Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.689965799Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-55f9348b36270033 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.690959040Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.690977897Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.644903538 +0000 UTC m=+0.473737968" 16:47:59 time="2020-08-15T20:47:57.691920367Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.691956309Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=419.719865ms Instance=stub-providertype8-6e661e92759805f5 InstanceType=type8 Since="2020-08-15 20:47:57.203201175 +0000 UTC m=+0.032035612" State=booting 16:47:59 time="2020-08-15T20:47:57.692220270Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=175.853746ms Instance=stub-providertype6-2018fa6e04f9ce92 InstanceType=type6 Since="2020-08-15 20:47:57.427707043 +0000 UTC m=+0.256541473" State=booting 16:47:59 time="2020-08-15T20:47:57.692246890Z" level=info msg="boot failed" Address= Duration=175.853746ms Instance=stub-providertype6-2018fa6e04f9ce92 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.60356076 +0000 UTC m=+0.432395219" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.694376668Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.694477524Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.696456418Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.690926192 +0000 UTC m=+0.519760610" 16:47:59 time="2020-08-15T20:47:57.698739828Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.698785899Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.699695368 +0000 UTC m=+0.528529790" 16:47:59 time="2020-08-15T20:47:57.698810650Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="888.245µs" ResumeAt="2020-08-15 20:47:57.699695368 +0000 UTC m=+0.528529790" 16:47:59 time="2020-08-15T20:47:57.701002629Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.701032513Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.702637794Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:36819" IdleBehavior=run Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.702764030Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3e5ddb0efd7a84af InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.703018444Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.703153586Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-69c93fb09f6c47ac WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.703177340Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-2018fa6e04f9ce92 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.703190862Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-207403def63a5b6f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.703205213Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-6e661e92759805f5 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.703225914Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3e5ddb0efd7a84af InstanceType=type8 ProbeStart="2020-08-15 20:47:57.586486859 +0000 UTC m=+0.415321296" 16:47:59 time="2020-08-15T20:47:57.703776467Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.703953953Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.605042974 +0000 UTC m=+0.433877398" 16:47:59 time="2020-08-15T20:47:57.705412926Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.705542367Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 ProbeStart="2020-08-15 20:47:57.581043794 +0000 UTC m=+0.409878242" 16:47:59 time="2020-08-15T20:47:57.708234358Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.708258018Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.57590808 +0000 UTC m=+0.404742507" 16:47:59 time="2020-08-15T20:47:57.715599027Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.715749361Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-628e687e95333623 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.715854754Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-196a76e25692f934 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.715978199Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.715991576Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.606816752 +0000 UTC m=+0.435651214" 16:47:59 time="2020-08-15T20:47:57.717761095Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-5d18c9ed03aabae5 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.718092069Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.718109448Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:57.648021429 +0000 UTC m=+0.476855876" 16:47:59 time="2020-08-15T20:47:57.723457197Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=224.079963ms Instance=stub-providertype8-1a44786139efcca InstanceType=type8 Since="2020-08-15 20:47:57.389013535 +0000 UTC m=+0.217847963" State=booting 16:47:59 time="2020-08-15T20:47:57.723494332Z" level=info msg="boot failed" Address= Duration=224.079963ms Instance=stub-providertype8-1a44786139efcca InstanceType=type8 ProbeStart="2020-08-15 20:47:57.613093501 +0000 UTC m=+0.441927926" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.724196425Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.725355148Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.726372964Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.730090358Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-326d74010c77412c InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.730822213Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.731538804Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.688025702 +0000 UTC m=+0.516860137" 16:47:59 time="2020-08-15T20:47:57.731773969Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.732011940Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.737043620Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.737202023Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.737223281Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.737530662Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.738532637Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.741037953Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.741151392Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.741819157 +0000 UTC m=+0.570653588" 16:47:59 time="2020-08-15T20:47:57.741175432Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="647.406µs" ResumeAt="2020-08-15 20:47:57.741819157 +0000 UTC m=+0.570653588" 16:47:59 time="2020-08-15T20:47:57.741271126Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.741819157 +0000 UTC m=+0.570653588" 16:47:59 time="2020-08-15T20:47:57.741288425Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="533.325µs" ResumeAt="2020-08-15 20:47:57.741819157 +0000 UTC m=+0.570653588" 16:47:59 time="2020-08-15T20:47:57.741910559Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-1a44786139efcca WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.742150335Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.689027719 +0000 UTC m=+0.517862166" 16:47:59 time="2020-08-15T20:47:57.742285804Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.613756372 +0000 UTC m=+0.442590826" 16:47:59 time="2020-08-15T20:47:57.742832284Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.742861475Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.743114602Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.743138296Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 ProbeStart="2020-08-15 20:47:57.616964466 +0000 UTC m=+0.445798911" 16:47:59 time="2020-08-15T20:47:57.744521155Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.744538606Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 ProbeStart="2020-08-15 20:47:57.720910928 +0000 UTC m=+0.549745356" 16:47:59 time="2020-08-15T20:47:57.745017458Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.745033282Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 ProbeStart="2020-08-15 20:47:57.717897921 +0000 UTC m=+0.546732361" 16:47:59 time="2020-08-15T20:47:57.746039531Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:57.703912221 +0000 UTC m=+0.532746639" 16:47:59 time="2020-08-15T20:47:57.746087231Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.746105850Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 ProbeStart="2020-08-15 20:47:57.703852866 +0000 UTC m=+0.532687301" 16:47:59 time="2020-08-15T20:47:57.746106746Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 ProbeStart="2020-08-15 20:47:57.620001071 +0000 UTC m=+0.448835505" 16:47:59 time="2020-08-15T20:47:57.746103883Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 ProbeStart="2020-08-15 20:47:57.620684055 +0000 UTC m=+0.449518481" 16:47:59 time="2020-08-15T20:47:57.746101253Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 ProbeStart="2020-08-15 20:47:57.704970319 +0000 UTC m=+0.533804763" 16:47:59 time="2020-08-15T20:47:57.746304943Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-a6dc35cdf94a493 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.747374399Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-4f3c5d4e5f7684cf InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.748013869Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-3e5ddb0efd7a84af InstanceType=type8 ProbeStart="2020-08-15 20:47:57.586486859 +0000 UTC m=+0.415321296" 16:47:59 time="2020-08-15T20:47:57.748058548Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-3e5ddb0efd7a84af InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.748091659Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.309792 Instance=stub-providertype8-3e5ddb0efd7a84af InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.748168804Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-52486da6db8b1542 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.748894836Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.751166344Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.753770718Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.754909650Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-3e5ddb0efd7a84af WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.759075627Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.759546965Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-53b7a0ff70658b94 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.759568908Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-53b7a0ff70658b94 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.636152026 +0000 UTC m=+0.464986486" 16:47:59 time="2020-08-15T20:47:57.761221312Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.761932606Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.761967162Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.63189215 +0000 UTC m=+0.460726587" 16:47:59 time="2020-08-15T20:47:57.762025088Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.762187409 +0000 UTC m=+0.591021831" 16:47:59 time="2020-08-15T20:47:57.762070036Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="123.761µs" ResumeAt="2020-08-15 20:47:57.762187409 +0000 UTC m=+0.591021831" 16:47:59 time="2020-08-15T20:47:57.765350783Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.765372278Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.718056673 +0000 UTC m=+0.546891086" 16:47:59 time="2020-08-15T20:47:57.765416252Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.765454484Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.647340203 +0000 UTC m=+0.476174653" 16:47:59 time="2020-08-15T20:47:57.765510439Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-d9270425c03436 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.766359264Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.769398819Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:39709" IdleBehavior=run Instance=stub-providertype2-38fa0450cbcd2243 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.778062446Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.778109695Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 ProbeStart="2020-08-15 20:47:57.742014092 +0000 UTC m=+0.570848514" 16:47:59 time="2020-08-15T20:47:57.782552670Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.782589506Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=281.466431ms Instance=stub-providertype2-52aaab031f765a41 InstanceType=type2 Since="2020-08-15 20:47:57.4364315 +0000 UTC m=+0.265265930" State=booting 16:47:59 time="2020-08-15T20:47:57.783330140Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.788239378Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.788255803Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 ProbeStart="2020-08-15 20:47:57.745960598 +0000 UTC m=+0.574795034" 16:47:59 time="2020-08-15T20:47:57.791278717Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.791308817Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=405.397527ms Instance=stub-providertype4-7539a2019f06397d InstanceType=type4 Since="2020-08-15 20:47:57.29957281 +0000 UTC m=+0.128407236" State=booting 16:47:59 time="2020-08-15T20:47:57.791435751Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.791449916Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.673646686 +0000 UTC m=+0.502481108" 16:47:59 time="2020-08-15T20:47:57.791915228Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.794498098Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.794512362Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.677015766 +0000 UTC m=+0.505850193" 16:47:59 time="2020-08-15T20:47:57.798015364Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-53b7a0ff70658b94 InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.798041684Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=271.169268ms Instance=stub-providertype6-53b7a0ff70658b94 InstanceType=type6 Since="2020-08-15 20:47:57.364982792 +0000 UTC m=+0.193817218" State=booting 16:47:59 time="2020-08-15T20:47:57.807547404Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-4e12d515167bb82c InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.810072142Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype2-52aaab031f765a41 16:47:59 time="2020-08-15T20:47:57.810343030Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-53b7a0ff70658b94 16:47:59 time="2020-08-15T20:47:57.810806751Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-7539a2019f06397d 16:47:59 time="2020-08-15T20:47:57.811797589Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype6-53b7a0ff70658b94 InstanceType=type6 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:57.812141253Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-7aa585e696d511e1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.813081255Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.815202809Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-931afd8b416421 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.816277762Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817061551Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.817468783Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817513011Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817532745Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817550751Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817567316Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817584696Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817601466Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.812518247 +0000 UTC m=+0.641352671" 16:47:59 time="2020-08-15T20:47:57.817625538Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-7aa585e696d511e1 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.678943598 +0000 UTC m=+0.507778036" 16:47:59 time="2020-08-15T20:47:57.818454494Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.818512569Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.818527241Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.818541887Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.818555755Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.818569674Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.818584346Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.819327243Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.819346514Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 ProbeStart="2020-08-15 20:47:57.774919736 +0000 UTC m=+0.603754167" 16:47:59 time="2020-08-15T20:47:57.819393993Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.819406462Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.768937796 +0000 UTC m=+0.597772224" 16:47:59 time="2020-08-15T20:47:57.820929575Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.823998601Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.824740424Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.825426061Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.77481037 +0000 UTC m=+0.603644823" 16:47:59 time="2020-08-15T20:47:57.825622222Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:57.782338215 +0000 UTC m=+0.611172660" 16:47:59 time="2020-08-15T20:47:57.830467726Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.830492886Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.783294518 +0000 UTC m=+0.612128974" 16:47:59 time="2020-08-15T20:47:57.843392385Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.824156175 +0000 UTC m=+0.652990599" 16:47:59 time="2020-08-15T20:47:57.844312467Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.845943320Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-7539a2019f06397d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.845990185Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-52aaab031f765a41 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.846006943Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-53b7a0ff70658b94 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.848509344Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-5254827163240d09 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.848542139Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-5254827163240d09 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.703381701 +0000 UTC m=+0.532216134" 16:47:59 time="2020-08-15T20:47:57.848750558Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.848848158Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.849569591 +0000 UTC m=+0.678404038" 16:47:59 time="2020-08-15T20:47:57.848875223Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="699.015µs" ResumeAt="2020-08-15 20:47:57.849569591 +0000 UTC m=+0.678404038" 16:47:59 time="2020-08-15T20:47:57.849484071Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.849569591 +0000 UTC m=+0.678404038" 16:47:59 time="2020-08-15T20:47:57.849514818Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="59.202µs" ResumeAt="2020-08-15 20:47:57.849569591 +0000 UTC m=+0.678404038" 16:47:59 time="2020-08-15T20:47:57.849579377Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.849569591 +0000 UTC m=+0.678404038" 16:47:59 time="2020-08-15T20:47:57.851466985Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-342d505ec67aabc0 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.851869955Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.851939934 +0000 UTC m=+0.680774362" 16:47:59 time="2020-08-15T20:47:57.851897563Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="46.615µs" ResumeAt="2020-08-15 20:47:57.851939934 +0000 UTC m=+0.680774362" 16:47:59 time="2020-08-15T20:47:57.852203398Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.852284990Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.851939934 +0000 UTC m=+0.680774362" 16:47:59 time="2020-08-15T20:47:57.852360506Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.851939934 +0000 UTC m=+0.680774362" 16:47:59 time="2020-08-15T20:47:57.852433809Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:57.851939934 +0000 UTC m=+0.680774362" 16:47:59 time="2020-08-15T20:47:57.852505126Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.851939934 +0000 UTC m=+0.680774362" 16:47:59 time="2020-08-15T20:47:57.852577081Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.851939934 +0000 UTC m=+0.680774362" 16:47:59 time="2020-08-15T20:47:57.852876783Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-342d505ec67aabc0 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.703286087 +0000 UTC m=+0.532120517" 16:47:59 time="2020-08-15T20:47:57.853455122Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.853475673Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.853505684Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000042 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.853525736Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000162 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.853539903Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.853563640Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.853577868Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.853591536Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.853605060Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.858483783Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-14f9503a50da3d91 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.859520151Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.861076748Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-1afdd2f816d19945 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.863409493Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=248.370854ms Instance=stub-providertype4-945fcdd893a310f InstanceType=type4 Since="2020-08-15 20:47:57.469568109 +0000 UTC m=+0.298402532" State=booting 16:47:59 time="2020-08-15T20:47:57.863465445Z" level=info msg="boot failed" Address= Duration=248.370854ms Instance=stub-providertype4-945fcdd893a310f InstanceType=type4 ProbeStart="2020-08-15 20:47:57.717938966 +0000 UTC m=+0.546773386" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.863539977Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.864915095Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.867265156Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.868266599Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.868289750Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.807263856 +0000 UTC m=+0.636098320" 16:47:59 time="2020-08-15T20:47:57.872245666Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.873687277Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.877660320Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-21aed68ac35f19f0 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.879650377Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-945fcdd893a310f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.879708896Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-52183384466dc1d4 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.880800186Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-23a414230985ee56 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.883290961Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-7aa585e696d511e1 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.678943598 +0000 UTC m=+0.507778036" 16:47:59 time="2020-08-15T20:47:57.883323310Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-7aa585e696d511e1 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.883342298Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.374166 Instance=stub-providertype4-7aa585e696d511e1 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.883915478Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.885038015Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-71075a807b512662 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.886567351Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.888712007Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.891496787Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.891518042Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.817914048 +0000 UTC m=+0.646748494" 16:47:59 time="2020-08-15T20:47:57.891846738Z" level=info msg="boot probe succeeded" Address="127.0.0.1:35857" Command=true Instance=stub-providertype6-5d214064018153da InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.891869680Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:35857" Instance=stub-providertype6-5d214064018153da InstanceType=type6 ProbeStart="2020-08-15 20:47:57.720664874 +0000 UTC m=+0.549499322" 16:47:59 time="2020-08-15T20:47:57.892105059Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.892122173Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.830531945 +0000 UTC m=+0.659366379" 16:47:59 time="2020-08-15T20:47:57.895278414Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.898015316Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-7aa585e696d511e1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.898287266Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-6448d41ce747221f InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.898404956Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.898428126Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.832021183 +0000 UTC m=+0.660855626" 16:47:59 time="2020-08-15T20:47:57.898437408Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:57.89853978 +0000 UTC m=+0.727374199" 16:47:59 time="2020-08-15T20:47:57.898490407Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="53.523µs" ResumeAt="2020-08-15 20:47:57.89853978 +0000 UTC m=+0.727374199" 16:47:59 time="2020-08-15T20:47:57.899721717Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:57.902094230Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-5254827163240d09 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.902506409Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.902522061Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 ProbeStart="2020-08-15 20:47:57.756188145 +0000 UTC m=+0.585022576" 16:47:59 time="2020-08-15T20:47:57.903990980Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-38a899594bff05d4 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.904952849Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:57.904949373 +0000 UTC m=+0.733783798" 16:47:59 time="2020-08-15T20:47:57.905718623Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.906000023Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.906054336Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.84302359 +0000 UTC m=+0.671858030" 16:47:59 time="2020-08-15T20:47:57.908268431Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-2e0144feb3dc2d6 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.911996642Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.912980404Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.912842787 +0000 UTC m=+0.741677219" 16:47:59 time="2020-08-15T20:47:57.913061456Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.913108319Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.856898811 +0000 UTC m=+0.685733308" 16:47:59 time="2020-08-15T20:47:57.913522026Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.913873197Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.913910325Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 ProbeStart="2020-08-15 20:47:57.853010546 +0000 UTC m=+0.681844998" 16:47:59 time="2020-08-15T20:47:57.914807665Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.915258123Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.915276487Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.75250791 +0000 UTC m=+0.581342363" 16:47:59 time="2020-08-15T20:47:57.915415872Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.915429173Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.880434918 +0000 UTC m=+0.709269352" 16:47:59 time="2020-08-15T20:47:57.915435161Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.915470933Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:57.867856335 +0000 UTC m=+0.696690774" 16:47:59 time="2020-08-15T20:47:57.916743023Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.917058675Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.917074141Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 ProbeStart="2020-08-15 20:47:57.874914999 +0000 UTC m=+0.703749417" 16:47:59 time="2020-08-15T20:47:57.919871436Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.919891416Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 ProbeStart="2020-08-15 20:47:57.752927401 +0000 UTC m=+0.581761842" 16:47:59 time="2020-08-15T20:47:57.920338093Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.920353233Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.881042466 +0000 UTC m=+0.709876881" 16:47:59 time="2020-08-15T20:47:57.921074889Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.921095003Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 ProbeStart="2020-08-15 20:47:57.867922263 +0000 UTC m=+0.696756687" 16:47:59 time="2020-08-15T20:47:57.921639297Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.921680912Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=380.858991ms Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 Since="2020-08-15 20:47:57.472151574 +0000 UTC m=+0.300986007" State=booting 16:47:59 time="2020-08-15T20:47:57.921718902Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype3-6c7ae37ae39d02db InstanceType=type3 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:57.921878098Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=278.742823ms Instance=stub-providertype6-179a1d40367517c6 InstanceType=type6 Since="2020-08-15 20:47:57.497236089 +0000 UTC m=+0.326070526" State=booting 16:47:59 time="2020-08-15T20:47:57.921904617Z" level=info msg="boot failed" Address= Duration=278.742823ms Instance=stub-providertype6-179a1d40367517c6 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.77597889 +0000 UTC m=+0.604813349" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:57.922879763Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2f8cdfe5e2e4da00 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.923337476Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-581092e28026dcd InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.923495228Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.923605920Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.927734031Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.928629879Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.923882862 +0000 UTC m=+0.752717282" 16:47:59 time="2020-08-15T20:47:57.928662135Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-581092e28026dcd InstanceType=type4 ProbeStart="2020-08-15 20:47:57.816224391 +0000 UTC m=+0.645058813" 16:47:59 time="2020-08-15T20:47:57.928702379Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2f8cdfe5e2e4da00 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.768374409 +0000 UTC m=+0.597208847" 16:47:59 time="2020-08-15T20:47:57.928745052Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-661c8184b38c6f71 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.928770122Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 ProbeStart="2020-08-15 20:47:57.816145844 +0000 UTC m=+0.644980272" 16:47:59 time="2020-08-15T20:47:57.928809334Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.928839464Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:57.928854125Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.928983480Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-28b9c12307c2a6b2 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.929756131Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.931169416Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-342d505ec67aabc0 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.703286087 +0000 UTC m=+0.532120517" 16:47:59 time="2020-08-15T20:47:57.931196529Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-342d505ec67aabc0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.931215243Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.333946 Instance=stub-providertype8-342d505ec67aabc0 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.931264092Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.921200245 +0000 UTC m=+0.750034679" 16:47:59 time="2020-08-15T20:47:57.932711627Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.938230882Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-44482319682c1dde InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.938603992Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-15406cdde5156261 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.939872372Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.939895315Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.872725501 +0000 UTC m=+0.701559948" 16:47:59 time="2020-08-15T20:47:57.940016295Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-1b357407fecc269 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.940029288Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-1b357407fecc269 InstanceType=type2 ProbeStart="2020-08-15 20:47:57.785799241 +0000 UTC m=+0.614633692" 16:47:59 time="2020-08-15T20:47:57.940516086Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype2-1b357407fecc269 InstanceType=type2 ProbeStart="2020-08-15 20:47:57.785799241 +0000 UTC m=+0.614633692" 16:47:59 time="2020-08-15T20:47:57.940538295Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype2-1b357407fecc269 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.940555940Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.298474 Instance=stub-providertype2-1b357407fecc269 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.941174589Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.941192734Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.85185637 +0000 UTC m=+0.680690837" 16:47:59 time="2020-08-15T20:47:57.944458183Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype3-6c7ae37ae39d02db 16:47:59 time="2020-08-15T20:47:57.945042143Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-342d505ec67aabc0 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.945061700Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-179a1d40367517c6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.945088145Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:57.945448151Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.937440199 +0000 UTC m=+0.766274618" 16:47:59 time="2020-08-15T20:47:57.949896315Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-86d109024279992 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.950899553Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.951033403Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-44482319682c1dde InstanceType=type3 ProbeStart="2020-08-15 20:47:57.768233444 +0000 UTC m=+0.597067893" 16:47:59 time="2020-08-15T20:47:57.952701647Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.952717647Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.952737233Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.837449474 +0000 UTC m=+0.666283920" 16:47:59 time="2020-08-15T20:47:57.952731822Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.953050782Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.955731462Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.955754251Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.765444149 +0000 UTC m=+0.594278589" 16:47:59 time="2020-08-15T20:47:57.956974417Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-45d3c1d147669746 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.961386190Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-1b357407fecc269 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.961410453Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-6c7ae37ae39d02db WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.962861081Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-4f39635bb7430c66 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.962979371Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.963824251 +0000 UTC m=+0.792658675" 16:47:59 time="2020-08-15T20:47:57.963007004Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="821.096µs" ResumeAt="2020-08-15 20:47:57.963824251 +0000 UTC m=+0.792658675" 16:47:59 time="2020-08-15T20:47:57.963824283Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.965530315Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.966667508Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.966774375Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:57.967406542 +0000 UTC m=+0.796240961" 16:47:59 time="2020-08-15T20:47:57.966808021Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="602.727µs" ResumeAt="2020-08-15 20:47:57.967406542 +0000 UTC m=+0.796240961" 16:47:59 time="2020-08-15T20:47:57.970489883Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.974988304Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:57.975027006Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=524.745474ms Instance=stub-providertype8-2d89c820f5c353cf InstanceType=type8 Since="2020-08-15 20:47:57.343176778 +0000 UTC m=+0.172011213" State=booting 16:47:59 time="2020-08-15T20:47:57.975222615Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.976162668Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.976408221Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-2d89c820f5c353cf WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.976850766Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:57.978991018Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:57.982021380Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:57.982296035Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 ProbeStart="2020-08-15 20:47:57.75496313 +0000 UTC m=+0.583797564" 16:47:59 time="2020-08-15T20:47:57.982702674Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-356aeee5fdde63b1 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.982730885Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-356aeee5fdde63b1 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.744918801 +0000 UTC m=+0.573753237" 16:47:59 time="2020-08-15T20:47:57.982922614Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.982853709 +0000 UTC m=+0.811688153" 16:47:59 time="2020-08-15T20:47:57.983070546Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-54a888203391860a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.983112128Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-54a888203391860a InstanceType=type8 ProbeStart="2020-08-15 20:47:57.754029904 +0000 UTC m=+0.582864334" 16:47:59 time="2020-08-15T20:47:57.983311293Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.983334149Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 ProbeStart="2020-08-15 20:47:57.752602089 +0000 UTC m=+0.581436507" 16:47:59 time="2020-08-15T20:47:57.983477438Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.983490925Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.741372631 +0000 UTC m=+0.570207066" 16:47:59 time="2020-08-15T20:47:57.983769930Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-16cd7d229a95cc49 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.986019144Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-2f8cdfe5e2e4da00 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.768374409 +0000 UTC m=+0.597208847" 16:47:59 time="2020-08-15T20:47:57.986048331Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-2f8cdfe5e2e4da00 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.986066951Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.373059 Instance=stub-providertype6-2f8cdfe5e2e4da00 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.986292196Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45677" Command=true Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.986318707Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45677" Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.874805774 +0000 UTC m=+0.703640208" 16:47:59 time="2020-08-15T20:47:57.987796675Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.987827094Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:57.988916306Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-2fc1667a025b22f1 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:57.994895591Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-402988c9e6acbde7 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:57.995554114Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:57.995855641 +0000 UTC m=+0.824690083" 16:47:59 time="2020-08-15T20:47:57.995585905Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="273.593µs" ResumeAt="2020-08-15 20:47:57.995855641 +0000 UTC m=+0.824690083" 16:47:59 time="2020-08-15T20:47:57.998645570Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-2f8cdfe5e2e4da00 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:57.999862660Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.999888431Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.933412306 +0000 UTC m=+0.762246765" 16:47:59 time="2020-08-15T20:47:57.999977441Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7694a644db212264 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:57.999989847Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7694a644db212264 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.867753254 +0000 UTC m=+0.696587707" 16:47:59 time="2020-08-15T20:47:58.000539909Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.000561249Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.817266328 +0000 UTC m=+0.646100760" 16:47:59 time="2020-08-15T20:47:58.001970497Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.001996158Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.815075987 +0000 UTC m=+0.643910420" 16:47:59 time="2020-08-15T20:47:58.002065905Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=319.555411ms Instance=stub-providertype2-fbb2a14ccdd7af InstanceType=type2 Since="2020-08-15 20:47:57.563622381 +0000 UTC m=+0.392456815" State=booting 16:47:59 time="2020-08-15T20:47:58.002093245Z" level=info msg="boot failed" Address= Duration=319.555411ms Instance=stub-providertype2-fbb2a14ccdd7af InstanceType=type2 ProbeStart="2020-08-15 20:47:57.883177776 +0000 UTC m=+0.712012226" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.002363017Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=176.748407ms Instance=stub-providertype6-79ae05bf7c9a40b8 InstanceType=type6 Since="2020-08-15 20:47:57.609178683 +0000 UTC m=+0.438013116" State=booting 16:47:59 time="2020-08-15T20:47:58.002387776Z" level=info msg="boot failed" Address= Duration=176.748407ms Instance=stub-providertype6-79ae05bf7c9a40b8 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.785927085 +0000 UTC m=+0.614761523" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.002768093Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.002781373Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.90549655 +0000 UTC m=+0.734331052" 16:47:59 time="2020-08-15T20:47:58.002914268Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-356aeee5fdde63b1 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.002939269Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=247.050083ms Instance=stub-providertype8-356aeee5fdde63b1 InstanceType=type8 Since="2020-08-15 20:47:57.497868719 +0000 UTC m=+0.326703154" State=booting 16:47:59 time="2020-08-15T20:47:58.006334857Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.007165967Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.007228658Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.007245428Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.007259074Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.007988545Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.008430253Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:58.008790832 +0000 UTC m=+0.837625244" 16:47:59 time="2020-08-15T20:47:58.008469896Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="333.867µs" ResumeAt="2020-08-15 20:47:58.008790832 +0000 UTC m=+0.837625244" 16:47:59 time="2020-08-15T20:47:58.008663734Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6d7acf370641dfb5 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.008696787Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6d7acf370641dfb5 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.825476332 +0000 UTC m=+0.654310764" 16:47:59 time="2020-08-15T20:47:58.008712610Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.008790832 +0000 UTC m=+0.837625244" 16:47:59 time="2020-08-15T20:47:58.008790152Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="13.808µs" ResumeAt="2020-08-15 20:47:58.008790832 +0000 UTC m=+0.837625244" 16:47:59 time="2020-08-15T20:47:58.009257821Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.009283265Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.824357418 +0000 UTC m=+0.653191866" 16:47:59 time="2020-08-15T20:47:58.010049140Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.010080769Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.981006212 +0000 UTC m=+0.809840645" 16:47:59 time="2020-08-15T20:47:58.012099610Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2195baf7d30e4b85 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.014054404Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.014234221Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.017945285Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.020090015Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.023975895Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-877a649ba141d44 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.024005227Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.024634160Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.024685495Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-fbb2a14ccdd7af WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.024729537Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-356aeee5fdde63b1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.024750422Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-79ae05bf7c9a40b8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.024787105Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.025179471 +0000 UTC m=+0.854013890" 16:47:59 time="2020-08-15T20:47:58.024813596Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="370.144µs" ResumeAt="2020-08-15 20:47:58.025179471 +0000 UTC m=+0.854013890" 16:47:59 time="2020-08-15T20:47:58.025680449Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.025787863Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.013031788 +0000 UTC m=+0.841866204" 16:47:59 time="2020-08-15T20:47:58.025879317Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2195baf7d30e4b85 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.852653706 +0000 UTC m=+0.681488139" 16:47:59 time="2020-08-15T20:47:58.026024948Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.783392562 +0000 UTC m=+0.612226982" 16:47:59 time="2020-08-15T20:47:58.026065825Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.955460566 +0000 UTC m=+0.784295013" 16:47:59 time="2020-08-15T20:47:58.026108123Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.026265809Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.998925418 +0000 UTC m=+0.827759913" 16:47:59 time="2020-08-15T20:47:58.026785944Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.026813765Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.026830108Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.026878821Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.028942144Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-5e90e1770e094fe8 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.031051022Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-3521469161cc970e InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.032047952Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-7755e280959e40fd InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.033033462Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.034883244Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.040728618Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:39691" IdleBehavior=run Instance=stub-providertype8-134739009e96db97 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.043058567Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.999935672 +0000 UTC m=+0.828770138" 16:47:59 time="2020-08-15T20:47:58.043123972Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-877a649ba141d44 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.830911145 +0000 UTC m=+0.659745573" 16:47:59 time="2020-08-15T20:47:58.043151462Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.998831479 +0000 UTC m=+0.827665915" 16:47:59 time="2020-08-15T20:47:58.043396697Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:57.985912592 +0000 UTC m=+0.814747271" 16:47:59 time="2020-08-15T20:47:58.043405742Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.044896645Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-2089c93c79844140 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.044995367Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-434132c8f4a49a23 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.045218539Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-6e28653210474ce6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.045916400Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.047685526Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.048797699Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-3d44b690e0770b97 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.050790181Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.053186885Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-62cccb84eb6e5d01 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.054910200Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-6104a2db88693a9f InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.057535758Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-736888b427bce82c InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.057558542Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-736888b427bce82c InstanceType=type3 ProbeStart="2020-08-15 20:47:57.856939657 +0000 UTC m=+0.685774086" 16:47:59 time="2020-08-15T20:47:58.057631243Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.057652382Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 ProbeStart="2020-08-15 20:47:57.905922381 +0000 UTC m=+0.734756811" 16:47:59 time="2020-08-15T20:47:58.063491831Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-17c7082b4ddb10ea InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.067533809Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.067655516Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype3-6d7acf370641dfb5 InstanceType=type3 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.067688415Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=228.85229ms Instance=stub-providertype3-6d7acf370641dfb5 InstanceType=type3 Since="2020-08-15 20:47:57.596624042 +0000 UTC m=+0.425458474" State=booting 16:47:59 time="2020-08-15T20:47:58.069210426Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.070193694 +0000 UTC m=+0.899028111" 16:47:59 time="2020-08-15T20:47:58.069239090Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="958.303µs" ResumeAt="2020-08-15 20:47:58.070193694 +0000 UTC m=+0.899028111" 16:47:59 time="2020-08-15T20:47:58.069339276Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.070228896Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.071424341Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.071583451Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.071673050Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:58.072387189 +0000 UTC m=+0.901221609" 16:47:59 time="2020-08-15T20:47:58.071694197Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="696.197µs" ResumeAt="2020-08-15 20:47:58.072387189 +0000 UTC m=+0.901221609" 16:47:59 time="2020-08-15T20:47:58.072955531Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.077004277Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.078361731Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-659b37d8e321bc52 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.079111102Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:58.079232028 +0000 UTC m=+0.908066448" 16:47:59 time="2020-08-15T20:47:58.079158932Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="77.867µs" ResumeAt="2020-08-15 20:47:58.079232028 +0000 UTC m=+0.908066448" 16:47:59 time="2020-08-15T20:47:58.083669222Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-6d7acf370641dfb5 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.090061407Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.090467997Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-2195baf7d30e4b85 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.852653706 +0000 UTC m=+0.681488139" 16:47:59 time="2020-08-15T20:47:58.090499887Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-2195baf7d30e4b85 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.090521818Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.525240 Instance=stub-providertype6-2195baf7d30e4b85 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.090753568Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=172.248159ms Instance=stub-providertype6-52486da6db8b1542 InstanceType=type6 Since="2020-08-15 20:47:57.748190559 +0000 UTC m=+0.577024990" State=booting 16:47:59 time="2020-08-15T20:47:58.090790077Z" level=info msg="boot failed" Address= Duration=172.248159ms Instance=stub-providertype6-52486da6db8b1542 InstanceType=type6 ProbeStart="2020-08-15 20:47:57.92043872 +0000 UTC m=+0.749273149" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.090902575Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-28b42e7cfffbf57 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.091048595Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:58.091784523 +0000 UTC m=+0.920618944" 16:47:59 time="2020-08-15T20:47:58.091073308Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="714.624µs" ResumeAt="2020-08-15 20:47:58.091784523 +0000 UTC m=+0.920618944" 16:47:59 time="2020-08-15T20:47:58.091255773Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.091731939Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.092650387Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.092682309Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.092884246Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.092996821Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-5acaa5c0c26b4e61 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.094777591Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype3-877a649ba141d44 InstanceType=type3 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.094815339Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=219.580738ms Instance=stub-providertype3-877a649ba141d44 InstanceType=type3 Since="2020-08-15 20:47:57.611330405 +0000 UTC m=+0.440164835" State=booting 16:47:59 time="2020-08-15T20:47:58.095326955Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.095352489Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.898184297 +0000 UTC m=+0.727018717" 16:47:59 time="2020-08-15T20:47:58.095398624Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-23a414230985ee56 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.095412033Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-23a414230985ee56 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.971724607 +0000 UTC m=+0.800559101" 16:47:59 time="2020-08-15T20:47:58.095449067Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.095606902Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:58.048958412 +0000 UTC m=+0.877792851" 16:47:59 time="2020-08-15T20:47:58.095672214Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.095686960Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.045952991 +0000 UTC m=+0.874787457" 16:47:59 time="2020-08-15T20:47:58.096139857Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.097504223Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:44507" IdleBehavior=run Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.097689069Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-877a649ba141d44 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.097719741Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-52486da6db8b1542 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.097736363Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-2195baf7d30e4b85 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.097789695Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.098759498Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.098758559 +0000 UTC m=+0.927592979" 16:47:59 time="2020-08-15T20:47:58.099505995Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.102081101Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.102265803Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 ProbeStart="2020-08-15 20:47:58.044255911 +0000 UTC m=+0.873090354" 16:47:59 time="2020-08-15T20:47:58.102737705Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:58.102924492 +0000 UTC m=+0.931758922" 16:47:59 time="2020-08-15T20:47:58.102778498Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="151.123µs" ResumeAt="2020-08-15 20:47:58.102924492 +0000 UTC m=+0.931758922" 16:47:59 time="2020-08-15T20:47:58.104806472Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-18102cd50cc22670 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.105006867Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.105037112Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.064951509 +0000 UTC m=+0.893785959" 16:47:59 time="2020-08-15T20:47:58.105043115Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.105087796Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:58.062986876 +0000 UTC m=+0.891821301" 16:47:59 time="2020-08-15T20:47:58.105101631Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.105128587Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 ProbeStart="2020-08-15 20:47:57.975736392 +0000 UTC m=+0.804570827" 16:47:59 time="2020-08-15T20:47:58.105072698Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.105190297Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 ProbeStart="2020-08-15 20:47:58.044983525 +0000 UTC m=+0.873817946" 16:47:59 time="2020-08-15T20:47:58.105100745Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-931afd8b416421 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.105231080Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-931afd8b416421 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.982360512 +0000 UTC m=+0.811194935" 16:47:59 time="2020-08-15T20:47:58.105088341Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.105273978Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.029394114 +0000 UTC m=+0.858228578" 16:47:59 time="2020-08-15T20:47:58.105105838Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.105312172Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.050041908 +0000 UTC m=+0.878876341" 16:47:59 time="2020-08-15T20:47:58.106250260Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.106738269Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.107329425Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.107348464Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.044853318 +0000 UTC m=+0.873687738" 16:47:59 time="2020-08-15T20:47:58.107698216Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.107713005Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 ProbeStart="2020-08-15 20:47:58.067473615 +0000 UTC m=+0.896308057" 16:47:59 time="2020-08-15T20:47:58.107894507Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.107906859Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.89837128 +0000 UTC m=+0.727205712" 16:47:59 time="2020-08-15T20:47:58.107969554Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=236.978202ms Instance=stub-providertype8-628e687e95333623 InstanceType=type8 Since="2020-08-15 20:47:57.715763881 +0000 UTC m=+0.544598307" State=booting 16:47:59 time="2020-08-15T20:47:58.107994940Z" level=info msg="boot failed" Address= Duration=236.978202ms Instance=stub-providertype8-628e687e95333623 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.952742074 +0000 UTC m=+0.781576509" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.111429727Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-326d74010c77412c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.111449212Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-326d74010c77412c InstanceType=type8 ProbeStart="2020-08-15 20:47:57.969501155 +0000 UTC m=+0.798335605" 16:47:59 time="2020-08-15T20:47:58.111488641Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.111500539Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 ProbeStart="2020-08-15 20:47:58.072656828 +0000 UTC m=+0.901491286" 16:47:59 time="2020-08-15T20:47:58.113655654Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-131339e37bcd83b5 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.113851369Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.113871541Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.058008126 +0000 UTC m=+0.886842577" 16:47:59 time="2020-08-15T20:47:58.113930137Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.113948122Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 ProbeStart="2020-08-15 20:47:57.914605149 +0000 UTC m=+0.743439579" 16:47:59 time="2020-08-15T20:47:58.114514646Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-55f9348b36270033 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.114532132Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-55f9348b36270033 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.975468401 +0000 UTC m=+0.804302827" 16:47:59 time="2020-08-15T20:47:58.114666289Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.114684083Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.091006215 +0000 UTC m=+0.919840652" 16:47:59 time="2020-08-15T20:47:58.115466152Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.116141324Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.116167238Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.090296413 +0000 UTC m=+0.919130838" 16:47:59 time="2020-08-15T20:47:58.116682723Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.116721919Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.117636692 +0000 UTC m=+0.946471119" 16:47:59 time="2020-08-15T20:47:58.116745393Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="894.519µs" ResumeAt="2020-08-15 20:47:58.117636692 +0000 UTC m=+0.946471119" 16:47:59 time="2020-08-15T20:47:58.118055088Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-628e687e95333623 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.118123991Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.118223967Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=416.646877ms Instance=stub-providertype3-20ec2d5fb4589140 InstanceType=type3 Since="2020-08-15 20:47:57.637522073 +0000 UTC m=+0.466356515" State=booting 16:47:59 time="2020-08-15T20:47:58.118250806Z" level=info msg="boot failed" Address= Duration=416.646877ms Instance=stub-providertype3-20ec2d5fb4589140 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.054168954 +0000 UTC m=+0.883003392" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.118829463Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.119097603 +0000 UTC m=+0.947932027" 16:47:59 time="2020-08-15T20:47:58.118852399Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="248.674µs" ResumeAt="2020-08-15 20:47:58.119097603 +0000 UTC m=+0.947932027" 16:47:59 time="2020-08-15T20:47:58.119679515Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.119703507Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.119747587Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.120478151Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.120497504Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.091915547 +0000 UTC m=+0.920749992" 16:47:59 time="2020-08-15T20:47:58.120542968Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.120554777Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:57.987001912 +0000 UTC m=+0.815836368" 16:47:59 time="2020-08-15T20:47:58.121769706Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.123229110Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.125097540Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-28c9d1b4f6432818 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.127276292Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.133325022Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-251ab1911b06963e InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.133507841Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.073061837 +0000 UTC m=+0.901896278" 16:47:59 time="2020-08-15T20:47:58.135140126Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.136086351Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-23a414230985ee56 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.971724607 +0000 UTC m=+0.800559101" 16:47:59 time="2020-08-15T20:47:58.136117556Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-23a414230985ee56 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.136136355Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.255315 Instance=stub-providertype8-23a414230985ee56 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.136413694Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.136750027Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.136849544Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.139737596Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-20ec2d5fb4589140 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.139775121Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-5096548dd78c298a InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.140719195Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 ProbeStart="2020-08-15 20:47:58.10319933 +0000 UTC m=+0.932033781" 16:47:59 time="2020-08-15T20:47:58.141091916Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-44482319682c1dde InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.141112124Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-44482319682c1dde InstanceType=type3 ProbeStart="2020-08-15 20:47:58.104933772 +0000 UTC m=+0.933768203" 16:47:59 time="2020-08-15T20:47:58.142990195Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.143293014Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.143723577 +0000 UTC m=+0.972557996" 16:47:59 time="2020-08-15T20:47:58.143335522Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="393.74µs" ResumeAt="2020-08-15 20:47:58.143723577 +0000 UTC m=+0.972557996" 16:47:59 time="2020-08-15T20:47:58.144938721Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.147277657Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-3c3420b82dd4fce2 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.147707829Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-55f9348b36270033 InstanceType=type8 ProbeStart="2020-08-15 20:47:57.975468401 +0000 UTC m=+0.804302827" 16:47:59 time="2020-08-15T20:47:58.147752613Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-55f9348b36270033 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.147781464Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.457790 Instance=stub-providertype8-55f9348b36270033 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.148421773Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.148444903Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:58.116955431 +0000 UTC m=+0.945789889" 16:47:59 time="2020-08-15T20:47:58.148540591Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.148561924Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.133463948 +0000 UTC m=+0.962298388" 16:47:59 time="2020-08-15T20:47:58.148729744Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.148740561Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-13f92b19e7358a5f InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.148831832Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.148870616Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=464.637472ms Instance=stub-providertype2-9fe6955b23d37e InstanceType=type2 Since="2020-08-15 20:47:57.638561884 +0000 UTC m=+0.467396309" State=booting 16:47:59 time="2020-08-15T20:47:58.148895216Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.148908762Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.122628217 +0000 UTC m=+0.951462792" 16:47:59 time="2020-08-15T20:47:58.149167657Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.149183231Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 ProbeStart="2020-08-15 20:47:57.993018013 +0000 UTC m=+0.821852459" 16:47:59 time="2020-08-15T20:47:58.149254067Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.149268761Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.005940357 +0000 UTC m=+0.834774814" 16:47:59 time="2020-08-15T20:47:58.149620804Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.149636622Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 ProbeStart="2020-08-15 20:47:58.025935054 +0000 UTC m=+0.854769490" 16:47:59 time="2020-08-15T20:47:58.149795598Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.149808931Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.026205623 +0000 UTC m=+0.855040056" 16:47:59 time="2020-08-15T20:47:58.151124839Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-9fe6955b23d37e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.151174318Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-55f9348b36270033 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.151188290Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-23a414230985ee56 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.152235157Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7694a644db212264 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.152253865Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7694a644db212264 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.149003646 +0000 UTC m=+0.977838084" 16:47:59 time="2020-08-15T20:47:58.154591929Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-638ff148eb3de8e9 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.154779383Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:58.155553172 +0000 UTC m=+0.984387580" 16:47:59 time="2020-08-15T20:47:58.154812587Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="744.669µs" ResumeAt="2020-08-15 20:47:58.155553172 +0000 UTC m=+0.984387580" 16:47:59 time="2020-08-15T20:47:58.156679642Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.156707456Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.156748594Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.156765494Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.162419994Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-196a76e25692f934 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.162439721Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-196a76e25692f934 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.048056277 +0000 UTC m=+0.876890716" 16:47:59 time="2020-08-15T20:47:58.162618276Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.162746480Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:58.163581768 +0000 UTC m=+0.992416187" 16:47:59 time="2020-08-15T20:47:58.162769418Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="815.497µs" ResumeAt="2020-08-15 20:47:58.163581768 +0000 UTC m=+0.992416187" 16:47:59 time="2020-08-15T20:47:58.163688573Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.166512876Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.167021741Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.170890997Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.180877349Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.180905146Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 ProbeStart="2020-08-15 20:47:58.050948185 +0000 UTC m=+0.879782608" 16:47:59 time="2020-08-15T20:47:58.181096180Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.181111796Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.138865648 +0000 UTC m=+0.967700085" 16:47:59 time="2020-08-15T20:47:58.182831541Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.182851596Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 ProbeStart="2020-08-15 20:47:58.156835009 +0000 UTC m=+0.985669455" 16:47:59 time="2020-08-15T20:47:58.184083993Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.184108711Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.105362829 +0000 UTC m=+0.934197266" 16:47:59 time="2020-08-15T20:47:58.184772893Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.184794102Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.062598965 +0000 UTC m=+0.891433404" 16:47:59 time="2020-08-15T20:47:58.186951260Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-5081060b766c9db6 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.190175727Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=579.896139ms Instance=stub-providertype3-173e5e6e09d0c910 InstanceType=type3 Since="2020-08-15 20:47:57.588175979 +0000 UTC m=+0.417010405" State=booting 16:47:59 time="2020-08-15T20:47:58.190213228Z" level=info msg="boot failed" Address= Duration=579.896139ms Instance=stub-providertype3-173e5e6e09d0c910 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.168072111 +0000 UTC m=+0.996906544" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.190439155Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-42436b170d751c11 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.190916716Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:58.191416261 +0000 UTC m=+1.020250682" 16:47:59 time="2020-08-15T20:47:58.190966112Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="466.328µs" ResumeAt="2020-08-15 20:47:58.191416261 +0000 UTC m=+1.020250682" 16:47:59 time="2020-08-15T20:47:58.192319317Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.195362367Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.195392491Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.195549804Z" level=info msg="boot probe succeeded" Address="127.0.0.1:36819" Command=true Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.195831726Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.196277685Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-63191d58a34080d2 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.196322087Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.192598989 +0000 UTC m=+1.021433402" 16:47:59 time="2020-08-15T20:47:58.196358276Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.192598989 +0000 UTC m=+1.021433402" 16:47:59 time="2020-08-15T20:47:58.196385158Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:58.192598989 +0000 UTC m=+1.021433402" 16:47:59 time="2020-08-15T20:47:58.196410929Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.192598989 +0000 UTC m=+1.021433402" 16:47:59 time="2020-08-15T20:47:58.196442853Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-6eb339154602315f InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.196465543Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.196496637Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.196511326Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:36819" Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 ProbeStart="2020-08-15 20:47:58.047757746 +0000 UTC m=+0.876592166" 16:47:59 time="2020-08-15T20:47:58.196549441Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.142328738 +0000 UTC m=+0.971163168" 16:47:59 time="2020-08-15T20:47:58.197028020Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.197046231Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.197911330Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.197942898Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.197958001Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.198011160Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.202560370Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4192214612966204 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.202590851Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.202907784Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.167182569 +0000 UTC m=+0.996017021" 16:47:59 time="2020-08-15T20:47:58.202976002Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.169990588 +0000 UTC m=+0.998825009" 16:47:59 time="2020-08-15T20:47:58.203011337Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.058065159 +0000 UTC m=+0.886899577" 16:47:59 time="2020-08-15T20:47:58.203110470Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-52183384466dc1d4 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.203277754Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-173e5e6e09d0c910 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.203588347Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.203604847Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.203626254Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.203660968Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-196a76e25692f934 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.209078003Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4192214612966204 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.066735439 +0000 UTC m=+0.895569881" 16:47:59 time="2020-08-15T20:47:58.209217186Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.169098034 +0000 UTC m=+0.997932491" 16:47:59 time="2020-08-15T20:47:58.209507811Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:58.210050773 +0000 UTC m=+1.038885196" 16:47:59 time="2020-08-15T20:47:58.209537392Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="517.258µs" ResumeAt="2020-08-15 20:47:58.210050773 +0000 UTC m=+1.038885196" 16:47:59 time="2020-08-15T20:47:58.210328103Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.211694462Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.211729158Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.17892255 +0000 UTC m=+1.007756999" 16:47:59 time="2020-08-15T20:47:58.212382784Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=431.951202ms Instance=stub-providertype3-60d469ad5e42a3e1 InstanceType=type3 Since="2020-08-15 20:47:57.657448028 +0000 UTC m=+0.486282455" State=booting 16:47:59 time="2020-08-15T20:47:58.212427809Z" level=info msg="boot failed" Address= Duration=431.951202ms Instance=stub-providertype3-60d469ad5e42a3e1 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.089399205 +0000 UTC m=+0.918233657" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.210330170Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45677" Command=true Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.212890743Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=332.188468ms Instance=stub-providertype4-196a76e25692f934 InstanceType=type4 Since="2020-08-15 20:47:57.715867824 +0000 UTC m=+0.544702248" State=booting 16:47:59 time="2020-08-15T20:47:58.213065740Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.213196425Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:58.210050773 +0000 UTC m=+1.038885196" 16:47:59 time="2020-08-15T20:47:58.213229005Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45677" Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.162531377 +0000 UTC m=+0.991365842" 16:47:59 time="2020-08-15T20:47:58.216251125Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-52183384466dc1d4 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.090111646 +0000 UTC m=+0.918946080" 16:47:59 time="2020-08-15T20:47:58.219517105Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-5254827163240d09 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.221480565Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 ProbeStart="2020-08-15 20:47:58.171147565 +0000 UTC m=+0.999982012" 16:47:59 time="2020-08-15T20:47:58.221517515Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 ProbeStart="2020-08-15 20:47:58.179914292 +0000 UTC m=+1.008748726" 16:47:59 time="2020-08-15T20:47:58.221520438Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 ProbeStart="2020-08-15 20:47:58.180949245 +0000 UTC m=+1.009783738" 16:47:59 time="2020-08-15T20:47:58.221889108Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45085" Command=true Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.222478135Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.223263871Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-196a76e25692f934 16:47:59 time="2020-08-15T20:47:58.223570610Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-60d469ad5e42a3e1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.224254497Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.224281713Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.224301468Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.228590316Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-5254827163240d09 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.191136712 +0000 UTC m=+1.019971161" 16:47:59 time="2020-08-15T20:47:58.228643879Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-4d434fdfdf9148e8 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.229515527Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45085" Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.105452075 +0000 UTC m=+0.934286494" 16:47:59 time="2020-08-15T20:47:58.229557108Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:58.223469429 +0000 UTC m=+1.052303848" 16:47:59 time="2020-08-15T20:47:58.229579938Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.223469429 +0000 UTC m=+1.052303848" 16:47:59 time="2020-08-15T20:47:58.229598539Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.186677013 +0000 UTC m=+1.015511463" 16:47:59 time="2020-08-15T20:47:58.229678238Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-74658a99acb615d1 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.230000425Z" level=error msg="create failed" InstanceType=type8 error="rate limited until 2020-08-15 20:47:58.223469429 +0000 UTC m=+1.052303848" 16:47:59 time="2020-08-15T20:47:58.230844838Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.230881104Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.230935170Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.232083323Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-4b776a3dec6c61e1 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.233032603Z" level=error msg="create failed" InstanceType=type2 error="rate limited until 2020-08-15 20:47:58.233044076 +0000 UTC m=+1.061878495" 16:47:59 time="2020-08-15T20:47:58.233710236Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.233744784Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 ProbeStart="2020-08-15 20:47:58.201992103 +0000 UTC m=+1.030826553" 16:47:59 time="2020-08-15T20:47:58.234818183Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.236814276Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.238773953Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.239890534Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.239911927Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.172053349 +0000 UTC m=+1.000887782" 16:47:59 time="2020-08-15T20:47:58.240042059Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.243236203Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-196a76e25692f934 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.245925894Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.245952252Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.200892901 +0000 UTC m=+1.029727378" 16:47:59 time="2020-08-15T20:47:58.246070462Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.246085546Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.078052262 +0000 UTC m=+0.906886723" 16:47:59 time="2020-08-15T20:47:58.247501386Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-4cb2efc43499d044 InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.249146195Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7e35102d2344f95c InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.249170421Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7e35102d2344f95c InstanceType=type6 ProbeStart="2020-08-15 20:47:58.137582882 +0000 UTC m=+0.966417321" 16:47:59 time="2020-08-15T20:47:58.256281664Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71075a807b512662 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.256302797Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71075a807b512662 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.064037563 +0000 UTC m=+0.892872003" 16:47:59 time="2020-08-15T20:47:58.268882224Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-52183384466dc1d4 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.272043920Z" level=info msg="boot probe succeeded" Address="127.0.0.1:35857" Command=true Instance=stub-providertype6-5d214064018153da InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.272070195Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:35857" Instance=stub-providertype6-5d214064018153da InstanceType=type6 ProbeStart="2020-08-15 20:47:58.226444196 +0000 UTC m=+1.055278616" 16:47:59 time="2020-08-15T20:47:58.272113850Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-a6dc35cdf94a493 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.272128710Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-a6dc35cdf94a493 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.110976383 +0000 UTC m=+0.939810832" 16:47:59 time="2020-08-15T20:47:58.273931545Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=210.389553ms Instance=stub-providertype8-52183384466dc1d4 InstanceType=type8 Since="2020-08-15 20:47:57.879722107 +0000 UTC m=+0.708556527" State=booting 16:47:59 time="2020-08-15T20:47:58.281066243Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.281276830Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-5254827163240d09 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.281963632Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.282019363Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.282049063Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.229469578 +0000 UTC m=+1.058304026" 16:47:59 time="2020-08-15T20:47:58.282088706Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 ProbeStart="2020-08-15 20:47:58.228539839 +0000 UTC m=+1.057374299" 16:47:59 time="2020-08-15T20:47:58.282131125Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=626.627842ms Instance=stub-providertype4-5254827163240d09 InstanceType=type4 Since="2020-08-15 20:47:57.564508883 +0000 UTC m=+0.393343319" State=booting 16:47:59 time="2020-08-15T20:47:58.282499233Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.282517673Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.242098165 +0000 UTC m=+1.070932607" 16:47:59 time="2020-08-15T20:47:58.282612237Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.282625386Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.147824491 +0000 UTC m=+0.976658924" 16:47:59 time="2020-08-15T20:47:58.282951286Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.284277522Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-52a7176239679fd3 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.287003758Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-52183384466dc1d4 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.287048315Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-5254827163240d09 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.287007456Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-54a888203391860a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.287533273Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-54a888203391860a InstanceType=type8 ProbeStart="2020-08-15 20:47:58.239363094 +0000 UTC m=+1.068197544" 16:47:59 time="2020-08-15T20:47:58.288152164Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-70cf1e538a5157eb InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.291548587Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.291572950Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.151208802 +0000 UTC m=+0.980043235" 16:47:59 time="2020-08-15T20:47:58.298506110Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5d18c9ed03aabae5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.298532315Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5d18c9ed03aabae5 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.147939452 +0000 UTC m=+0.976773875" 16:47:59 time="2020-08-15T20:47:58.298817241Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4e12d515167bb82c InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.298838558Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4e12d515167bb82c InstanceType=type6 ProbeStart="2020-08-15 20:47:58.162959218 +0000 UTC m=+0.991793659" 16:47:59 time="2020-08-15T20:47:58.299001085Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.299016686Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 ProbeStart="2020-08-15 20:47:58.149910539 +0000 UTC m=+0.978745018" 16:47:59 time="2020-08-15T20:47:58.302611964Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-7e35102d2344f95c InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.303622163Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=472.69619ms Instance=stub-providertype6-7e35102d2344f95c InstanceType=type6 Since="2020-08-15 20:47:57.6648867 +0000 UTC m=+0.493721131" State=booting 16:47:59 time="2020-08-15T20:47:58.304755677Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.304900047Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-a6dc35cdf94a493 InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.304935391Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=364.65789ms Instance=stub-providertype6-a6dc35cdf94a493 InstanceType=type6 Since="2020-08-15 20:47:57.746318525 +0000 UTC m=+0.575152942" State=booting 16:47:59 time="2020-08-15T20:47:58.305294457Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-7586b21b9728391e InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.306153804Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000101 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.307940371Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.315054098Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-7e35102d2344f95c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.315090800Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-a6dc35cdf94a493 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.315374752Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-d9270425c03436 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.315391985Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-d9270425c03436 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.166096131 +0000 UTC m=+0.994930568" 16:47:59 time="2020-08-15T20:47:58.315441336Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.315536887Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.148092824 +0000 UTC m=+0.976927254" 16:47:59 time="2020-08-15T20:47:58.323201837Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=300.083514ms Instance=stub-providertype4-21aed68ac35f19f0 InstanceType=type4 Since="2020-08-15 20:47:57.877680071 +0000 UTC m=+0.706514488" State=booting 16:47:59 time="2020-08-15T20:47:58.323243155Z" level=info msg="boot failed" Address= Duration=300.083514ms Instance=stub-providertype4-21aed68ac35f19f0 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.177763558 +0000 UTC m=+1.006598002" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.323277352Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-21aed68ac35f19f0 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.324448079Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.328380421Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.333976887Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-5d18c9ed03aabae5 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.147939452 +0000 UTC m=+0.976773875" 16:47:59 time="2020-08-15T20:47:58.334016261Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-5d18c9ed03aabae5 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.334036811Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.616249 Instance=stub-providertype8-5d18c9ed03aabae5 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.334930956Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.335250504Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.335303139Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-50d4397dca20e3f9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.335325112Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-50d4397dca20e3f9 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.186915204 +0000 UTC m=+1.015749651" 16:47:59 time="2020-08-15T20:47:58.337821968Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-4e12d515167bb82c InstanceType=type6 ProbeStart="2020-08-15 20:47:58.162959218 +0000 UTC m=+0.991793659" 16:47:59 time="2020-08-15T20:47:58.337850259Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-4e12d515167bb82c InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.337868444Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.530275 Instance=stub-providertype6-4e12d515167bb82c InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.344665801Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-21aed68ac35f19f0 16:47:59 time="2020-08-15T20:47:58.345651228Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.345823893Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.346972002Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-5d18c9ed03aabae5 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.346997161Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-4e12d515167bb82c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.351281086Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.352747458Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.355116755Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-74333a1db0299ef3 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.356172859Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.305029523 +0000 UTC m=+1.133863957" 16:47:59 time="2020-08-15T20:47:58.356223672Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.294111369 +0000 UTC m=+1.122945816" 16:47:59 time="2020-08-15T20:47:58.356260208Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 ProbeStart="2020-08-15 20:47:58.294922798 +0000 UTC m=+1.123757269" 16:47:59 time="2020-08-15T20:47:58.358618575Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-21aed68ac35f19f0 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.367910334Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-d9270425c03436 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.367952895Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=400.572199ms Instance=stub-providertype4-d9270425c03436 InstanceType=type4 Since="2020-08-15 20:47:57.765523947 +0000 UTC m=+0.594358369" State=booting 16:47:59 time="2020-08-15T20:47:58.368171361Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.368192754Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.315920367 +0000 UTC m=+1.144754814" 16:47:59 time="2020-08-15T20:47:58.368554930Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.368569148Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.307323074 +0000 UTC m=+1.136157516" 16:47:59 time="2020-08-15T20:47:58.368765820Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.368839039Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.368859868Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.315402905 +0000 UTC m=+1.144237347" 16:47:59 time="2020-08-15T20:47:58.368907955Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-65157426e50ec28b InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.368919967Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-65157426e50ec28b InstanceType=type6 ProbeStart="2020-08-15 20:47:58.216266069 +0000 UTC m=+1.045100489" 16:47:59 time="2020-08-15T20:47:58.369145089Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=445.32644ms Instance=stub-providertype4-14f9503a50da3d91 InstanceType=type4 Since="2020-08-15 20:47:57.858505754 +0000 UTC m=+0.687340183" State=booting 16:47:59 time="2020-08-15T20:47:58.369175448Z" level=info msg="boot failed" Address= Duration=445.32644ms Instance=stub-providertype4-14f9503a50da3d91 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.303832189 +0000 UTC m=+1.132666623" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.369207638Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-14f9503a50da3d91 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.369285096Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-40daa2804b1aa313 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.371301105Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.378454346Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1afdd2f816d19945 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.378815849Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.381188783Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-14f9503a50da3d91 16:47:59 time="2020-08-15T20:47:58.381311460Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-d9270425c03436 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.382335285Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-50663c4c6c049ff9 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.382525485Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1afdd2f816d19945 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.226352625 +0000 UTC m=+1.055187070" 16:47:59 time="2020-08-15T20:47:58.382568050Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.335157656 +0000 UTC m=+1.163992102" 16:47:59 time="2020-08-15T20:47:58.382650294Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-581092e28026dcd InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.382675899Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-581092e28026dcd InstanceType=type4 ProbeStart="2020-08-15 20:47:58.316534321 +0000 UTC m=+1.145368756" 16:47:59 time="2020-08-15T20:47:58.383373552Z" level=warning msg="new instance unresponsive, shutting down" Address="127.0.0.1:39709" Duration=551.04353ms Instance=stub-providertype2-38fa0450cbcd2243 InstanceType=type2 Since="2020-08-15 20:47:57.76942251 +0000 UTC m=+0.598256944" State=booting 16:47:59 time="2020-08-15T20:47:58.383410181Z" level=info msg="boot failed" Address="127.0.0.1:39709" Duration=551.04353ms Instance=stub-providertype2-38fa0450cbcd2243 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.320465985 +0000 UTC m=+1.149300474" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.383430294Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-65157426e50ec28b InstanceType=type6 ProbeStart="2020-08-15 20:47:58.216266069 +0000 UTC m=+1.045100489" 16:47:59 time="2020-08-15T20:47:58.383451801Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-65157426e50ec28b InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.383469197Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.717435 Instance=stub-providertype6-65157426e50ec28b InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.384190556Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.384214521Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.190761901 +0000 UTC m=+1.019596339" 16:47:59 time="2020-08-15T20:47:58.384443361Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4f3c5d4e5f7684cf InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.384461805Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4f3c5d4e5f7684cf InstanceType=type3 ProbeStart="2020-08-15 20:47:58.242157342 +0000 UTC m=+1.070991784" 16:47:59 time="2020-08-15T20:47:58.388877933Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-50d4397dca20e3f9 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.388909438Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=502.727467ms Instance=stub-providertype4-50d4397dca20e3f9 InstanceType=type4 Since="2020-08-15 20:47:57.684187738 +0000 UTC m=+0.513022184" State=booting 16:47:59 time="2020-08-15T20:47:58.389306379Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.389322216Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.22259133 +0000 UTC m=+1.051425763" 16:47:59 time="2020-08-15T20:47:58.389898877Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.389917092Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.323080135 +0000 UTC m=+1.151914576" 16:47:59 time="2020-08-15T20:47:58.391118468Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.391138005Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 ProbeStart="2020-08-15 20:47:58.323357767 +0000 UTC m=+1.152192206" 16:47:59 time="2020-08-15T20:47:58.392210219Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.392244879Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000121 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.392259925Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.393476760Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-3bc219a5c50811b4 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.397033061Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-50d4397dca20e3f9 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.397060822Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-65157426e50ec28b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.397075534Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-14f9503a50da3d91 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.397088913Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-38fa0450cbcd2243 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.398009069Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-48856598f07b0c4f InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.398101378Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.398116467Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 ProbeStart="2020-08-15 20:47:58.329621574 +0000 UTC m=+1.158456019" 16:47:59 time="2020-08-15T20:47:58.398729449Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:58.398968143 +0000 UTC m=+1.227802556" 16:47:59 time="2020-08-15T20:47:58.398756769Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="214.603µs" ResumeAt="2020-08-15 20:47:58.398968143 +0000 UTC m=+1.227802556" 16:47:59 time="2020-08-15T20:47:58.398909292Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype3-1afdd2f816d19945 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.226352625 +0000 UTC m=+1.055187070" 16:47:59 time="2020-08-15T20:47:58.398932440Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype3-1afdd2f816d19945 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.398950838Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.537854 Instance=stub-providertype3-1afdd2f816d19945 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.399005002Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.399019486Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.356497866 +0000 UTC m=+1.185332298" 16:47:59 time="2020-08-15T20:47:58.399251066Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.399356700Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=325.171391ms Instance=stub-providertype4-45d3c1d147669746 InstanceType=type4 Since="2020-08-15 20:47:57.9569946 +0000 UTC m=+0.785829025" State=booting 16:47:59 time="2020-08-15T20:47:58.399387789Z" level=info msg="boot failed" Address= Duration=325.171391ms Instance=stub-providertype4-45d3c1d147669746 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.282165985 +0000 UTC m=+1.111000416" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.400062434Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.400087661Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.400673636Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=536.242493ms Instance=stub-providertype4-cae54ddc325f819 InstanceType=type4 Since="2020-08-15 20:47:57.680920012 +0000 UTC m=+0.509754443" State=booting 16:47:59 time="2020-08-15T20:47:58.400709817Z" level=info msg="boot failed" Address= Duration=536.242493ms Instance=stub-providertype4-cae54ddc325f819 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.217162487 +0000 UTC m=+1.045996936" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.400786179Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.400799983Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.356125328 +0000 UTC m=+1.184959775" 16:47:59 time="2020-08-15T20:47:58.400993643Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.406991608Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=475.618928ms Instance=stub-providertype6-7fc960db0e00730a InstanceType=type6 Since="2020-08-15 20:47:57.859538747 +0000 UTC m=+0.688373174" State=booting 16:47:59 time="2020-08-15T20:47:58.407484347Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-252e76038f4a0972 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.412567406Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-c9f37670c47cca8 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.412861080Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.412877625Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.382946467 +0000 UTC m=+1.211780907" 16:47:59 time="2020-08-15T20:47:58.412919158Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.412939790Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.367984983 +0000 UTC m=+1.196819413" 16:47:59 time="2020-08-15T20:47:58.413126552Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.413196929Z" level=error msg="create failed" InstanceType=type4 error="rate limited until 2020-08-15 20:47:58.413528089 +0000 UTC m=+1.242362517" 16:47:59 time="2020-08-15T20:47:58.413218914Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="312.585µs" ResumeAt="2020-08-15 20:47:58.413528089 +0000 UTC m=+1.242362517" 16:47:59 time="2020-08-15T20:47:58.414910956Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.414937927Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.415222935Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-931afd8b416421 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.415246251Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-931afd8b416421 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.38268767 +0000 UTC m=+1.211522148" 16:47:59 time="2020-08-15T20:47:58.416027430Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.416048671Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 ProbeStart="2020-08-15 20:47:58.216437016 +0000 UTC m=+1.045271440" 16:47:59 time="2020-08-15T20:47:58.416072287Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-ce9e06596372b2d InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.416704744Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.416721044Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 ProbeStart="2020-08-15 20:47:58.382250148 +0000 UTC m=+1.211084595" 16:47:59 time="2020-08-15T20:47:58.417210188Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-2b97025e09a770eb InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.417798308Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=335.244778ms Instance=stub-providertype8-661c8184b38c6f71 InstanceType=type8 Since="2020-08-15 20:47:57.928758952 +0000 UTC m=+0.757593383" State=booting 16:47:59 time="2020-08-15T20:47:58.417832616Z" level=info msg="boot failed" Address= Duration=335.244778ms Instance=stub-providertype8-661c8184b38c6f71 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.264003736 +0000 UTC m=+1.092838161" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.419366218Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.419399764Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.419420030Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-63191d58a34080d2 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.419431701Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-cae54ddc325f819 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.419453624Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-1afdd2f816d19945 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.419466332Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-45d3c1d147669746 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.419477275Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.419480356Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-7fc960db0e00730a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.419949569Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.420094309Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 ProbeStart="2020-08-15 20:47:58.227444316 +0000 UTC m=+1.056278765" 16:47:59 time="2020-08-15T20:47:58.420146315Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.382293002 +0000 UTC m=+1.211127435" 16:47:59 time="2020-08-15T20:47:58.420179913Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-63191d58a34080d2 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.259531128 +0000 UTC m=+1.088365575" 16:47:59 time="2020-08-15T20:47:58.420242988Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.358654573 +0000 UTC m=+1.187489007" 16:47:59 time="2020-08-15T20:47:58.420285621Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-332ec197fda2625d InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.423065611Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-76faa982abce3a0c InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.424395543Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-736888b427bce82c InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.424430435Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-736888b427bce82c InstanceType=type3 ProbeStart="2020-08-15 20:47:58.384051658 +0000 UTC m=+1.212886089" 16:47:59 time="2020-08-15T20:47:58.426578825Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype3-4f3c5d4e5f7684cf InstanceType=type3 ProbeStart="2020-08-15 20:47:58.242157342 +0000 UTC m=+1.070991784" 16:47:59 time="2020-08-15T20:47:58.426619903Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype3-4f3c5d4e5f7684cf InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.426649267Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.679254 Instance=stub-providertype3-4f3c5d4e5f7684cf InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.419468450Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.427176206Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 ProbeStart="2020-08-15 20:47:58.229924259 +0000 UTC m=+1.058758693" 16:47:59 time="2020-08-15T20:47:58.429419220Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.429442687Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 ProbeStart="2020-08-15 20:47:58.263490926 +0000 UTC m=+1.092325387" 16:47:59 time="2020-08-15T20:47:58.430426477Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.430447395Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 ProbeStart="2020-08-15 20:47:58.223605516 +0000 UTC m=+1.052439950" 16:47:59 time="2020-08-15T20:47:58.430498638Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.430510446Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.391210429 +0000 UTC m=+1.220044891" 16:47:59 time="2020-08-15T20:47:58.430972608Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-326d74010c77412c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.430994047Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-326d74010c77412c InstanceType=type8 ProbeStart="2020-08-15 20:47:58.371423078 +0000 UTC m=+1.200257524" 16:47:59 time="2020-08-15T20:47:58.431641035Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.432603984Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-661c8184b38c6f71 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.432626294Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-4f3c5d4e5f7684cf WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.435482054Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.437380270Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.437400596Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.244983322 +0000 UTC m=+1.073817782" 16:47:59 time="2020-08-15T20:47:58.440725205Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.440748864Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.252032567 +0000 UTC m=+1.080867001" 16:47:59 time="2020-08-15T20:47:58.440792082Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.440804469Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.36898049 +0000 UTC m=+1.197814913" 16:47:59 time="2020-08-15T20:47:58.443587093Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.443605471Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.393340205 +0000 UTC m=+1.222174706" 16:47:59 time="2020-08-15T20:47:58.445527666Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.445546849Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.290961512 +0000 UTC m=+1.119795956" 16:47:59 time="2020-08-15T20:47:58.448229363Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.448261228Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 ProbeStart="2020-08-15 20:47:58.245915344 +0000 UTC m=+1.074749871" 16:47:59 time="2020-08-15T20:47:58.453710595Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.453733941Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:58.389846732 +0000 UTC m=+1.218681173" 16:47:59 time="2020-08-15T20:47:58.460193891Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.460219931Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.409968779 +0000 UTC m=+1.238803210" 16:47:59 time="2020-08-15T20:47:58.460283816Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-28b9c12307c2a6b2 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.460297163Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-28b9c12307c2a6b2 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.290069582 +0000 UTC m=+1.118904025" 16:47:59 time="2020-08-15T20:47:58.460595212Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.460682001Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5acaa5c0c26b4e61 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.460883705Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.461001746Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.461283465Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.461316600Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.433198918 +0000 UTC m=+1.262033372" 16:47:59 time="2020-08-15T20:47:58.461602004Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5acaa5c0c26b4e61 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.265168284 +0000 UTC m=+1.094002755" 16:47:59 time="2020-08-15T20:47:58.461641780Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.407071944 +0000 UTC m=+1.235906388" 16:47:59 time="2020-08-15T20:47:58.461675065Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.414907817 +0000 UTC m=+1.243742290" 16:47:59 time="2020-08-15T20:47:58.461709608Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.433910989 +0000 UTC m=+1.262745410" 16:47:59 time="2020-08-15T20:47:58.467698010Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.468860981Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=179.264493ms Instance=stub-providertype6-18102cd50cc22670 InstanceType=type6 Since="2020-08-15 20:47:58.104826975 +0000 UTC m=+0.933661408" State=booting 16:47:59 time="2020-08-15T20:47:58.468899966Z" level=info msg="boot failed" Address= Duration=179.264493ms Instance=stub-providertype6-18102cd50cc22670 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.284091468 +0000 UTC m=+1.112925901" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.469809396Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.470058828Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.473036923Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.473150771Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-18102cd50cc22670 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.473429951Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.473448434Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.292214523 +0000 UTC m=+1.121048946" 16:47:59 time="2020-08-15T20:47:58.474302167Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.474322095Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.453647082 +0000 UTC m=+1.282481547" 16:47:59 time="2020-08-15T20:47:58.474480785Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.244983322 +0000 UTC m=+1.073817782" 16:47:59 time="2020-08-15T20:47:58.474501848Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.474519512Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.508956 Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.474554650Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.475306436Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2fc1667a025b22f1 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.475337831Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2fc1667a025b22f1 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.329319668 +0000 UTC m=+1.158154128" 16:47:59 time="2020-08-15T20:47:58.477757767Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.481265245Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.358915452 +0000 UTC m=+1.187749883" 16:47:59 time="2020-08-15T20:47:58.481737854Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.481743529Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=422.707577ms Instance=stub-providertype8-6448d41ce747221f InstanceType=type8 Since="2020-08-15 20:47:57.89830689 +0000 UTC m=+0.727141313" State=booting 16:47:59 time="2020-08-15T20:47:58.481784074Z" level=info msg="boot failed" Address= Duration=422.707577ms Instance=stub-providertype8-6448d41ce747221f InstanceType=type8 ProbeStart="2020-08-15 20:47:58.321014432 +0000 UTC m=+1.149848890" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.481814593Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-159e385147f955ac InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.482013898Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 ProbeStart="2020-08-15 20:47:58.445914628 +0000 UTC m=+1.274749062" 16:47:59 time="2020-08-15T20:47:58.482054119Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-63191d58a34080d2 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.259531128 +0000 UTC m=+1.088365575" 16:47:59 time="2020-08-15T20:47:58.482074117Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-63191d58a34080d2 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.482090498Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.285773 Instance=stub-providertype8-63191d58a34080d2 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.483043633Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.483069063Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.485197900Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.485220165Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.45391395 +0000 UTC m=+1.282748374" 16:47:59 time="2020-08-15T20:47:58.489041661Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-7ed543364803913b InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.491255386Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-387bfba4009ba942 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.491846953Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-6ef7c314b25f2556 16:47:59 time="2020-08-15T20:47:58.492350372Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-63191d58a34080d2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.492373581Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-6448d41ce747221f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.492410617Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-6ef7c314b25f2556 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.493020651Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.493040644Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.382441302 +0000 UTC m=+1.211275732" 16:47:59 time="2020-08-15T20:47:58.493582168Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.493619365Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-28b9c12307c2a6b2 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.493665327Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 ProbeStart="2020-08-15 20:47:58.461555581 +0000 UTC m=+1.290390016" 16:47:59 time="2020-08-15T20:47:58.493708146Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-5acaa5c0c26b4e61 InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.493730797Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=361.067079ms Instance=stub-providertype8-28b9c12307c2a6b2 InstanceType=type8 Since="2020-08-15 20:47:57.92900252 +0000 UTC m=+0.757836946" State=booting 16:47:59 time="2020-08-15T20:47:58.495268122Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.495545689Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-f46a39a335e8aab InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.496685147Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=172.157354ms Instance=stub-providertype6-5acaa5c0c26b4e61 InstanceType=type6 Since="2020-08-15 20:47:58.093010968 +0000 UTC m=+0.921845401" State=booting 16:47:59 time="2020-08-15T20:47:58.505161852Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.505187462Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:58.480917496 +0000 UTC m=+1.309751967" 16:47:59 time="2020-08-15T20:47:58.507090617Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.507141069Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.505111467 +0000 UTC m=+1.333945899" 16:47:59 time="2020-08-15T20:47:58.510392067Z" level=info msg="boot probe succeeded" Address="127.0.0.1:36819" Command=true Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.510413579Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:36819" Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 ProbeStart="2020-08-15 20:47:58.467911823 +0000 UTC m=+1.296746247" 16:47:59 time="2020-08-15T20:47:58.511237798Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.511260758Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:58.506914131 +0000 UTC m=+1.335748578" 16:47:59 time="2020-08-15T20:47:58.511433146Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.512559973Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.505111467 +0000 UTC m=+1.333945899" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:58.515430072Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-6ef7c314b25f2556 16:47:59 time="2020-08-15T20:47:58.515561694Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-5acaa5c0c26b4e61 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.515581352Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-28b9c12307c2a6b2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.515703226Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.517311156Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.517946688Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-2fc1667a025b22f1 InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.521942161Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.521968792Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-638ff148eb3de8e9 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.522475650Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.48513255 +0000 UTC m=+1.313966996" 16:47:59 time="2020-08-15T20:47:58.522800640Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 ProbeStart="2020-08-15 20:47:58.417070717 +0000 UTC m=+1.245905136" 16:47:59 time="2020-08-15T20:47:58.522850405Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=340.382017ms Instance=stub-providertype6-2fc1667a025b22f1 InstanceType=type6 Since="2020-08-15 20:47:57.98893768 +0000 UTC m=+0.817772111" State=booting 16:47:59 time="2020-08-15T20:47:58.523695024Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-86d109024279992 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.523713527Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-86d109024279992 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.415913373 +0000 UTC m=+1.244747816" 16:47:59 time="2020-08-15T20:47:58.524794661Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.524813969Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.513094522 +0000 UTC m=+1.341928975" 16:47:59 time="2020-08-15T20:47:58.525698635Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.525717471Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.356952857 +0000 UTC m=+1.185787308" 16:47:59 time="2020-08-15T20:47:58.526736292Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71075a807b512662 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.526754185Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71075a807b512662 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.51281848 +0000 UTC m=+1.341652923" 16:47:59 time="2020-08-15T20:47:58.529799994Z" level=info msg="instance appeared in cloud" Address="127.0.0.1:41983" IdleBehavior=run Instance=stub-providertype6-4b9fa82686be7e12 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.529965386Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-2fc1667a025b22f1 16:47:59 time="2020-08-15T20:47:58.530070902Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-6ef7c314b25f2556 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.530314434Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.49649462 +0000 UTC m=+1.325329070" 16:47:59 time="2020-08-15T20:47:58.530367315Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-638ff148eb3de8e9 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.394911874 +0000 UTC m=+1.223746352" 16:47:59 time="2020-08-15T20:47:58.533039852Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000038 Instance=stub-providertype6-c567a08fb7edb1a PID=1 16:47:59 time="2020-08-15T20:47:58.533351140Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=448.857058ms Instance=stub-providertype8-7755e280959e40fd InstanceType=type8 Since="2020-08-15 20:47:58.032066999 +0000 UTC m=+0.860901424" State=booting 16:47:59 time="2020-08-15T20:47:58.533392751Z" level=info msg="boot failed" Address= Duration=448.857058ms Instance=stub-providertype8-7755e280959e40fd InstanceType=type8 ProbeStart="2020-08-15 20:47:58.480924059 +0000 UTC m=+1.309758482" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.534584681Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.534604213Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.504500649 +0000 UTC m=+1.333335068" 16:47:59 time="2020-08-15T20:47:58.539710201Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000038 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.544093056Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-2fc1667a025b22f1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.544124844Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-7755e280959e40fd WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.555665312Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.555696217Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.466913249 +0000 UTC m=+1.295747695" 16:47:59 time="2020-08-15T20:47:58.555987970Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4192214612966204 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.556006069Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4192214612966204 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.525918285 +0000 UTC m=+1.354752719" 16:47:59 time="2020-08-15T20:47:58.556118696Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.556130505Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.445784126 +0000 UTC m=+1.274618551" 16:47:59 time="2020-08-15T20:47:58.556372056Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.556440958Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.557395376Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.557419467Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 ProbeStart="2020-08-15 20:47:58.526914049 +0000 UTC m=+1.355748498" 16:47:59 time="2020-08-15T20:47:58.558599851Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-7df598dcde9e5526 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.561249260Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000038 ExitCode=3 Instance=stub-providertype6-c567a08fb7edb1a PID=1 16:47:59 time="2020-08-15T20:47:58.561341631Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.566463548Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000038 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:58.566613686Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.566636831Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.389956189 +0000 UTC m=+1.218790621" 16:47:59 time="2020-08-15T20:47:58.566696077Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.566709942Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 ProbeStart="2020-08-15 20:47:58.533239748 +0000 UTC m=+1.362074207" 16:47:59 time="2020-08-15T20:47:58.567085723Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.567123256Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 ProbeStart="2020-08-15 20:47:58.465937147 +0000 UTC m=+1.294771601" 16:47:59 time="2020-08-15T20:47:58.567313885Z" level=info msg="boot probe succeeded" Address="127.0.0.1:44507" Command=true Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.567328999Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:44507" Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.367130671 +0000 UTC m=+1.195965121" 16:47:59 time="2020-08-15T20:47:58.567481403Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6eb339154602315f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.567494449Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6eb339154602315f InstanceType=type8 ProbeStart="2020-08-15 20:47:58.407339994 +0000 UTC m=+1.236174429" 16:47:59 time="2020-08-15T20:47:58.567902910Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-638ff148eb3de8e9 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.394911874 +0000 UTC m=+1.223746352" 16:47:59 time="2020-08-15T20:47:58.567926931Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-638ff148eb3de8e9 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.567955244Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.413335 Instance=stub-providertype6-638ff148eb3de8e9 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.568906313Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.569153368Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-22614d6fbeca336a InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.584667832Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.585378658Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.585408424Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000038 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:58.585658893Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-638ff148eb3de8e9 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.585727066Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 ProbeStart="2020-08-15 20:47:58.485915292 +0000 UTC m=+1.314749716" 16:47:59 time="2020-08-15T20:47:58.585775411Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.439913184 +0000 UTC m=+1.268747614" 16:47:59 time="2020-08-15T20:47:58.591361637Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.591408404Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.539937284 +0000 UTC m=+1.368771717" 16:47:59 time="2020-08-15T20:47:58.596330551Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.596359992Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.539292067 +0000 UTC m=+1.368126519" 16:47:59 time="2020-08-15T20:47:58.596945304Z" level=info msg="boot probe succeeded" Address="127.0.0.1:39691" Command=true Instance=stub-providertype8-134739009e96db97 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.596968817Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:39691" Instance=stub-providertype8-134739009e96db97 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.394437246 +0000 UTC m=+1.223271692" 16:47:59 time="2020-08-15T20:47:58.597017494Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3521469161cc970e InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.597030579Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3521469161cc970e InstanceType=type6 ProbeStart="2020-08-15 20:47:58.506256027 +0000 UTC m=+1.335090585" 16:47:59 time="2020-08-15T20:47:58.597233614Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4b776a3dec6c61e1 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.597246742Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4b776a3dec6c61e1 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.433238635 +0000 UTC m=+1.262073062" 16:47:59 time="2020-08-15T20:47:58.597396368Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-38a899594bff05d4 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.597414744Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-38a899594bff05d4 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.452115668 +0000 UTC m=+1.280950111" 16:47:59 time="2020-08-15T20:47:58.608487867Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.608511278Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.565923708 +0000 UTC m=+1.394758129" 16:47:59 time="2020-08-15T20:47:58.609480018Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-131339e37bcd83b5 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.609498603Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-131339e37bcd83b5 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.503408623 +0000 UTC m=+1.332243089" 16:47:59 time="2020-08-15T20:47:58.610024375Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.610045735Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.503421021 +0000 UTC m=+1.332255442" 16:47:59 time="2020-08-15T20:47:58.614234293Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.614258534Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.562910464 +0000 UTC m=+1.391744888" 16:47:59 time="2020-08-15T20:47:58.614601055Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.615729881Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.615758888Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45085" Command=true Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.616557368Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-44482319682c1dde InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.624216633Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45085" Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.59088394 +0000 UTC m=+1.419718398" 16:47:59 time="2020-08-15T20:47:58.624283597Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-44482319682c1dde InstanceType=type3 ProbeStart="2020-08-15 20:47:58.585825075 +0000 UTC m=+1.414659516" 16:47:59 time="2020-08-15T20:47:58.624692313Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.624717567Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.592682852 +0000 UTC m=+1.421517289" 16:47:59 time="2020-08-15T20:47:58.624928379Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-3d44b690e0770b97 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.624951965Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-3d44b690e0770b97 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.468926357 +0000 UTC m=+1.297760806" 16:47:59 time="2020-08-15T20:47:58.630951550Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 ProbeStart="2020-08-15 20:47:58.482308105 +0000 UTC m=+1.311142537" 16:47:59 time="2020-08-15T20:47:58.631131575Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.631147585Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 ProbeStart="2020-08-15 20:47:58.496741244 +0000 UTC m=+1.325575667" 16:47:59 time="2020-08-15T20:47:58.632412012Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.632434012Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.62624773 +0000 UTC m=+1.455082166" 16:47:59 time="2020-08-15T20:47:58.633736343Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.633760481Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.555914979 +0000 UTC m=+1.384749411" 16:47:59 time="2020-08-15T20:47:58.638489211Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.638509862Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.559600344 +0000 UTC m=+1.388434789" 16:47:59 time="2020-08-15T20:47:58.638590076Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.62624773 +0000 UTC m=+1.455082166" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:58.639597055Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-38a899594bff05d4 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.639631518Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=548.103774ms Instance=stub-providertype8-38a899594bff05d4 InstanceType=type8 Since="2020-08-15 20:47:57.904011906 +0000 UTC m=+0.732846337" State=booting 16:47:59 time="2020-08-15T20:47:58.640244956Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.640276214Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-5e90e1770e094fe8 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.640437090Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.590932535 +0000 UTC m=+1.419766970" 16:47:59 time="2020-08-15T20:47:58.642520895Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-45e19a2c5ef4e819 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.643520680Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-5e90e1770e094fe8 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.414950182 +0000 UTC m=+1.243784618" 16:47:59 time="2020-08-15T20:47:58.645461686Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-131339e37bcd83b5 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.503408623 +0000 UTC m=+1.332243089" 16:47:59 time="2020-08-15T20:47:58.645490048Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-131339e37bcd83b5 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.645509180Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.531832 Instance=stub-providertype6-131339e37bcd83b5 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.646487998Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.646565484Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.646584480Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.524608715 +0000 UTC m=+1.353443159" 16:47:59 time="2020-08-15T20:47:58.646921509Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.646981667Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 ProbeStart="2020-08-15 20:47:58.439751219 +0000 UTC m=+1.268585664" 16:47:59 time="2020-08-15T20:47:58.646997869Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000038 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.647040144Z" level=warning msg="probe failed" Address="127.0.0.1:39691" Command="crunch-run --list" Instance=stub-providertype8-134739009e96db97 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.647167569Z" level=warning msg="new instance unresponsive, shutting down" Address="127.0.0.1:39691" Duration=352.933724ms Instance=stub-providertype8-134739009e96db97 InstanceType=type8 Since="2020-08-15 20:47:58.041503532 +0000 UTC m=+0.870337968" State=booting 16:47:59 time="2020-08-15T20:47:58.647380784Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-24a40f5936a7f8de InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.650371828Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000038 State=Complete 16:47:59 time="2020-08-15T20:47:58.655944280Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.656067725Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.656513700Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-251ab1911b06963e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.657232824Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.643604246 +0000 UTC m=+1.472438678" 16:47:59 time="2020-08-15T20:47:58.657277039Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.643826018 +0000 UTC m=+1.472660449" 16:47:59 time="2020-08-15T20:47:58.658174500Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-134739009e96db97 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.658212133Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-38a899594bff05d4 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.658226978Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-131339e37bcd83b5 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.658507164Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-251ab1911b06963e InstanceType=type2 ProbeStart="2020-08-15 20:47:58.530484891 +0000 UTC m=+1.359319323" 16:47:59 time="2020-08-15T20:47:58.658601796Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5096548dd78c298a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.658614173Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5096548dd78c298a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.522885476 +0000 UTC m=+1.351719907" 16:47:59 time="2020-08-15T20:47:58.661296799Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype3-4b776a3dec6c61e1 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.433238635 +0000 UTC m=+1.262073062" 16:47:59 time="2020-08-15T20:47:58.661332368Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype3-4b776a3dec6c61e1 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.661351696Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.429243 Instance=stub-providertype3-4b776a3dec6c61e1 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.661388574Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype3-4b776a3dec6c61e1 InstanceType=type3 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.661651534Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-13f92b19e7358a5f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.661665907Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-13f92b19e7358a5f InstanceType=type8 ProbeStart="2020-08-15 20:47:58.525213786 +0000 UTC m=+1.354048232" 16:47:59 time="2020-08-15T20:47:58.665273087Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000103 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.666310880Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.668613153Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=379.946508ms Instance=stub-providertype8-5081060b766c9db6 InstanceType=type8 Since="2020-08-15 20:47:58.186969308 +0000 UTC m=+1.015803734" State=booting 16:47:59 time="2020-08-15T20:47:58.668652169Z" level=info msg="boot failed" Address= Duration=379.946508ms Instance=stub-providertype8-5081060b766c9db6 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.566915798 +0000 UTC m=+1.395750242" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.668684335Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-5081060b766c9db6 InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.669482087Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype3-4b776a3dec6c61e1 16:47:59 time="2020-08-15T20:47:58.670431750Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.669494032Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.670684906Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:58.624323555 +0000 UTC m=+1.453157972" 16:47:59 time="2020-08-15T20:47:58.670861131Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-4d58dc8683d11ab7 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.674516710Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-1343bcb8376eeb3 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.675534960Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.683325830Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-660aedf1a6e222f5 PID=1 16:47:59 time="2020-08-15T20:47:58.689564286Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype2-251ab1911b06963e InstanceType=type2 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.689602684Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=397.138498ms Instance=stub-providertype2-251ab1911b06963e InstanceType=type2 Since="2020-08-15 20:47:58.133346365 +0000 UTC m=+0.962180825" State=booting 16:47:59 time="2020-08-15T20:47:58.689733825Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.692151979Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-5081060b766c9db6 16:47:59 time="2020-08-15T20:47:58.692758015Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-4b776a3dec6c61e1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.693651352Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000001 InstanceType=type2 16:47:59 time="2020-08-15T20:47:58.695071901Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-5e90e1770e094fe8 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.414950182 +0000 UTC m=+1.243784618" 16:47:59 time="2020-08-15T20:47:58.695120745Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-5e90e1770e094fe8 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.695139611Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.666176 Instance=stub-providertype4-5e90e1770e094fe8 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.695183774Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 State=booting 16:47:59 time="2020-08-15T20:47:58.696519514Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.700637163Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.700664079Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.552549262 +0000 UTC m=+1.381383736" 16:47:59 time="2020-08-15T20:47:58.701919953Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-25826451d91ac90f InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.702654747Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000158 Instance=stub-providertype6-c567a08fb7edb1a PID=2 16:47:59 time="2020-08-15T20:47:58.703496768Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.703515263Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.64591172 +0000 UTC m=+1.474746151" 16:47:59 time="2020-08-15T20:47:58.704408909Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-5e90e1770e094fe8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.704432977Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-251ab1911b06963e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.704447843Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-5081060b766c9db6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.708879144Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-660aedf1a6e222f5 PID=1 State=Locked 16:47:59 time="2020-08-15T20:47:58.712580883Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000158 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.724804958Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.724833793Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.715247962 +0000 UTC m=+1.544082412" 16:47:59 time="2020-08-15T20:47:58.726098247Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.726124208Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.724349889 +0000 UTC m=+1.553184352" 16:47:59 time="2020-08-15T20:47:58.729607579Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-13f92b19e7358a5f InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.729652249Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=376.439237ms Instance=stub-providertype8-13f92b19e7358a5f InstanceType=type8 Since="2020-08-15 20:47:58.148774555 +0000 UTC m=+0.977608995" State=booting 16:47:59 time="2020-08-15T20:47:58.729967377Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-13f92b19e7358a5f InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.737543858Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.737567663Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.651030807 +0000 UTC m=+1.479865256" 16:47:59 time="2020-08-15T20:47:58.738154123Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45677" Command=true Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.738176004Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45677" Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.682813815 +0000 UTC m=+1.511648265" 16:47:59 time="2020-08-15T20:47:58.738343268Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.738357843Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.609359252 +0000 UTC m=+1.438193697" 16:47:59 time="2020-08-15T20:47:58.738804222Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.738825930Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.658249811 +0000 UTC m=+1.487084248" 16:47:59 time="2020-08-15T20:47:58.739298423Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.739313954Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.55287308 +0000 UTC m=+1.381707661" 16:47:59 time="2020-08-15T20:47:58.739353516Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.739365474Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.724911328 +0000 UTC m=+1.553745775" 16:47:59 time="2020-08-15T20:47:58.740974258Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7694a644db212264 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.740995551Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7694a644db212264 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.658318546 +0000 UTC m=+1.487152978" 16:47:59 time="2020-08-15T20:47:58.744205180Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-5096548dd78c298a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.522885476 +0000 UTC m=+1.351719907" 16:47:59 time="2020-08-15T20:47:58.744240190Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-5096548dd78c298a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.744260148Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.604468 Instance=stub-providertype6-5096548dd78c298a InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.746145135Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-13f92b19e7358a5f 16:47:59 time="2020-08-15T20:47:58.746716897Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-5096548dd78c298a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.747529415Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.747550237Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 ProbeStart="2020-08-15 20:47:58.604110138 +0000 UTC m=+1.432944563" 16:47:59 time="2020-08-15T20:47:58.747598949Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.747612746Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.592842285 +0000 UTC m=+1.421676724" 16:47:59 time="2020-08-15T20:47:58.748205357Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.748224480Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 ProbeStart="2020-08-15 20:47:58.67648398 +0000 UTC m=+1.505318445" 16:47:59 time="2020-08-15T20:47:58.749639998Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.749661072Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.564775686 +0000 UTC m=+1.393610159" 16:47:59 time="2020-08-15T20:47:58.749736152Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.749749000Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.647930446 +0000 UTC m=+1.476764879" 16:47:59 time="2020-08-15T20:47:58.751133216Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000183 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.752405330Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.753958234Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.753977487Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 ProbeStart="2020-08-15 20:47:58.65719156 +0000 UTC m=+1.486026019" 16:47:59 time="2020-08-15T20:47:58.761322185Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-6104a2db88693a9f InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.761351019Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-6104a2db88693a9f InstanceType=type6 ProbeStart="2020-08-15 20:47:58.602977725 +0000 UTC m=+1.431812170" 16:47:59 time="2020-08-15T20:47:58.765935585Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-13f92b19e7358a5f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.770778434Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000158 ExitCode=1 Instance=stub-providertype6-c567a08fb7edb1a PID=2 16:47:59 time="2020-08-15T20:47:58.772387949Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=544.17103ms Instance=stub-providertype8-62cccb84eb6e5d01 InstanceType=type8 Since="2020-08-15 20:47:58.053207128 +0000 UTC m=+0.882041558" State=booting 16:47:59 time="2020-08-15T20:47:58.772427895Z" level=info msg="boot failed" Address= Duration=544.17103ms Instance=stub-providertype8-62cccb84eb6e5d01 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.597378153 +0000 UTC m=+1.426212588" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.777956901Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000063 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.778211772Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.778476069Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.778948868Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-62cccb84eb6e5d01 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.779892021Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000158 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:58.782589898Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-32e91a8f5dbad373 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.783309169Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000158 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:58.783504744Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.731210193 +0000 UTC m=+1.560044624" 16:47:59 time="2020-08-15T20:47:58.783621003Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.562824867 +0000 UTC m=+1.391659315" 16:47:59 time="2020-08-15T20:47:58.783846428Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.783856950Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 ProbeStart="2020-08-15 20:47:58.730722751 +0000 UTC m=+1.559557205" 16:47:59 time="2020-08-15T20:47:58.785422210Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.785442772Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.718013232 +0000 UTC m=+1.546847706" 16:47:59 time="2020-08-15T20:47:58.785504856Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-402988c9e6acbde7 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.785517857Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-402988c9e6acbde7 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.664920044 +0000 UTC m=+1.493754482" 16:47:59 time="2020-08-15T20:47:58.787931371Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.787957941Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 ProbeStart="2020-08-15 20:47:58.565008024 +0000 UTC m=+1.393842466" 16:47:59 time="2020-08-15T20:47:58.798425674Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=607.230671ms Instance=stub-providertype4-2089c93c79844140 InstanceType=type4 Since="2020-08-15 20:47:58.044926815 +0000 UTC m=+0.873761223" State=booting 16:47:59 time="2020-08-15T20:47:58.798467277Z" level=info msg="boot failed" Address= Duration=607.230671ms Instance=stub-providertype4-2089c93c79844140 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.652157437 +0000 UTC m=+1.480991894" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.798450640Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.798501806Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 ProbeStart="2020-08-15 20:47:58.688797719 +0000 UTC m=+1.517632175" 16:47:59 time="2020-08-15T20:47:58.799833614Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-2089c93c79844140 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:58.805596930Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-2089c93c79844140 16:47:59 time="2020-08-15T20:47:58.810228710Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.815545642Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.815663301Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.817108895Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.819404371Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.762856326 +0000 UTC m=+1.591690772" 16:47:59 time="2020-08-15T20:47:58.819456689Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.7439967 +0000 UTC m=+1.572831148" 16:47:59 time="2020-08-15T20:47:58.819492173Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 ProbeStart="2020-08-15 20:47:58.750229308 +0000 UTC m=+1.579063782" 16:47:59 time="2020-08-15T20:47:58.819578055Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-1c33143dfa909fb7 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.819938398Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.819968886Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 ProbeStart="2020-08-15 20:47:58.750931193 +0000 UTC m=+1.579765628" 16:47:59 time="2020-08-15T20:47:58.820071418Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.820084609Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 ProbeStart="2020-08-15 20:47:58.784915717 +0000 UTC m=+1.613750174" 16:47:59 time="2020-08-15T20:47:58.820871520Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=545.807528ms Instance=stub-providertype4-659b37d8e321bc52 InstanceType=type4 Since="2020-08-15 20:47:58.078392479 +0000 UTC m=+0.907226914" State=booting 16:47:59 time="2020-08-15T20:47:58.820907643Z" level=info msg="boot failed" Address= Duration=545.807528ms Instance=stub-providertype4-659b37d8e321bc52 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.624199989 +0000 UTC m=+1.453034442" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.820979777Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.820997066Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 ProbeStart="2020-08-15 20:47:58.648952205 +0000 UTC m=+1.477786646" 16:47:59 time="2020-08-15T20:47:58.821424286Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.821442223Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.62617717 +0000 UTC m=+1.455011605" 16:47:59 time="2020-08-15T20:47:58.821485999Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.821498416Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.756572919 +0000 UTC m=+1.585407359" 16:47:59 time="2020-08-15T20:47:58.821570743Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.822671677Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.822691994Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.677703227 +0000 UTC m=+1.506537694" 16:47:59 time="2020-08-15T20:47:58.823084599Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2e0144feb3dc2d6 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.823319416Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-32313e50b8da0cd8 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.824289333Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2e0144feb3dc2d6 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.631997077 +0000 UTC m=+1.460831546" 16:47:59 time="2020-08-15T20:47:58.824746346Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-28b42e7cfffbf57 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.824768194Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-28b42e7cfffbf57 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.653541864 +0000 UTC m=+1.482376286" 16:47:59 time="2020-08-15T20:47:58.826252694Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.826271073Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.632927503 +0000 UTC m=+1.461761934" 16:47:59 time="2020-08-15T20:47:58.827901389Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-659b37d8e321bc52 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.827925065Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-2089c93c79844140 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.830954626Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.830974397Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.784119053 +0000 UTC m=+1.612953504" 16:47:59 time="2020-08-15T20:47:58.831261618Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-402988c9e6acbde7 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.664920044 +0000 UTC m=+1.493754482" 16:47:59 time="2020-08-15T20:47:58.831285806Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-402988c9e6acbde7 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.831304796Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.836383 Instance=stub-providertype8-402988c9e6acbde7 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.832215680Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000143 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.832514193Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-34fc0ec60101a939 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.833401868Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-6104a2db88693a9f InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.833451366Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=548.04748ms Instance=stub-providertype6-6104a2db88693a9f InstanceType=type6 Since="2020-08-15 20:47:58.054930264 +0000 UTC m=+0.883764690" State=booting 16:47:59 time="2020-08-15T20:47:58.840345757Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-4f39635bb7430c66 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.840375175Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-4f39635bb7430c66 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.664029573 +0000 UTC m=+1.492864022" 16:47:59 time="2020-08-15T20:47:58.841703025Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-6104a2db88693a9f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.841727140Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-402988c9e6acbde7 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.841819285Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000158 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.842895599Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000181 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.845483489Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-6b4758ead15ffbbf InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.846147460Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.846171057Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 ProbeStart="2020-08-15 20:47:58.682914592 +0000 UTC m=+1.511749030" 16:47:59 time="2020-08-15T20:47:58.846465372Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000158 State=Complete 16:47:59 time="2020-08-15T20:47:58.852880058Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-74658a99acb615d1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.852901647Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-74658a99acb615d1 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.650061828 +0000 UTC m=+1.478896279" 16:47:59 time="2020-08-15T20:47:58.853127714Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.853142310Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 ProbeStart="2020-08-15 20:47:58.797989635 +0000 UTC m=+1.626824070" 16:47:59 time="2020-08-15T20:47:58.853189681Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.853213143Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.672918006 +0000 UTC m=+1.501752451" 16:47:59 time="2020-08-15T20:47:58.853698378Z" level=info msg="boot probe succeeded" Address="127.0.0.1:35857" Command=true Instance=stub-providertype6-5d214064018153da InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.853718419Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:35857" Instance=stub-providertype6-5d214064018153da InstanceType=type6 ProbeStart="2020-08-15 20:47:58.816524433 +0000 UTC m=+1.645358869" 16:47:59 time="2020-08-15T20:47:58.860498554Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.860522318Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.645157588 +0000 UTC m=+1.473992049" 16:47:59 time="2020-08-15T20:47:58.862245873Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-434132c8f4a49a23 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.862266007Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-434132c8f4a49a23 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.688924656 +0000 UTC m=+1.517759149" 16:47:59 time="2020-08-15T20:47:58.862617792Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype3-28b42e7cfffbf57 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.653541864 +0000 UTC m=+1.482376286" 16:47:59 time="2020-08-15T20:47:58.862640601Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype3-28b42e7cfffbf57 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.862753929Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.771829 Instance=stub-providertype3-28b42e7cfffbf57 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.865165778Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.865817125Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.865838613Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.820796094 +0000 UTC m=+1.649630538" 16:47:59 time="2020-08-15T20:47:58.866203079Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-7b851cb8fafd2b0 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.872333724Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-28b42e7cfffbf57 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.877105845Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-17c7082b4ddb10ea InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.877135773Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-17c7082b4ddb10ea InstanceType=type6 ProbeStart="2020-08-15 20:47:58.700513537 +0000 UTC m=+1.529347981" 16:47:59 time="2020-08-15T20:47:58.877814549Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-4f39635bb7430c66 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.877850212Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=701.149369ms Instance=stub-providertype4-4f39635bb7430c66 InstanceType=type4 Since="2020-08-15 20:47:57.962880231 +0000 UTC m=+0.791714653" State=booting 16:47:59 time="2020-08-15T20:47:58.878669611Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.878906306Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-59cad68ae21dc478 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.882363639Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.882384971Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 ProbeStart="2020-08-15 20:47:58.714928644 +0000 UTC m=+1.543763103" 16:47:59 time="2020-08-15T20:47:58.882796579Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-6e28653210474ce6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.882812968Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-6e28653210474ce6 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.694295913 +0000 UTC m=+1.523130405" 16:47:59 time="2020-08-15T20:47:58.883868765Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.883878519Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-4f39635bb7430c66 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.883901263Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.883914982Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.841968833 +0000 UTC m=+1.670803258" 16:47:59 time="2020-08-15T20:47:58.883950891Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:58.841754853 +0000 UTC m=+1.670589284" 16:47:59 time="2020-08-15T20:47:58.883893447Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.883981059Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 ProbeStart="2020-08-15 20:47:58.841932118 +0000 UTC m=+1.670766562" 16:47:59 time="2020-08-15T20:47:58.885543901Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.885562251Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 ProbeStart="2020-08-15 20:47:58.673017486 +0000 UTC m=+1.501851914" 16:47:59 time="2020-08-15T20:47:58.886493202Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-2e0144feb3dc2d6 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.631997077 +0000 UTC m=+1.460831546" 16:47:59 time="2020-08-15T20:47:58.886523851Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-2e0144feb3dc2d6 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.886542322Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.978239 Instance=stub-providertype4-2e0144feb3dc2d6 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.887443833Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.887542010Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-4711302ed91dda90 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.888638666Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.888657809Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.856439548 +0000 UTC m=+1.685273973" 16:47:59 time="2020-08-15T20:47:58.888703903Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.888715978Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 ProbeStart="2020-08-15 20:47:58.849398692 +0000 UTC m=+1.678233143" 16:47:59 time="2020-08-15T20:47:58.889342093Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.889360187Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.844954561 +0000 UTC m=+1.673789001" 16:47:59 time="2020-08-15T20:47:58.889713113Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.889729734Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.737915589 +0000 UTC m=+1.566750099" 16:47:59 time="2020-08-15T20:47:58.889924883Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-15406cdde5156261 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.889940708Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-15406cdde5156261 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.737509834 +0000 UTC m=+1.566344284" 16:47:59 time="2020-08-15T20:47:58.890135007Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.890164319Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.890228224Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.861900589 +0000 UTC m=+1.690735144" 16:47:59 time="2020-08-15T20:47:58.890570147Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.890586154Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:58.865306575 +0000 UTC m=+1.694141059" 16:47:59 time="2020-08-15T20:47:58.891084509Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.71764341 +0000 UTC m=+1.546477897" 16:47:59 time="2020-08-15T20:47:58.898255701Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.898286459Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.775220191 +0000 UTC m=+1.604054620" 16:47:59 time="2020-08-15T20:47:58.898318365Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.898343649Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.876051767 +0000 UTC m=+1.704886213" 16:47:59 time="2020-08-15T20:47:58.898351962Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000078 Instance=stub-providertype6-c567a08fb7edb1a PID=3 16:47:59 time="2020-08-15T20:47:58.898272995Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3521469161cc970e InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.898947227Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-74658a99acb615d1 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.898988535Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-434132c8f4a49a23 InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.899239928Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4192214612966204 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.899322287Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-2e0144feb3dc2d6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.899355232Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3521469161cc970e InstanceType=type6 ProbeStart="2020-08-15 20:47:58.862973592 +0000 UTC m=+1.691808020" 16:47:59 time="2020-08-15T20:47:58.899358144Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000078 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.901420426Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=420.37067ms Instance=stub-providertype4-74658a99acb615d1 InstanceType=type4 Since="2020-08-15 20:47:58.229691178 +0000 UTC m=+1.058525609" State=booting 16:47:59 time="2020-08-15T20:47:58.901453893Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=643.919533ms Instance=stub-providertype6-434132c8f4a49a23 InstanceType=type6 Since="2020-08-15 20:47:58.045005197 +0000 UTC m=+0.873839616" State=booting 16:47:59 time="2020-08-15T20:47:58.901476139Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4192214612966204 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.883923581 +0000 UTC m=+1.712758027" 16:47:59 time="2020-08-15T20:47:58.902569492Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:58.902664480Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-48736355de400977 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:58.904187446Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.904209617Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.88191521 +0000 UTC m=+1.710749704" 16:47:59 time="2020-08-15T20:47:58.905821476Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-17c7082b4ddb10ea InstanceType=type6 ProbeStart="2020-08-15 20:47:58.700513537 +0000 UTC m=+1.529347981" 16:47:59 time="2020-08-15T20:47:58.905850310Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-17c7082b4ddb10ea InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.905868545Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.842343 Instance=stub-providertype6-17c7082b4ddb10ea InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.905893723Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-6e28653210474ce6 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.694295913 +0000 UTC m=+1.523130405" 16:47:59 time="2020-08-15T20:47:58.905912319Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-6e28653210474ce6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.905927850Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.860699 Instance=stub-providertype6-6e28653210474ce6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.906040068Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.906106359Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 ProbeStart="2020-08-15 20:47:58.774682563 +0000 UTC m=+1.603517007" 16:47:59 time="2020-08-15T20:47:58.907026568Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000021 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.907051301Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000141 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.908292950Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-69717a5ee58a48e6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.909618409Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.909636232Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.881734566 +0000 UTC m=+1.710569011" 16:47:59 time="2020-08-15T20:47:58.910502596Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.910521321Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.799381594 +0000 UTC m=+1.628216029" 16:47:59 time="2020-08-15T20:47:58.916247241Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71075a807b512662 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.916271440Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71075a807b512662 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.8761199 +0000 UTC m=+1.704954348" 16:47:59 time="2020-08-15T20:47:58.916321858Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.916334911Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 ProbeStart="2020-08-15 20:47:58.774822786 +0000 UTC m=+1.603657206" 16:47:59 time="2020-08-15T20:47:58.916404533Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.917368607Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.917384935Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 ProbeStart="2020-08-15 20:47:58.884994176 +0000 UTC m=+1.713828645" 16:47:59 time="2020-08-15T20:47:58.922547418Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.922571752Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 ProbeStart="2020-08-15 20:47:58.848368803 +0000 UTC m=+1.677203253" 16:47:59 time="2020-08-15T20:47:58.930478959Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.930677986Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-42436b170d751c11 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.930732451Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.930840692Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.930908207Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.934114499Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000078 ExitCode=3 Instance=stub-providertype6-c567a08fb7edb1a PID=3 16:47:59 time="2020-08-15T20:47:58.934460924Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.936720243Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.937248149Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.937330909Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.937711903Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-74658a99acb615d1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.937750138Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-434132c8f4a49a23 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.937763965Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-6e28653210474ce6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.937776149Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-17c7082b4ddb10ea WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.937731916Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.937856775Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.892939403 +0000 UTC m=+1.721773849" 16:47:59 time="2020-08-15T20:47:58.938168198Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=835.434415ms Instance=stub-providertype6-16cd7d229a95cc49 InstanceType=type6 Since="2020-08-15 20:47:57.983793335 +0000 UTC m=+0.812627769" State=booting 16:47:59 time="2020-08-15T20:47:58.938195644Z" level=info msg="boot failed" Address= Duration=835.434415ms Instance=stub-providertype6-16cd7d229a95cc49 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.819227761 +0000 UTC m=+1.648062184" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.938296301Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.911764756 +0000 UTC m=+1.740599209" 16:47:59 time="2020-08-15T20:47:58.938329643Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-42436b170d751c11 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.828131016 +0000 UTC m=+1.656965450" 16:47:59 time="2020-08-15T20:47:58.938359499Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 ProbeStart="2020-08-15 20:47:58.771791542 +0000 UTC m=+1.600625978" 16:47:59 time="2020-08-15T20:47:58.938390344Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.800264394 +0000 UTC m=+1.629098840" 16:47:59 time="2020-08-15T20:47:58.938418836Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 ProbeStart="2020-08-15 20:47:58.891161192 +0000 UTC m=+1.719995692" 16:47:59 time="2020-08-15T20:47:58.938451482Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.898441933 +0000 UTC m=+1.727276367" 16:47:59 time="2020-08-15T20:47:58.938485272Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=636.244054ms Instance=stub-providertype3-3c3420b82dd4fce2 InstanceType=type3 Since="2020-08-15 20:47:58.147298799 +0000 UTC m=+0.976133233" State=booting 16:47:59 time="2020-08-15T20:47:58.938507202Z" level=info msg="boot failed" Address= Duration=636.244054ms Instance=stub-providertype3-3c3420b82dd4fce2 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.783542866 +0000 UTC m=+1.612377287" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.938631214Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.840442614 +0000 UTC m=+1.669277045" 16:47:59 time="2020-08-15T20:47:58.938686334Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.938705172Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.892324213 +0000 UTC m=+1.721158670" 16:47:59 time="2020-08-15T20:47:58.939665954Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.939693374Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.941461115Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.941480948Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.90595142 +0000 UTC m=+1.734785852" 16:47:59 time="2020-08-15T20:47:58.942747688Z" level=error msg="create failed" InstanceType=type6 error="rate limited until 2020-08-15 20:47:58.943145024 +0000 UTC m=+1.771979448" 16:47:59 time="2020-08-15T20:47:58.942776191Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="372.351µs" ResumeAt="2020-08-15 20:47:58.943145024 +0000 UTC m=+1.771979448" 16:47:59 time="2020-08-15T20:47:58.942907028Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype3-15406cdde5156261 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.737509834 +0000 UTC m=+1.566344284" 16:47:59 time="2020-08-15T20:47:58.942928593Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype3-15406cdde5156261 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.942947071Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=1.004304 Instance=stub-providertype3-15406cdde5156261 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.943955268Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000061 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.943983234Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000041 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.946226687Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000078 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:58.946267479Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.821922776 +0000 UTC m=+1.650757218" 16:47:59 time="2020-08-15T20:47:58.946318129Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.912022629 +0000 UTC m=+1.740857078" 16:47:59 time="2020-08-15T20:47:58.947396813Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.949292494Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000078 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:58.949390886Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.949436095Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-15406cdde5156261 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.949457552Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-3c3420b82dd4fce2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.949470592Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-16cd7d229a95cc49 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.949490786Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.820934444 +0000 UTC m=+1.649768885" 16:47:59 time="2020-08-15T20:47:58.949591611Z" level=info msg="boot probe succeeded" Address="127.0.0.1:41983" Command=true Instance=stub-providertype6-4b9fa82686be7e12 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.949607602Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:41983" Instance=stub-providertype6-4b9fa82686be7e12 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.856332038 +0000 UTC m=+1.685166469" 16:47:59 time="2020-08-15T20:47:58.949685255Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype6-70941bf8cde2eca6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.949784860Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.949797415Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.937802747 +0000 UTC m=+1.766637184" 16:47:59 time="2020-08-15T20:47:58.949835989Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.949848435Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 ProbeStart="2020-08-15 20:47:58.937938966 +0000 UTC m=+1.766773390" 16:47:59 time="2020-08-15T20:47:58.949904092Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-42436b170d751c11 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:58.949929214Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=637.67604ms Instance=stub-providertype8-42436b170d751c11 InstanceType=type8 Since="2020-08-15 20:47:58.19045498 +0000 UTC m=+1.019289410" State=booting 16:47:59 time="2020-08-15T20:47:58.950175678Z" level=error msg="create failed" InstanceType=type3 error="rate limited until 2020-08-15 20:47:58.950660263 +0000 UTC m=+1.779494674" 16:47:59 time="2020-08-15T20:47:58.950201789Z" level=info msg="suspending remote calls due to rate-limit error" CallType="create instance" Duration="461.56µs" ResumeAt="2020-08-15 20:47:58.950660263 +0000 UTC m=+1.779494674" 16:47:59 time="2020-08-15T20:47:58.950814657Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.952208987Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-30c57d409baf5233 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.955496987Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45085" Command=true Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.955530139Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45085" Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.941775368 +0000 UTC m=+1.770609807" 16:47:59 time="2020-08-15T20:47:58.957662658Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-22614d6fbeca336a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.957684898Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-22614d6fbeca336a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.8983458 +0000 UTC m=+1.727180229" 16:47:59 time="2020-08-15T20:47:58.957725050Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.957736338Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.942985316 +0000 UTC m=+1.771819748" 16:47:59 time="2020-08-15T20:47:58.960906011Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-42436b170d751c11 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.961892062Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000161 InstanceType=type3 16:47:59 time="2020-08-15T20:47:58.963064338Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype3-2d72508aa051d350 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:58.964112896Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000078 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.964242325Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.964261248Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 ProbeStart="2020-08-15 20:47:58.938239641 +0000 UTC m=+1.767074072" 16:47:59 time="2020-08-15T20:47:58.964407114Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-44482319682c1dde InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.964436677Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.964444964Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-44482319682c1dde InstanceType=type3 ProbeStart="2020-08-15 20:47:58.949623825 +0000 UTC m=+1.778458254" 16:47:59 time="2020-08-15T20:47:58.964845779Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.964862546Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 ProbeStart="2020-08-15 20:47:58.957029017 +0000 UTC m=+1.785863465" 16:47:59 time="2020-08-15T20:47:58.964894962Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.964908625Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 ProbeStart="2020-08-15 20:47:58.957036556 +0000 UTC m=+1.785870987" 16:47:59 time="2020-08-15T20:47:58.965063890Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.965078494Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.957949388 +0000 UTC m=+1.786783835" 16:47:59 time="2020-08-15T20:47:58.965172181Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=412.632953ms Instance=stub-providertype8-387bfba4009ba942 InstanceType=type8 Since="2020-08-15 20:47:58.491274261 +0000 UTC m=+1.320108678" State=booting 16:47:59 time="2020-08-15T20:47:58.965200789Z" level=info msg="boot failed" Address= Duration=412.632953ms Instance=stub-providertype8-387bfba4009ba942 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.903907182 +0000 UTC m=+1.732741631" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.965243922Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.965344886Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.960960931 +0000 UTC m=+1.789795363" 16:47:59 time="2020-08-15T20:47:58.965953582Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.968700258Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.950056501 +0000 UTC m=+1.778890925" 16:47:59 time="2020-08-15T20:47:58.969638221Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000078 State=Complete 16:47:59 time="2020-08-15T20:47:58.970935557Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-22d3161b328a18bc InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.971751719Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.971795198Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.960960931 +0000 UTC m=+1.789795363" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:58.972339240Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-45e19a2c5ef4e819 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.972419738Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.972631658Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.972697623Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.972708322Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-387bfba4009ba942 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.973904575Z" level=info msg="probe reported broken instance" Address="127.0.0.1:41983" Instance=stub-providertype6-4b9fa82686be7e12 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.856332038 +0000 UTC m=+1.685166469" 16:47:59 time="2020-08-15T20:47:58.973937731Z" level=info msg="set idle behavior" Address="127.0.0.1:41983" IdleBehavior=drain Instance=stub-providertype6-4b9fa82686be7e12 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.973970185Z" level=info msg="shutdown worker" Address="127.0.0.1:41983" IdleBehavior=drain IdleDuration=0.444144 Instance=stub-providertype6-4b9fa82686be7e12 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:58.974127493Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.965157205 +0000 UTC m=+1.793991673" 16:47:59 time="2020-08-15T20:47:58.974500473Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=698.099129ms Instance=stub-providertype8-28c9d1b4f6432818 InstanceType=type8 Since="2020-08-15 20:47:58.125126119 +0000 UTC m=+0.953960551" State=booting 16:47:59 time="2020-08-15T20:47:58.974547935Z" level=info msg="boot failed" Address= Duration=698.099129ms Instance=stub-providertype8-28c9d1b4f6432818 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.823225241 +0000 UTC m=+1.652059680" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:58.974865546Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-45e19a2c5ef4e819 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.903994258 +0000 UTC m=+1.732828684" 16:47:59 time="2020-08-15T20:47:58.975135468Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:58.970831301 +0000 UTC m=+1.799665745" 16:47:59 time="2020-08-15T20:47:58.975375815Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 ProbeStart="2020-08-15 20:47:58.91934684 +0000 UTC m=+1.748181295" 16:47:59 time="2020-08-15T20:47:58.975611369Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.970910934 +0000 UTC m=+1.799745381" 16:47:59 time="2020-08-15T20:47:58.979566568Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000023 InstanceType=type8 16:47:59 time="2020-08-15T20:47:58.979953479Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000198 Instance=stub-providertype6-c567a08fb7edb1a PID=4 16:47:59 time="2020-08-15T20:47:58.981465040Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000198 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.981738850Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype8-515d6d738e6c415 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:58.984039092Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.984284084Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.984298831Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.976919008 +0000 UTC m=+1.805753427" 16:47:59 time="2020-08-15T20:47:58.984635094Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.976206658 +0000 UTC m=+1.805041092" 16:47:59 time="2020-08-15T20:47:58.984901810Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.984918457Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.97626963 +0000 UTC m=+1.805104060" 16:47:59 time="2020-08-15T20:47:58.988748309Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-74333a1db0299ef3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.988774173Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-74333a1db0299ef3 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.949956575 +0000 UTC m=+1.778791000" 16:47:59 time="2020-08-15T20:47:58.988865885Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.988877951Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.981112091 +0000 UTC m=+1.809946548" 16:47:59 time="2020-08-15T20:47:58.989521146Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.989616943Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.989809956Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7df598dcde9e5526 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.990076766Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-28c9d1b4f6432818 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.990121013Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-4b9fa82686be7e12 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:58.992377334Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.98458071 +0000 UTC m=+1.813415154" 16:47:59 time="2020-08-15T20:47:58.992437664Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 ProbeStart="2020-08-15 20:47:58.984990734 +0000 UTC m=+1.813825169" 16:47:59 time="2020-08-15T20:47:58.992470324Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7df598dcde9e5526 InstanceType=type8 ProbeStart="2020-08-15 20:47:58.958911575 +0000 UTC m=+1.787746009" 16:47:59 time="2020-08-15T20:47:58.992746772Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:58.992764998Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.990440489 +0000 UTC m=+1.819274928" 16:47:59 time="2020-08-15T20:47:58.996234503Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000037 Instance=stub-providertype6-4503ce82f78d0809 PID=1 16:47:59 time="2020-08-15T20:47:58.996452426Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000037 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:58.997910115Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 ProbeStart="2020-08-15 20:47:58.990440489 +0000 UTC m=+1.819274928" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.001747636Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.001766972Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 ProbeStart="2020-08-15 20:47:58.997944267 +0000 UTC m=+1.826778694" 16:47:59 time="2020-08-15T20:47:59.001906373Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.001919802Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 ProbeStart="2020-08-15 20:47:58.980012706 +0000 UTC m=+1.808847149" 16:47:59 time="2020-08-15T20:47:59.002203524Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 ProbeStart="2020-08-15 20:47:58.997944267 +0000 UTC m=+1.826778694" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.002563876Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.004314281Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 ProbeStart="2020-08-15 20:47:58.981914337 +0000 UTC m=+1.810748785" 16:47:59 time="2020-08-15T20:47:59.005533476Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000198 ExitCode=1 Instance=stub-providertype6-c567a08fb7edb1a PID=4 16:47:59 time="2020-08-15T20:47:59.006045194Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-48856598f07b0c4f InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.006774789Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000040 Instance=stub-providertype8-2ace21fc713e95fc PID=1 16:47:59 time="2020-08-15T20:47:59.008370884Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000040 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.015083472Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-48856598f07b0c4f InstanceType=type2 ProbeStart="2020-08-15 20:47:58.981102088 +0000 UTC m=+1.809936529" 16:47:59 time="2020-08-15T20:47:59.015186770Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000058 Instance=stub-providertype2-38550618aeb9fb77 PID=1 16:47:59 time="2020-08-15T20:47:59.015275689Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000198 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.017108586Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.017132522Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.008240463 +0000 UTC m=+1.837074930" 16:47:59 time="2020-08-15T20:47:59.017181021Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000058 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.017438647Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.017454454Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 ProbeStart="2020-08-15 20:47:59.006357567 +0000 UTC m=+1.835192024" 16:47:59 time="2020-08-15T20:47:59.017623281Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.008240463 +0000 UTC m=+1.837074930" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.017729178Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7694a644db212264 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.017743763Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7694a644db212264 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.014822742 +0000 UTC m=+1.843657184" 16:47:59 time="2020-08-15T20:47:59.018255543Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.018265471Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 ProbeStart="2020-08-15 20:47:59.006357567 +0000 UTC m=+1.835192024" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.018373586Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-32313e50b8da0cd8 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.018396570Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-32313e50b8da0cd8 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.997232394 +0000 UTC m=+1.826066847" 16:47:59 time="2020-08-15T20:47:59.018595559Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-7694a644db212264 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.014822742 +0000 UTC m=+1.843657184" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.018699669Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.018704433Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.018732026Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.017540874 +0000 UTC m=+1.846375493" 16:47:59 time="2020-08-15T20:47:59.018767777Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.017965258 +0000 UTC m=+1.846799699" 16:47:59 time="2020-08-15T20:47:59.018797415Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 ProbeStart="2020-08-15 20:47:58.990910713 +0000 UTC m=+1.819745146" 16:47:59 time="2020-08-15T20:47:59.018996631Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype4-32313e50b8da0cd8 InstanceType=type4 ProbeStart="2020-08-15 20:47:58.997232394 +0000 UTC m=+1.826066847" 16:47:59 time="2020-08-15T20:47:59.019020522Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype4-32313e50b8da0cd8 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.019039879Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.195699 Instance=stub-providertype4-32313e50b8da0cd8 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:59.019355433Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.017965258 +0000 UTC m=+1.846799699" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.019618644Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.017540874 +0000 UTC m=+1.846375493" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.020357849Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000160 Instance=stub-providertype8-7694a644db212264 PID=1 16:47:59 time="2020-08-15T20:47:59.020438351Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000198 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.020606038Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000160 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.020631925Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.020817846Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000198 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.020853398Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.020971255Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 ProbeStart="2020-08-15 20:47:59.020498455 +0000 UTC m=+1.849332882" 16:47:59 time="2020-08-15T20:47:59.021151594Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-6313883ce21cb812 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:59.021323937Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 ProbeStart="2020-08-15 20:47:59.020498455 +0000 UTC m=+1.849332882" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.021433204Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000040 ExitCode=1 Instance=stub-providertype8-2ace21fc713e95fc PID=1 16:47:59 time="2020-08-15T20:47:59.021600978Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45677" Command=true Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.022155585Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000198 State=Complete 16:47:59 time="2020-08-15T20:47:59.023336560Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45677" Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.021280712 +0000 UTC m=+1.850115145" 16:47:59 time="2020-08-15T20:47:59.023881358Z" level=info msg="probes succeeded, instance is in service" Address="127.0.0.1:45677" Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.021280712 +0000 UTC m=+1.850115145" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.023955626Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.024025196Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.024034036Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 ProbeStart="2020-08-15 20:47:59.023384217 +0000 UTC m=+1.852218668" 16:47:59 time="2020-08-15T20:47:59.024377037Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.024534074Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 ProbeStart="2020-08-15 20:47:59.023384217 +0000 UTC m=+1.852218668" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.024560858Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.023916943 +0000 UTC m=+1.852751378" 16:47:59 time="2020-08-15T20:47:59.024797956Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.023916943 +0000 UTC m=+1.852751378" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.024929059Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000080 Instance=stub-providertype8-405517c089b934b6 PID=1 16:47:59 time="2020-08-15T20:47:59.025011622Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000080 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.025177036Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000197 Instance=stub-providertype6-3369755a2e5f7917 PID=1 16:47:59 time="2020-08-15T20:47:59.025188091Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000037 ExitCode=0 Instance=stub-providertype6-4503ce82f78d0809 PID=1 16:47:59 time="2020-08-15T20:47:59.025292500Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000197 Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.025905874Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000178 Instance=stub-providertype2-279d5ab29f22bfbd PID=1 16:47:59 time="2020-08-15T20:47:59.026015416Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000178 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.027228612Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000059 Instance=stub-providertype3-51825d31521f7308 PID=1 16:47:59 time="2020-08-15T20:47:59.027331989Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000059 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.028511041Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000117 Instance=stub-providertype6-c567a08fb7edb1a PID=5 16:47:59 time="2020-08-15T20:47:59.028559237Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 ProbeStart="2020-08-15 20:47:59.023284798 +0000 UTC m=+1.852119277" 16:47:59 time="2020-08-15T20:47:59.029124771Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000040 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.030674745Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000117 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.032255782Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000060 Instance=stub-providertype4-1fc4715eee2c000b PID=1 16:47:59 time="2020-08-15T20:47:59.033692848Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000040 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.035028378Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000157 Instance=stub-providertype6-1f175c897a14c51 PID=1 16:47:59 time="2020-08-15T20:47:59.038410344Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000037 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.038703373Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.038722564Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.035078559 +0000 UTC m=+1.863912986" 16:47:59 time="2020-08-15T20:47:59.038754401Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000058 ExitCode=0 Instance=stub-providertype2-38550618aeb9fb77 PID=1 16:47:59 time="2020-08-15T20:47:59.038835951Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-332ec197fda2625d InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.038849244Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-332ec197fda2625d InstanceType=type6 ProbeStart="2020-08-15 20:47:59.017579922 +0000 UTC m=+1.846414351" 16:47:59 time="2020-08-15T20:47:59.040199480Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-32313e50b8da0cd8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.038726846Z" level=info msg="crunch-run process started" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000157 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.040336206Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.040380723Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.040406576Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 ProbeStart="2020-08-15 20:47:59.034662528 +0000 UTC m=+1.863496981" 16:47:59 time="2020-08-15T20:47:59.040449400Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.029088606 +0000 UTC m=+1.857923047" 16:47:59 time="2020-08-15T20:47:59.040822067Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000139 Instance=stub-providertype3-4c22b02936d4ff9b PID=1 16:47:59 time="2020-08-15T20:47:59.040898739Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000060 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.043393052Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000037 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.045629270Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000139 Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.046016193Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000058 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.049723920Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000197 Instance=stub-providertype6-3369755a2e5f7917 PID=1 State=Running 16:47:59 time="2020-08-15T20:47:59.049765982Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000080 ExitCode=3 Instance=stub-providertype8-405517c089b934b6 PID=1 16:47:59 time="2020-08-15T20:47:59.051793527Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000160 ExitCode=1 Instance=stub-providertype8-7694a644db212264 PID=1 16:47:59 time="2020-08-15T20:47:59.051847483Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000058 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.053041452Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype6-332ec197fda2625d InstanceType=type6 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.053074078Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=597.280228ms Instance=stub-providertype6-332ec197fda2625d InstanceType=type6 Since="2020-08-15 20:47:58.420299688 +0000 UTC m=+1.249134123" State=booting 16:47:59 time="2020-08-15T20:47:59.053168624Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000040 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.053294400Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.053310773Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.04314991 +0000 UTC m=+1.871984408" 16:47:59 time="2020-08-15T20:47:59.053583138Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000060 ExitCode=0 Instance=stub-providertype4-1fc4715eee2c000b PID=1 16:47:59 time="2020-08-15T20:47:59.053653014Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.053689355Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.053707822Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.040922944 +0000 UTC m=+1.869757380" 16:47:59 time="2020-08-15T20:47:59.053857592Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.053871688Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 ProbeStart="2020-08-15 20:47:59.02103417 +0000 UTC m=+1.849868614" 16:47:59 time="2020-08-15T20:47:59.054207370Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.054224029Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.049684257 +0000 UTC m=+1.878518706" 16:47:59 time="2020-08-15T20:47:59.054273060Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000160 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.054310194Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000037 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.054403926Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000080 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.055389732Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000037 State=Complete 16:47:59 time="2020-08-15T20:47:59.056909623Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.056930624Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.051688919 +0000 UTC m=+1.880523368" 16:47:59 time="2020-08-15T20:47:59.056970443Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.056982670Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.05019806 +0000 UTC m=+1.879032496" 16:47:59 time="2020-08-15T20:47:59.057063666Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.057076135Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.051911953 +0000 UTC m=+1.880746390" 16:47:59 time="2020-08-15T20:47:59.057238225Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000058 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.057288042Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 ProbeStart="2020-08-15 20:47:59.043962807 +0000 UTC m=+1.872797237" 16:47:59 time="2020-08-15T20:47:59.057341883Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000160 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.058367739Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000040 State=Complete 16:47:59 time="2020-08-15T20:47:59.058408768Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000058 State=Complete 16:47:59 time="2020-08-15T20:47:59.060738740Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000080 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.067107934Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000178 ExitCode=0 Instance=stub-providertype2-279d5ab29f22bfbd PID=1 16:47:59 time="2020-08-15T20:47:59.067180418Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.067188854Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000120 Instance=stub-providertype8-d428445aa6ef614 PID=1 16:47:59 time="2020-08-15T20:47:59.067192937Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000059 ExitCode=2 Instance=stub-providertype3-51825d31521f7308 PID=1 16:47:59 time="2020-08-15T20:47:59.067196636Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000117 ExitCode=0 Instance=stub-providertype6-c567a08fb7edb1a PID=5 16:47:59 time="2020-08-15T20:47:59.067463731Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000139 Instance=stub-providertype3-4c22b02936d4ff9b PID=1 State=Running 16:47:59 time="2020-08-15T20:47:59.067500223Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000157 ExitCode=2 Instance=stub-providertype6-1f175c897a14c51 PID=1 16:47:59 time="2020-08-15T20:47:59.067805732Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-252e76038f4a0972 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.069433352Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000060 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.070012428Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.051911953 +0000 UTC m=+1.880746390" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.070208237Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.070222696Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.053917586 +0000 UTC m=+1.882752018" 16:47:59 time="2020-08-15T20:47:59.071842942Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 ProbeStart="2020-08-15 20:47:59.053111945 +0000 UTC m=+1.881946368" 16:47:59 time="2020-08-15T20:47:59.072709254Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-332ec197fda2625d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.072752459Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-252e76038f4a0972 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.025634617 +0000 UTC m=+1.854469044" 16:47:59 time="2020-08-15T20:47:59.073449215Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000120 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.074382159Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000160 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.074836212Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.075305496Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.075321586Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 ProbeStart="2020-08-15 20:47:59.040487642 +0000 UTC m=+1.869322125" 16:47:59 time="2020-08-15T20:47:59.075407315Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.075418938Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 ProbeStart="2020-08-15 20:47:59.073397895 +0000 UTC m=+1.902232322" 16:47:59 time="2020-08-15T20:47:59.075473131Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.075485295Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.073334695 +0000 UTC m=+1.902169121" 16:47:59 time="2020-08-15T20:47:59.075718755Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000200 Instance=stub-providertype8-2ace21fc713e95fc PID=2 16:47:59 time="2020-08-15T20:47:59.075861116Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000200 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.076130584Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.076145019Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 ProbeStart="2020-08-15 20:47:59.074962599 +0000 UTC m=+1.903797035" 16:47:59 time="2020-08-15T20:47:59.076154378Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 ProbeStart="2020-08-15 20:47:59.073397895 +0000 UTC m=+1.902232322" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.076343228Z" level=info msg="killing crunch-run process" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000157 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.076434562Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000178 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.076479278Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000059 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.076522409Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000117 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.076577197Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.076652598Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 ProbeStart="2020-08-15 20:47:59.069491074 +0000 UTC m=+1.898325528" 16:47:59 time="2020-08-15T20:47:59.076827028Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.076842315Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.075911077 +0000 UTC m=+1.904745506" 16:47:59 time="2020-08-15T20:47:59.076862494Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.073334695 +0000 UTC m=+1.902169121" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.076952535Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 ProbeStart="2020-08-15 20:47:59.036994208 +0000 UTC m=+1.865828724" 16:47:59 time="2020-08-15T20:47:59.076979035Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000080 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.076855099Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000160 State=Complete 16:47:59 time="2020-08-15T20:47:59.077208375Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-70cf1e538a5157eb InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.077672950Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-70cf1e538a5157eb InstanceType=type4 ProbeStart="2020-08-15 20:47:59.038594958 +0000 UTC m=+1.867429408" 16:47:59 time="2020-08-15T20:47:59.078027914Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.078263068Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.075911077 +0000 UTC m=+1.904745506" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.078426514Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000199 Instance=stub-providertype8-7694a644db212264 PID=2 16:47:59 time="2020-08-15T20:47:59.078509034Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000199 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.078526347Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000080 State=Complete 16:47:59 time="2020-08-15T20:47:59.078726048Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-70cf1e538a5157eb InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.078754151Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=750.423316ms Instance=stub-providertype4-70cf1e538a5157eb InstanceType=type4 Since="2020-08-15 20:47:58.288171664 +0000 UTC m=+1.117006092" State=booting 16:47:59 time="2020-08-15T20:47:59.078929095Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 ProbeStart="2020-08-15 20:47:59.076606499 +0000 UTC m=+1.905440931" 16:47:59 time="2020-08-15T20:47:59.079012775Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 ProbeStart="2020-08-15 20:47:59.074962599 +0000 UTC m=+1.903797035" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.079413804Z" level=info msg="sending signal" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000157 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.079474175Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000178 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.079519403Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000059 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.079603986Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000060 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.079611844Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000117 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.079880646Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000081 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.080257577Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 ProbeStart="2020-08-15 20:47:59.076606499 +0000 UTC m=+1.905440931" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.080413772Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000120 ExitCode=2 Instance=stub-providertype8-d428445aa6ef614 PID=1 16:47:59 time="2020-08-15T20:47:59.080578220Z" level=info msg="instance appeared in cloud" Address= IdleBehavior=run Instance=stub-providertype4-179b59d8a9a5d809 InstanceType=type4 State=booting 16:47:59 time="2020-08-15T20:47:59.080921765Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000180 Instance=stub-providertype4-364f0ff8af8eef6b PID=1 16:47:59 time="2020-08-15T20:47:59.080975588Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000178 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.081008083Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000059 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.081025438Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=618.77739ms Instance=stub-providertype4-2b97025e09a770eb InstanceType=type4 Since="2020-08-15 20:47:58.417227592 +0000 UTC m=+1.246061998" State=booting 16:47:59 time="2020-08-15T20:47:59.081052239Z" level=info msg="boot failed" Address= Duration=618.77739ms Instance=stub-providertype4-2b97025e09a770eb InstanceType=type4 ProbeStart="2020-08-15 20:47:59.036004948 +0000 UTC m=+1.864839388" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.081072226Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000117 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.081197879Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000180 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.081261237Z" level=info msg="crunch-run process ended" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000157 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.081425752Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000060 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.081873065Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000097 Instance=stub-providertype2-38550618aeb9fb77 PID=2 16:47:59 time="2020-08-15T20:47:59.081894148Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000077 Instance=stub-providertype6-4503ce82f78d0809 PID=2 16:47:59 time="2020-08-15T20:47:59.081967808Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000097 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.082026724Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000077 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.082163413Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.082242332Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.082257318Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.08187135 +0000 UTC m=+1.910705793" 16:47:59 time="2020-08-15T20:47:59.082258427Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 ProbeStart="2020-08-15 20:47:59.081918581 +0000 UTC m=+1.910752996" 16:47:59 time="2020-08-15T20:47:59.082524569Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000119 Instance=stub-providertype8-405517c089b934b6 PID=2 16:47:59 time="2020-08-15T20:47:59.082608366Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000119 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.082680363Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.08187135 +0000 UTC m=+1.910705793" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.082865908Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 ProbeStart="2020-08-15 20:47:59.081918581 +0000 UTC m=+1.910752996" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.083760336Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000054 Instance=stub-providertype6-5c24155b9170e16 PID=1 16:47:59 time="2020-08-15T20:47:59.083942037Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000054 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.084055829Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000094 Instance=stub-providertype6-72126e84f0a7aec6 PID=1 16:47:59 time="2020-08-15T20:47:59.084388707Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000094 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.084699924Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000154 Instance=stub-providertype2-279d5ab29f22bfbd PID=2 16:47:59 time="2020-08-15T20:47:59.084779265Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-2b97025e09a770eb WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.084791305Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000154 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.084811700Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000200 ExitCode=2 Instance=stub-providertype8-2ace21fc713e95fc PID=2 16:47:59 time="2020-08-15T20:47:59.084804132Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-70cf1e538a5157eb WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.085404878Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000178 State=Complete 16:47:59 time="2020-08-15T20:47:59.085419490Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000157 State=Complete 16:47:59 time="2020-08-15T20:47:59.085427222Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000117 State=Complete 16:47:59 time="2020-08-15T20:47:59.085435049Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000060 State=Complete 16:47:59 time="2020-08-15T20:47:59.085451489Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000059 State=Complete 16:47:59 time="2020-08-15T20:47:59.085817742Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000140 Instance=stub-providertype4-27dff7ab244fcd36 PID=1 16:47:59 time="2020-08-15T20:47:59.085995642Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000120 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.086587609Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000039 Instance=stub-providertype8-2c9e457114fcddea PID=1 16:47:59 time="2020-08-15T20:47:59.086822745Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000140 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.086869457Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000138 Instance=stub-providertype4-493a23eb55ece0ea PID=1 16:47:59 time="2020-08-15T20:47:59.087366542Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000134 Instance=stub-providertype6-1f175c897a14c51 PID=2 16:47:59 time="2020-08-15T20:47:59.088033060Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000138 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.088069298Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000039 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.088473003Z" level=info msg="crunch-run process started" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000134 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.088582853Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=750.871568ms Instance=stub-providertype8-52a7176239679fd3 InstanceType=type8 Since="2020-08-15 20:47:58.2842997 +0000 UTC m=+1.113134136" State=booting 16:47:59 time="2020-08-15T20:47:59.088620350Z" level=info msg="boot failed" Address= Duration=750.871568ms Instance=stub-providertype8-52a7176239679fd3 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.035171269 +0000 UTC m=+1.864005704" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.089867071Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.089896814Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.085873487 +0000 UTC m=+1.914707925" 16:47:59 time="2020-08-15T20:47:59.090427571Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a PID=6 16:47:59 time="2020-08-15T20:47:59.090492000Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000120 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.092381883Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.092405619Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.088683414 +0000 UTC m=+1.917517887" 16:47:59 time="2020-08-15T20:47:59.092425435Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000099 Instance=stub-providertype4-1fc4715eee2c000b PID=2 16:47:59 time="2020-08-15T20:47:59.092473531Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.092390802Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000019 Instance=stub-providertype3-2a19dd3f570dc8ad PID=1 16:47:59 time="2020-08-15T20:47:59.092630788Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000099 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.092714247Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000019 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.092759983Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000159 Instance=stub-providertype8-35ca80d72521a90 PID=1 16:47:59 time="2020-08-15T20:47:59.092794211Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.085873487 +0000 UTC m=+1.914707925" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.092833246Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000179 Instance=stub-providertype3-51825d31521f7308 PID=2 16:47:59 time="2020-08-15T20:47:59.092981626Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000159 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.093034615Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000179 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.093186262Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.088683414 +0000 UTC m=+1.917517887" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.093187652Z" level=info msg="boot probe succeeded" Address="127.0.0.1:35857" Command=true Instance=stub-providertype6-5d214064018153da InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.093323665Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000120 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.093343127Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:35857" Instance=stub-providertype6-5d214064018153da InstanceType=type6 ProbeStart="2020-08-15 20:47:59.092414888 +0000 UTC m=+1.921249328" 16:47:59 time="2020-08-15T20:47:59.093428703Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.093752883Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000200 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.093795359Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.092924648 +0000 UTC m=+1.921759117" 16:47:59 time="2020-08-15T20:47:59.094100006Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.092924648 +0000 UTC m=+1.921759117" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.094342758Z" level=info msg="probes succeeded, instance is in service" Address="127.0.0.1:35857" Instance=stub-providertype6-5d214064018153da InstanceType=type6 ProbeStart="2020-08-15 20:47:59.092414888 +0000 UTC m=+1.921249328" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.094454111Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.094578636Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000120 State=Complete 16:47:59 time="2020-08-15T20:47:59.094658427Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.094142274 +0000 UTC m=+1.922976722" 16:47:59 time="2020-08-15T20:47:59.095039678Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.094142274 +0000 UTC m=+1.922976722" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.096170278Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-52a7176239679fd3 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.096616941Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.096660238Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.095480564 +0000 UTC m=+1.924315034" 16:47:59 time="2020-08-15T20:47:59.096825110Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000200 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.097371864Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000200 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.097961499Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000200 State=Complete 16:47:59 time="2020-08-15T20:47:59.099941088Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000079 Instance=stub-providertype8-d428445aa6ef614 PID=2 16:47:59 time="2020-08-15T20:47:59.100013959Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000079 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.100782216Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000053 Instance=stub-providertype6-5d214064018153da PID=1 16:47:59 time="2020-08-15T20:47:59.100862294Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000176 Instance=stub-providertype8-2ace21fc713e95fc PID=3 16:47:59 time="2020-08-15T20:47:59.100931697Z" level=info msg="crunch-run process started" Address="127.0.0.1:35857" ContainerUUID=zzzzz-dz642-000000000000053 Instance=stub-providertype6-5d214064018153da InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.100998443Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000176 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.101082138Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000154 ExitCode=1 Instance=stub-providertype2-279d5ab29f22bfbd PID=2 16:47:59 time="2020-08-15T20:47:59.101349260Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000140 ExitCode=3 Instance=stub-providertype4-27dff7ab244fcd36 PID=1 16:47:59 time="2020-08-15T20:47:59.101752780Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.101769298Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 ProbeStart="2020-08-15 20:47:59.101485609 +0000 UTC m=+1.930320230" 16:47:59 time="2020-08-15T20:47:59.101822406Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000098 Instance=stub-providertype3-7426715c257c2559 PID=1 16:47:59 time="2020-08-15T20:47:59.101902739Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000174 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=1 16:47:59 time="2020-08-15T20:47:59.101930504Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000098 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.102018069Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000174 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.102189623Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 ProbeStart="2020-08-15 20:47:59.101485609 +0000 UTC m=+1.930320230" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.104174691Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000077 ExitCode=2 Instance=stub-providertype6-4503ce82f78d0809 PID=2 16:47:59 time="2020-08-15T20:47:59.104220231Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000173 Instance=stub-providertype6-2d531646eefe2d2 PID=1 16:47:59 time="2020-08-15T20:47:59.104324066Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000173 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.105660653Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000154 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.105721460Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000077 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.105761892Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000140 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.106696736Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.106715004Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 ProbeStart="2020-08-15 20:47:59.106455616 +0000 UTC m=+1.935290051" 16:47:59 time="2020-08-15T20:47:59.106963170Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 ProbeStart="2020-08-15 20:47:59.106455616 +0000 UTC m=+1.935290051" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.107558528Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.108208693Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.106912288 +0000 UTC m=+1.935746730" 16:47:59 time="2020-08-15T20:47:59.108694841Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000034 Instance=stub-providertype2-482c0d1794f0d7da PID=1 16:47:59 time="2020-08-15T20:47:59.108988421Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000138 ExitCode=1 Instance=stub-providertype4-493a23eb55ece0ea PID=1 16:47:59 time="2020-08-15T20:47:59.109073407Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000094 ExitCode=3 Instance=stub-providertype6-72126e84f0a7aec6 PID=1 16:47:59 time="2020-08-15T20:47:59.110340808Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000077 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.110549290Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000154 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.113281834Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000034 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.113467458Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000180 ExitCode=2 Instance=stub-providertype4-364f0ff8af8eef6b PID=1 16:47:59 time="2020-08-15T20:47:59.116071714Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000119 ExitCode=1 Instance=stub-providertype8-405517c089b934b6 PID=2 16:47:59 time="2020-08-15T20:47:59.116076408Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000054 ExitCode=1 Instance=stub-providertype6-5c24155b9170e16 PID=1 16:47:59 time="2020-08-15T20:47:59.116233990Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000140 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.116282261Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000098 ExitCode=3 Instance=stub-providertype3-7426715c257c2559 PID=1 16:47:59 time="2020-08-15T20:47:59.116245381Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000137 Instance=stub-providertype3-7d21ebf5c816ced2 PID=1 16:47:59 time="2020-08-15T20:47:59.116432808Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000137 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.116600414Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000097 ExitCode=1 Instance=stub-providertype2-38550618aeb9fb77 PID=2 16:47:59 time="2020-08-15T20:47:59.116685190Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a PID=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.116711483Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000179 ExitCode=2 Instance=stub-providertype3-51825d31521f7308 PID=2 16:47:59 time="2020-08-15T20:47:59.117072485Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.117091691Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 ProbeStart="2020-08-15 20:47:59.113019419 +0000 UTC m=+1.941853881" 16:47:59 time="2020-08-15T20:47:59.117151782Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7586b21b9728391e InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.117173548Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7586b21b9728391e InstanceType=type6 ProbeStart="2020-08-15 20:47:59.096419944 +0000 UTC m=+1.925254391" 16:47:59 time="2020-08-15T20:47:59.117359461Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000077 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.117384850Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1343bcb8376eeb3 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.117398384Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1343bcb8376eeb3 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.096917419 +0000 UTC m=+1.925751846" 16:47:59 time="2020-08-15T20:47:59.117364336Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.117446266Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000019 ExitCode=1 Instance=stub-providertype3-2a19dd3f570dc8ad PID=1 16:47:59 time="2020-08-15T20:47:59.117570592Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=1.000155813s Instance=stub-providertype8-c8039cb4455c5f6 InstanceType=type8 Since="2020-08-15 20:47:58.106756483 +0000 UTC m=+0.935590917" State=booting 16:47:59 time="2020-08-15T20:47:59.117704247Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000199 ExitCode=3 Instance=stub-providertype8-7694a644db212264 PID=2 16:47:59 time="2020-08-15T20:47:59.117739978Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.117742849Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000159 ExitCode=0 Instance=stub-providertype8-35ca80d72521a90 PID=1 16:47:59 time="2020-08-15T20:47:59.117956755Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.117981466Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.112367812 +0000 UTC m=+1.941202260" 16:47:59 time="2020-08-15T20:47:59.118023968Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000039 ExitCode=3 Instance=stub-providertype8-2c9e457114fcddea PID=1 16:47:59 time="2020-08-15T20:47:59.119435436Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.119452657Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 ProbeStart="2020-08-15 20:47:59.115845829 +0000 UTC m=+1.944680319" 16:47:59 time="2020-08-15T20:47:59.117759643Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.115911791 +0000 UTC m=+1.944746225" 16:47:59 time="2020-08-15T20:47:59.120772717Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.121142930Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-c8039cb4455c5f6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.121320166Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000019 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121369774Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000199 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121416374Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000098 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121451243Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000138 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121495695Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000054 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121535409Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000119 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121593388Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000094 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121650887Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000180 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121870005Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000134 ExitCode=2 Instance=stub-providertype6-1f175c897a14c51 PID=2 16:47:59 time="2020-08-15T20:47:59.121921029Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000097 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.121991136Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000179 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.122025868Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000140 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.122056396Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.116930763 +0000 UTC m=+1.945765182" 16:47:59 time="2020-08-15T20:47:59.122219355Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000159 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.122297988Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000039 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.122403596Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype3-1343bcb8376eeb3 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.096917419 +0000 UTC m=+1.925751846" 16:47:59 time="2020-08-15T20:47:59.122419106Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype3-1343bcb8376eeb3 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.122432513Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.447893 Instance=stub-providertype3-1343bcb8376eeb3 InstanceType=type3 State=booting 16:47:59 time="2020-08-15T20:47:59.122453305Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000154 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.122838290Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-7586b21b9728391e InstanceType=type6 ProbeStart="2020-08-15 20:47:59.096419944 +0000 UTC m=+1.925254391" 16:47:59 time="2020-08-15T20:47:59.122862629Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-7586b21b9728391e InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.122881081Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.817553 Instance=stub-providertype6-7586b21b9728391e InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:59.123639024Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000140 State=Complete 16:47:59 time="2020-08-15T20:47:59.123676123Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000077 State=Complete 16:47:59 time="2020-08-15T20:47:59.124602153Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000173 ExitCode=3 Instance=stub-providertype6-2d531646eefe2d2 PID=1 16:47:59 time="2020-08-15T20:47:59.124876009Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000180 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.125047434Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000179 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.125349572Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000039 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.128719705Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000097 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.128777627Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000159 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.129182266Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000093 Instance=stub-providertype6-4503ce82f78d0809 PID=3 16:47:59 time="2020-08-15T20:47:59.129236624Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000019 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.129297771Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000193 Instance=stub-providertype2-647ea68f0b80eccd PID=1 16:47:59 time="2020-08-15T20:47:59.129518205Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000193 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.129759068Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000093 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.131059544Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000176 ExitCode=1 Instance=stub-providertype8-2ace21fc713e95fc PID=3 16:47:59 time="2020-08-15T20:47:59.132659113Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-7586b21b9728391e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.132681499Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-1343bcb8376eeb3 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.132705110Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000034 ExitCode=0 Instance=stub-providertype2-482c0d1794f0d7da PID=1 16:47:59 time="2020-08-15T20:47:59.133771219Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000154 State=Complete 16:47:59 time="2020-08-15T20:47:59.134701531Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000174 ExitCode=2 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=1 16:47:59 time="2020-08-15T20:47:59.134749987Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000199 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.134818240Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000098 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.134867798Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000138 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.134914104Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000054 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.134954794Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000119 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.134998847Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000094 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.135149144Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000079 ExitCode=3 Instance=stub-providertype8-d428445aa6ef614 PID=2 16:47:59 time="2020-08-15T20:47:59.135221792Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000099 ExitCode=2 Instance=stub-providertype4-1fc4715eee2c000b PID=2 16:47:59 time="2020-08-15T20:47:59.135262894Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000018 Instance=stub-providertype4-27dff7ab244fcd36 PID=2 16:47:59 time="2020-08-15T20:47:59.135482929Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000137 ExitCode=2 Instance=stub-providertype3-7d21ebf5c816ced2 PID=1 16:47:59 time="2020-08-15T20:47:59.135532560Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000039 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.135551226Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000053 Instance=stub-providertype6-5d214064018153da PID=1 State=Running 16:47:59 time="2020-08-15T20:47:59.135675130Z" level=info msg="killing crunch-run process" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000134 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.135738696Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000179 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.135772910Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000018 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.136218329Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000073 Instance=stub-providertype2-279d5ab29f22bfbd PID=3 16:47:59 time="2020-08-15T20:47:59.136382457Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000073 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.136632741Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000019 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.136637074Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-54a888203391860a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.136775613Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-54a888203391860a InstanceType=type8 ProbeStart="2020-08-15 20:47:59.128979921 +0000 UTC m=+1.957814347" 16:47:59 time="2020-08-15T20:47:59.136817387Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000159 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.136906549Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000039 State=Complete 16:47:59 time="2020-08-15T20:47:59.136937151Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000179 State=Complete 16:47:59 time="2020-08-15T20:47:59.136957814Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000180 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.137055066Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=744.709232ms Instance=stub-providertype4-40daa2804b1aa313 InstanceType=type4 Since="2020-08-15 20:47:58.369297701 +0000 UTC m=+1.198132128" State=booting 16:47:59 time="2020-08-15T20:47:59.137083823Z" level=info msg="boot failed" Address= Duration=744.709232ms Instance=stub-providertype4-40daa2804b1aa313 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.114006906 +0000 UTC m=+1.942841360" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.136910172Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.137332086Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000097 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.137377802Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.134634535 +0000 UTC m=+1.963468984" 16:47:59 time="2020-08-15T20:47:59.137379412Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.137432124Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.134961495 +0000 UTC m=+1.963795932" 16:47:59 time="2020-08-15T20:47:59.137462609Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000054 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.137785565Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000174 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.137893908Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000176 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.137955520Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000173 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.138001088Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000034 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.138077498Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000119 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.138093619Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000094 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.138951989Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000097 State=Complete 16:47:59 time="2020-08-15T20:47:59.138970739Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000019 State=Complete 16:47:59 time="2020-08-15T20:47:59.138986860Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000054 State=Complete 16:47:59 time="2020-08-15T20:47:59.139002722Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000180 State=Complete 16:47:59 time="2020-08-15T20:47:59.139014300Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.134961495 +0000 UTC m=+1.963795932" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.139018093Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000159 State=Complete 16:47:59 time="2020-08-15T20:47:59.139306775Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000199 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.139331017Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000138 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.138954339Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.139891696Z" level=info msg="sending signal" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000134 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.141807518Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000073 ExitCode=2 Instance=stub-providertype2-279d5ab29f22bfbd PID=3 16:47:59 time="2020-08-15T20:47:59.145349529Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000136 Instance=stub-providertype8-2c9e457114fcddea PID=2 16:47:59 time="2020-08-15T20:47:59.146901952Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3bc219a5c50811b4 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.148088445Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3bc219a5c50811b4 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.108258881 +0000 UTC m=+1.937093312" 16:47:59 time="2020-08-15T20:47:59.147051077Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000034 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.147088337Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000017 Instance=stub-providertype3-51825d31521f7308 PID=3 16:47:59 time="2020-08-15T20:47:59.148475883Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.134634535 +0000 UTC m=+1.963468984" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.148506847Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000098 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.148670450Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000017 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.148968446Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000138 State=Complete 16:47:59 time="2020-08-15T20:47:59.149004440Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000094 State=Complete 16:47:59 time="2020-08-15T20:47:59.149028631Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000119 State=Complete 16:47:59 time="2020-08-15T20:47:59.150485998Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000057 Instance=stub-providertype4-364f0ff8af8eef6b PID=2 16:47:59 time="2020-08-15T20:47:59.150864373Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000137 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.147156887Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000193 ExitCode=1 Instance=stub-providertype2-647ea68f0b80eccd PID=1 16:47:59 time="2020-08-15T20:47:59.152255102Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000093 ExitCode=0 Instance=stub-providertype6-4503ce82f78d0809 PID=3 16:47:59 time="2020-08-15T20:47:59.152603675Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000018 ExitCode=2 Instance=stub-providertype4-27dff7ab244fcd36 PID=2 16:47:59 time="2020-08-15T20:47:59.152652331Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000136 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.153362554Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-40daa2804b1aa313 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.153553155Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000073 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.153616395Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000079 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.153714753Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000099 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.153914231Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000137 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.147196841Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.136836596 +0000 UTC m=+1.965671043" 16:47:59 time="2020-08-15T20:47:59.147216704Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000176 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.147220314Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000174 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.147223028Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000173 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.155430533Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000098 State=Complete 16:47:59 time="2020-08-15T20:47:59.155461746Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000199 State=Complete 16:47:59 time="2020-08-15T20:47:59.156142872Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000010 Instance=stub-providertype2-38550618aeb9fb77 PID=3 16:47:59 time="2020-08-15T20:47:59.156212688Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000057 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.156242168Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000013 Instance=stub-providertype6-72126e84f0a7aec6 PID=2 16:47:59 time="2020-08-15T20:47:59.156289039Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000133 Instance=stub-providertype6-5c24155b9170e16 PID=2 16:47:59 time="2020-08-15T20:47:59.156332452Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-405517c089b934b6 PID=3 16:47:59 time="2020-08-15T20:47:59.156375846Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000016 Instance=stub-providertype8-35ca80d72521a90 PID=2 16:47:59 time="2020-08-15T20:47:59.156432348Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000193 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.156484860Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000093 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.156540742Z" level=info msg="crunch-run process ended" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000134 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.156650201Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000079 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.156752782Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000099 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.156766270Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-3bc219a5c50811b4 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.108258881 +0000 UTC m=+1.937093312" 16:47:59 time="2020-08-15T20:47:59.156800697Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-3bc219a5c50811b4 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.156819809Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.763323 Instance=stub-providertype6-3bc219a5c50811b4 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:59.157347818Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000056 Instance=stub-providertype8-7694a644db212264 PID=3 16:47:59 time="2020-08-15T20:47:59.157390532Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000016 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.157541544Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.157675583Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000134 State=Complete 16:47:59 time="2020-08-15T20:47:59.157842417Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000133 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.157869149Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000013 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.157894361Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000010 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.158417254Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000016 ExitCode=0 Instance=stub-providertype8-35ca80d72521a90 PID=2 16:47:59 time="2020-08-15T20:47:59.158570615Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000056 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.158580816Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000073 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.159067748Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000136 ExitCode=0 Instance=stub-providertype8-2c9e457114fcddea PID=2 16:47:59 time="2020-08-15T20:47:59.159367136Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000177 Instance=stub-providertype4-493a23eb55ece0ea PID=2 16:47:59 time="2020-08-15T20:47:59.159418304Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000175 Instance=stub-providertype8-733014a83a1a22a0 PID=1 16:47:59 time="2020-08-15T20:47:59.159573310Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-50663c4c6c049ff9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.159587072Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-50663c4c6c049ff9 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.122911766 +0000 UTC m=+1.951746192" 16:47:59 time="2020-08-15T20:47:59.160105956Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-76faa982abce3a0c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.160121564Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-76faa982abce3a0c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.122960299 +0000 UTC m=+1.951794733" 16:47:59 time="2020-08-15T20:47:59.160908451Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000034 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.161097175Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000175 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.161152237Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000177 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.162385077Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000137 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.162439877Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000174 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.162508089Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.162557332Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000193 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.162610904Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000093 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.164850577Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.167304495Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000136 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.167542785Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000018 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.169431512Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-76faa982abce3a0c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.122960299 +0000 UTC m=+1.951794733" 16:47:59 time="2020-08-15T20:47:59.169466489Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-76faa982abce3a0c InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.169498035Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.746409 Instance=stub-providertype8-76faa982abce3a0c InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:59.169784604Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000010 ExitCode=0 Instance=stub-providertype2-38550618aeb9fb77 PID=3 16:47:59 time="2020-08-15T20:47:59.169820266Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000155 Instance=stub-providertype3-7426715c257c2559 PID=2 16:47:59 time="2020-08-15T20:47:59.169899027Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000035 Instance=stub-providertype3-2a19dd3f570dc8ad PID=2 16:47:59 time="2020-08-15T20:47:59.169957406Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-405517c089b934b6 PID=3 State=Locked 16:47:59 time="2020-08-15T20:47:59.170024338Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000073 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.169804406Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000057 ExitCode=3 Instance=stub-providertype4-364f0ff8af8eef6b PID=2 16:47:59 time="2020-08-15T20:47:59.169920866Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-50663c4c6c049ff9 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.169922277Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000130 Instance=stub-providertype2-6d87b8e5d22bd743 PID=1 16:47:59 time="2020-08-15T20:47:59.170248435Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000176 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.170424386Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000173 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.170734184Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000155 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.171447188Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-3bc219a5c50811b4 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.171515232Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=740.555311ms Instance=stub-providertype4-50663c4c6c049ff9 InstanceType=type4 Since="2020-08-15 20:47:58.382356452 +0000 UTC m=+1.211190881" State=booting 16:47:59 time="2020-08-15T20:47:59.171759753Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.154653373 +0000 UTC m=+1.983487804" 16:47:59 time="2020-08-15T20:47:59.172003316Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 ProbeStart="2020-08-15 20:47:59.158337441 +0000 UTC m=+1.987171875" 16:47:59 time="2020-08-15T20:47:59.172939588Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000174 State=Complete 16:47:59 time="2020-08-15T20:47:59.172981517Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000137 State=Complete 16:47:59 time="2020-08-15T20:47:59.172993859Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000034 State=Complete 16:47:59 time="2020-08-15T20:47:59.173009314Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000073 State=Complete 16:47:59 time="2020-08-15T20:47:59.173020509Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000176 State=Complete 16:47:59 time="2020-08-15T20:47:59.173030079Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000093 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.173034603Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000173 State=Complete 16:47:59 time="2020-08-15T20:47:59.173581427Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000136 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.173641323Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000018 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.175160484Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000016 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.175205976Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000193 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.175304298Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000133 ExitCode=2 Instance=stub-providertype6-5c24155b9170e16 PID=2 16:47:59 time="2020-08-15T20:47:59.175339166Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000177 ExitCode=0 Instance=stub-providertype4-493a23eb55ece0ea PID=2 16:47:59 time="2020-08-15T20:47:59.175499217Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-f46a39a335e8aab InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.175522481Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-f46a39a335e8aab InstanceType=type8 ProbeStart="2020-08-15 20:47:59.128886891 +0000 UTC m=+1.957721359" 16:47:59 time="2020-08-15T20:47:59.175535626Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000079 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.175753372Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000130 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.175786600Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000035 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.175818503Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000099 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.175911801Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000010 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.176019605Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000057 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.176698763Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000079 State=Complete 16:47:59 time="2020-08-15T20:47:59.176719725Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000093 State=Complete 16:47:59 time="2020-08-15T20:47:59.176746433Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000193 State=Complete 16:47:59 time="2020-08-15T20:47:59.178424003Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000056 ExitCode=2 Instance=stub-providertype8-7694a644db212264 PID=3 16:47:59 time="2020-08-15T20:47:59.179328331Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000099 State=Complete 16:47:59 time="2020-08-15T20:47:59.179346512Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000169 Instance=stub-providertype2-482c0d1794f0d7da PID=2 16:47:59 time="2020-08-15T20:47:59.179445732Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1f175c897a14c51 PID=3 16:47:59 time="2020-08-15T20:47:59.181481836Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000016 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.181492263Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000010 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.181554549Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000057 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.181673894Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000017 ExitCode=1 Instance=stub-providertype3-51825d31521f7308 PID=3 16:47:59 time="2020-08-15T20:47:59.182127831Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000175 ExitCode=2 Instance=stub-providertype8-733014a83a1a22a0 PID=1 16:47:59 time="2020-08-15T20:47:59.182383819Z" level=info msg="crunch-run process started" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.182472191Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000169 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.182899758Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000155 ExitCode=0 Instance=stub-providertype3-7426715c257c2559 PID=2 16:47:59 time="2020-08-15T20:47:59.183137280Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.183642405Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-50663c4c6c049ff9 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.183668901Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-76faa982abce3a0c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.185215231Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000177 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.185399111Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000056 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.185455249Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000175 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.185486029Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-f46a39a335e8aab InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.185493311Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000017 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.185581902Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000133 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.185643435Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=633.324434ms Instance=stub-providertype8-f46a39a335e8aab InstanceType=type8 Since="2020-08-15 20:47:58.495562493 +0000 UTC m=+1.324396925" State=booting 16:47:59 time="2020-08-15T20:47:59.185748458Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.173155126 +0000 UTC m=+2.001989575" 16:47:59 time="2020-08-15T20:47:59.186176187Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000018 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.186991593Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.187008367Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.177567371 +0000 UTC m=+2.006401819" 16:47:59 time="2020-08-15T20:47:59.187398609Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000136 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.187518559Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000130 ExitCode=3 Instance=stub-providertype2-6d87b8e5d22bd743 PID=1 16:47:59 time="2020-08-15T20:47:59.187957873Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000013 ExitCode=3 Instance=stub-providertype6-72126e84f0a7aec6 PID=2 16:47:59 time="2020-08-15T20:47:59.188056147Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000110 Instance=stub-providertype6-4503ce82f78d0809 PID=4 16:47:59 time="2020-08-15T20:47:59.188152712Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000049 Instance=stub-providertype2-279d5ab29f22bfbd PID=4 16:47:59 time="2020-08-15T20:47:59.188276585Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000055 Instance=stub-providertype8-2ace21fc713e95fc PID=4 16:47:59 time="2020-08-15T20:47:59.189091778Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000133 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.190999420Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-25826451d91ac90f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.190992379Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000017 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.191226802Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-581092e28026dcd InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.191243530Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.194773999Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000035 ExitCode=2 Instance=stub-providertype3-2a19dd3f570dc8ad PID=2 16:47:59 time="2020-08-15T20:47:59.196006716Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000115 Instance=stub-providertype3-7d21ebf5c816ced2 PID=2 16:47:59 time="2020-08-15T20:47:59.197492974Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000196 Instance=stub-providertype4-1fc4715eee2c000b PID=3 16:47:59 time="2020-08-15T20:47:59.197600828Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000196 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.197791908Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000110 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.198105766Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000049 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.198450746Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7ed543364803913b InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.198462579Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000055 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.198484807Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000115 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.198598534Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.198716716Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000177 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.198914971Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000030 Instance=stub-providertype6-2d531646eefe2d2 PID=2 16:47:59 time="2020-08-15T20:47:59.198935385Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4d58dc8683d11ab7 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.199319811Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000016 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.199350301Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-25826451d91ac90f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.152443021 +0000 UTC m=+1.981277468" 16:47:59 time="2020-08-15T20:47:59.199393912Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-581092e28026dcd InstanceType=type4 ProbeStart="2020-08-15 20:47:59.181665595 +0000 UTC m=+2.010500029" 16:47:59 time="2020-08-15T20:47:59.199426241Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.181445033 +0000 UTC m=+2.010279480" 16:47:59 time="2020-08-15T20:47:59.199458979Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000057 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.199477486Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000010 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.199483945Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000030 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.199504807Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000175 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.199496210Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=947.290379ms Instance=stub-providertype8-4d434fdfdf9148e8 InstanceType=type8 Since="2020-08-15 20:47:58.228658854 +0000 UTC m=+1.057493286" State=booting 16:47:59 time="2020-08-15T20:47:59.199575945Z" level=info msg="boot failed" Address= Duration=947.290379ms Instance=stub-providertype8-4d434fdfdf9148e8 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.175949232 +0000 UTC m=+2.004783665" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.199599656Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.181922184 +0000 UTC m=+2.010756615" 16:47:59 time="2020-08-15T20:47:59.199926688Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000190 ExitCode=0 Instance=stub-providertype6-1f175c897a14c51 PID=3 16:47:59 time="2020-08-15T20:47:59.200062587Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000133 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.200186035Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000070 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=2 16:47:59 time="2020-08-15T20:47:59.199501140Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000056 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.200278990Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000070 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.200346615Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000018 State=Complete 16:47:59 time="2020-08-15T20:47:59.200373874Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000136 State=Complete 16:47:59 time="2020-08-15T20:47:59.200406799Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7ed543364803913b InstanceType=type8 ProbeStart="2020-08-15 20:47:59.153423263 +0000 UTC m=+1.982257684" 16:47:59 time="2020-08-15T20:47:59.200618176Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000017 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.200752064Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000110 ExitCode=2 Instance=stub-providertype6-4503ce82f78d0809 PID=4 16:47:59 time="2020-08-15T20:47:59.200790592Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4d58dc8683d11ab7 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.148539679 +0000 UTC m=+1.977374109" 16:47:59 time="2020-08-15T20:47:59.201695708Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000177 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.202292538Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.202321862Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 ProbeStart="2020-08-15 20:47:59.199054676 +0000 UTC m=+2.027889137" 16:47:59 time="2020-08-15T20:47:59.202374747Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000035 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.203349087Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-f46a39a335e8aab WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.203425576Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000015 Instance=stub-providertype8-d428445aa6ef614 PID=3 16:47:59 time="2020-08-15T20:47:59.203669171Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000130 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.203722079Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000155 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.203782697Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000013 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.204473286Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000133 State=Complete 16:47:59 time="2020-08-15T20:47:59.204489732Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000177 State=Complete 16:47:59 time="2020-08-15T20:47:59.204506824Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000016 State=Complete 16:47:59 time="2020-08-15T20:47:59.204522576Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000017 State=Complete 16:47:59 time="2020-08-15T20:47:59.204537753Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000010 State=Complete 16:47:59 time="2020-08-15T20:47:59.205583834Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=2 16:47:59 time="2020-08-15T20:47:59.205687609Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000049 ExitCode=2 Instance=stub-providertype2-279d5ab29f22bfbd PID=4 16:47:59 time="2020-08-15T20:47:59.206384344Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000175 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.206643738Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000036 Instance=stub-providertype4-27dff7ab244fcd36 PID=3 16:47:59 time="2020-08-15T20:47:59.206699383Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000035 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.206860984Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.207059073Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000015 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.207139235Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000013 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.207767158Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000057 State=Complete 16:47:59 time="2020-08-15T20:47:59.208541647Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000056 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.209020309Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000076 Instance=stub-providertype4-364f0ff8af8eef6b PID=3 16:47:59 time="2020-08-15T20:47:59.209147764Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-4d58dc8683d11ab7 InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.209176360Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=477.663699ms Instance=stub-providertype8-4d58dc8683d11ab7 InstanceType=type8 Since="2020-08-15 20:47:58.670875994 +0000 UTC m=+1.499710410" State=booting 16:47:59 time="2020-08-15T20:47:59.209267730Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.209287063Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.209394431Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000130 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.209468483Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000155 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.209518796Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 ProbeStart="2020-08-15 20:47:59.200833157 +0000 UTC m=+2.029667586" 16:47:59 time="2020-08-15T20:47:59.209925261Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.200868433 +0000 UTC m=+2.029702862" 16:47:59 time="2020-08-15T20:47:59.210036666Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000049 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.210085566Z" level=info msg="killing crunch-run process" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.210128212Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000110 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.211252320Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000175 State=Complete 16:47:59 time="2020-08-15T20:47:59.211278738Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000056 State=Complete 16:47:59 time="2020-08-15T20:47:59.212829303Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=2 State=Locked 16:47:59 time="2020-08-15T20:47:59.213017735Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000036 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.213644901Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.213673856Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.205635826 +0000 UTC m=+2.034470276" 16:47:59 time="2020-08-15T20:47:59.214286746Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.214642314Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-ce9e06596372b2d InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.214884657Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000074 Instance=stub-providertype3-51825d31521f7308 PID=4 16:47:59 time="2020-08-15T20:47:59.214982490Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000169 ExitCode=1 Instance=stub-providertype2-482c0d1794f0d7da PID=2 16:47:59 time="2020-08-15T20:47:59.215030198Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000076 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.214994216Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-4d58dc8683d11ab7 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.215124914Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-4d434fdfdf9148e8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.215144731Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.206913599 +0000 UTC m=+2.035748029" 16:47:59 time="2020-08-15T20:47:59.215184502Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000013 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.215198753Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-ce9e06596372b2d InstanceType=type4 ProbeStart="2020-08-15 20:47:59.171902097 +0000 UTC m=+2.000736529" 16:47:59 time="2020-08-15T20:47:59.215277941Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000135 Instance=stub-providertype8-2c9e457114fcddea PID=3 16:47:59 time="2020-08-15T20:47:59.215332347Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-493a23eb55ece0ea PID=3 16:47:59 time="2020-08-15T20:47:59.215358825Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000074 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.215377758Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000095 Instance=stub-providertype8-35ca80d72521a90 PID=3 16:47:59 time="2020-08-15T20:47:59.215427861Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000150 Instance=stub-providertype6-5c24155b9170e16 PID=3 16:47:59 time="2020-08-15T20:47:59.215590564Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000035 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.215702915Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000152 Instance=stub-providertype8-7694a644db212264 PID=4 16:47:59 time="2020-08-15T20:47:59.215749897Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000095 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.215772944Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.215785875Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.213038199 +0000 UTC m=+2.041872625" 16:47:59 time="2020-08-15T20:47:59.215777364Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000135 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.215846564Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.215955799Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000130 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.216211551Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000110 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.216241921Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000150 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.216225350Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-4cb2efc43499d044 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.216269444Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.216326618Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000049 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.216372315Z" level=info msg="sending signal" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.216442226Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000152 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.216545091Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.216883480Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.213914337 +0000 UTC m=+2.042748772" 16:47:59 time="2020-08-15T20:47:59.219265786Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.219500910Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000055 ExitCode=2 Instance=stub-providertype8-2ace21fc713e95fc PID=4 16:47:59 time="2020-08-15T20:47:59.223603211Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000115 ExitCode=3 Instance=stub-providertype3-7d21ebf5c816ced2 PID=2 16:47:59 time="2020-08-15T20:47:59.223914005Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000036 ExitCode=0 Instance=stub-providertype4-27dff7ab244fcd36 PID=3 16:47:59 time="2020-08-15T20:47:59.223977406Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.224116975Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000155 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.224161176Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000074 ExitCode=3 Instance=stub-providertype3-51825d31521f7308 PID=4 16:47:59 time="2020-08-15T20:47:59.224367859Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000032 Instance=stub-providertype8-733014a83a1a22a0 PID=2 16:47:59 time="2020-08-15T20:47:59.224423014Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.215235246 +0000 UTC m=+2.044069682" 16:47:59 time="2020-08-15T20:47:59.224542432Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-4cb2efc43499d044 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.175304303 +0000 UTC m=+2.004138763" 16:47:59 time="2020-08-15T20:47:59.224573043Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.212959078 +0000 UTC m=+2.041793541" 16:47:59 time="2020-08-15T20:47:59.225182174Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000155 State=Complete 16:47:59 time="2020-08-15T20:47:59.225207529Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000013 State=Complete 16:47:59 time="2020-08-15T20:47:59.225234575Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000035 State=Complete 16:47:59 time="2020-08-15T20:47:59.225853187Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000032 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.226231830Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000030 Instance=stub-providertype6-2d531646eefe2d2 PID=2 State=Running 16:47:59 time="2020-08-15T20:47:59.226284173Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000025 Instance=stub-providertype2-38550618aeb9fb77 PID=4 16:47:59 time="2020-08-15T20:47:59.226376852Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000049 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.226580707Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000196 ExitCode=1 Instance=stub-providertype4-1fc4715eee2c000b PID=3 16:47:59 time="2020-08-15T20:47:59.226620440Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000015 ExitCode=2 Instance=stub-providertype8-d428445aa6ef614 PID=3 16:47:59 time="2020-08-15T20:47:59.226686400Z" level=info msg="crunch-run process ended" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.226985464Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000025 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.230249171Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000070 ExitCode=2 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=2 16:47:59 time="2020-08-15T20:47:59.231029924Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=402.667756ms Instance=stub-providertype8-32e91a8f5dbad373 InstanceType=type8 Since="2020-08-15 20:47:58.782607619 +0000 UTC m=+1.611442072" State=booting 16:47:59 time="2020-08-15T20:47:59.231064664Z" level=info msg="boot failed" Address= Duration=402.667756ms Instance=stub-providertype8-32e91a8f5dbad373 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.185275392 +0000 UTC m=+2.014109828" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.231161775Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000169 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.231208531Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000055 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.231230434Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000135 ExitCode=2 Instance=stub-providertype8-2c9e457114fcddea PID=3 16:47:59 time="2020-08-15T20:47:59.231340130Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000074 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.231405879Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000115 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.231459943Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000036 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.231488544Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.231589948Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.231747865Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.224307243 +0000 UTC m=+2.053141689" 16:47:59 time="2020-08-15T20:47:59.231802122Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.224913214 +0000 UTC m=+2.053747655" 16:47:59 time="2020-08-15T20:47:59.232036586Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000110 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.231170036Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-493a23eb55ece0ea PID=3 State=Locked 16:47:59 time="2020-08-15T20:47:59.232261460Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.215914494 +0000 UTC m=+2.044748917" 16:47:59 time="2020-08-15T20:47:59.232356856Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000130 State=Complete 16:47:59 time="2020-08-15T20:47:59.232514212Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-326d74010c77412c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.232529312Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-326d74010c77412c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.226921743 +0000 UTC m=+2.055756193" 16:47:59 time="2020-08-15T20:47:59.232540597Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000109 Instance=stub-providertype6-72126e84f0a7aec6 PID=3 16:47:59 time="2020-08-15T20:47:59.233035981Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.233053428Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.200649327 +0000 UTC m=+2.029483779" 16:47:59 time="2020-08-15T20:47:59.233148487Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000110 State=Complete 16:47:59 time="2020-08-15T20:47:59.233156456Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000109 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.233172363Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000049 State=Complete 16:47:59 time="2020-08-15T20:47:59.233196717Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000190 State=Complete 16:47:59 time="2020-08-15T20:47:59.233284702Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000082 Instance=stub-providertype2-279d5ab29f22bfbd PID=5 16:47:59 time="2020-08-15T20:47:59.233302109Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000015 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.233409990Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000196 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.233446380Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000082 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.233460770Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000194 Instance=stub-providertype3-2a19dd3f570dc8ad PID=3 16:47:59 time="2020-08-15T20:47:59.233600088Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000194 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.233938734Z" level=info msg="boot probe succeeded" Address="127.0.0.1:44507" Command=true Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.233956744Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:44507" Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.23216167 +0000 UTC m=+2.060996110" 16:47:59 time="2020-08-15T20:47:59.234394285Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.234448216Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 ProbeStart="2020-08-15 20:47:59.232914231 +0000 UTC m=+2.061748665" 16:47:59 time="2020-08-15T20:47:59.234575245Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.234588577Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.233499455 +0000 UTC m=+2.062333886" 16:47:59 time="2020-08-15T20:47:59.234819360Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-931afd8b416421 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.234833289Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-931afd8b416421 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.233939217 +0000 UTC m=+2.062773648" 16:47:59 time="2020-08-15T20:47:59.235189333Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 ProbeStart="2020-08-15 20:47:59.232914231 +0000 UTC m=+2.061748665" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.235245674Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000076 Instance=stub-providertype4-364f0ff8af8eef6b PID=3 State=Running 16:47:59 time="2020-08-15T20:47:59.235574979Z" level=info msg="probes succeeded, instance is in service" Address="127.0.0.1:44507" Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.23216167 +0000 UTC m=+2.060996110" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.235714227Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-931afd8b416421 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.233939217 +0000 UTC m=+2.062773648" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.235808858Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.235834910Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000189 Instance=stub-providertype6-1f175c897a14c51 PID=4 16:47:59 time="2020-08-15T20:47:59.235926952Z" level=info msg="crunch-run process started" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000189 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.235961241Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1c33143dfa909fb7 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.236055012Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1c33143dfa909fb7 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.206264049 +0000 UTC m=+2.035098499" 16:47:59 time="2020-08-15T20:47:59.236191409Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-736888b427bce82c InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.236219181Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-736888b427bce82c InstanceType=type3 ProbeStart="2020-08-15 20:47:59.235939046 +0000 UTC m=+2.064773480" 16:47:59 time="2020-08-15T20:47:59.236335407Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-1c33143dfa909fb7 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.236363705Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=386.671044ms Instance=stub-providertype4-1c33143dfa909fb7 InstanceType=type4 Since="2020-08-15 20:47:58.819593026 +0000 UTC m=+1.648427455" State=booting 16:47:59 time="2020-08-15T20:47:59.236396886Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000015 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.236543782Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-736888b427bce82c InstanceType=type3 ProbeStart="2020-08-15 20:47:59.235939046 +0000 UTC m=+2.064773480" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.236711137Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000145 Instance=stub-providertype2-6d87b8e5d22bd743 PID=2 16:47:59 time="2020-08-15T20:47:59.236828913Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000145 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.237226279Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000135 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.237381549Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000015 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.237399380Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000196 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.237536315Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000070 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.237577779Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.233499455 +0000 UTC m=+2.062333886" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.237583277Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.234921207 +0000 UTC m=+2.063755642" 16:47:59 time="2020-08-15T20:47:59.238618429Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000196 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.238643918Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.234921207 +0000 UTC m=+2.063755642" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.238653092Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000015 State=Complete 16:47:59 time="2020-08-15T20:47:59.238982512Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000169 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.239041089Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000055 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.239057443Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000074 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.239106234Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000036 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.239057435Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000115 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.239357962Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000113 Instance=stub-providertype3-7426715c257c2559 PID=3 16:47:59 time="2020-08-15T20:47:59.239531798Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000113 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.239937664Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000196 State=Complete 16:47:59 time="2020-08-15T20:47:59.240143981Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.240229704Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:59.239005268 +0000 UTC m=+2.067839716" 16:47:59 time="2020-08-15T20:47:59.240288910Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000135 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.240235901Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000074 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.240492374Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.240508190Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.238579253 +0000 UTC m=+2.067413688" 16:47:59 time="2020-08-15T20:47:59.240645319Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000169 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.240774435Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000152 ExitCode=0 Instance=stub-providertype8-7694a644db212264 PID=4 16:47:59 time="2020-08-15T20:47:59.240879782Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000115 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.241130699Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000116 Instance=stub-providertype4-700ee2bdf42b6914 PID=1 16:47:59 time="2020-08-15T20:47:59.241465684Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000131 Instance=stub-providertype3-22d25dd56b8d471a PID=1 16:47:59 time="2020-08-15T20:47:59.241558708Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000069 Instance=stub-providertype6-4503ce82f78d0809 PID=5 16:47:59 time="2020-08-15T20:47:59.242491927Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000011 Instance=stub-providertype3-736888b427bce82c PID=1 16:47:59 time="2020-08-15T20:47:59.242718075Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000091 Instance=stub-providertype3-931afd8b416421 PID=1 16:47:59 time="2020-08-15T20:47:59.243079715Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000070 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.244090054Z" level=info msg="crunch-run process started" Address="127.0.0.1:44507" ContainerUUID=zzzzz-dz642-000000000000116 Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.246212608Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000025 ExitCode=0 Instance=stub-providertype2-38550618aeb9fb77 PID=4 16:47:59 time="2020-08-15T20:47:59.246686067Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000109 ExitCode=3 Instance=stub-providertype6-72126e84f0a7aec6 PID=3 16:47:59 time="2020-08-15T20:47:59.247784354Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000131 ExitCode=3 Instance=stub-providertype3-22d25dd56b8d471a PID=1 16:47:59 time="2020-08-15T20:47:59.247919589Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000075 Instance=stub-providertype4-1225ce839a88b076 PID=1 16:47:59 time="2020-08-15T20:47:59.248010092Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000145 ExitCode=0 Instance=stub-providertype2-6d87b8e5d22bd743 PID=2 16:47:59 time="2020-08-15T20:47:59.248060822Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000095 ExitCode=3 Instance=stub-providertype8-35ca80d72521a90 PID=3 16:47:59 time="2020-08-15T20:47:59.249342360Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000011 ExitCode=0 Instance=stub-providertype3-736888b427bce82c PID=1 16:47:59 time="2020-08-15T20:47:59.249441761Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000150 ExitCode=3 Instance=stub-providertype6-5c24155b9170e16 PID=3 16:47:59 time="2020-08-15T20:47:59.250360465Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6eb339154602315f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.250380824Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6eb339154602315f InstanceType=type8 ProbeStart="2020-08-15 20:47:59.249967703 +0000 UTC m=+2.078802191" 16:47:59 time="2020-08-15T20:47:59.250360468Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.250428975Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.249991718 +0000 UTC m=+2.078826166" 16:47:59 time="2020-08-15T20:47:59.250452481Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000135 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.250606363Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000036 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.250703977Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.250715478Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-6eb339154602315f InstanceType=type8 ProbeStart="2020-08-15 20:47:59.249967703 +0000 UTC m=+2.078802191" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.250749206Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.249991718 +0000 UTC m=+2.078826166" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.250770526Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.23899511 +0000 UTC m=+2.067829543" 16:47:59 time="2020-08-15T20:47:59.250872669Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000069 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.250750930Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000113 Instance=stub-providertype3-7426715c257c2559 PID=3 State=Running 16:47:59 time="2020-08-15T20:47:59.251068614Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000055 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.251460550Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.251486615Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000011 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.251539401Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000195 Instance=stub-providertype4-1fc4715eee2c000b PID=4 16:47:59 time="2020-08-15T20:47:59.251720137Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000195 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.251729286Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000075 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.251993621Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000131 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.252003134Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-32e91a8f5dbad373 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.252042608Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000091 Instance=stub-providertype3-931afd8b416421 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.252046758Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1c33143dfa909fb7 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.252082470Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.250973977 +0000 UTC m=+2.079808414" 16:47:59 time="2020-08-15T20:47:59.252143241Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.252169428Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 ProbeStart="2020-08-15 20:47:59.240983397 +0000 UTC m=+2.069817831" 16:47:59 time="2020-08-15T20:47:59.252206958Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000070 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.252368571Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=578.579119ms Instance=stub-providertype6-24a40f5936a7f8de InstanceType=type6 Since="2020-08-15 20:47:58.647396464 +0000 UTC m=+1.476230893" State=booting 16:47:59 time="2020-08-15T20:47:59.252407943Z" level=info msg="boot failed" Address= Duration=578.579119ms Instance=stub-providertype6-24a40f5936a7f8de InstanceType=type6 ProbeStart="2020-08-15 20:47:59.225975564 +0000 UTC m=+2.054810012" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.252436886Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000074 State=Complete 16:47:59 time="2020-08-15T20:47:59.252455222Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000115 State=Complete 16:47:59 time="2020-08-15T20:47:59.252468808Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000169 State=Complete 16:47:59 time="2020-08-15T20:47:59.252745540Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.252438986Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype6-24a40f5936a7f8de InstanceType=type6 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.252814766Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000112 Instance=stub-providertype8-d428445aa6ef614 PID=4 16:47:59 time="2020-08-15T20:47:59.252923000Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000112 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.253390624Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.252232189 +0000 UTC m=+2.081066628" 16:47:59 time="2020-08-15T20:47:59.253486339Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000011 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253529253Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000150 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253557158Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000082 ExitCode=2 Instance=stub-providertype2-279d5ab29f22bfbd PID=5 16:47:59 time="2020-08-15T20:47:59.253589922Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000095 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253651213Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000152 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253683619Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000131 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253721471Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000145 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253765685Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000109 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253808256Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000025 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.253864429Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000029 Instance=stub-providertype6-10b92d0169a39144 PID=1 16:47:59 time="2020-08-15T20:47:59.254024240Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.252232189 +0000 UTC m=+2.081066628" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.254294942Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000029 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.254537739Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-86d109024279992 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.254552403Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-86d109024279992 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.253841992 +0000 UTC m=+2.082676419" 16:47:59 time="2020-08-15T20:47:59.254706836Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000135 State=Complete 16:47:59 time="2020-08-15T20:47:59.254732820Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000036 State=Complete 16:47:59 time="2020-08-15T20:47:59.254747179Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000055 State=Complete 16:47:59 time="2020-08-15T20:47:59.254771719Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000070 State=Complete 16:47:59 time="2020-08-15T20:47:59.254883766Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000072 Instance=stub-providertype8-2ace21fc713e95fc PID=5 16:47:59 time="2020-08-15T20:47:59.255073670Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000033 Instance=stub-providertype4-15974b9d7f803594 PID=1 16:47:59 time="2020-08-15T20:47:59.255187779Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000072 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.255258793Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000033 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.255486716Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.255500777Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.254928397 +0000 UTC m=+2.083762834" 16:47:59 time="2020-08-15T20:47:59.255636174Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000121 Instance=stub-providertype2-482c0d1794f0d7da PID=3 16:47:59 time="2020-08-15T20:47:59.255754233Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000121 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.255817974Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.254928397 +0000 UTC m=+2.083762834" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.255862282Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-86d109024279992 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.253841992 +0000 UTC m=+2.082676419" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.256731586Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000131 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.256821219Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000109 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.256870174Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000025 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.257259629Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-51825d31521f7308 PID=5 16:47:59 time="2020-08-15T20:47:59.257509990Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.257736974Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000131 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.258072569Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000082 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.258335540Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000025 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.258480122Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000032 ExitCode=1 Instance=stub-providertype8-733014a83a1a22a0 PID=2 16:47:59 time="2020-08-15T20:47:59.258581841Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000109 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.258778578Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000131 State=Complete 16:47:59 time="2020-08-15T20:47:59.258847397Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.258875407Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.258595947 +0000 UTC m=+2.087430375" 16:47:59 time="2020-08-15T20:47:59.259372590Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.258595947 +0000 UTC m=+2.087430375" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.259428076Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.259443656Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 ProbeStart="2020-08-15 20:47:59.258919662 +0000 UTC m=+2.087754093" 16:47:59 time="2020-08-15T20:47:59.259539991Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000109 State=Complete 16:47:59 time="2020-08-15T20:47:59.259668173Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 ProbeStart="2020-08-15 20:47:59.258919662 +0000 UTC m=+2.087754093" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.260304951Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000050 Instance=stub-providertype3-7d21ebf5c816ced2 PID=3 16:47:59 time="2020-08-15T20:47:59.260358644Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000011 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.260406135Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000150 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.260454896Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000095 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.260500513Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000152 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.260547111Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000145 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.260604410Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000192 Instance=stub-providertype8-2c9e457114fcddea PID=4 16:47:59 time="2020-08-15T20:47:59.260760667Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000192 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.260825790Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000050 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.261244702Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000082 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.261518529Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000152 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.261569755Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000114 Instance=stub-providertype4-27dff7ab244fcd36 PID=4 16:47:59 time="2020-08-15T20:47:59.261738278Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000067 Instance=stub-providertype3-22d25dd56b8d471a PID=2 16:47:59 time="2020-08-15T20:47:59.261806402Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000114 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.261897424Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000149 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=3 16:47:59 time="2020-08-15T20:47:59.261938438Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000095 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.262100154Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000149 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.262168573Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000067 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.262465366Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000152 State=Complete 16:47:59 time="2020-08-15T20:47:59.262543964Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000082 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.262905611Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-34fc0ec60101a939 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.262922812Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-34fc0ec60101a939 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.239913419 +0000 UTC m=+2.068747851" 16:47:59 time="2020-08-15T20:47:59.263329206Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000069 ExitCode=1 Instance=stub-providertype6-4503ce82f78d0809 PID=5 16:47:59 time="2020-08-15T20:47:59.263490323Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.263735542Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-24a40f5936a7f8de 16:47:59 time="2020-08-15T20:47:59.263769618Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000001 Instance=stub-providertype2-86d109024279992 PID=1 16:47:59 time="2020-08-15T20:47:59.263846156Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000001 Instance=stub-providertype2-86d109024279992 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.264163165Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000089 Instance=stub-providertype3-42d37cdca33fd566 PID=1 16:47:59 time="2020-08-15T20:47:59.264230528Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000111 Instance=stub-providertype8-6eb339154602315f PID=1 16:47:59 time="2020-08-15T20:47:59.264258326Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000089 Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.264310485Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000011 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.264326131Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000111 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.264431009Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000071 Instance=stub-providertype8-7694a644db212264 PID=5 16:47:59 time="2020-08-15T20:47:59.264506822Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000071 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.264653631Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000145 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.264682044Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000032 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.265050035Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000150 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.265342932Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000195 ExitCode=3 Instance=stub-providertype4-1fc4715eee2c000b PID=4 16:47:59 time="2020-08-15T20:47:59.265380543Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.263199253 +0000 UTC m=+2.092033686" 16:47:59 time="2020-08-15T20:47:59.265526045Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000033 ExitCode=3 Instance=stub-providertype4-15974b9d7f803594 PID=1 16:47:59 time="2020-08-15T20:47:59.265760439Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000151 Instance=stub-providertype8-1e3ffa8aa44a03a4 PID=1 16:47:59 time="2020-08-15T20:47:59.265999081Z" level=info msg="boot probe succeeded" Address="127.0.0.1:36819" Command=true Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.266017335Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:36819" Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 ProbeStart="2020-08-15 20:47:59.26557204 +0000 UTC m=+2.094406493" 16:47:59 time="2020-08-15T20:47:59.266007342Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000151 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.266052637Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.266075274Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.265391471 +0000 UTC m=+2.094225906" 16:47:59 time="2020-08-15T20:47:59.266098569Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000011 State=Complete 16:47:59 time="2020-08-15T20:47:59.266121959Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000025 State=Complete 16:47:59 time="2020-08-15T20:47:59.266135605Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000095 State=Complete 16:47:59 time="2020-08-15T20:47:59.266153423Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000150 State=Complete 16:47:59 time="2020-08-15T20:47:59.266164764Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000082 State=Complete 16:47:59 time="2020-08-15T20:47:59.266176357Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000145 State=Complete 16:47:59 time="2020-08-15T20:47:59.266461709Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.266488165Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 ProbeStart="2020-08-15 20:47:59.265913005 +0000 UTC m=+2.094747432" 16:47:59 time="2020-08-15T20:47:59.266822859Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 ProbeStart="2020-08-15 20:47:59.265913005 +0000 UTC m=+2.094747432" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.266970346Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000194 ExitCode=3 Instance=stub-providertype3-2a19dd3f570dc8ad PID=3 16:47:59 time="2020-08-15T20:47:59.266991907Z" level=info msg="probes succeeded, instance is in service" Address="127.0.0.1:36819" Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 ProbeStart="2020-08-15 20:47:59.26557204 +0000 UTC m=+2.094406493" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.267039362Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 PID=4 16:47:59 time="2020-08-15T20:47:59.267090581Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000153 Instance=stub-providertype4-1a4c99ae5daeb77e PID=1 16:47:59 time="2020-08-15T20:47:59.267046216Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000126 Instance=stub-providertype6-2f1def81a59b0698 PID=1 16:47:59 time="2020-08-15T20:47:59.267155085Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.265391471 +0000 UTC m=+2.094225906" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.267247509Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000153 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.267253280Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000126 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.267303128Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.267381595Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000195 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.267433303Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000189 ExitCode=3 Instance=stub-providertype6-1f175c897a14c51 PID=4 16:47:59 time="2020-08-15T20:47:59.267453309Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000033 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.267496349Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000121 ExitCode=1 Instance=stub-providertype2-482c0d1794f0d7da PID=3 16:47:59 time="2020-08-15T20:47:59.267540815Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.267600256Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.267207522 +0000 UTC m=+2.096041953" 16:47:59 time="2020-08-15T20:47:59.267646134Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000069 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.267969440Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.267207522 +0000 UTC m=+2.096041953" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.268405865Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000091 ExitCode=0 Instance=stub-providertype3-931afd8b416421 PID=1 16:47:59 time="2020-08-15T20:47:59.268908206Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000187 Instance=stub-providertype3-736888b427bce82c PID=2 16:47:59 time="2020-08-15T20:47:59.269348642Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000032 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.269651226Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000031 Instance=stub-providertype8-35ca80d72521a90 PID=4 16:47:59 time="2020-08-15T20:47:59.270402100Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000031 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.270894681Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000033 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.271799819Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000187 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.272082413Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000195 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.272345479Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000069 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.272438144Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-51825d31521f7308 PID=5 State=Locked 16:47:59 time="2020-08-15T20:47:59.272551847Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000116 ExitCode=2 Instance=stub-providertype4-700ee2bdf42b6914 PID=1 16:47:59 time="2020-08-15T20:47:59.272814873Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa PID=1 16:47:59 time="2020-08-15T20:47:59.273156683Z" level=info msg="crunch-run process started" Address="127.0.0.1:36819" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.273679851Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000050 ExitCode=1 Instance=stub-providertype3-7d21ebf5c816ced2 PID=3 16:47:59 time="2020-08-15T20:47:59.275170521Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000012 Instance=stub-providertype4-cb6dfce30dfaa54 PID=1 16:47:59 time="2020-08-15T20:47:59.275641083Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000012 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.275870682Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000111 ExitCode=2 Instance=stub-providertype8-6eb339154602315f PID=1 16:47:59 time="2020-08-15T20:47:59.275935146Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000046 Instance=stub-providertype6-5c24155b9170e16 PID=4 16:47:59 time="2020-08-15T20:47:59.275970909Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-c9f37670c47cca8 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.276029613Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000126 ExitCode=0 Instance=stub-providertype6-2f1def81a59b0698 PID=1 16:47:59 time="2020-08-15T20:47:59.276051004Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000046 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.276227366Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000187 ExitCode=3 Instance=stub-providertype3-736888b427bce82c PID=2 16:47:59 time="2020-08-15T20:47:59.276268360Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000029 ExitCode=3 Instance=stub-providertype6-10b92d0169a39144 PID=1 16:47:59 time="2020-08-15T20:47:59.276241503Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000072 ExitCode=3 Instance=stub-providertype8-2ace21fc713e95fc PID=5 16:47:59 time="2020-08-15T20:47:59.276343904Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000032 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.276361663Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-c9f37670c47cca8 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.254426022 +0000 UTC m=+2.083260449" 16:47:59 time="2020-08-15T20:47:59.276403568Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000033 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.276419178Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000069 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.276436278Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000195 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.276514954Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa PID=1 State=Locked 16:47:59 time="2020-08-15T20:47:59.276571264Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.276584922Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 ProbeStart="2020-08-15 20:47:59.276288127 +0000 UTC m=+2.105122554" 16:47:59 time="2020-08-15T20:47:59.277526966Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-24a40f5936a7f8de WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.277562815Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000112 ExitCode=0 Instance=stub-providertype8-d428445aa6ef614 PID=4 16:47:59 time="2020-08-15T20:47:59.277625073Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000153 ExitCode=1 Instance=stub-providertype4-1a4c99ae5daeb77e PID=1 16:47:59 time="2020-08-15T20:47:59.277639986Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000067 ExitCode=1 Instance=stub-providertype3-22d25dd56b8d471a PID=2 16:47:59 time="2020-08-15T20:47:59.277923684Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000050 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.278029608Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.278087018Z" level=info msg="killing crunch-run process" Address="127.0.0.1:44507" ContainerUUID=zzzzz-dz642-000000000000116 Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.278134899Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000194 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.278204492Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000091 Instance=stub-providertype3-931afd8b416421 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.278264817Z" level=info msg="killing crunch-run process" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000189 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.278288268Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.278299268Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000121 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.278488858Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 ProbeStart="2020-08-15 20:47:59.277674989 +0000 UTC m=+2.106509439" 16:47:59 time="2020-08-15T20:47:59.278526126Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.277976134 +0000 UTC m=+2.106810562" 16:47:59 time="2020-08-15T20:47:59.278809491Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.278948129Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000195 State=Complete 16:47:59 time="2020-08-15T20:47:59.278965220Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000069 State=Complete 16:47:59 time="2020-08-15T20:47:59.278985162Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000033 State=Complete 16:47:59 time="2020-08-15T20:47:59.278988491Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 ProbeStart="2020-08-15 20:47:59.277674989 +0000 UTC m=+2.106509439" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.279027688Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.277976134 +0000 UTC m=+2.106810562" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.279003857Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000032 State=Complete 16:47:59 time="2020-08-15T20:47:59.279260593Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.278442214 +0000 UTC m=+2.107276648" 16:47:59 time="2020-08-15T20:47:59.279514362Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000107 Instance=stub-providertype3-6c2a1b7ff02a0e0a PID=1 16:47:59 time="2020-08-15T20:47:59.279595131Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000107 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.279821994Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-3d44b690e0770b97 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.279826825Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.278442214 +0000 UTC m=+2.107276648" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.279985151Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000029 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280012645Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-3d44b690e0770b97 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.279501094 +0000 UTC m=+2.108335528" 16:47:59 time="2020-08-15T20:47:59.280254467Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000067 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280319966Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000172 Instance=stub-providertype4-15974b9d7f803594 PID=2 16:47:59 time="2020-08-15T20:47:59.280333404Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000111 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280396236Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000072 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280410063Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000172 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.280429378Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000126 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280493588Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000187 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280542111Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000112 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280578074Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000153 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.280981988Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000191 Instance=stub-providertype8-733014a83a1a22a0 PID=3 16:47:59 time="2020-08-15T20:47:59.281019993Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.839698 Instance=stub-providertype2-733c374d736e41cc InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.280986871Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000050 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.281152516Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000191 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.281197790Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000194 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.281279756Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-3d44b690e0770b97 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.279501094 +0000 UTC m=+2.108335528" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.281358909Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000121 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.281433982Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000065 Instance=stub-providertype3-289172b9cced2e2 PID=1 16:47:59 time="2020-08-15T20:47:59.281479361Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.281665279Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000065 Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.281704902Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000050 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.281724531Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 PID=4 State=Locked 16:47:59 time="2020-08-15T20:47:59.282311478Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 PID=2 16:47:59 time="2020-08-15T20:47:59.282436438Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.283172093Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000166 Instance=stub-providertype6-4503ce82f78d0809 PID=6 16:47:59 time="2020-08-15T20:47:59.283245716Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000001 ExitCode=3 Instance=stub-providertype2-86d109024279992 PID=1 16:47:59 time="2020-08-15T20:47:59.283312529Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000166 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.283336041Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000067 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.283382861Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.283448559Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000111 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.283516299Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000126 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.283546638Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000121 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.283561193Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000187 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.283592429Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000112 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.283642418Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000153 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.283570541Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000029 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.283451635Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000072 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.283449842Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.28291839 +0000 UTC m=+2.111752834" 16:47:59 time="2020-08-15T20:47:59.283902270Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000194 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.284000412Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000067 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.284464865Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000111 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.284846718Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.284866452Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.28291839 +0000 UTC m=+2.111752834" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.284934884Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000146 Instance=stub-providertype3-6688f8bd3e99b0a8 PID=1 16:47:59 time="2020-08-15T20:47:59.285009861Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000146 Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.285035973Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000026 Instance=stub-providertype3-430c8b35bb9457d8 PID=1 16:47:59 time="2020-08-15T20:47:59.285105286Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000026 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.285362156Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 PID=2 State=Locked 16:47:59 time="2020-08-15T20:47:59.285379914Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000121 State=Complete 16:47:59 time="2020-08-15T20:47:59.285401332Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000194 State=Complete 16:47:59 time="2020-08-15T20:47:59.285416618Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000050 State=Complete 16:47:59 time="2020-08-15T20:47:59.285453925Z" level=info msg="sending signal" Address="127.0.0.1:44507" ContainerUUID=zzzzz-dz642-000000000000116 Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.285536516Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000091 Instance=stub-providertype3-931afd8b416421 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.285421116Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000187 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.285594104Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000071 ExitCode=1 Instance=stub-providertype8-7694a644db212264 PID=5 16:47:59 time="2020-08-15T20:47:59.285587467Z" level=info msg="sending signal" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000189 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.285621729Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000126 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.285689139Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000114 ExitCode=1 Instance=stub-providertype4-27dff7ab244fcd36 PID=4 16:47:59 time="2020-08-15T20:47:59.285615313Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000118 Priority=18 State=Locked 16:47:59 time="2020-08-15T20:47:59.285694751Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000153 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.285789175Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000072 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.285901215Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000029 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.285918417Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:59.283924983 +0000 UTC m=+2.112759403" 16:47:59 time="2020-08-15T20:47:59.286045665Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000112 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.286392291Z" level=info msg="crunch-run process ended" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000189 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.286605187Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 ProbeStart="2020-08-15 20:47:59.283924983 +0000 UTC m=+2.112759403" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.286704389Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000075 ExitCode=1 Instance=stub-providertype4-1225ce839a88b076 PID=1 16:47:59 time="2020-08-15T20:47:59.286796220Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000001 Instance=stub-providertype2-86d109024279992 InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.287072347Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000091 Instance=stub-providertype3-931afd8b416421 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.287088575Z" level=info msg="crunch-run process ended" Address="127.0.0.1:44507" ContainerUUID=zzzzz-dz642-000000000000116 Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.288148551Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000067 State=Complete 16:47:59 time="2020-08-15T20:47:59.288177597Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000187 State=Complete 16:47:59 time="2020-08-15T20:47:59.288192356Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000111 State=Complete 16:47:59 time="2020-08-15T20:47:59.288571847Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000092 Instance=stub-providertype4-1fc4715eee2c000b PID=5 16:47:59 time="2020-08-15T20:47:59.288798667Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000052 Instance=stub-providertype4-1a4c99ae5daeb77e PID=2 16:47:59 time="2020-08-15T20:47:59.288888860Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000092 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.288929394Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000043 Instance=stub-providertype3-22d25dd56b8d471a PID=3 16:47:59 time="2020-08-15T20:47:59.288995662Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-733c374d736e41cc WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.289044342Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-2ace21fc713e95fc PID=6 16:47:59 time="2020-08-15T20:47:59.289001102Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000043 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.289089823Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000052 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.289217644Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.289899201Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000001 Instance=stub-providertype2-86d109024279992 InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.290530301Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000112 State=Complete 16:47:59 time="2020-08-15T20:47:59.290553159Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000153 State=Complete 16:47:59 time="2020-08-15T20:47:59.290565842Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000116 State=Complete 16:47:59 time="2020-08-15T20:47:59.290579286Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000072 State=Complete 16:47:59 time="2020-08-15T20:47:59.290590987Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000029 State=Complete 16:47:59 time="2020-08-15T20:47:59.290604554Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000091 State=Complete 16:47:59 time="2020-08-15T20:47:59.290621577Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000189 State=Complete 16:47:59 time="2020-08-15T20:47:59.290630604Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000001 Instance=stub-providertype2-86d109024279992 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.290784767Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-48856598f07b0c4f InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.290913951Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-48856598f07b0c4f InstanceType=type2 ProbeStart="2020-08-15 20:47:59.290048765 +0000 UTC m=+2.118883197" 16:47:59 time="2020-08-15T20:47:59.290994545Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000192 ExitCode=1 Instance=stub-providertype8-2c9e457114fcddea PID=4 16:47:59 time="2020-08-15T20:47:59.291354794Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-48856598f07b0c4f InstanceType=type2 ProbeStart="2020-08-15 20:47:59.290048765 +0000 UTC m=+2.118883197" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.291442989Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000001 State=Complete 16:47:59 time="2020-08-15T20:47:59.291471288Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000126 State=Complete 16:47:59 time="2020-08-15T20:47:59.291583068Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.291599122Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.290996647 +0000 UTC m=+2.119831083" 16:47:59 time="2020-08-15T20:47:59.291820459Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.290996647 +0000 UTC m=+2.119831083" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.291848244Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000151 ExitCode=3 Instance=stub-providertype8-1e3ffa8aa44a03a4 PID=1 16:47:59 time="2020-08-15T20:47:59.291903556Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000012 ExitCode=1 Instance=stub-providertype4-cb6dfce30dfaa54 PID=1 16:47:59 time="2020-08-15T20:47:59.292277450Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.292293345Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.291989011 +0000 UTC m=+2.120823462" 16:47:59 time="2020-08-15T20:47:59.292504874Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000128 Instance=stub-providertype8-5a29abd555172153 PID=1 16:47:59 time="2020-08-15T20:47:59.292560024Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.291989011 +0000 UTC m=+2.120823462" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.292585637Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000185 Instance=stub-providertype3-7d21ebf5c816ced2 PID=4 16:47:59 time="2020-08-15T20:47:59.292937423Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000185 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.292970686Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000048 Instance=stub-providertype8-d428445aa6ef614 PID=5 16:47:59 time="2020-08-15T20:47:59.292995620Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000122 Instance=stub-providertype3-931afd8b416421 PID=2 16:47:59 time="2020-08-15T20:47:59.293037669Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000149 ExitCode=2 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=3 16:47:59 time="2020-08-15T20:47:59.293067244Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000128 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.293173111Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000122 Instance=stub-providertype3-931afd8b416421 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.293202329Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000048 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.294043718Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000165 Instance=stub-providertype6-2f1def81a59b0698 PID=2 16:47:59 time="2020-08-15T20:47:59.294089121Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000026 ExitCode=3 Instance=stub-providertype3-430c8b35bb9457d8 PID=1 16:47:59 time="2020-08-15T20:47:59.294238344Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000146 ExitCode=1 Instance=stub-providertype3-6688f8bd3e99b0a8 PID=1 16:47:59 time="2020-08-15T20:47:59.294473234Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000163 Instance=stub-providertype3-736888b427bce82c PID=3 16:47:59 time="2020-08-15T20:47:59.294522908Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000085 Instance=stub-providertype6-1f175c897a14c51 PID=5 16:47:59 time="2020-08-15T20:47:59.294568579Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 PID=2 16:47:59 time="2020-08-15T20:47:59.295487655Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000051 Instance=stub-providertype4-700ee2bdf42b6914 PID=2 16:47:59 time="2020-08-15T20:47:59.296114629Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000165 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.296276424Z" level=info msg="crunch-run process started" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000085 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.296510935Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-2ace21fc713e95fc PID=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.296600065Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000163 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.297187127Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000005 Instance=stub-providertype6-46a03cb44af864ba PID=1 16:47:59 time="2020-08-15T20:47:59.301517856Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000107 ExitCode=0 Instance=stub-providertype3-6c2a1b7ff02a0e0a PID=1 16:47:59 time="2020-08-15T20:47:59.301571225Z" level=info msg="crunch-run process started" Address="127.0.0.1:44507" ContainerUUID=zzzzz-dz642-000000000000051 Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.301721165Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.301744963Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000046 ExitCode=2 Instance=stub-providertype6-5c24155b9170e16 PID=4 16:47:59 time="2020-08-15T20:47:59.302347196Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000005 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.302439579Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000089 ExitCode=0 Instance=stub-providertype3-42d37cdca33fd566 PID=1 16:47:59 time="2020-08-15T20:47:59.301783724Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000092 ExitCode=3 Instance=stub-providertype4-1fc4715eee2c000b PID=5 16:47:59 time="2020-08-15T20:47:59.302443803Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000048 ExitCode=0 Instance=stub-providertype8-d428445aa6ef614 PID=5 16:47:59 time="2020-08-15T20:47:59.302153008Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000083 Instance=stub-providertype3-2a19dd3f570dc8ad PID=4 16:47:59 time="2020-08-15T20:47:59.302205184Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000168 Instance=stub-providertype8-6eb339154602315f PID=2 16:47:59 time="2020-08-15T20:47:59.302762662Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000083 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.302234837Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000012 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.302847463Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000151 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.302891770Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000071 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.302922462Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000149 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.302954323Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000026 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.303006913Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000146 Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.303040559Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.303046184Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000114 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.303138295Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000075 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.303171497Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000168 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.303183723Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.303203584Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.295967846 +0000 UTC m=+2.124802319" 16:47:59 time="2020-08-15T20:47:59.303238596Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000192 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.303296097Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000191 ExitCode=0 Instance=stub-providertype8-733014a83a1a22a0 PID=3 16:47:59 time="2020-08-15T20:47:59.304035956Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.304050619Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.297386223 +0000 UTC m=+2.126220647" 16:47:59 time="2020-08-15T20:47:59.304096717Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.295694281 +0000 UTC m=+2.124528711" 16:47:59 time="2020-08-15T20:47:59.304217603Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000107 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.304271428Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000046 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.302239592Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000031 Instance=stub-providertype8-35ca80d72521a90 PID=4 State=Running 16:47:59 time="2020-08-15T20:47:59.302243148Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000172 ExitCode=1 Instance=stub-providertype4-15974b9d7f803594 PID=2 16:47:59 time="2020-08-15T20:47:59.303339236Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-159e385147f955ac InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.304381054Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-159e385147f955ac InstanceType=type4 ProbeStart="2020-08-15 20:47:59.280613709 +0000 UTC m=+2.109448135" 16:47:59 time="2020-08-15T20:47:59.303345700Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.304422581Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.298922436 +0000 UTC m=+2.127756886" 16:47:59 time="2020-08-15T20:47:59.303353097Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.304463221Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 ProbeStart="2020-08-15 20:47:59.29859237 +0000 UTC m=+2.127426821" 16:47:59 time="2020-08-15T20:47:59.304992745Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000166 ExitCode=2 Instance=stub-providertype6-4503ce82f78d0809 PID=6 16:47:59 time="2020-08-15T20:47:59.305662708Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.306175915Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 ProbeStart="2020-08-15 20:47:59.303171014 +0000 UTC m=+2.132005451" 16:47:59 time="2020-08-15T20:47:59.306228089Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000075 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.306360868Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000114 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.306420438Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.306437136Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.304137353 +0000 UTC m=+2.132971793" 16:47:59 time="2020-08-15T20:47:59.307213551Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000075 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.308521725Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000163 ExitCode=3 Instance=stub-providertype3-736888b427bce82c PID=3 16:47:59 time="2020-08-15T20:47:59.308806109Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000075 State=Complete 16:47:59 time="2020-08-15T20:47:59.308959734Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.308975813Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 ProbeStart="2020-08-15 20:47:59.306237593 +0000 UTC m=+2.135072030" 16:47:59 time="2020-08-15T20:47:59.309076116Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000114 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.309101178Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000048 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.310747467Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000114 State=Complete 16:47:59 time="2020-08-15T20:47:59.310854734Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000089 Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.310907039Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000012 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.310908515Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000191 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.310999109Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000151 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.311043543Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000071 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.311087709Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000149 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.311152803Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000026 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.311195569Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000146 Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.311363843Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000172 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.311484869Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000163 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.311532283Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000166 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.311590389Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000092 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.312015752Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-8cd00c4e533e9a3 PID=1 16:47:59 time="2020-08-15T20:47:59.312073430Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000192 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.312138955Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000107 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.312192245Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000046 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.312203109Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.312253567Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000043 ExitCode=2 Instance=stub-providertype3-22d25dd56b8d471a PID=3 16:47:59 time="2020-08-15T20:47:59.312305859Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000048 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.312572690Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 ProbeStart="2020-08-15 20:47:59.306237593 +0000 UTC m=+2.135072030" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.313386440Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000151 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.313770474Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000149 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.314639311Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000089 Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.314738923Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000012 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.316009684Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 PID=2 State=Locked 16:47:59 time="2020-08-15T20:47:59.316390268Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000012 State=Complete 16:47:59 time="2020-08-15T20:47:59.316411303Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000149 State=Complete 16:47:59 time="2020-08-15T20:47:59.316431873Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000151 State=Complete 16:47:59 time="2020-08-15T20:47:59.316475175Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000026 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.316633856Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000071 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.316779984Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000107 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.316808766Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000192 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.317260653Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000048 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.317769784Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000092 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.317950373Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000005 ExitCode=2 Instance=stub-providertype6-46a03cb44af864ba PID=1 16:47:59 time="2020-08-15T20:47:59.318050773Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000191 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.318108304Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000172 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.318153705Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000122 Instance=stub-providertype3-931afd8b416421 PID=2 State=Running 16:47:59 time="2020-08-15T20:47:59.318464420Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000163 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.318525587Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000166 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.318930483Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000043 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.319035033Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000046 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.319073258Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000085 ExitCode=1 Instance=stub-providertype6-1f175c897a14c51 PID=5 16:47:59 time="2020-08-15T20:47:59.319146065Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000185 ExitCode=0 Instance=stub-providertype3-7d21ebf5c816ced2 PID=4 16:47:59 time="2020-08-15T20:47:59.319186212Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000083 ExitCode=0 Instance=stub-providertype3-2a19dd3f570dc8ad PID=4 16:47:59 time="2020-08-15T20:47:59.319164623Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.319271346Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000092 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.319286071Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.319580071Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000052 ExitCode=3 Instance=stub-providertype4-1a4c99ae5daeb77e PID=2 16:47:59 time="2020-08-15T20:47:59.319788921Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-48736355de400977 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.320058023Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000065 ExitCode=1 Instance=stub-providertype3-289172b9cced2e2 PID=1 16:47:59 time="2020-08-15T20:47:59.320066645Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000166 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.320152005Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000087 Instance=stub-providertype8-7694a644db212264 PID=6 16:47:59 time="2020-08-15T20:47:59.320249931Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000087 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.320503052Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000089 Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.320524647Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=324.697402ms Instance=stub-providertype3-2d72508aa051d350 InstanceType=type3 Since="2020-08-15 20:47:58.963084163 +0000 UTC m=+1.791918590" State=booting 16:47:59 time="2020-08-15T20:47:59.320553142Z" level=info msg="boot failed" Address= Duration=324.697402ms Instance=stub-providertype3-2d72508aa051d350 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.287781555 +0000 UTC m=+2.116615992" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.320900038Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000146 Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.320929709Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000191 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.320938635Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-48736355de400977 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.292631016 +0000 UTC m=+2.121465445" 16:47:59 time="2020-08-15T20:47:59.320953374Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000172 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.321325321Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype4-48736355de400977 InstanceType=type4 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.321375239Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=389.951764ms Instance=stub-providertype4-48736355de400977 InstanceType=type4 Since="2020-08-15 20:47:58.902679258 +0000 UTC m=+1.731513681" State=booting 16:47:59 time="2020-08-15T20:47:59.321589410Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-48736355de400977 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.321893703Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000163 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.322037447Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000168 ExitCode=3 Instance=stub-providertype8-6eb339154602315f PID=2 16:47:59 time="2020-08-15T20:47:59.322182055Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000026 State=Complete 16:47:59 time="2020-08-15T20:47:59.322201056Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000192 State=Complete 16:47:59 time="2020-08-15T20:47:59.322216664Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000107 State=Complete 16:47:59 time="2020-08-15T20:47:59.322235951Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000166 State=Complete 16:47:59 time="2020-08-15T20:47:59.322248081Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000089 State=Complete 16:47:59 time="2020-08-15T20:47:59.322260464Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000046 State=Complete 16:47:59 time="2020-08-15T20:47:59.322271868Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000092 State=Complete 16:47:59 time="2020-08-15T20:47:59.322283172Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000071 State=Complete 16:47:59 time="2020-08-15T20:47:59.322294355Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000048 State=Complete 16:47:59 time="2020-08-15T20:47:59.322393712Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000197 Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.322573884Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000170 Priority=10 State=Locked 16:47:59 time="2020-08-15T20:47:59.322617595Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000008 Priority=8 State=Locked 16:47:59 time="2020-08-15T20:47:59.322784371Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000002 Instance=stub-providertype3-64a9c3f4308fc0ba PID=1 16:47:59 time="2020-08-15T20:47:59.322924937Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000002 Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.323113453Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000051 Instance=stub-providertype4-700ee2bdf42b6914 PID=2 State=Running 16:47:59 time="2020-08-15T20:47:59.323130426Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000185 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.323214131Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000083 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.323159363Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000007 Instance=stub-providertype8-2ace21fc713e95fc PID=7 16:47:59 time="2020-08-15T20:47:59.323291272Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000161 Instance=stub-providertype3-6c2a1b7ff02a0e0a PID=2 16:47:59 time="2020-08-15T20:47:59.323395062Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000161 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.323440359Z" level=info msg="killing crunch-run process" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000085 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.323589554Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000171 Instance=stub-providertype4-1225ce839a88b076 PID=2 16:47:59 time="2020-08-15T20:47:59.323619800Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000129 Instance=stub-providertype4-cb6dfce30dfaa54 PID=2 16:47:59 time="2020-08-15T20:47:59.323652465Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000043 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.323620532Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000005 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.323398273Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000007 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.323755671Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000171 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.323769799Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000129 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.323881598Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000165 ExitCode=1 Instance=stub-providertype6-2f1def81a59b0698 PID=2 16:47:59 time="2020-08-15T20:47:59.323886400Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.323973535Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000163 State=Complete 16:47:59 time="2020-08-15T20:47:59.323996060Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000191 State=Complete 16:47:59 time="2020-08-15T20:47:59.324045037Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 ProbeStart="2020-08-15 20:47:59.322977259 +0000 UTC m=+2.151811695" 16:47:59 time="2020-08-15T20:47:59.324064871Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-6b4758ead15ffbbf InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.324081618Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-6b4758ead15ffbbf InstanceType=type6 ProbeStart="2020-08-15 20:47:59.30391284 +0000 UTC m=+2.132747273" 16:47:59 time="2020-08-15T20:47:59.324090606Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000139 Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.324133837Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.324249701Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000128 ExitCode=1 Instance=stub-providertype8-5a29abd555172153 PID=1 16:47:59 time="2020-08-15T20:47:59.324493117Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000043 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.324982577Z" level=info msg="crunch-run process ended" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000085 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.325008115Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 ProbeStart="2020-08-15 20:47:59.322977259 +0000 UTC m=+2.151811695" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.325317757Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000047 Instance=stub-providertype8-733014a83a1a22a0 PID=4 16:47:59 time="2020-08-15T20:47:59.325399660Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000047 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.325437363Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000127 Instance=stub-providertype8-d428445aa6ef614 PID=6 16:47:59 time="2020-08-15T20:47:59.325502881Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=4 16:47:59 time="2020-08-15T20:47:59.325526419Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000127 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.325542473Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-4ac3e9b44c9ce925 PID=4 State=Locked 16:47:59 time="2020-08-15T20:47:59.325605818Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.325677625Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000043 State=Complete 16:47:59 time="2020-08-15T20:47:59.325690997Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000172 State=Complete 16:47:59 time="2020-08-15T20:47:59.325699270Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000146 State=Complete 16:47:59 time="2020-08-15T20:47:59.325738154Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000188 Instance=stub-providertype4-15974b9d7f803594 PID=3 16:47:59 time="2020-08-15T20:47:59.325754674Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000139 16:47:59 time="2020-08-15T20:47:59.325799604Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000096 Priority=16 State=Locked 16:47:59 time="2020-08-15T20:47:59.325811526Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000188 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.325744720Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000197 16:47:59 time="2020-08-15T20:47:59.325941631Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000167 Instance=stub-providertype8-2c9e457114fcddea PID=5 16:47:59 time="2020-08-15T20:47:59.325977254Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000128 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.326012088Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000167 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.326037787Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000165 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.326104034Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000168 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.326118856Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.326138426Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000052 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.326185300Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000065 Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.326407842Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000085 State=Complete 16:47:59 time="2020-08-15T20:47:59.327115859Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000142 Instance=stub-providertype6-3369755a2e5f7917 PID=2 16:47:59 time="2020-08-15T20:47:59.327700373Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000041 Instance=stub-providertype3-430c8b35bb9457d8 PID=2 16:47:59 time="2020-08-15T20:47:59.328432361Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000024 Instance=stub-providertype8-405517c089b934b6 PID=4 16:47:59 time="2020-08-15T20:47:59.328887053Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 ProbeStart="2020-08-15 20:47:59.32579148 +0000 UTC m=+2.154625905" 16:47:59 time="2020-08-15T20:47:59.329380232Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000168 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.329940134Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000142 Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.330336627Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000052 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.330578897Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000139 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.331261143Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000065 Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.331282705Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000165 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.331571900Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000090 Instance=stub-providertype4-27dff7ab244fcd36 PID=5 16:47:59 time="2020-08-15T20:47:59.332202074Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000024 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.332621036Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000041 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.333402539Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000167 Instance=stub-providertype8-2c9e457114fcddea PID=5 State=Running 16:47:59 time="2020-08-15T20:47:59.333813643Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000009 Instance=stub-providertype4-1fc4715eee2c000b PID=6 16:47:59 time="2020-08-15T20:47:59.334039230Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000009 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.334381508Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000197 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.334921581Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000022 Instance=stub-providertype6-5c24155b9170e16 PID=5 16:47:59 time="2020-08-15T20:47:59.335015911Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000185 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.335065675Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000083 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.335139251Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000090 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.335196222Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000182 Instance=stub-providertype6-4503ce82f78d0809 PID=7 16:47:59 time="2020-08-15T20:47:59.335230201Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-48736355de400977 16:47:59 time="2020-08-15T20:47:59.335263843Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000102 Instance=stub-providertype6-1f175c897a14c51 PID=6 16:47:59 time="2020-08-15T20:47:59.335310546Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000128 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.335496811Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000022 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.335508459Z" level=info msg="crunch-run process started" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000102 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.335523458Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000182 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.335710591Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-2d72508aa051d350 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.335765393Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000144 Instance=stub-providertype8-3fc951cc3c88058e PID=1 16:47:59 time="2020-08-15T20:47:59.335902465Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000005 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.335971980Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000088 Instance=stub-providertype8-1e3ffa8aa44a03a4 PID=2 16:47:59 time="2020-08-15T20:47:59.336025657Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.336041165Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.333927994 +0000 UTC m=+2.162762423" 16:47:59 time="2020-08-15T20:47:59.336072217Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.336091734Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 ProbeStart="2020-08-15 20:47:59.333872061 +0000 UTC m=+2.162706499" 16:47:59 time="2020-08-15T20:47:59.336025891Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000144 Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.336393760Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000088 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.336499825Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000052 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.336505780Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000129 ExitCode=2 Instance=stub-providertype4-cb6dfce30dfaa54 PID=2 16:47:59 time="2020-08-15T20:47:59.336792757Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000168 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.336902996Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000083 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.336953185Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000128 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.337592379Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000065 Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.337620705Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000165 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.337639686Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000185 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.337855372Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000005 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.338083785Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000128 State=Complete 16:47:59 time="2020-08-15T20:47:59.338101702Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000168 State=Complete 16:47:59 time="2020-08-15T20:47:59.338116400Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000052 State=Complete 16:47:59 time="2020-08-15T20:47:59.338128823Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000083 State=Complete 16:47:59 time="2020-08-15T20:47:59.338182796Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000161 ExitCode=0 Instance=stub-providertype3-6c2a1b7ff02a0e0a PID=2 16:47:59 time="2020-08-15T20:47:59.338883345Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000118 ExitCode=1 Instance=stub-providertype6-8cd00c4e533e9a3 PID=1 16:47:59 time="2020-08-15T20:47:59.339155382Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000165 State=Complete 16:47:59 time="2020-08-15T20:47:59.339176518Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000065 State=Complete 16:47:59 time="2020-08-15T20:47:59.339190942Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000185 State=Complete 16:47:59 time="2020-08-15T20:47:59.339208099Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000005 State=Complete 16:47:59 time="2020-08-15T20:47:59.339370831Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000028 Instance=stub-providertype4-1a4c99ae5daeb77e PID=3 16:47:59 time="2020-08-15T20:47:59.339445491Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000028 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.340097982Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.340201858Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000129 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.340256049Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000161 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.340470882Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-252e76038f4a0972 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.340489277Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-252e76038f4a0972 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.340143156 +0000 UTC m=+2.168977585" 16:47:59 time="2020-08-15T20:47:59.340700176Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000171 ExitCode=2 Instance=stub-providertype4-1225ce839a88b076 PID=2 16:47:59 time="2020-08-15T20:47:59.340845688Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000047 ExitCode=1 Instance=stub-providertype8-733014a83a1a22a0 PID=4 16:47:59 time="2020-08-15T20:47:59.340854725Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-252e76038f4a0972 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.340143156 +0000 UTC m=+2.168977585" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.341221308Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.341244254Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.340914492 +0000 UTC m=+2.169748937" 16:47:59 time="2020-08-15T20:47:59.341509327Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.340914492 +0000 UTC m=+2.169748937" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.342269858Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.342287861Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 ProbeStart="2020-08-15 20:47:59.341948284 +0000 UTC m=+2.170782704" 16:47:59 time="2020-08-15T20:47:59.342557732Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000127 ExitCode=1 Instance=stub-providertype8-d428445aa6ef614 PID=6 16:47:59 time="2020-08-15T20:47:59.342582752Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 ProbeStart="2020-08-15 20:47:59.341948284 +0000 UTC m=+2.170782704" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.343191896Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.343279734Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000129 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.343293341Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000161 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.343525576Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-5a29abd555172153 PID=2 16:47:59 time="2020-08-15T20:47:59.343689146Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.343873924Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000021 Instance=stub-providertype6-2f1def81a59b0698 PID=3 16:47:59 time="2020-08-15T20:47:59.344008605Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000021 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.344017479Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000118 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.344078356Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000129 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.344135523Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000161 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.344684315Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000104 Instance=stub-providertype8-452d99d2ed6dcfdc PID=1 16:47:59 time="2020-08-15T20:47:59.344927621Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000104 Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.345358814Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000102 ExitCode=2 Instance=stub-providertype6-1f175c897a14c51 PID=6 16:47:59 time="2020-08-15T20:47:59.346611318Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000007 ExitCode=3 Instance=stub-providertype8-2ace21fc713e95fc PID=7 16:47:59 time="2020-08-15T20:47:59.347018969Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7b851cb8fafd2b0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.347059166Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000088 ExitCode=0 Instance=stub-providertype8-1e3ffa8aa44a03a4 PID=2 16:47:59 time="2020-08-15T20:47:59.347141785Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-4c22b02936d4ff9b PID=2 16:47:59 time="2020-08-15T20:47:59.347227956Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.347343452Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7b851cb8fafd2b0 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.327825645 +0000 UTC m=+2.156660077" 16:47:59 time="2020-08-15T20:47:59.347364716Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000129 State=Complete 16:47:59 time="2020-08-15T20:47:59.347386587Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000161 State=Complete 16:47:59 time="2020-08-15T20:47:59.347399527Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000118 State=Complete 16:47:59 time="2020-08-15T20:47:59.347644557Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-6eb339154602315f PID=3 16:47:59 time="2020-08-15T20:47:59.347731567Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.347768346Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000062 Instance=stub-providertype6-46a03cb44af864ba PID=2 16:47:59 time="2020-08-15T20:47:59.347860967Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000062 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.348153019Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-48736355de400977 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.348219754Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000002 ExitCode=2 Instance=stub-providertype3-64a9c3f4308fc0ba PID=1 16:47:59 time="2020-08-15T20:47:59.348181948Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000024 ExitCode=2 Instance=stub-providertype8-405517c089b934b6 PID=4 16:47:59 time="2020-08-15T20:47:59.348303900Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000127 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.348373826Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000007 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.348509294Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000171 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.348557551Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000047 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.348598646Z" level=info msg="killing crunch-run process" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000102 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.349112166Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000108 Instance=stub-providertype4-26e2fcfa16fea4d3 PID=1 16:47:59 time="2020-08-15T20:47:59.349186446Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000141 Instance=stub-providertype6-8cd00c4e533e9a3 PID=2 16:47:59 time="2020-08-15T20:47:59.349199004Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000108 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.349249335Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.349263286Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.348764491 +0000 UTC m=+2.177598925" 16:47:59 time="2020-08-15T20:47:59.349272618Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000141 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.349513196Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.348764491 +0000 UTC m=+2.177598925" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.350556684Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000002 Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.350648578Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000088 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.350685791Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000024 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.351038200Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000148 Instance=stub-providertype4-cb6dfce30dfaa54 PID=3 16:47:59 time="2020-08-15T20:47:59.351122717Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000148 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.352238548Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000188 ExitCode=0 Instance=stub-providertype4-15974b9d7f803594 PID=3 16:47:59 time="2020-08-15T20:47:59.352264772Z" level=info msg="sending signal" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000102 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.352286156Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000047 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.352333358Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000127 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.352376024Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000171 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.352781276Z" level=info msg="crunch-run process ended" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000102 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.352855541Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000047 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.352875587Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000090 ExitCode=2 Instance=stub-providertype4-27dff7ab244fcd36 PID=5 16:47:59 time="2020-08-15T20:47:59.353032500Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000127 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.353032808Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000087 ExitCode=0 Instance=stub-providertype8-7694a644db212264 PID=6 16:47:59 time="2020-08-15T20:47:59.353061579Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000171 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.353675198Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000002 Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.353731450Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000024 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.353831841Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000088 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.354706411Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000007 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.354761857Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000021 ExitCode=2 Instance=stub-providertype6-2f1def81a59b0698 PID=3 16:47:59 time="2020-08-15T20:47:59.354934738Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000102 State=Complete 16:47:59 time="2020-08-15T20:47:59.354949045Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000127 State=Complete 16:47:59 time="2020-08-15T20:47:59.354956791Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000047 State=Complete 16:47:59 time="2020-08-15T20:47:59.354972371Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000171 State=Complete 16:47:59 time="2020-08-15T20:47:59.355060740Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000087 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.355122290Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000188 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.355171164Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000090 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.355232466Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000182 ExitCode=0 Instance=stub-providertype6-4503ce82f78d0809 PID=7 16:47:59 time="2020-08-15T20:47:59.355719302Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000002 Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.355768445Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000024 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.355843399Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.355957887Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000007 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.355995924Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000088 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.356023585Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 ProbeStart="2020-08-15 20:47:59.353957484 +0000 UTC m=+2.182791898" 16:47:59 time="2020-08-15T20:47:59.356235704Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000101 Instance=stub-providertype6-34f038c8cd856313 PID=1 16:47:59 time="2020-08-15T20:47:59.356308972Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000101 Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.358565808Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 ProbeStart="2020-08-15 20:47:59.353957484 +0000 UTC m=+2.182791898" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.359571632Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000181 Instance=stub-providertype6-1f175c897a14c51 PID=7 16:47:59 time="2020-08-15T20:47:59.359788546Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000064 Instance=stub-providertype8-733014a83a1a22a0 PID=5 16:47:59 time="2020-08-15T20:47:59.360030311Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000144 Instance=stub-providertype8-3fc951cc3c88058e PID=1 State=Running 16:47:59 time="2020-08-15T20:47:59.360098650Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000096 ExitCode=3 Instance=stub-providertype8-6eb339154602315f PID=3 16:47:59 time="2020-08-15T20:47:59.360173198Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000141 ExitCode=0 Instance=stub-providertype6-8cd00c4e533e9a3 PID=2 16:47:59 time="2020-08-15T20:47:59.360539461Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000064 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.361513714Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000184 Instance=stub-providertype8-d428445aa6ef614 PID=7 16:47:59 time="2020-08-15T20:47:59.361615334Z" level=info msg="crunch-run process started" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000181 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.361652928Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000024 State=Complete 16:47:59 time="2020-08-15T20:47:59.361677348Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000007 State=Complete 16:47:59 time="2020-08-15T20:47:59.361701422Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000002 State=Complete 16:47:59 time="2020-08-15T20:47:59.362489862Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000088 State=Complete 16:47:59 time="2020-08-15T20:47:59.362947013Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000028 ExitCode=0 Instance=stub-providertype4-1a4c99ae5daeb77e PID=3 16:47:59 time="2020-08-15T20:47:59.363294084Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000009 ExitCode=1 Instance=stub-providertype4-1fc4715eee2c000b PID=6 16:47:59 time="2020-08-15T20:47:59.363333190Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000184 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.363366087Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000142 ExitCode=3 Instance=stub-providertype6-3369755a2e5f7917 PID=2 16:47:59 time="2020-08-15T20:47:59.363419381Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000087 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.363591398Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000188 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.364273150Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000090 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.365118746Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000104 ExitCode=0 Instance=stub-providertype8-452d99d2ed6dcfdc PID=1 16:47:59 time="2020-08-15T20:47:59.365146612Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000041 ExitCode=0 Instance=stub-providertype3-430c8b35bb9457d8 PID=2 16:47:59 time="2020-08-15T20:47:59.365212701Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000170 ExitCode=1 Instance=stub-providertype3-4c22b02936d4ff9b PID=2 16:47:59 time="2020-08-15T20:47:59.365607454Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-69717a5ee58a48e6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.365697171Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000063 Instance=stub-providertype8-405517c089b934b6 PID=5 16:47:59 time="2020-08-15T20:47:59.365879116Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000068 Instance=stub-providertype4-1225ce839a88b076 PID=3 16:47:59 time="2020-08-15T20:47:59.365972376Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000068 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.366181983Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000063 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.366301666Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000182 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.366355765Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.366416470Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000141 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.366443547Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000062 ExitCode=2 Instance=stub-providertype6-46a03cb44af864ba PID=2 16:47:59 time="2020-08-15T20:47:59.366475448Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-69717a5ee58a48e6 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.342927072 +0000 UTC m=+2.171761509" 16:47:59 time="2020-08-15T20:47:59.366578324Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.367311295Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000087 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.367332312Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000188 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.367346669Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000090 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.367354909Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000143 Instance=stub-providertype8-2ace21fc713e95fc PID=8 16:47:59 time="2020-08-15T20:47:59.367447993Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000143 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.367453204Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000108 ExitCode=0 Instance=stub-providertype4-26e2fcfa16fea4d3 PID=1 16:47:59 time="2020-08-15T20:47:59.367776115Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000021 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.367907149Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000183 Instance=stub-providertype8-4bd8c9b2cd98e99b PID=1 16:47:59 time="2020-08-15T20:47:59.367936492Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.366247402 +0000 UTC m=+2.195081832" 16:47:59 time="2020-08-15T20:47:59.368003368Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000023 Instance=stub-providertype8-1e3ffa8aa44a03a4 PID=3 16:47:59 time="2020-08-15T20:47:59.368019371Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype6-69717a5ee58a48e6 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.342927072 +0000 UTC m=+2.171761509" 16:47:59 time="2020-08-15T20:47:59.368078355Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype6-69717a5ee58a48e6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.368096789Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.459782 Instance=stub-providertype6-69717a5ee58a48e6 InstanceType=type6 State=booting 16:47:59 time="2020-08-15T20:47:59.368161371Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000023 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.368229776Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000183 Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.368439495Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000090 State=Complete 16:47:59 time="2020-08-15T20:47:59.368455265Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000188 State=Complete 16:47:59 time="2020-08-15T20:47:59.368520794Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000041 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.368763109Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.368764683Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.368955224Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.367619923 +0000 UTC m=+2.196454353" 16:47:59 time="2020-08-15T20:47:59.369212083Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.367619923 +0000 UTC m=+2.196454353" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.369318575Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000103 Instance=stub-providertype8-7694a644db212264 PID=7 16:47:59 time="2020-08-15T20:47:59.369342692Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000142 Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.369394912Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000009 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.369417983Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000103 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.369434733Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000028 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.369592914Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.369613788Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 ProbeStart="2020-08-15 20:47:59.369205961 +0000 UTC m=+2.198040381" 16:47:59 time="2020-08-15T20:47:59.369785521Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000087 State=Complete 16:47:59 time="2020-08-15T20:47:59.369867071Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 ProbeStart="2020-08-15 20:47:59.369205961 +0000 UTC m=+2.198040381" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.369899273Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000022 ExitCode=0 Instance=stub-providertype6-5c24155b9170e16 PID=5 16:47:59 time="2020-08-15T20:47:59.370156806Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-70941bf8cde2eca6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.370271247Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000182 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.370312546Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.370342655Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000141 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.370406972Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-70941bf8cde2eca6 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.348638126 +0000 UTC m=+2.177472556" 16:47:59 time="2020-08-15T20:47:59.370585147Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000182 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.370687833Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000141 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.370978521Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000096 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.371359263Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000021 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.371364986Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000147 Instance=stub-providertype4-15974b9d7f803594 PID=4 16:47:59 time="2020-08-15T20:47:59.371513605Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000147 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.371568423Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000041 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.371573500Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000104 Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.371816453Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000108 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.371858332Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000022 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.371918668Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000062 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.371990999Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.372046815Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000021 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.372048925Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.372115653Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 Signal=15 16:47:59 time="2020-08-15T20:47:59.372222500Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.371640878 +0000 UTC m=+2.200475322" 16:47:59 time="2020-08-15T20:47:59.372263616Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.371731525 +0000 UTC m=+2.200565943" 16:47:59 time="2020-08-15T20:47:59.372286084Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000041 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.372499845Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000170 Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.372540142Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.371640878 +0000 UTC m=+2.200475322" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.372688825Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000021 State=Complete 16:47:59 time="2020-08-15T20:47:59.372707661Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000096 State=Complete 16:47:59 time="2020-08-15T20:47:59.372717217Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000141 State=Complete 16:47:59 time="2020-08-15T20:47:59.372726289Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000041 State=Complete 16:47:59 time="2020-08-15T20:47:59.372735112Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000182 State=Complete 16:47:59 time="2020-08-15T20:47:59.372835149Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.371731525 +0000 UTC m=+2.200565943" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.373119212Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000142 Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.373155809Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000009 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.373148081Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000028 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.373272982Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000170 State=Complete 16:47:59 time="2020-08-15T20:47:59.373455058Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000008 ExitCode=0 Instance=stub-providertype8-5a29abd555172153 PID=2 16:47:59 time="2020-08-15T20:47:59.373841319Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000028 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.373924873Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.373959911Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.374063074Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 ProbeStart="2020-08-15 20:47:59.372973777 +0000 UTC m=+2.201808210" 16:47:59 time="2020-08-15T20:47:59.374179132Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.373185794 +0000 UTC m=+2.202020230" 16:47:59 time="2020-08-15T20:47:59.374226676Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.374230629Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000142 Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.374258514Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000009 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.374378742Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 ProbeStart="2020-08-15 20:47:59.372973777 +0000 UTC m=+2.201808210" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.374405795Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.373185794 +0000 UTC m=+2.202020230" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.374521203Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 ProbeStart="2020-08-15 20:47:59.373918203 +0000 UTC m=+2.202752643" 16:47:59 time="2020-08-15T20:47:59.374667112Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000066 Instance=stub-providertype4-41f27cc6f3875d04 PID=1 16:47:59 time="2020-08-15T20:47:59.374735839Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000066 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.374782897Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000104 Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.374961677Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 ProbeStart="2020-08-15 20:47:59.373918203 +0000 UTC m=+2.202752643" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.375130478Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000062 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.375154287Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000022 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.375139705Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000108 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.375281215Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000061 Instance=stub-providertype6-8cd00c4e533e9a3 PID=3 16:47:59 time="2020-08-15T20:47:59.375387752Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000061 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.375411867Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.375556504Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000104 Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.375573578Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000062 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.375668709Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000142 State=Complete 16:47:59 time="2020-08-15T20:47:59.375685899Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000022 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.375689661Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000009 State=Complete 16:47:59 time="2020-08-15T20:47:59.375730696Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000028 State=Complete 16:47:59 time="2020-08-15T20:47:59.375976173Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000108 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.376362630Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000105 Instance=stub-providertype4-1a4c99ae5daeb77e PID=4 16:47:59 time="2020-08-15T20:47:59.376434314Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000104 State=Complete 16:47:59 time="2020-08-15T20:47:59.376455073Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000108 State=Complete 16:47:59 time="2020-08-15T20:47:59.376469193Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000062 State=Complete 16:47:59 time="2020-08-15T20:47:59.376536547Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000076 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.376457810Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000105 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.376983724Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000022 State=Complete 16:47:59 time="2020-08-15T20:47:59.377086052Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000027 Instance=stub-providertype4-27dff7ab244fcd36 PID=6 16:47:59 time="2020-08-15T20:47:59.377229249Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000027 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.377508998Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.378433473Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000103 ExitCode=1 Instance=stub-providertype8-7694a644db212264 PID=7 16:47:59 time="2020-08-15T20:47:59.378592264Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-69717a5ee58a48e6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.378660178Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000004 Instance=stub-providertype4-364f0ff8af8eef6b PID=4 16:47:59 time="2020-08-15T20:47:59.378784153Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000004 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.378822080Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.378931084Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000181 ExitCode=1 Instance=stub-providertype6-1f175c897a14c51 PID=7 16:47:59 time="2020-08-15T20:47:59.379409490Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.379524920Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000167 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.379749680Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000186 Instance=stub-providertype4-57930cf840a79c3b PID=1 16:47:59 time="2020-08-15T20:47:59.379812915Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000008 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.379841214Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000186 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.379893518Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000044 Instance=stub-providertype4-493a23eb55ece0ea PID=4 16:47:59 time="2020-08-15T20:47:59.379963694Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000044 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.380038522Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000156 Priority=16 State=Locked 16:47:59 time="2020-08-15T20:47:59.380068948Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000086 Priority=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.380094555Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000167 16:47:59 time="2020-08-15T20:47:59.380114803Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000023 ExitCode=3 Instance=stub-providertype8-1e3ffa8aa44a03a4 PID=3 16:47:59 time="2020-08-15T20:47:59.380095132Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000103 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.380084862Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000076 16:47:59 time="2020-08-15T20:47:59.380346185Z" level=info msg="killing crunch-run process" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000181 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.380472026Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000008 State=Complete 16:47:59 time="2020-08-15T20:47:59.380788584Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000167 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.380820215Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000076 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.381842005Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000031 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.383681769Z" level=info msg="sending signal" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000181 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.383702246Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000164 Instance=stub-providertype4-3e19bf7a317ae3f PID=1 16:47:59 time="2020-08-15T20:47:59.383793626Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000103 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.383843036Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000164 Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.384065465Z" level=info msg="crunch-run process ended" Address="127.0.0.1:45677" ContainerUUID=zzzzz-dz642-000000000000181 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.384074717Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.384097086Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.383691294 +0000 UTC m=+2.212525739" 16:47:59 time="2020-08-15T20:47:59.384134765Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000103 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.384270327Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 PID=5 16:47:59 time="2020-08-15T20:47:59.384273066Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000084 Instance=stub-providertype4-26e2fcfa16fea4d3 PID=2 16:47:59 time="2020-08-15T20:47:59.384369942Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.384390008Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000124 Instance=stub-providertype4-1fc4715eee2c000b PID=7 16:47:59 time="2020-08-15T20:47:59.384461091Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000084 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.384470358Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000143 ExitCode=1 Instance=stub-providertype8-2ace21fc713e95fc PID=8 16:47:59 time="2020-08-15T20:47:59.384544354Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000124 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.384601458Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.383691294 +0000 UTC m=+2.212525739" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.384938337Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.385153189Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000103 State=Complete 16:47:59 time="2020-08-15T20:47:59.385170701Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000181 State=Complete 16:47:59 time="2020-08-15T20:47:59.385398974Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000086 ExitCode=0 Instance=stub-providertype6-72126e84f0a7aec6 PID=5 16:47:59 time="2020-08-15T20:47:59.385598919Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000101 ExitCode=2 Instance=stub-providertype6-34f038c8cd856313 PID=1 16:47:59 time="2020-08-15T20:47:59.385642322Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000113 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.386133701Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000113 16:47:59 time="2020-08-15T20:47:59.386339583Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000031 16:47:59 time="2020-08-15T20:47:59.386519528Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000143 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.386549975Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000023 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.386572575Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.386604622Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000031 16:47:59 time="2020-08-15T20:47:59.387251324Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000064 ExitCode=3 Instance=stub-providertype8-733014a83a1a22a0 PID=5 16:47:59 time="2020-08-15T20:47:59.387355972Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000101 Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.387669393Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000184 ExitCode=2 Instance=stub-providertype8-d428445aa6ef614 PID=7 16:47:59 time="2020-08-15T20:47:59.387379834Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000045 Priority=5 State=Locked 16:47:59 time="2020-08-15T20:47:59.388184241Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000148 ExitCode=1 Instance=stub-providertype4-cb6dfce30dfaa54 PID=3 16:47:59 time="2020-08-15T20:47:59.389702515Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000031 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.389850687Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000113 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.389968209Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000023 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.390279973Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000186 ExitCode=3 Instance=stub-providertype4-57930cf840a79c3b PID=1 16:47:59 time="2020-08-15T20:47:59.390606801Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000143 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.391001700Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000101 Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.391597307Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000061 ExitCode=1 Instance=stub-providertype6-8cd00c4e533e9a3 PID=3 16:47:59 time="2020-08-15T20:47:59.393564146Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000105 ExitCode=1 Instance=stub-providertype4-1a4c99ae5daeb77e PID=4 16:47:59 time="2020-08-15T20:47:59.393731537Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.394078287Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000066 ExitCode=2 Instance=stub-providertype4-41f27cc6f3875d04 PID=1 16:47:59 time="2020-08-15T20:47:59.394127267Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000183 ExitCode=2 Instance=stub-providertype8-4bd8c9b2cd98e99b PID=1 16:47:59 time="2020-08-15T20:47:59.394161264Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000147 ExitCode=3 Instance=stub-providertype4-15974b9d7f803594 PID=4 16:47:59 time="2020-08-15T20:47:59.394929820Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000030 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.395374134Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000143 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.395398168Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000101 Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.395425586Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000147 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.395567389Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000086 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.395586013Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000023 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.395613541Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000105 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.395673796Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000064 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.395799549Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000068 ExitCode=1 Instance=stub-providertype4-1225ce839a88b076 PID=3 16:47:59 time="2020-08-15T20:47:59.395929725Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000184 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.395976836Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000061 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.396052367Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000183 Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.396099662Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000148 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.396134766Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000066 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.396182256Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000186 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.396568037Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000143 State=Complete 16:47:59 time="2020-08-15T20:47:59.396591709Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000023 State=Complete 16:47:59 time="2020-08-15T20:47:59.396603426Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000086 State=Complete 16:47:59 time="2020-08-15T20:47:59.396616887Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000101 State=Complete 16:47:59 time="2020-08-15T20:47:59.396627519Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.397535713Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.397562760Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.397258501 +0000 UTC m=+2.226092936" 16:47:59 time="2020-08-15T20:47:59.397947900Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.397258501 +0000 UTC m=+2.226092936" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.398576736Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.398595435Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 ProbeStart="2020-08-15 20:47:59.397975876 +0000 UTC m=+2.226810304" 16:47:59 time="2020-08-15T20:47:59.398647957Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000147 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.398713020Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000064 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.398748737Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000105 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.398932324Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 ProbeStart="2020-08-15 20:47:59.397975876 +0000 UTC m=+2.226810304" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.398968210Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000184 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.399068437Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000061 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.399144917Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000148 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.399217933Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000105 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.399228032Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000186 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.399260653Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.399270570Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000183 Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.399264422Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000066 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.399247038Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000064 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.399568942Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000147 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.399578766Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.399587001Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.380280988 +0000 UTC m=+2.209115397" 16:47:59 time="2020-08-15T20:47:59.399745570Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000061 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.399789056Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000063 ExitCode=1 Instance=stub-providertype8-405517c089b934b6 PID=5 16:47:59 time="2020-08-15T20:47:59.399875290Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 ProbeStart="2020-08-15 20:47:59.398919201 +0000 UTC m=+2.227753661" 16:47:59 time="2020-08-15T20:47:59.399920471Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000186 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.400140355Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000184 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.400244831Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000106 Priority=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.400270500Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000030 16:47:59 time="2020-08-15T20:47:59.400257989Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000148 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.400616217Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000066 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.400891630Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.400949711Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000183 Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.400997360Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000068 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.401147639Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 ProbeStart="2020-08-15 20:47:59.398919201 +0000 UTC m=+2.227753661" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.401363965Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000183 State=Complete 16:47:59 time="2020-08-15T20:47:59.401374134Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000186 State=Complete 16:47:59 time="2020-08-15T20:47:59.401380413Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000147 State=Complete 16:47:59 time="2020-08-15T20:47:59.401386913Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000064 State=Complete 16:47:59 time="2020-08-15T20:47:59.401393814Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000061 State=Complete 16:47:59 time="2020-08-15T20:47:59.401400654Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000066 State=Complete 16:47:59 time="2020-08-15T20:47:59.401406426Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000184 State=Complete 16:47:59 time="2020-08-15T20:47:59.401413619Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000105 State=Complete 16:47:59 time="2020-08-15T20:47:59.401419476Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000148 State=Complete 16:47:59 time="2020-08-15T20:47:59.401795358Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000030 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.401978322Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.400496143 +0000 UTC m=+2.229330597" 16:47:59 time="2020-08-15T20:47:59.402098199Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000123 Instance=stub-providertype4-1a4c99ae5daeb77e PID=5 16:47:59 time="2020-08-15T20:47:59.402850501Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000123 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.402858389Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Reason="state=Queued" 16:47:59 time="2020-08-15T20:47:59.403044668Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.400496143 +0000 UTC m=+2.229330597" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.403078884Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000003 Instance=stub-providertype4-15974b9d7f803594 PID=5 16:47:59 time="2020-08-15T20:47:59.403187732Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000003 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.403507254Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-2d531646eefe2d2 PID=3 16:47:59 time="2020-08-15T20:47:59.403593891Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.403826860Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.403844190Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.403479635 +0000 UTC m=+2.232314060" 16:47:59 time="2020-08-15T20:47:59.404059992Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000044 Instance=stub-providertype4-493a23eb55ece0ea PID=4 State=Running 16:47:59 time="2020-08-15T20:47:59.404099547Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000068 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.404182158Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.403479635 +0000 UTC m=+2.232314060" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.404226045Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.404240722Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.403915593 +0000 UTC m=+2.232750043" 16:47:59 time="2020-08-15T20:47:59.404381920Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000068 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.404584295Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.403915593 +0000 UTC m=+2.232750043" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.405799576Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000063 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.405979081Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-54a888203391860a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.405994191Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-54a888203391860a InstanceType=type8 ProbeStart="2020-08-15 20:47:59.405701975 +0000 UTC m=+2.234536391" 16:47:59 time="2020-08-15T20:47:59.406057805Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.406278733Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-54a888203391860a InstanceType=type8 ProbeStart="2020-08-15 20:47:59.405701975 +0000 UTC m=+2.234536391" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.406345430Z" level=info msg="kill attempt unsuccessful" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 error="Process exited with status 1" stderr="zzzzz-dz642-000000000000106: container is running\n" stdout= 16:47:59 time="2020-08-15T20:47:59.406472458Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000068 State=Complete 16:47:59 time="2020-08-15T20:47:59.407490951Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-2c63eaf9464c423f PID=1 16:47:59 time="2020-08-15T20:47:59.407560792Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000162 Instance=stub-providertype4-41f27cc6f3875d04 PID=2 16:47:59 time="2020-08-15T20:47:59.407567533Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000081 Instance=stub-providertype4-cb6dfce30dfaa54 PID=4 16:47:59 time="2020-08-15T20:47:59.407591839Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.407662668Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000081 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.407664964Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000162 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.408303067Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-ce9e06596372b2d InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.408323431Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-ce9e06596372b2d InstanceType=type4 ProbeStart="2020-08-15 20:47:59.407949178 +0000 UTC m=+2.236783585" 16:47:59 time="2020-08-15T20:47:59.408684282Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-ce9e06596372b2d InstanceType=type4 ProbeStart="2020-08-15 20:47:59.407949178 +0000 UTC m=+2.236783585" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.409044074Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000063 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 Signal=15 16:47:59 time="2020-08-15T20:47:59.409349452Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-4cb2efc43499d044 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.409370522Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-4cb2efc43499d044 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.408999949 +0000 UTC m=+2.237834390" 16:47:59 time="2020-08-15T20:47:59.409378701Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000063 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.409686940Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-4cb2efc43499d044 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.408999949 +0000 UTC m=+2.237834390" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.409930875Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000063 State=Complete 16:47:59 time="2020-08-15T20:47:59.410323586Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7ed543364803913b InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.410344103Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7ed543364803913b InstanceType=type8 ProbeStart="2020-08-15 20:47:59.409960385 +0000 UTC m=+2.238794811" 16:47:59 time="2020-08-15T20:47:59.410416151Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000042 Instance=stub-providertype4-57930cf840a79c3b PID=2 16:47:59 time="2020-08-15T20:47:59.410521579Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000042 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.410681383Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-7ed543364803913b InstanceType=type8 ProbeStart="2020-08-15 20:47:59.409960385 +0000 UTC m=+2.238794811" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.411045582Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=3 16:47:59 time="2020-08-15T20:47:59.411132064Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000084 ExitCode=2 Instance=stub-providertype4-26e2fcfa16fea4d3 PID=2 16:47:59 time="2020-08-15T20:47:59.411192865Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.411386479Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-25826451d91ac90f InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.411403346Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-25826451d91ac90f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.410983762 +0000 UTC m=+2.239818189" 16:47:59 time="2020-08-15T20:47:59.411725588Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-25826451d91ac90f InstanceType=type4 ProbeStart="2020-08-15 20:47:59.410983762 +0000 UTC m=+2.239818189" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.412380484Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.412399168Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.412019661 +0000 UTC m=+2.240854103" 16:47:59 time="2020-08-15T20:47:59.412673399Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.412690228Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000124 ExitCode=1 Instance=stub-providertype4-1fc4715eee2c000b PID=7 16:47:59 time="2020-08-15T20:47:59.412713053Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.412019661 +0000 UTC m=+2.240854103" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.412685645Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000164 ExitCode=1 Instance=stub-providertype4-3e19bf7a317ae3f PID=1 16:47:59 time="2020-08-15T20:47:59.412830819Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000004 ExitCode=0 Instance=stub-providertype4-364f0ff8af8eef6b PID=4 16:47:59 time="2020-08-15T20:47:59.412946618Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.413236077Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000124 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.413294062Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000084 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.413527338Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.413543232Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 ProbeStart="2020-08-15 20:47:59.413320366 +0000 UTC m=+2.242154801" 16:47:59 time="2020-08-15T20:47:59.413598147Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000156 ExitCode=3 Instance=stub-providertype4-2c63eaf9464c423f PID=1 16:47:59 time="2020-08-15T20:47:59.413758917Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 ProbeStart="2020-08-15 20:47:59.413320366 +0000 UTC m=+2.242154801" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.414435896Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.414454734Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.414020366 +0000 UTC m=+2.242854815" 16:47:59 time="2020-08-15T20:47:59.414835244Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.414020366 +0000 UTC m=+2.242854815" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.414899958Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000106 Priority=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.414932324Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000164 Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.415090747Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.415230289Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000004 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.415372304Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.415499060Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.415062513 +0000 UTC m=+2.243896942" 16:47:59 time="2020-08-15T20:47:59.415856725Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.415062513 +0000 UTC m=+2.243896942" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.417117623Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000124 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.417154464Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000084 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.417542428Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-581092e28026dcd InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.417560331Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-581092e28026dcd InstanceType=type4 ProbeStart="2020-08-15 20:47:59.417096748 +0000 UTC m=+2.245931178" 16:47:59 time="2020-08-15T20:47:59.417697963Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000124 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.417725520Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.417785458Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000027 ExitCode=1 Instance=stub-providertype4-27dff7ab244fcd36 PID=6 16:47:59 time="2020-08-15T20:47:59.418018991Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000164 Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.418099621Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000084 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.418124090Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-581092e28026dcd InstanceType=type4 ProbeStart="2020-08-15 20:47:59.417096748 +0000 UTC m=+2.245931178" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.418157986Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.416130708 +0000 UTC m=+2.244965145" 16:47:59 time="2020-08-15T20:47:59.418214429Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.418331411Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.418707095Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000004 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.419837635Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000162 ExitCode=1 Instance=stub-providertype4-41f27cc6f3875d04 PID=2 16:47:59 time="2020-08-15T20:47:59.421349161Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000123 ExitCode=1 Instance=stub-providertype4-1a4c99ae5daeb77e PID=5 16:47:59 time="2020-08-15T20:47:59.421412383Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000003 ExitCode=1 Instance=stub-providertype4-15974b9d7f803594 PID=5 16:47:59 time="2020-08-15T20:47:59.421928603Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000164 Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.421978023Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000156 Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.422002690Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000004 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.422106747Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000084 State=Complete 16:47:59 time="2020-08-15T20:47:59.422126840Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000124 State=Complete 16:47:59 time="2020-08-15T20:47:59.423880850Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000027 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.423933881Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.418054025 +0000 UTC m=+2.246888459" 16:47:59 time="2020-08-15T20:47:59.424842162Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000156 State=Complete 16:47:59 time="2020-08-15T20:47:59.424877509Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000164 State=Complete 16:47:59 time="2020-08-15T20:47:59.424904010Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.418054025 +0000 UTC m=+2.246888459" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.424959988Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000081 Instance=stub-providertype4-cb6dfce30dfaa54 PID=4 State=Running 16:47:59 time="2020-08-15T20:47:59.425126895Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-22d3161b328a18bc InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.425445858Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000162 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.425797198Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=4 16:47:59 time="2020-08-15T20:47:59.426239919Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.426358423Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000042 ExitCode=3 Instance=stub-providertype4-57930cf840a79c3b PID=2 16:47:59 time="2020-08-15T20:47:59.426632044Z" level=info msg="[test] container was killed" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=3 16:47:59 time="2020-08-15T20:47:59.426749459Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-22d3161b328a18bc InstanceType=type8 ProbeStart="2020-08-15 20:47:59.407499388 +0000 UTC m=+2.236333814" 16:47:59 time="2020-08-15T20:47:59.426798954Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000004 State=Complete 16:47:59 time="2020-08-15T20:47:59.426836912Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000003 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.426896178Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000123 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.427338778Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000027 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.427832751Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.427973972Z" level=warning msg="probe failed" Address= Command="crunch-run --list" Instance=stub-providertype8-22d3161b328a18bc InstanceType=type8 error="Process exited with status 1" stderr="crunch-run: command not found\n" stdout= 16:47:59 time="2020-08-15T20:47:59.428195479Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000045 ExitCode=2 Instance=stub-providertype6-2d531646eefe2d2 PID=3 16:47:59 time="2020-08-15T20:47:59.428414300Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.427086338 +0000 UTC m=+2.255920758" 16:47:59 time="2020-08-15T20:47:59.428463365Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000027 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.428481982Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=436.544017ms Instance=stub-providertype8-22d3161b328a18bc InstanceType=type8 Since="2020-08-15 20:47:58.970955363 +0000 UTC m=+1.799789797" State=booting 16:47:59 time="2020-08-15T20:47:59.428703639Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.428857954Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 ProbeStart="2020-08-15 20:47:59.428390532 +0000 UTC m=+2.257224941" 16:47:59 time="2020-08-15T20:47:59.429151984Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000027 State=Complete 16:47:59 time="2020-08-15T20:47:59.429240739Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 ProbeStart="2020-08-15 20:47:59.428390532 +0000 UTC m=+2.257224941" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.429303890Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.429395195Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.429076567 +0000 UTC m=+2.257911025" 16:47:59 time="2020-08-15T20:47:59.429779320Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.429076567 +0000 UTC m=+2.257911025" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.429946198Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000123 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.430021340Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.430057156Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000003 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.430116746Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000042 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.430448257Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000123 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.430538244Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.430559556Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000003 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.430903462Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 ProbeStart="2020-08-15 20:47:59.430054882 +0000 UTC m=+2.258889320" 16:47:59 time="2020-08-15T20:47:59.431235805Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 ProbeStart="2020-08-15 20:47:59.430054882 +0000 UTC m=+2.258889320" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.431364546Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.431494622Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.4310122 +0000 UTC m=+2.259846652" 16:47:59 time="2020-08-15T20:47:59.431572586Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000003 State=Complete 16:47:59 time="2020-08-15T20:47:59.431587605Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000123 State=Complete 16:47:59 time="2020-08-15T20:47:59.431813451Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.4310122 +0000 UTC m=+2.259846652" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.432560097Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.432577444Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.432117354 +0000 UTC m=+2.260951788" 16:47:59 time="2020-08-15T20:47:59.432651562Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000162 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.432888351Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.432117354 +0000 UTC m=+2.260951788" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.433154691Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000042 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.433177494Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000162 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.433228882Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.433304381Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.433313448Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.432918865 +0000 UTC m=+2.261753313" 16:47:59 time="2020-08-15T20:47:59.433534700Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000042 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.433719802Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000162 State=Complete 16:47:59 time="2020-08-15T20:47:59.433784771Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.432918865 +0000 UTC m=+2.261753313" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.433804230Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000045 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.433962417Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000042 State=Complete 16:47:59 time="2020-08-15T20:47:59.434542344Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.434555458Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.434227611 +0000 UTC m=+2.263062044" 16:47:59 time="2020-08-15T20:47:59.434737987Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000045 State=Complete 16:47:59 time="2020-08-15T20:47:59.434812227Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.434227611 +0000 UTC m=+2.263062044" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.435439743Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.435458604Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.435027436 +0000 UTC m=+2.263861901" 16:47:59 time="2020-08-15T20:47:59.435842577Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.435027436 +0000 UTC m=+2.263861901" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.436412288Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.436431265Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.436099525 +0000 UTC m=+2.264933980" 16:47:59 dispatcher_test.go:142: 16:47:59 time="2020-08-15T20:47:59.436725824Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.436099525 +0000 UTC m=+2.264933980" RunningContainers=0 State=idle 16:47:59 c.Errorf("container completed twice: %s", ctr.UUID) 16:47:59 ... Error: container completed twice: zzzzz-dz642-000000000000106 16:47:59 16:47:59 time="2020-08-15T20:47:59.437957994Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 ExitCode=0 Instance=stub-providertype2-647ea68f0b80eccd PID=4 16:47:59 time="2020-08-15T20:47:59.438207894Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-326d74010c77412c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.438220006Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-326d74010c77412c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.43798736 +0000 UTC m=+2.266821806" 16:47:59 time="2020-08-15T20:47:59.438374852Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-326d74010c77412c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.43798736 +0000 UTC m=+2.266821806" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.439310880Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-22d3161b328a18bc WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.439789518Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.439807946Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.439476946 +0000 UTC m=+2.268311405" 16:47:59 time="2020-08-15T20:47:59.439916045Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.440056649Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.439476946 +0000 UTC m=+2.268311405" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.440271627Z" level=info msg="crunch-run process ended" Address="127.0.0.1:44507" ContainerUUID=zzzzz-dz642-000000000000051 Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.441782133Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.441800775Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.441399365 +0000 UTC m=+2.270233786" 16:47:59 time="2020-08-15T20:47:59.441971546Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-59cad68ae21dc478 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.441988048Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-59cad68ae21dc478 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.426734886 +0000 UTC m=+2.255569320" 16:47:59 time="2020-08-15T20:47:59.442137044Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.441399365 +0000 UTC m=+2.270233786" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.442448968Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.442467490Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.44195671 +0000 UTC m=+2.270791168" 16:47:59 time="2020-08-15T20:47:59.442895049Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.44195671 +0000 UTC m=+2.270791168" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.443042760Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.443651231Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.443692836Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.443879077Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.443088771 +0000 UTC m=+2.271923198" 16:47:59 time="2020-08-15T20:47:59.444287668Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.444290357Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.443088771 +0000 UTC m=+2.271923198" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.444327618Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.443989469 +0000 UTC m=+2.272823901" 16:47:59 time="2020-08-15T20:47:59.444547754Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000106 State=Complete 16:47:59 time="2020-08-15T20:47:59.444650124Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.443989469 +0000 UTC m=+2.272823901" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.444939614Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000051 16:47:59 time="2020-08-15T20:47:59.445023322Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000051 16:47:59 time="2020-08-15T20:47:59.445257639Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000051 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.447293358Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000122 Instance=stub-providertype3-931afd8b416421 InstanceType=type3 16:47:59 time="2020-08-15T20:47:59.448895586Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.450477505Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000122 16:47:59 time="2020-08-15T20:47:59.450560649Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000125 Priority=5 State=Locked 16:47:59 time="2020-08-15T20:47:59.450672366Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.450760367Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:59.450266093 +0000 UTC m=+2.279100548" 16:47:59 time="2020-08-15T20:47:59.450862044Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000122 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.451292716Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 ProbeStart="2020-08-15 20:47:59.450266093 +0000 UTC m=+2.279100548" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.451328094Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-34fc0ec60101a939 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.451409800Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-34fc0ec60101a939 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.450918649 +0000 UTC m=+2.279753098" 16:47:59 time="2020-08-15T20:47:59.451866740Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-34fc0ec60101a939 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.450918649 +0000 UTC m=+2.279753098" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.455357288Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 PID=3 16:47:59 time="2020-08-15T20:47:59.455471646Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.457646099Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.457666097Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 ProbeStart="2020-08-15 20:47:59.457258404 +0000 UTC m=+2.286092846" 16:47:59 time="2020-08-15T20:47:59.457970027Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 ProbeStart="2020-08-15 20:47:59.457258404 +0000 UTC m=+2.286092846" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.460937461Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.460955750Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.460690238 +0000 UTC m=+2.289524661" 16:47:59 time="2020-08-15T20:47:59.461169431Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.460690238 +0000 UTC m=+2.289524661" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.462533576Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.462554324Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.462306843 +0000 UTC m=+2.291141304" 16:47:59 time="2020-08-15T20:47:59.462761653Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.462306843 +0000 UTC m=+2.291141304" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.463381973Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000081 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.465157185Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-c9f37670c47cca8 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.465171629Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-c9f37670c47cca8 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.464738436 +0000 UTC m=+2.293572862" 16:47:59 time="2020-08-15T20:47:59.465436515Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-c9f37670c47cca8 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.464738436 +0000 UTC m=+2.293572862" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.466059631Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-30c57d409baf5233 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.466072988Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-30c57d409baf5233 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.452086845 +0000 UTC m=+2.280921280" 16:47:59 time="2020-08-15T20:47:59.466073317Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000081 16:47:59 time="2020-08-15T20:47:59.468950792Z" level=warning msg="new instance unresponsive, shutting down" Address= Duration=567.851594ms Instance=stub-providertype4-4711302ed91dda90 InstanceType=type4 Since="2020-08-15 20:47:58.887557747 +0000 UTC m=+1.716392181" State=booting 16:47:59 time="2020-08-15T20:47:59.468987448Z" level=info msg="boot failed" Address= Duration=567.851594ms Instance=stub-providertype4-4711302ed91dda90 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.455409339 +0000 UTC m=+2.284243775" stderr="cannot fork\n" 16:47:59 time="2020-08-15T20:47:59.469332507Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000081 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.471323112Z" level=info msg="crunch-run process ended" Address="127.0.0.1:36819" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.473801063Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-4711302ed91dda90 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.475809965Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000132 Priority=12 State=Locked 16:47:59 time="2020-08-15T20:47:59.476282087Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.476303173Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 ProbeStart="2020-08-15 20:47:59.475912938 +0000 UTC m=+2.304747351" 16:47:59 time="2020-08-15T20:47:59.476633320Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 ProbeStart="2020-08-15 20:47:59.475912938 +0000 UTC m=+2.304747351" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.479024695Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa PID=2 16:47:59 time="2020-08-15T20:47:59.479155655Z" level=info msg="crunch-run process started" Address="127.0.0.1:36819" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.479211066Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.479225166Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 ProbeStart="2020-08-15 20:47:59.478924533 +0000 UTC m=+2.307758985" 16:47:59 time="2020-08-15T20:47:59.479291370Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-159e385147f955ac InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.479303677Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-159e385147f955ac InstanceType=type4 ProbeStart="2020-08-15 20:47:59.47879254 +0000 UTC m=+2.307626954" 16:47:59 time="2020-08-15T20:47:59.479689835Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 ProbeStart="2020-08-15 20:47:59.478924533 +0000 UTC m=+2.307758985" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.479752242Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-159e385147f955ac InstanceType=type4 ProbeStart="2020-08-15 20:47:59.47879254 +0000 UTC m=+2.307626954" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.480229494Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.480244376Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 ProbeStart="2020-08-15 20:47:59.479980556 +0000 UTC m=+2.308814987" 16:47:59 time="2020-08-15T20:47:59.480485368Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 ProbeStart="2020-08-15 20:47:59.479980556 +0000 UTC m=+2.308814987" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.481696779Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.481749120Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.481273611 +0000 UTC m=+2.310108044" 16:47:59 time="2020-08-15T20:47:59.482143658Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.481273611 +0000 UTC m=+2.310108044" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.484950005Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.484970359Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.484638099 +0000 UTC m=+2.313472538" 16:47:59 time="2020-08-15T20:47:59.484954882Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-179b59d8a9a5d809 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.485020181Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-179b59d8a9a5d809 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.472920649 +0000 UTC m=+2.301755101" 16:47:59 time="2020-08-15T20:47:59.485094919Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000125 ExitCode=3 Instance=stub-providertype6-10b92d0169a39144 PID=3 16:47:59 time="2020-08-15T20:47:59.485211832Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.485227344Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:59.484921515 +0000 UTC m=+2.313755946" 16:47:59 time="2020-08-15T20:47:59.487146671Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.487168875Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 ProbeStart="2020-08-15 20:47:59.486686042 +0000 UTC m=+2.315520449" 16:47:59 time="2020-08-15T20:47:59.487363205Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.487380764Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.486974252 +0000 UTC m=+2.315808666" 16:47:59 time="2020-08-15T20:47:59.487478316Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 ProbeStart="2020-08-15 20:47:59.486686042 +0000 UTC m=+2.315520449" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.487735959Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.486974252 +0000 UTC m=+2.315808666" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.488447368Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.488464929Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.487943221 +0000 UTC m=+2.316777626" 16:47:59 time="2020-08-15T20:47:59.488808121Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.487943221 +0000 UTC m=+2.316777626" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.492531076Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.492946255Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.492964622Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.492576622 +0000 UTC m=+2.321411038" 16:47:59 time="2020-08-15T20:47:59.493258416Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.492576622 +0000 UTC m=+2.321411038" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.493288963Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.495163017Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000014 Priority=14 State=Locked 16:47:59 time="2020-08-15T20:47:59.495327678Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3521469161cc970e InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.495345611Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3521469161cc970e InstanceType=type6 ProbeStart="2020-08-15 20:47:59.494959382 +0000 UTC m=+2.323793829" 16:47:59 time="2020-08-15T20:47:59.495606198Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.495711402Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-3521469161cc970e InstanceType=type6 ProbeStart="2020-08-15 20:47:59.494959382 +0000 UTC m=+2.323793829" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.496014853Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000125 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.496417267Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000125 State=Complete 16:47:59 time="2020-08-15T20:47:59.497324216Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.497342612Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:59.497010043 +0000 UTC m=+2.325844460" 16:47:59 time="2020-08-15T20:47:59.497409975Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-71075a807b512662 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.497429514Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-71075a807b512662 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.497126235 +0000 UTC m=+2.325960655" 16:47:59 time="2020-08-15T20:47:59.497910245Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000132 ExitCode=1 Instance=stub-providertype4-79fd5dff976108fa PID=2 16:47:59 time="2020-08-15T20:47:59.498538664Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 ProbeStart="2020-08-15 20:47:59.497010043 +0000 UTC m=+2.325844460" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.499509451Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-71075a807b512662 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.497126235 +0000 UTC m=+2.325960655" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.503531134Z" level=info msg="killing crunch-run process" Address="127.0.0.1:36819" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.505004831Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.505053336Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a PID=7 16:47:59 time="2020-08-15T20:47:59.505139413Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.502695685 +0000 UTC m=+2.331530134" 16:47:59 time="2020-08-15T20:47:59.505223729Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-515d6d738e6c415 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.505331034Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-515d6d738e6c415 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.488986508 +0000 UTC m=+2.317820924" 16:47:59 time="2020-08-15T20:47:59.505380404Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.505824343Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.505857178Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.503582754 +0000 UTC m=+2.332417184" 16:47:59 time="2020-08-15T20:47:59.505978583Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.505993301Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.503917496 +0000 UTC m=+2.332751953" 16:47:59 time="2020-08-15T20:47:59.506003453Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.506028256Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.504912919 +0000 UTC m=+2.333747364" 16:47:59 time="2020-08-15T20:47:59.506161152Z" level=info msg="probe reported broken instance" Address= Instance=stub-providertype8-515d6d738e6c415 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.488986508 +0000 UTC m=+2.317820924" 16:47:59 time="2020-08-15T20:47:59.506185012Z" level=info msg="set idle behavior" Address= IdleBehavior=drain Instance=stub-providertype8-515d6d738e6c415 InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.506202980Z" level=info msg="shutdown worker" Address= IdleBehavior=drain IdleDuration=0.524439 Instance=stub-providertype8-515d6d738e6c415 InstanceType=type8 State=booting 16:47:59 time="2020-08-15T20:47:59.506235428Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.503582754 +0000 UTC m=+2.332417184" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.506299787Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.506447670Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.502695685 +0000 UTC m=+2.331530134" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.506477616Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.505922174 +0000 UTC m=+2.334756600" 16:47:59 time="2020-08-15T20:47:59.506590217Z" level=info msg="sending signal" Address="127.0.0.1:36819" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.506801184Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.505922174 +0000 UTC m=+2.334756600" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.506837147Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.503917496 +0000 UTC m=+2.332751953" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.506860942Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.504912919 +0000 UTC m=+2.333747364" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.507049501Z" level=info msg="crunch-run process ended" Address="127.0.0.1:36819" ContainerUUID=zzzzz-dz642-000000000000132 Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.507693338Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4192214612966204 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.508146438Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-515d6d738e6c415 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.508192875Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4192214612966204 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.507374247 +0000 UTC m=+2.336208697" 16:47:59 time="2020-08-15T20:47:59.508497649Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000132 State=Complete 16:47:59 time="2020-08-15T20:47:59.508727543Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.508746876Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 ProbeStart="2020-08-15 20:47:59.50839854 +0000 UTC m=+2.337232981" 16:47:59 time="2020-08-15T20:47:59.509040615Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 ProbeStart="2020-08-15 20:47:59.50839854 +0000 UTC m=+2.337232981" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.509220122Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.509238555Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 ProbeStart="2020-08-15 20:47:59.508924496 +0000 UTC m=+2.337758902" 16:47:59 time="2020-08-15T20:47:59.509569173Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 ProbeStart="2020-08-15 20:47:59.508924496 +0000 UTC m=+2.337758902" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.511292738Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.511311392Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.51078682 +0000 UTC m=+2.339621233" 16:47:59 time="2020-08-15T20:47:59.511323074Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-22614d6fbeca336a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.511344337Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-22614d6fbeca336a InstanceType=type6 ProbeStart="2020-08-15 20:47:59.511006067 +0000 UTC m=+2.339840506" 16:47:59 time="2020-08-15T20:47:59.511621240Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.51078682 +0000 UTC m=+2.339621233" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.511657579Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-22614d6fbeca336a InstanceType=type6 ProbeStart="2020-08-15 20:47:59.511006067 +0000 UTC m=+2.339840506" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.512340563Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.512359419Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.51192811 +0000 UTC m=+2.340762531" 16:47:59 time="2020-08-15T20:47:59.512635506Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.51192811 +0000 UTC m=+2.340762531" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.514263700Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.514282597Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.513777497 +0000 UTC m=+2.342611922" 16:47:59 time="2020-08-15T20:47:59.514603624Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 ProbeStart="2020-08-15 20:47:59.513777497 +0000 UTC m=+2.342611922" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.516101505Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-45e19a2c5ef4e819 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.516120696Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-45e19a2c5ef4e819 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.515662867 +0000 UTC m=+2.344497309" 16:47:59 time="2020-08-15T20:47:59.516245714Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.516366484Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-45e19a2c5ef4e819 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.515662867 +0000 UTC m=+2.344497309" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.517959155Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.517978415Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.517480006 +0000 UTC m=+2.346314467" 16:47:59 time="2020-08-15T20:47:59.518246281Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.517480006 +0000 UTC m=+2.346314467" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.518252019Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.518288684Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.51791267 +0000 UTC m=+2.346747102" 16:47:59 time="2020-08-15T20:47:59.518464204Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.51791267 +0000 UTC m=+2.346747102" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.519737538Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.519763430Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 ProbeStart="2020-08-15 20:47:59.519315777 +0000 UTC m=+2.348150197" 16:47:59 time="2020-08-15T20:47:59.519789608Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000020 Priority=20 State=Locked 16:47:59 time="2020-08-15T20:47:59.520032113Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 ProbeStart="2020-08-15 20:47:59.519315777 +0000 UTC m=+2.348150197" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.520145728Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.520168149Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 ProbeStart="2020-08-15 20:47:59.519912274 +0000 UTC m=+2.348746717" 16:47:59 time="2020-08-15T20:47:59.520345750Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 ProbeStart="2020-08-15 20:47:59.519912274 +0000 UTC m=+2.348746717" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.521736198Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 PID=3 16:47:59 time="2020-08-15T20:47:59.521825348Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.521957957Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.521978025Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.521687015 +0000 UTC m=+2.350521426" 16:47:59 time="2020-08-15T20:47:59.522162066Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-44482319682c1dde InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.522175955Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-44482319682c1dde InstanceType=type3 ProbeStart="2020-08-15 20:47:59.521913569 +0000 UTC m=+2.350747984" 16:47:59 time="2020-08-15T20:47:59.522235021Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.521687015 +0000 UTC m=+2.350521426" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.522455636Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-44482319682c1dde InstanceType=type3 ProbeStart="2020-08-15 20:47:59.521913569 +0000 UTC m=+2.350747984" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.523658411Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-74333a1db0299ef3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.523677337Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-74333a1db0299ef3 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.52317128 +0000 UTC m=+2.352005742" 16:47:59 time="2020-08-15T20:47:59.524014124Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-74333a1db0299ef3 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.52317128 +0000 UTC m=+2.352005742" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.524174169Z" level=info msg="boot probe succeeded" Address="127.0.0.1:45085" Command=true Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.524295402Z" level=info msg="instance booted; will try probeRunning" Address="127.0.0.1:45085" Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.523913272 +0000 UTC m=+2.352747695" 16:47:59 time="2020-08-15T20:47:59.524633488Z" level=info msg="probes succeeded, instance is in service" Address="127.0.0.1:45085" Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.523913272 +0000 UTC m=+2.352747695" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.525502708Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.525523458Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.52496022 +0000 UTC m=+2.353794661" 16:47:59 time="2020-08-15T20:47:59.525781078Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-6313883ce21cb812 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.525800898Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-6313883ce21cb812 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.513924495 +0000 UTC m=+2.342758901" 16:47:59 time="2020-08-15T20:47:59.525849463Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000014 ExitCode=2 Instance=stub-providertype6-c567a08fb7edb1a PID=7 16:47:59 time="2020-08-15T20:47:59.525982531Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 ProbeStart="2020-08-15 20:47:59.52496022 +0000 UTC m=+2.353794661" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.529599252Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.529618314Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.529242382 +0000 UTC m=+2.358076795" 16:47:59 time="2020-08-15T20:47:59.529813501Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.530761358Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.530781186Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 ProbeStart="2020-08-15 20:47:59.530388467 +0000 UTC m=+2.359222887" 16:47:59 time="2020-08-15T20:47:59.531166162Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 ProbeStart="2020-08-15 20:47:59.530388467 +0000 UTC m=+2.359222887" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.531263894Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.531394953Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.530919681 +0000 UTC m=+2.359754113" 16:47:59 time="2020-08-15T20:47:59.531789369Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.530919681 +0000 UTC m=+2.359754113" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.532447002Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.532465337Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.532062941 +0000 UTC m=+2.360897398" 16:47:59 time="2020-08-15T20:47:59.532810019Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.532062941 +0000 UTC m=+2.360897398" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.533380802Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7df598dcde9e5526 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.533398906Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7df598dcde9e5526 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.533015941 +0000 UTC m=+2.361850354" 16:47:59 time="2020-08-15T20:47:59.533688937Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-7df598dcde9e5526 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.533015941 +0000 UTC m=+2.361850354" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.533887258Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.533912807Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.298482 Instance=stub-providertype3-1c73fac825416fed InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.533982817Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.648881 Instance=stub-providertype4-71075a807b512662 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534001234Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.145016 Instance=stub-providertype8-53bf1faf0cf52517 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534018285Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.241210 Instance=stub-providertype8-6a4eef7a2694763d InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534035489Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.219865 Instance=stub-providertype8-5225fcd6090ec04f InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534050583Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.013442 Instance=stub-providertype8-2c86a526ee438107 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534065507Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.645318 Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534079764Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.462479 Instance=stub-providertype8-5e00e6df0b340430 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534096032Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.389126 Instance=stub-providertype2-100f49ac68915c32 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.534113578Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.299271 Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534128689Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.964957 Instance=stub-providertype6-22614d6fbeca336a InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534143971Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.457117 Instance=stub-providertype4-51bc2c3c9b3aa730 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534163511Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.581092 Instance=stub-providertype6-7724d9213a0ef514 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534179031Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.367631 Instance=stub-providertype6-549fda49272c4a7 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534195140Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.198923 Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534210014Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.891668 Instance=stub-providertype8-45e19a2c5ef4e819 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534225423Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.052208 Instance=stub-providertype6-7e23bc6fc8214b8a InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534240014Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.638939 Instance=stub-providertype3-1512c3f6a02d3510 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534254832Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.567555 Instance=stub-providertype4-3b587d976edf598d InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534271049Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.931505 Instance=stub-providertype2-55b9352859b63774 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.534276315Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-3c701634bda94243 InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.534287202Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.903373 Instance=stub-providertype3-44482319682c1dde InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534343845Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.179204 Instance=stub-providertype6-74333a1db0299ef3 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534362288Z" level=info msg="shutdown worker" Address="127.0.0.1:45085" IdleBehavior=run IdleDuration=1.878212 Instance=stub-providertype6-77e6089b2f436dc4 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534325534Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-7d91efb0ef227a3c InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.534383825Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.160098 Instance=stub-providertype3-146f70ff3be70cb0 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534229161Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-39413b061aff0882 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.534437589Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.483631 Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534483505Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.975861 Instance=stub-providertype8-7df598dcde9e5526 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534500087Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.338011 Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.534516003Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.185869 Instance=stub-providertype6-46a03cb44af864ba InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534522814Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-1ed184bbb9340ea4 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.534534024Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.416395 Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.534568371Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype2-6d6534d37b692f2c InstanceType=type2 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.534575662Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.197182 Instance=stub-providertype6-4503ce82f78d0809 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534614825Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.190850 Instance=stub-providertype8-5a29abd555172153 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534628548Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.159036 Instance=stub-providertype6-8cd00c4e533e9a3 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534638911Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.136609 Instance=stub-providertype2-48856598f07b0c4f InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.534649406Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.307645 Instance=stub-providertype2-38550618aeb9fb77 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.534663615Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.210904 Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534679968Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.165019 Instance=stub-providertype8-7694a644db212264 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534695466Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.215409 Instance=stub-providertype3-51825d31521f7308 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534713894Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.166453 Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534729723Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.168489 Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534744150Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.187501 Instance=stub-providertype3-4c22b02936d4ff9b InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534758883Z" level=info msg="shutdown worker" Address="127.0.0.1:45677" IdleBehavior=run IdleDuration=0.173117 Instance=stub-providertype6-1f175c897a14c51 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534778375Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.301317 Instance=stub-providertype2-279d5ab29f22bfbd InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.534792622Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.204823 Instance=stub-providertype6-3369755a2e5f7917 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534807486Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.127299 Instance=stub-providertype3-252e76038f4a0972 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534821786Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.150224 Instance=stub-providertype4-26e2fcfa16fea4d3 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534837420Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.171477 Instance=stub-providertype8-d428445aa6ef614 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534852901Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.189906 Instance=stub-providertype8-452d99d2ed6dcfdc InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534868722Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.176248 Instance=stub-providertype6-34f038c8cd856313 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534885850Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.166324 Instance=stub-providertype8-4bd8c9b2cd98e99b InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534902491Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.589799 Instance=stub-providertype3-4ee85d4eeb7d6b00 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.534917524Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.157660 Instance=stub-providertype4-27dff7ab244fcd36 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534932585Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.282169 Instance=stub-providertype6-5aff01c926fbf29b InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534947119Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.151087 Instance=stub-providertype4-3e19bf7a317ae3f InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534963769Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.165796 Instance=stub-providertype6-5c24155b9170e16 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534980472Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.786055 Instance=stub-providertype6-ac6a2c7fd67fe69 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.534996822Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.584076 Instance=stub-providertype6-fc418f1dcd5bfad InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535012433Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.156196 Instance=stub-providertype4-364f0ff8af8eef6b InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535027037Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.230931 Instance=stub-providertype3-2a19dd3f570dc8ad InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535048333Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.153207 Instance=stub-providertype8-35ca80d72521a90 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535064251Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.155540 Instance=stub-providertype8-2c9e457114fcddea InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535082429Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.150461 Instance=stub-providertype6-72126e84f0a7aec6 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535135539Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.242059 Instance=stub-providertype3-7d21ebf5c816ced2 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535153395Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.437350 Instance=stub-providertype2-6162b30a261d0f56 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.535169675Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.150231 Instance=stub-providertype6-4ac3e9b44c9ce925 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535197944Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.279428 Instance=stub-providertype2-482c0d1794f0d7da InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.535213331Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.623183 Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535229034Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.217958 Instance=stub-providertype3-4bdb185b70ab53ba InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535244232Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.951369 Instance=stub-providertype8-7b4826e2d3aa4530 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535259074Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.831461 Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535275274Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.048744 Instance=stub-providertype8-54a888203391860a InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535292465Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.298180 Instance=stub-providertype2-6d87b8e5d22bd743 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.535315671Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.174747 Instance=stub-providertype8-733014a83a1a22a0 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535332186Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.364408 Instance=stub-providertype3-15ed320f42dae2b7 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535346499Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.833402 Instance=stub-providertype4-25826451d91ac90f InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535361959Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.318314 Instance=stub-providertype4-26984b92f6740304 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535377146Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.057877 Instance=stub-providertype6-60390908b802bdfc InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535395275Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.930892 Instance=stub-providertype6-4a0df4baa53a0341 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535410216Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.119317 Instance=stub-providertype4-ce9e06596372b2d InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535427363Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.287902 Instance=stub-providertype2-4cb2efc43499d044 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.535442658Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.046378 Instance=stub-providertype8-7ed543364803913b InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535460315Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.892166 Instance=stub-providertype4-581092e28026dcd InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535476560Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.886903 Instance=stub-providertype3-342a0313380457d7 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535494046Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.859191 Instance=stub-providertype4-1328e4d4457b9829 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535508502Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.010840 Instance=stub-providertype4-2f5411c4623917c InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535524405Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.794462 Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535539050Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.711196 Instance=stub-providertype3-29e3c198436e73da InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535554072Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.938554 Instance=stub-providertype6-24f219a32f4bbc46 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535569725Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.343451 Instance=stub-providertype4-243a768b7c4e0b68 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535581749Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-54a888203391860a InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.535585059Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.392562 Instance=stub-providertype8-27837d94d2613bb5 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535625515Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.179801 Instance=stub-providertype4-46baf44754e0c0c1 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535641277Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.339132 Instance=stub-providertype4-2309b5402489a5b2 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535655818Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.138228 Instance=stub-providertype8-59a30874792c8ee8 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.534585152Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype2-5c45107896f29609 InstanceType=type2 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.535678901Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.346836 Instance=stub-providertype4-30b95ff183c471d4 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535718478Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.250122 Instance=stub-providertype8-3485757ea7ed5d97 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535733424Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.805617 Instance=stub-providertype8-326d74010c77412c InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535750393Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.500842 Instance=stub-providertype2-14d41ffaa8be9186 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.535766923Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.239144 Instance=stub-providertype3-736888b427bce82c InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535782965Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.235042 Instance=stub-providertype4-3332aafe336eacca InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535797354Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.509673 Instance=stub-providertype6-53e4b406ea6f9c64 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535817333Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.837051 Instance=stub-providertype3-1fcc20aeaed4e9a8 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535832349Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.168487 Instance=stub-providertype4-1225ce839a88b076 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.535847322Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.246657 Instance=stub-providertype3-22d25dd56b8d471a InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535862546Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.703330 Instance=stub-providertype8-34fc0ec60101a939 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535878824Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.187246 Instance=stub-providertype8-6eb339154602315f InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535893612Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.112151 Instance=stub-providertype3-34ad5ac882093298 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535909812Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.167350 Instance=stub-providertype8-1e3ffa8aa44a03a4 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.535925280Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.270547 Instance=stub-providertype2-86d109024279992 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.535940198Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.560693 Instance=stub-providertype6-58ee1a765542106f InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535957811Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.270578 Instance=stub-providertype3-42d37cdca33fd566 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.535973150Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.191930 Instance=stub-providertype6-2f1def81a59b0698 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.535988264Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.490047 Instance=stub-providertype6-4a007b2750145bf1 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.536002585Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.123411 Instance=stub-providertype4-c9f37670c47cca8 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.536018929Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.201866 Instance=stub-providertype3-430c8b35bb9457d8 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.536032622Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.250072 Instance=stub-providertype3-6688f8bd3e99b0a8 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.536047849Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.110478 Instance=stub-providertype8-bca82a42dd96e5a InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.536062759Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.254380 Instance=stub-providertype3-289172b9cced2e2 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.536079612Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.212664 Instance=stub-providertype3-6c2a1b7ff02a0e0a InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.536096912Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.487284 Instance=stub-providertype2-3d44b690e0770b97 InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.536112921Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.054283 Instance=stub-providertype4-159e385147f955ac InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.534858005Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype3-64a9c3f4308fc0ba InstanceType=type3 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.534904158Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-405517c089b934b6 InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.536006825Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-71a32b414b3eb387 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.535572374Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-5f0d379b5bf1350c InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.536257221Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-6eb339154602315f InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.534895803Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-2ace21fc713e95fc InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.535517756Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-23f8204bfd4847fd InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.536402112Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.619639 Instance=stub-providertype6-25b10429c7d52fd InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.536418894Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.303112 Instance=stub-providertype8-c7964976f269a28 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.536435456Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.672869 Instance=stub-providertype4-5809f54b4cca68cb InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.536450309Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.297653 Instance=stub-providertype3-596cb51f24869c5d InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.536465980Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.885702 Instance=stub-providertype6-4c7d0ca62520ac90 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.536481206Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.468923 Instance=stub-providertype6-65cc41010442e884 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.536495822Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.246259 Instance=stub-providertype4-466b36dbc9b344e9 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.536511431Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.505439 Instance=stub-providertype6-3521469161cc970e InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.536667552Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype6-3521469161cc970e InstanceType=type6 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.536886073Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000014 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.537092055Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000014 State=Complete 16:47:59 time="2020-08-15T20:47:59.537233614Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4192214612966204 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.537251254Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4192214612966204 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.536907491 +0000 UTC m=+2.365741902" 16:47:59 time="2020-08-15T20:47:59.537358966Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.537372460Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.525913023 +0000 UTC m=+2.354747462" 16:47:59 time="2020-08-15T20:47:59.537530898Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-4192214612966204 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.536907491 +0000 UTC m=+2.365741902" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.539540005Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-6313883ce21cb812 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.539561377Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-6313883ce21cb812 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.538988118 +0000 UTC m=+2.367822557" 16:47:59 time="2020-08-15T20:47:59.540022878Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-6313883ce21cb812 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.538988118 +0000 UTC m=+2.367822557" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.540254951Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.540275914Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.539920496 +0000 UTC m=+2.368754949" 16:47:59 time="2020-08-15T20:47:59.540612155Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-3c701634bda94243 16:47:59 time="2020-08-15T20:47:59.540641917Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-2ace21fc713e95fc 16:47:59 time="2020-08-15T20:47:59.540656595Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype2-5c45107896f29609 16:47:59 time="2020-08-15T20:47:59.540673869Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-7d91efb0ef227a3c 16:47:59 time="2020-08-15T20:47:59.540696941Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-5f0d379b5bf1350c 16:47:59 time="2020-08-15T20:47:59.540716099Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-23f8204bfd4847fd 16:47:59 time="2020-08-15T20:47:59.540748059Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-1ed184bbb9340ea4 16:47:59 time="2020-08-15T20:47:59.540761863Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-405517c089b934b6 16:47:59 time="2020-08-15T20:47:59.540796619Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-71a32b414b3eb387 16:47:59 time="2020-08-15T20:47:59.540824079Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype2-6d6534d37b692f2c 16:47:59 time="2020-08-15T20:47:59.540837333Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype3-64a9c3f4308fc0ba 16:47:59 time="2020-08-15T20:47:59.540855410Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-39413b061aff0882 16:47:59 time="2020-08-15T20:47:59.540919992Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-6eb339154602315f 16:47:59 time="2020-08-15T20:47:59.540994641Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-54a888203391860a 16:47:59 time="2020-08-15T20:47:59.541031346Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-d428445aa6ef614 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541046717Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-252e76038f4a0972 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541058855Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-26e2fcfa16fea4d3 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541071233Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-452d99d2ed6dcfdc WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541085543Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-4bd8c9b2cd98e99b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541096621Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-34f038c8cd856313 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541107954Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-ac6a2c7fd67fe69 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541119995Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-4ee85d4eeb7d6b00 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541131611Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-27dff7ab244fcd36 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541143065Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-5aff01c926fbf29b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541161141Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-3e19bf7a317ae3f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541173279Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-5c24155b9170e16 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541184066Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-fc418f1dcd5bfad WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541195509Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-364f0ff8af8eef6b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541204790Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-2a19dd3f570dc8ad WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541215127Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-2c9e457114fcddea WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541228041Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-72126e84f0a7aec6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541239528Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-35ca80d72521a90 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541250866Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-6162b30a261d0f56 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541263958Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-4ac3e9b44c9ce925 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541274026Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-7d21ebf5c816ced2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541282927Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-482c0d1794f0d7da WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541293140Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-4bdb185b70ab53ba WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541304726Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-7b4826e2d3aa4530 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541316509Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-15ed320f42dae2b7 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541328171Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-6d87b8e5d22bd743 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541338998Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-733014a83a1a22a0 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541350636Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-4cb2efc43499d044 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541361910Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-7ed543364803913b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541374854Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-25826451d91ac90f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541385399Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-26984b92f6740304 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541396287Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-60390908b802bdfc WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541406528Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-4a0df4baa53a0341 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541416984Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-ce9e06596372b2d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541425853Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-581092e28026dcd WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541436469Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-342a0313380457d7 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541446681Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1328e4d4457b9829 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541457276Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-2f5411c4623917c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541562378Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-29e3c198436e73da WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541598619Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-2309b5402489a5b2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541612616Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-59a30874792c8ee8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541625224Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-24f219a32f4bbc46 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541643015Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-243a768b7c4e0b68 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541655751Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-27837d94d2613bb5 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541666990Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-46baf44754e0c0c1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541678405Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-14d41ffaa8be9186 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541689741Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-30b95ff183c471d4 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541700337Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-3485757ea7ed5d97 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541712702Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-326d74010c77412c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541722888Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-1fcc20aeaed4e9a8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541734368Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1225ce839a88b076 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541748723Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-22d25dd56b8d471a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541761330Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-736888b427bce82c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541772672Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-3332aafe336eacca WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541784005Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-53e4b406ea6f9c64 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541797206Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-34fc0ec60101a939 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541808141Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-86d109024279992 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541818975Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-58ee1a765542106f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541830548Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-34ad5ac882093298 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541842276Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-1e3ffa8aa44a03a4 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541853559Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-c9f37670c47cca8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541864294Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-42d37cdca33fd566 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541873749Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-2f1def81a59b0698 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541884859Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-4a007b2750145bf1 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541897148Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-289172b9cced2e2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541909894Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-6c2a1b7ff02a0e0a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541922785Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-430c8b35bb9457d8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541938916Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-6688f8bd3e99b0a8 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541948238Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-bca82a42dd96e5a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541957510Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-3d44b690e0770b97 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541967641Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-159e385147f955ac WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541980672Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-596cb51f24869c5d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.541993969Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-4c7d0ca62520ac90 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542007219Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-25b10429c7d52fd WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542019313Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-c7964976f269a28 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542028201Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-5809f54b4cca68cb WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542038565Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-65cc41010442e884 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542049673Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-466b36dbc9b344e9 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542060782Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-1c73fac825416fed WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542071583Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-71075a807b512662 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542089171Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-53bf1faf0cf52517 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542100958Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-5e00e6df0b340430 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542110614Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-100f49ac68915c32 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542123766Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-6a4eef7a2694763d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542134835Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-5225fcd6090ec04f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542145598Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-2c86a526ee438107 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542156834Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-22614d6fbeca336a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542168356Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-45e19a2c5ef4e819 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542227295Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-51bc2c3c9b3aa730 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542242141Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-7724d9213a0ef514 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542254674Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-549fda49272c4a7 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542266317Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-7e23bc6fc8214b8a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542277667Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-1512c3f6a02d3510 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542291295Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-3b587d976edf598d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542302878Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-74333a1db0299ef3 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542313355Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-77e6089b2f436dc4 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542322995Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-55b9352859b63774 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542333053Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-44482319682c1dde WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542342812Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-146f70ff3be70cb0 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542356253Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-7df598dcde9e5526 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542369235Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-4503ce82f78d0809 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542382862Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-5a29abd555172153 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542394962Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-46a03cb44af864ba WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542404644Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-8cd00c4e533e9a3 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542416213Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-48856598f07b0c4f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542428887Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-38550618aeb9fb77 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542444116Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-7694a644db212264 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542455147Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-51825d31521f7308 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542466348Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-3369755a2e5f7917 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542478627Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-4c22b02936d4ff9b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542488374Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-1f175c897a14c51 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.542499563Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-279d5ab29f22bfbd WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.543112058Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.543251974Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.543274253Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.542696417 +0000 UTC m=+2.371530841" 16:47:59 time="2020-08-15T20:47:59.543328490Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.543344285Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.542913834 +0000 UTC m=+2.371748272" 16:47:59 time="2020-08-15T20:47:59.543586937Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.542696417 +0000 UTC m=+2.371530841" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.543710259Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.542913834 +0000 UTC m=+2.371748272" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.544709544Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000006 Priority=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.545360192Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.545380126Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.543915673 +0000 UTC m=+2.372750115" 16:47:59 time="2020-08-15T20:47:59.545516628Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.545531627Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.544921457 +0000 UTC m=+2.373755889" 16:47:59 time="2020-08-15T20:47:59.545743443Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.543915673 +0000 UTC m=+2.372750115" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.545878330Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.544921457 +0000 UTC m=+2.373755889" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.546452185Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 PID=3 16:47:59 time="2020-08-15T20:47:59.546526343Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.546540826Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.546210893 +0000 UTC m=+2.375045330" 16:47:59 time="2020-08-15T20:47:59.546548600Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.546919888Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.546210893 +0000 UTC m=+2.375045330" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.547450937Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.547469548Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 ProbeStart="2020-08-15 20:47:59.546952664 +0000 UTC m=+2.375787086" 16:47:59 time="2020-08-15T20:47:59.547850430Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 ProbeStart="2020-08-15 20:47:59.546952664 +0000 UTC m=+2.375787086" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.548399866Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.548420460Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.547989847 +0000 UTC m=+2.376824274" 16:47:59 time="2020-08-15T20:47:59.548748620Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.547989847 +0000 UTC m=+2.376824274" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.550276934Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.550278265Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-6b4758ead15ffbbf InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.550317833Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-6b4758ead15ffbbf InstanceType=type6 ProbeStart="2020-08-15 20:47:59.54996984 +0000 UTC m=+2.378804265" 16:47:59 time="2020-08-15T20:47:59.550296710Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 ProbeStart="2020-08-15 20:47:59.549853453 +0000 UTC m=+2.378687922" 16:47:59 time="2020-08-15T20:47:59.550674995Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-6b4758ead15ffbbf InstanceType=type6 ProbeStart="2020-08-15 20:47:59.54996984 +0000 UTC m=+2.378804265" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.550825097Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 ProbeStart="2020-08-15 20:47:59.549853453 +0000 UTC m=+2.378687922" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.552906142Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-3521469161cc970e 16:47:59 time="2020-08-15T20:47:59.552994712Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-7d91efb0ef227a3c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553017401Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1ed184bbb9340ea4 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553030888Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-6d6534d37b692f2c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553042544Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-5c45107896f29609 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553055149Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-64a9c3f4308fc0ba WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553066137Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-2ace21fc713e95fc WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553079476Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-405517c089b934b6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553092710Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-23f8204bfd4847fd WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553095810Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.553104596Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-5f0d379b5bf1350c WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553195142Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-54a888203391860a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553209878Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-71a32b414b3eb387 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553224451Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-6eb339154602315f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553236848Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-39413b061aff0882 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553245599Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-3c701634bda94243 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.553650902Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000144 Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 16:47:59 time="2020-08-15T20:47:59.553809189Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 ProbeStart="2020-08-15 20:47:59.552660092 +0000 UTC m=+2.381494517" 16:47:59 time="2020-08-15T20:47:59.554308084Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7b851cb8fafd2b0 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.554326288Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7b851cb8fafd2b0 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.553985153 +0000 UTC m=+2.382819572" 16:47:59 time="2020-08-15T20:47:59.554576202Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-7b851cb8fafd2b0 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.553985153 +0000 UTC m=+2.382819572" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.554699426Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000144 16:47:59 time="2020-08-15T20:47:59.556108154Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000020 ExitCode=0 Instance=stub-providertype4-1408d2ac22c4d294 PID=3 16:47:59 time="2020-08-15T20:47:59.556332437Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.556352346Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 ProbeStart="2020-08-15 20:47:59.555952057 +0000 UTC m=+2.384786475" 16:47:59 time="2020-08-15T20:47:59.556723274Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 ProbeStart="2020-08-15 20:47:59.555952057 +0000 UTC m=+2.384786475" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.556851952Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000144 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.558449359Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.558465860Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.557968386 +0000 UTC m=+2.386802802" 16:47:59 time="2020-08-15T20:47:59.558868551Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.557968386 +0000 UTC m=+2.386802802" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.560196446Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.560570827Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.560592151Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.560079034 +0000 UTC m=+2.388913464" 16:47:59 time="2020-08-15T20:47:59.560986263Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.560079034 +0000 UTC m=+2.388913464" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.562417165Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-70941bf8cde2eca6 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.562437419Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-70941bf8cde2eca6 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.561979413 +0000 UTC m=+2.390813840" 16:47:59 time="2020-08-15T20:47:59.562769276Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-70941bf8cde2eca6 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.561979413 +0000 UTC m=+2.390813840" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.563331119Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 Signal=15 16:47:59 time="2020-08-15T20:47:59.563380905Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.563399356Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.563002005 +0000 UTC m=+2.391836417" 16:47:59 time="2020-08-15T20:47:59.563686665Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-3521469161cc970e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.563713556Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000020 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.564333961Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000044 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 16:47:59 time="2020-08-15T20:47:59.564462967Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000020 State=Complete 16:47:59 time="2020-08-15T20:47:59.564769053Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000044 16:47:59 time="2020-08-15T20:47:59.566509362Z" level=info msg="crunch-run process ended" Address="127.0.0.1:35857" ContainerUUID=zzzzz-dz642-000000000000053 Instance=stub-providertype6-5d214064018153da InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.566625896Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000044 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.569789344Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000053 16:47:59 time="2020-08-15T20:47:59.570386593Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.570406532Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.570014405 +0000 UTC m=+2.398848850" 16:47:59 time="2020-08-15T20:47:59.570785086Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.570014405 +0000 UTC m=+2.398848850" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.570925724Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000053 State=Cancelled 16:47:59 time="2020-08-15T20:47:59.571346279Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-59cad68ae21dc478 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.571363569Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-59cad68ae21dc478 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.570954676 +0000 UTC m=+2.399789147" 16:47:59 time="2020-08-15T20:47:59.571684479Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000006 ExitCode=2 Instance=stub-providertype6-660aedf1a6e222f5 PID=3 16:47:59 containers finished (2.39273392s), waiting for instances to shutdown and queue to clear 16:47:59 time="2020-08-15T20:47:59.571766250Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-59cad68ae21dc478 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.570954676 +0000 UTC m=+2.399789147" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.572381533Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.572400520Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.571999918 +0000 UTC m=+2.400834383" 16:47:59 time="2020-08-15T20:47:59.572766849Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.571999918 +0000 UTC m=+2.400834383" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.574819934Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.576474345Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-30c57d409baf5233 InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.576495245Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-30c57d409baf5233 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.575978999 +0000 UTC m=+2.404813430" 16:47:59 time="2020-08-15T20:47:59.576908364Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-30c57d409baf5233 InstanceType=type8 ProbeStart="2020-08-15 20:47:59.575978999 +0000 UTC m=+2.404813430" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.577957314Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 Signal=15 16:47:59 time="2020-08-15T20:47:59.578401457Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000006 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 16:47:59 time="2020-08-15T20:47:59.579775964Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000006 State=Complete 16:47:59 time="2020-08-15T20:47:59.580498689Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-179b59d8a9a5d809 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.580520739Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-179b59d8a9a5d809 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.579954328 +0000 UTC m=+2.408788766" 16:47:59 time="2020-08-15T20:47:59.580903448Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-179b59d8a9a5d809 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.579954328 +0000 UTC m=+2.408788766" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.582295065Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.582327446Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:59.581942758 +0000 UTC m=+2.410777181" 16:47:59 time="2020-08-15T20:47:59.582755667Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 ProbeStart="2020-08-15 20:47:59.581942758 +0000 UTC m=+2.410777181" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.583436297Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.583457746Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.582966233 +0000 UTC m=+2.411800639" 16:47:59 time="2020-08-15T20:47:59.583880262Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 ProbeStart="2020-08-15 20:47:59.582966233 +0000 UTC m=+2.411800639" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.584943876Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.325772 Instance=stub-providertype3-293a0c2bf9fc6568 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.584990823Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.706066 Instance=stub-providertype4-59cad68ae21dc478 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585003996Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.114923 Instance=stub-providertype6-5caf47a7f582d0f9 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585019580Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.632778 Instance=stub-providertype8-30c57d409baf5233 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.585035300Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.181805 Instance=stub-providertype4-15974b9d7f803594 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585050320Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.181959 Instance=stub-providertype4-1a4c99ae5daeb77e InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585067228Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.504470 Instance=stub-providertype4-179b59d8a9a5d809 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585081652Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.256675 Instance=stub-providertype4-11379066825c65f6 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585095937Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.375778 Instance=stub-providertype8-4dba7b0f9da1d7eb InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.585111884Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.905671 Instance=stub-providertype8-4192214612966204 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.585126636Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.563959 Instance=stub-providertype4-6313883ce21cb812 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585137504Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.957582 Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.585150684Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.000041 Instance=stub-providertype8-7950358b44e12d33 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.585160274Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.461900 Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585176168Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.277207 Instance=stub-providertype6-447280452c360cb3 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585190819Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.214239 Instance=stub-providertype4-450064ce6551cb89 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585204755Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype8-6d7f55666529f937 InstanceType=type8 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.585209984Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.023850 Instance=stub-providertype6-195b09315af08f8f InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585266316Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.915918 Instance=stub-providertype8-542922dc4085d3a3 InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.585242599Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype6-3940d667a3aa3ac2 InstanceType=type6 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.585282062Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.577259 Instance=stub-providertype8-16d0000295bc556e InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.585378204Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.739871 Instance=stub-providertype6-6b4758ead15ffbbf InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585398799Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.200447 Instance=stub-providertype4-1fc4715eee2c000b InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585416476Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.719185 Instance=stub-providertype3-7b851cb8fafd2b0 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.585433317Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.670602 Instance=stub-providertype3-7888e4e9d7979b4d InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.585449691Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=1.606437 Instance=stub-providertype4-64f875ba592fd007 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585465426Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.177773 Instance=stub-providertype4-41f27cc6f3875d04 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585481127Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=2.239048 Instance=stub-providertype6-323423cfcde2c269 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585503944Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.174964 Instance=stub-providertype4-57930cf840a79c3b InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.585520637Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.635819 Instance=stub-providertype6-70941bf8cde2eca6 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585538527Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.199896 Instance=stub-providertype3-7426715c257c2559 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.585554633Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.181942 Instance=stub-providertype6-2d531646eefe2d2 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.585570202Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.158842 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.585584750Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.177972 Instance=stub-providertype4-2c63eaf9464c423f InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.592385225Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.592407195Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.591970843 +0000 UTC m=+2.420805278" 16:47:59 time="2020-08-15T20:47:59.592844248Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 ProbeStart="2020-08-15 20:47:59.591970843 +0000 UTC m=+2.420805278" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.594282387Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.594301697Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 ProbeStart="2020-08-15 20:47:59.593939951 +0000 UTC m=+2.422774365" 16:47:59 time="2020-08-15T20:47:59.594666185Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-3940d667a3aa3ac2 16:47:59 time="2020-08-15T20:47:59.594691948Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype8-6d7f55666529f937 16:47:59 time="2020-08-15T20:47:59.594704464Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-293a0c2bf9fc6568 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594722169Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-59cad68ae21dc478 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594732392Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-5caf47a7f582d0f9 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594742890Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-30c57d409baf5233 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594752248Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-15974b9d7f803594 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594761919Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1a4c99ae5daeb77e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594771249Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-179b59d8a9a5d809 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594782722Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-11379066825c65f6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594793782Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-4dba7b0f9da1d7eb WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594805608Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-4192214612966204 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594816991Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-6313883ce21cb812 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594829358Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-7950358b44e12d33 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594838542Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-195b09315af08f8f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594849201Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-542922dc4085d3a3 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594861428Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-16d0000295bc556e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594871618Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-447280452c360cb3 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594882657Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-450064ce6551cb89 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594893589Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-6b4758ead15ffbbf WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594904306Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1fc4715eee2c000b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594915219Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-7b851cb8fafd2b0 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594924281Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-7888e4e9d7979b4d WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594933732Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-64f875ba592fd007 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594942857Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-57930cf840a79c3b WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594956281Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-70941bf8cde2eca6 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594977061Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-41f27cc6f3875d04 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.594991578Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-323423cfcde2c269 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.595001634Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-2d531646eefe2d2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.595014595Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-7426715c257c2559 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.595026396Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-647ea68f0b80eccd WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.595039597Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-2c63eaf9464c423f WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.596348808Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.596374087Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.595917415 +0000 UTC m=+2.424751869" 16:47:59 time="2020-08-15T20:47:59.596778875Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 ProbeStart="2020-08-15 20:47:59.595917415 +0000 UTC m=+2.424751869" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.598929061Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.682507 Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.598974991Z" level=info msg="shutdown worker" Address="127.0.0.1:44507" IdleBehavior=run IdleDuration=0.158703 Instance=stub-providertype4-700ee2bdf42b6914 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.598995321Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.151705 Instance=stub-providertype3-931afd8b416421 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.599013101Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.651596 Instance=stub-providertype3-29dfefc406b7c98 InstanceType=type3 State=idle 16:47:59 time="2020-08-15T20:47:59.599020207Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype6-576f7a3de7c3a6b2 InstanceType=type6 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.601285856Z" level=info msg="boot probe succeeded" Address= Command=true Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 stderr= stdout= 16:47:59 time="2020-08-15T20:47:59.601304908Z" level=info msg="instance booted; will try probeRunning" Address= Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 ProbeStart="2020-08-15 20:47:59.600922129 +0000 UTC m=+2.429756566" 16:47:59 time="2020-08-15T20:47:59.601623960Z" level=info msg="probes succeeded, instance is in service" Address= Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 ProbeStart="2020-08-15 20:47:59.600922129 +0000 UTC m=+2.429756566" RunningContainers=0 State=idle 16:47:59 time="2020-08-15T20:47:59.605189954Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-576f7a3de7c3a6b2 16:47:59 time="2020-08-15T20:47:59.605212925Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-700ee2bdf42b6914 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.605229478Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-931afd8b416421 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.605243757Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype3-29dfefc406b7c98 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.605255445Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-6d7f55666529f937 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.605267187Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-3940d667a3aa3ac2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.608940212Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.153400 Instance=stub-providertype6-10b92d0169a39144 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.608989149Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.913787 Instance=stub-providertype2-75ac416436dc488e InstanceType=type2 State=idle 16:47:59 time="2020-08-15T20:47:59.615425857Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-10b92d0169a39144 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.615457645Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype2-75ac416436dc488e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.615476740Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-576f7a3de7c3a6b2 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.616963520Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.153578 Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.617087566Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype4-cb6dfce30dfaa54 InstanceType=type4 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.625582238Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype4-cb6dfce30dfaa54 16:47:59 time="2020-08-15T20:47:59.630926424Z" level=info msg="shutdown worker" Address="127.0.0.1:36819" IdleBehavior=run IdleDuration=0.151745 Instance=stub-providertype4-79fd5dff976108fa InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.635731756Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-cb6dfce30dfaa54 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.635759983Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-79fd5dff976108fa WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.660944952Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.155045 Instance=stub-providertype6-c567a08fb7edb1a InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.666074114Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-c567a08fb7edb1a WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.690980212Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.153648 Instance=stub-providertype4-1408d2ac22c4d294 InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.696332020Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype4-1408d2ac22c4d294 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.698998597Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.152423 Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 State=idle 16:47:59 time="2020-08-15T20:47:59.699124531Z" level=warning msg="shutdown failed" Address= Instance=stub-providertype6-660aedf1a6e222f5 InstanceType=type6 error="instance could not be destroyed" 16:47:59 time="2020-08-15T20:47:59.703946411Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.150295 Instance=stub-providertype8-3fc951cc3c88058e InstanceType=type8 State=idle 16:47:59 time="2020-08-15T20:47:59.706460061Z" level=info msg="worker still listed after shutdown; retrying" Instance=stub-providertype6-660aedf1a6e222f5 16:47:59 time="2020-08-15T20:47:59.706482479Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype8-3fc951cc3c88058e WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.717182074Z" level=info msg="instance disappeared in cloud" Instance=stub-providertype6-660aedf1a6e222f5 WorkerState=shutdown 16:47:59 time="2020-08-15T20:47:59.718978578Z" level=info msg="shutdown worker" Address= IdleBehavior=run IdleDuration=0.154645 Instance=stub-providertype4-493a23eb55ece0ea InstanceType=type4 State=idle 16:47:59 time="2020-08-15T20:47:59.719039332Z" level=info msg="shutdown worker" Address="127.0.0.1:35857" IdleBehavior=run IdleDuration=0.152533 Instance=stub-providertype6-5d214064018153da InstanceType=type6 State=idle 16:47:59 OOPS: 8 passed, 1 FAILED 16:47:59 --- FAIL: Test (2.56s) 16:47:59 FAIL 16:47:59 coverage: 71.6% of statements 16:47:59 FAIL git.arvados.org/arvados.git/lib/dispatchcloud 2.571s 16:47:59 FAIL 16:48:00 ======= lib/dispatchcloud tests -- FAILED 16:48:00 ======= test lib/dispatchcloud -- 6s
And these are the lines that mention the container in question:
16:47:59 time="2020-08-15T20:47:57.185275459Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000106 InstanceType=type2 16:47:59 time="2020-08-15T20:47:57.186635503Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000106 InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.205583834Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=2 16:47:59 time="2020-08-15T20:47:59.206860984Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.212829303Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=2 State=Locked 16:47:59 time="2020-08-15T20:47:59.396627519Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.400244831Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000106 Priority=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.402858389Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Reason="state=Queued" 16:47:59 time="2020-08-15T20:47:59.406057805Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.406345430Z" level=info msg="kill attempt unsuccessful" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 error="Process exited with status 1" stderr="zzzzz-dz642-000000000000106: container is running\n" stdout= 16:47:59 time="2020-08-15T20:47:59.411045582Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=3 16:47:59 time="2020-08-15T20:47:59.411192865Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.412673399Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.412946618Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.414899958Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000106 Priority=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.425797198Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=4 16:47:59 time="2020-08-15T20:47:59.426239919Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.426632044Z" level=info msg="[test] container was killed" ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd PID=3 16:47:59 ... Error: container completed twice: zzzzz-dz642-000000000000106 16:47:59 time="2020-08-15T20:47:59.437957994Z" level=info msg="[test] exiting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000106 ExitCode=0 Instance=stub-providertype2-647ea68f0b80eccd PID=4 16:47:59 time="2020-08-15T20:47:59.439916045Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Reason="state=Complete" 16:47:59 time="2020-08-15T20:47:59.443042760Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 16:47:59 time="2020-08-15T20:47:59.443651231Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 16:47:59 time="2020-08-15T20:47:59.444547754Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000106 State=Complete
Files
Updated by Ward Vandewege about 4 years ago
The container that was completed twice is the only one for which this was logged:
16:47:59 time="2020-08-15T20:47:59.406345430Z" level=info msg="kill attempt unsuccessful" Address= ContainerUUID=zzzzz-dz642-000000000000106 Instance=stub-providertype2-647ea68f0b80eccd InstanceType=type2 Signal=15 error="Process exited with status 1" stderr="zzzzz-dz642-000000000000106: container is running\n" stdout=
Also, the container that was completed twice is the only one that was requeued twice:
16:47:59 time="2020-08-15T20:47:59.400244831Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000106 Priority=6 State=Locked 16:47:59 time="2020-08-15T20:47:59.414899958Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000106 Priority=6 State=Locked
Updated by Ward Vandewege about 4 years ago
I re-ran the tests with debug enabled until I was able to reproduce the fail:
./run-tests.sh ARVADOS_DEBUG=1 --temp ~/.cache --leave-temp --interactive
32 test lib/dispatchcloud -check.vv -check.f=DispatcherSuite.TestDispatchToStubDriver
root@0dcc16c03da5:/tmp# grep zzzzz-dz642-000000000000190 tmp.4YtkQVWB9U time="2020-08-20T19:57:48.083718920Z" level=debug msg="uuidLock acquired" ContainerUUID=zzzzz-dz642-000000000000190 Op=lock time="2020-08-20T19:57:48.083863465Z" level=debug msg="lock succeeded" ContainerUUID=zzzzz-dz642-000000000000190 InstanceType=type6 time="2020-08-20T19:57:48.091777448Z" level=debug msg="uuidLock not available, Op=lock in progress" ContainerUUID=zzzzz-dz642-000000000000190 Op=lock time="2020-08-20T19:57:48.109514521Z" level=debug msg="uuidLock acquired" ContainerUUID=zzzzz-dz642-000000000000190 Op=lock time="2020-08-20T19:57:48.109855029Z" level=debug msg="container no longer queued by the time we decided to lock it, doing nothing" ContainerUUID=zzzzz-dz642-000000000000190 InstanceType=type6 State=Locked time="2020-08-20T19:57:48.117541942Z" level=info msg="creating new instance" ContainerUUID=zzzzz-dz642-000000000000190 InstanceType=type6 time="2020-08-20T19:57:49.124587359Z" level=debug msg="starting container" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-4fb58fbeaf635d47 InstanceType=type6 Priority=10 time="2020-08-20T19:57:49.129333474Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-4fb58fbeaf635d47 PID=3 time="2020-08-20T19:57:49.129438515Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-4fb58fbeaf635d47 InstanceType=type6 time="2020-08-20T19:57:49.148551338Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-4fb58fbeaf635d47 PID=3 State=Locked time="2020-08-20T19:57:49.341244479Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-4fb58fbeaf635d47 InstanceType=type6 time="2020-08-20T19:57:49.345499965Z" level=debug msg="uuidLock acquired" ContainerUUID=zzzzz-dz642-000000000000190 Op=cancel time="2020-08-20T19:57:49.345524781Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000190 Priority=10 State=Locked time="2020-08-20T19:57:49.345875006Z" level=debug msg="cannot kill: already disappeared" ContainerUUID=zzzzz-dz642-000000000000190 Reason="state=Queued" time="2020-08-20T19:57:49.345896970Z" level=debug msg="clearing placeholder for exited crunch-run process" ContainerUUID=zzzzz-dz642-000000000000190 time="2020-08-20T19:57:49.346202153Z" level=debug msg="uuidLock acquired" ContainerUUID=zzzzz-dz642-000000000000190 Op=lock time="2020-08-20T19:57:49.346229749Z" level=debug msg="lock succeeded" ContainerUUID=zzzzz-dz642-000000000000190 InstanceType=type6 time="2020-08-20T19:57:49.346666870Z" level=debug msg="starting container" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Priority=10 time="2020-08-20T19:57:49.346913904Z" level=info msg="killing crunch-run process" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Reason="state=Queued" time="2020-08-20T19:57:49.350151482Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Signal=15 time="2020-08-20T19:57:49.351529401Z" level=info msg="kill attempt unsuccessful" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Signal=15 error="Process exited with status 1" stderr="zzzzz-dz642-000000000000190: container is running\n" stdout= time="2020-08-20T19:57:49.353147539Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Signal=15 time="2020-08-20T19:57:49.353380025Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d PID=7 time="2020-08-20T19:57:49.353510878Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 time="2020-08-20T19:57:49.353531297Z" level=info msg="kill attempt unsuccessful" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Signal=15 error="Process exited with status 1" stderr="zzzzz-dz642-000000000000190: container is running\n" stdout= time="2020-08-20T19:57:49.356201981Z" level=info msg="sending signal" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Signal=15 time="2020-08-20T19:57:49.356611972Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 time="2020-08-20T19:57:49.360397792Z" level=debug msg="uuidLock acquired" ContainerUUID=zzzzz-dz642-000000000000190 Op=cancel time="2020-08-20T19:57:49.360450872Z" level=info msg="requeueing locked container because crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000190 Priority=10 State=Locked time="2020-08-20T19:57:49.360745846Z" level=debug msg="cannot kill: already disappeared" ContainerUUID=zzzzz-dz642-000000000000190 Reason="state=Queued" time="2020-08-20T19:57:49.360779084Z" level=debug msg="clearing placeholder for exited crunch-run process" ContainerUUID=zzzzz-dz642-000000000000190 time="2020-08-20T19:57:49.361426138Z" level=debug msg="uuidLock acquired" ContainerUUID=zzzzz-dz642-000000000000190 Op=lock time="2020-08-20T19:57:49.361452241Z" level=debug msg="lock succeeded" ContainerUUID=zzzzz-dz642-000000000000190 InstanceType=type6 time="2020-08-20T19:57:49.361571056Z" level=debug msg="starting container" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 Priority=10 time="2020-08-20T19:57:49.367444133Z" level=info msg="[test] starting crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d PID=8 time="2020-08-20T19:57:49.367535819Z" level=info msg="crunch-run process started" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 time="2020-08-20T19:57:49.369604599Z" level=info msg="[test] container was killed" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d PID=7 time="2020-08-20T19:57:49.388620411Z" level=info msg="[test] crashing crunch-run stub" ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d PID=8 State=Running ... Error: container completed twice: zzzzz-dz642-000000000000190 time="2020-08-20T19:57:49.426099646Z" level=info msg="crunch-run process ended" Address= ContainerUUID=zzzzz-dz642-000000000000190 Instance=stub-providertype6-1d5a5d96389b7f4d InstanceType=type6 time="2020-08-20T19:57:49.430838443Z" level=debug msg="uuidLock acquired" ContainerUUID=zzzzz-dz642-000000000000190 Op=cancel time="2020-08-20T19:57:49.430890828Z" level=info msg="cancelling container because state=Running after crunch-run exited" ContainerUUID=zzzzz-dz642-000000000000190 time="2020-08-20T19:57:49.431133065Z" level=debug msg="cannot kill: already disappeared" ContainerUUID=zzzzz-dz642-000000000000190 Reason="state=Cancelled" time="2020-08-20T19:57:49.431159881Z" level=debug msg="clearing placeholder for exited crunch-run process" ContainerUUID=zzzzz-dz642-000000000000190 time="2020-08-20T19:57:49.431359915Z" level=info msg="container finished -- dropping from queue" ContainerUUID=zzzzz-dz642-000000000000190 State=Cancelled
This snippet attached as 000000000000190.log, the complete log of the failed run as fail-with-debug.log
As before, this is the only container that hit the "kill attempt unsuccessful" code path, twice (!) this time.
But unlike before, there are other containers that were requeued more than once. That's probably because I increased the stubvm.CrunchRunCrashRate crash rate to 0.5 from 0.1.
Updated by Ward Vandewege about 4 years ago
- File fail-with-debug.log fail-with-debug.log added
- File zzzzz-dz642-000000000000190.log added
Updated by Ward Vandewege about 4 years ago
- File 000000000000190.log 000000000000190.log added
Updated by Ward Vandewege about 4 years ago
- File deleted (
zzzzz-dz642-000000000000190.log)
Updated by Ward Vandewege about 4 years ago
- Target version changed from To Be Groomed to 2020-08-26 Sprint
- Assigned To set to Tom Clegg
- Status changed from New to In Progress
Updated by Tom Clegg about 4 years ago
- Test stub updates state to Complete before reporting that crunch-run has exited
- Test stub doesn't call the "crashed while running" hook if it doesn't succeed in changing state to Running
- Don't lock a Queued container if the worker pool is still reporting a live crunch-run process from a previous invocation. Otherwise, before Queued->Locked takes effect, sync() might start a "kill crunch-run proc for requeued ctr" goroutine that lives long enough to kill the new crunch-run process.
The third bug could have incorrectly aborted containers in production too, so we now check for it in the simulation test (it happened in around 3% of my test runs before the fix). The first two were only test bugs.
16723-kill-vs-requeue @ 965b6fc27b3eaf3a812132cea093b03b02f35896 -- developer-run-tests: #2021
Updated by Ward Vandewege about 4 years ago
Tom Clegg wrote:
Needed several fixes:
- Test stub updates state to Complete before reporting that crunch-run has exited
- Test stub doesn't call the "crashed while running" hook if it doesn't succeed in changing state to Running
- Don't lock a Queued container if the worker pool is still reporting a live crunch-run process from a previous invocation. Otherwise, before Queued->Locked takes effect, sync() might start a "kill crunch-run proc for requeued ctr" goroutine that lives long enough to kill the new crunch-run process.
The third bug could have incorrectly aborted containers in production too, so we now check for it in the simulation test (it happened in around 3% of my test runs before the fix). The first two were only test bugs.
16723-kill-vs-requeue @ 965b6fc27b3eaf3a812132cea093b03b02f35896 -- developer-run-tests: #2021
I pushed a fix for one test in 2160f72372422c1970a3effb9ba6961b94da318d. There are 2 more failing tests in lib/dispatchcloud/scheduler: SchedulerSuite.TestStartWhileCreating and SchedulerSuite.TestUseIdleWorkers and it seems odd that the "not restarting yet: crunch-run process from previous attempt has not exited" message is coming up in those tests.
Code LGTM assuming the tests can be fixed.
Updated by Tom Clegg about 4 years ago
16723-kill-vs-requeue @ a644bfd36efe4d0ea885d3a1c20809deb748e42e -- developer-run-tests: #2025
Updated by Anonymous about 4 years ago
- % Done changed from 0 to 100
- Status changed from In Progress to Resolved
Applied in changeset arvados|20dad0340d1230f041824afb4f8c19c848ba16f3.
Updated by Tom Clegg about 4 years ago
- Status changed from Resolved to In Progress
Updated by Tom Clegg about 4 years ago
The last commit wasn't quite right. The log message said "not locking yet" but really meant "locked, but not starting yet". This fixes the log message ("not starting yet"), and adds the "not locking yet" logic in the right place. This gets us the intended behavior: leave a requeued container in Queued state until the worker pool reports the old crunch-run proc is gone, then lock it and try to run it again.
16723-kill-vs-requeue @ 26519f015ebbd7e7b4ef288d4e89d877ea05c0ec -- developer-run-tests: #2027
Updated by Tom Clegg almost 4 years ago
- Target version changed from 2020-08-26 Sprint to 2020-09-09 Sprint
Updated by Ward Vandewege almost 4 years ago
Tom Clegg wrote:
The last commit wasn't quite right. The log message said "not locking yet" but really meant "locked, but not starting yet". This fixes the log message ("not starting yet"), and adds the "not locking yet" logic in the right place. This gets us the intended behavior: leave a requeued container in Queued state until the worker pool reports the old crunch-run proc is gone, then lock it and try to run it again.
16723-kill-vs-requeue @ 26519f015ebbd7e7b4ef288d4e89d877ea05c0ec -- developer-run-tests: #2027
LGTM, thanks!
Updated by Anonymous almost 4 years ago
- Status changed from In Progress to Resolved
Applied in changeset arvados|f3e3a6cc4b72120f856e14f3039b1c0c1f0326bd.