Arvados

arvados-node-manager 0.1.20150511215048 gave exception

2015-07-17_14:38:50.20116 2015-07-17 14:38:50 pykka[30669] DEBUG: Exception returned from ComputeNodeUpdateActor (urn:uuid:5d00d4ba-330e-4b08-88ac-5794ac0d371d) to caller:
2015-07-17_14:38:50.20120 Traceback (most recent call last):
2015-07-17_14:38:50.20120   File "/usr/local/lib/python2.7/dist-packages/pykka/actor.py", line 200, in _actor_loop
2015-07-17_14:38:50.20121     response = self._handle_receive(message)
2015-07-17_14:38:50.20121   File "/usr/local/lib/python2.7/dist-packages/pykka/actor.py", line 294, in _handle_receive
2015-07-17_14:38:50.20122     return callee(*message['args'], **message['kwargs'])
2015-07-17_14:38:50.20122   File "/usr/local/lib/python2.7/dist-packages/arvnodeman/computenode/dispatch/__init__.py", line 252, in throttle_wrapper
2015-07-17_14:38:50.20123     result = orig_func(self, *args, **kwargs)
2015-07-17_14:38:50.20123   File "/usr/local/lib/python2.7/dist-packages/arvnodeman/computenode/dispatch/__init__.py", line 265, in sync_node
2015-07-17_14:38:50.20124     return self._cloud.sync_node(cloud_node, arvados_node)
2015-07-17_14:38:50.20124   File "/usr/local/lib/python2.7/dist-packages/arvnodeman/computenode/driver/gce.py", line 144, in sync_node
2015-07-17_14:38:50.20125     method='POST', data=metadata_req)
2015-07-17_14:38:50.20125   File "/usr/local/lib/python2.7/dist-packages/libcloud/common/base.py", line 874, in async_request
2015-07-17_14:38:50.20126     response = request(**kwargs)
2015-07-17_14:38:50.20127   File "/usr/local/lib/python2.7/dist-packages/libcloud/common/google.py", line 684, in request
2015-07-17_14:38:50.20127     *args, **kwargs)
2015-07-17_14:38:50.20127   File "/usr/local/lib/python2.7/dist-packages/libcloud/common/base.py", line 736, in request
2015-07-17_14:38:50.20128     response = responseCls(**kwargs)
2015-07-17_14:38:50.20128   File "/usr/local/lib/python2.7/dist-packages/libcloud/common/base.py", line 119, in __init__
2015-07-17_14:38:50.20128     self.object = self.parse_body()
2015-07-17_14:38:50.20128   File "/usr/local/lib/python2.7/dist-packages/libcloud/common/google.py", line 249, in parse_body
2015-07-17_14:38:50.20129     raise GoogleBaseError(message, self.status, code)
2015-07-17_14:38:50.20129 GoogleBaseError: u'Invalid fingerprint.'
2015-07-17_14:38:56.68637 2015-07-17 14:38:56 arvnodeman.arvados_nodes[30669] DEBUG: ArvadosNodeListMonitorActor (at 22100688) sending poll
2015-07-17_14:38:56.68725 2015-07-17 14:38:56 arvnodeman.jobqueue[30669] DEBUG: JobQueueMonitorActor (at 29545168) sending poll
2015-07-17_14:38:56.73487 2015-07-17 14:38:56 arvnodeman.jobqueue[30669] DEBUG: Sending server wishlist: n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8, n1-standard-8
2015-07-17_14:38:56.73495 2015-07-17 14:38:56 arvnodeman.jobqueue[30669] DEBUG: JobQueueMonitorActor (at 29545168) got response with 17 items
2015-07-17_14:38:56.97197 2015-07-17 14:38:56 arvnodeman.arvados_nodes[30669] DEBUG: ArvadosNodeListMonitorActor (at 22100688) got response with 143 items
2015-07-17_14:39:31.90599 2015-07-17 14:39:31 arvnodeman.cloud_nodes[30669] WARNING: CloudNodeListMonitorActor (at 22127120) got error: The read operation timed out - waiting 120 seconds