Arvados

from: qr1hi-d1hrv-ooaz68wsp1gm7wx#Log from job qr1hi-8i9sb-i4pplxizsmn0ign but I cannot see the log from that job (bug filed already). I'm not exactly sure what happened here, It seems like it couldnt output of two things?

Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr run-command: caught exception:
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr Traceback (most recent call last):
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/tmp/crunch-src/crunch_scripts/crunchutil/robust_put.py", line 37, in upload
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr out.write_directory_tree(source_dir, max_manifest_depth=0)
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/commands/put.py", line 312, in write_directory_tree
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr path, stream_name, max_manifest_depth)
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/collection.py", line 296, in write_directory_tree
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr self.do_queued_work()
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/collection.py", line 223, in do_queued_work
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr self._work_file()
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/collection.py", line 236, in _work_file
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr self.write(buf)
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/collection.py", line 522, in write
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr return super(ResumableCollectionWriter, self).write(data)
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/collection.py", line 307, in write
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr self.flush_data()
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/commands/put.py", line 288, in flush_data
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr super(ArvPutCollectionWriter, self).flush_data()
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/collection.py", line 314, in flush_data
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr self._keep_client.put(data_buffer[0:self.KEEP_BLOCK_SIZE]))
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/usr/local/lib/python2.7/dist-packages/arvados_python_client-0.1-py2.7.egg/arvados/keep.py", line 686, in put
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr (data_hash, copies, thread_limiter.done()))
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr KeepWriteError: Write fail for 9fb2d52b958648657d791990ee912527: wanted 2 but wrote 1
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr run-command: Too many upload failures, giving up
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr Traceback (most recent call last):
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/tmp/crunch-src/crunch_scripts/run-command", line 307, in <module>
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr outcollection = robust_put.upload(outdir, logger)
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr File "/tmp/crunch-src/crunch_scripts/crunchutil/robust_put.py", line 48, in upload
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr raise e
Sat Nov 8 00:07:31 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr arvados.errors.KeepWriteError: Write fail for 9fb2d52b958648657d791990ee912527: wanted 2 but wrote 1
Sat Nov 8 00:07:32 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 stderr srun: error: compute48: task 0: Exited with exit code 1
Sat Nov 8 00:07:33 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 child 27891 on compute48.1 exit 1 success=
Sat Nov 8 00:07:33 2014 qr1hi-8i9sb-i4pplxizsmn0ign 27500 1 failure (#1, permanent) after 1655 seconds