Arvados

Bug #4499

Updated by Tim Pierce over 9 years ago

sguthrie reports that "qr1hi-d1hrv-3n1gezo6gondyrv":http://crvr.se/qr1hi-d1hrv-3n1gezo6gondyrv, despite running with one_task_per_input_file, spawns 300 tasks on an input collection with 60 files in it: 

 Job "qr1hi-8i9sb-zc7ivqn134e8czx":http://crvr.se/qr1hi-8i9sb-zc7ivqn134e8czx takes input collection "qr1hi-4zz18-zc07fkmhzhfzriz":http://crvr.se/qr1hi-4zz18-zc07fkmhzhfzriz, which has 60 files. 

 This job runs @addPopulationMemEff.py@ at commit 5299b46be, which specifies: 

 <pre> 
 arvados.job_setup.one_task_per_input_file(if_sequence=0, and_end_task=True, input_as_path=True) 
 </pre> 

 but the job produces nearly 300 tasks: 
 <pre> 
         "tasks_summary": { 
           "done": 1, 
           "running": 8, 
           "failed": 0, 
           "todo": 292 
         }, 
 </pre> 

Back