Arvados

Bug #12684

Updated by Peter Amstutz over 1 year ago

Updated Feb 23, 2023 

 The SDK either doesn't retry at all, or doesn't retry enough.    Requiring end users to manually provide @num_retries@ on every call is not a (human) scalable solution. 

 * The number of retries should be settable when creating the API object 
 * The default retry count should be much more robust -- like 8 retries 

 h2. Old ticket 

 This sounds like what #3147 was intended to address, but it's apparently not working: 

 <pre> 
 Traceback (most recent call last): 
   File "./myg_runs.py", line 244, in <module> 
     main() 
   File "./myg_runs.py", line 230, in main 
     dump_subprojects(stats, project, SKIP_PROJECTS) 
   File "./myg_runs.py", line 210, in dump_subprojects 
     dump_pipeline_instances(stats, sp) 
   File "./myg_runs.py", line 182, in dump_pipeline_instances 
     time = dump_pipeline_instance(stats, i) 
   File "./myg_runs.py", line 167, in dump_pipeline_instance 
     dump_jobs(batchid, sample, cwl_runner['job']['components']) 
   File "./myg_runs.py", line 84, in dump_jobs 
     jobs = api.jobs().list(filters=[['uuid','=',job_uuid]]).execute() 
   File "/usr/lib/python2.7/dist-packages/oauth2client/util.py", line 140, in positional_wrapper 
     return wrapped(*args, **kwargs) 
   File "/usr/lib/python2.7/dist-packages/googleapiclient/http.py", line 840, in execute 
     raise HttpError(resp, content, uri=self.uri) 
 arvados.errors.ApiError: <HttpError 502 when requesting https://e51c5.arvadosapi.com/arvados/v1/jobs?alt=json&filters=%5B%5B%22uuid%22%2C+%22%3D%22%2C+%22e51c5-8i9sb-b8od8nvombxq3h3%22%5D%5D returned "Bad Gateway"> 
 </pre>

Back