Bug #12684
Updated by Brett Smith about 1 year ago
Updated Feb 23, 2023
The SDK either doesn't retry at all, or doesn't retry enough. Requiring end users to manually provide @num_retries@ on every call is not a (human) scalable solution.
* The number of retries should be settable when creating the API object
** This should be used for requests made while initializing the client object, like fetching the discovery document
* The default retry count should be much more robust -- like 8 retries
h2. Old ticket
This sounds like what #3147 was intended to address, but it's apparently not working:
<pre>
Traceback (most recent call last):
File "./myg_runs.py", line 244, in <module>
main()
File "./myg_runs.py", line 230, in main
dump_subprojects(stats, project, SKIP_PROJECTS)
File "./myg_runs.py", line 210, in dump_subprojects
dump_pipeline_instances(stats, sp)
File "./myg_runs.py", line 182, in dump_pipeline_instances
time = dump_pipeline_instance(stats, i)
File "./myg_runs.py", line 167, in dump_pipeline_instance
dump_jobs(batchid, sample, cwl_runner['job']['components'])
File "./myg_runs.py", line 84, in dump_jobs
jobs = api.jobs().list(filters=[['uuid','=',job_uuid]]).execute()
File "/usr/lib/python2.7/dist-packages/oauth2client/util.py", line 140, in positional_wrapper
return wrapped(*args, **kwargs)
File "/usr/lib/python2.7/dist-packages/googleapiclient/http.py", line 840, in execute
raise HttpError(resp, content, uri=self.uri)
arvados.errors.ApiError: <HttpError 502 when requesting https://e51c5.arvadosapi.com/arvados/v1/jobs?alt=json&filters=%5B%5B%22uuid%22%2C+%22%3D%22%2C+%22e51c5-8i9sb-b8od8nvombxq3h3%22%5D%5D returned "Bad Gateway">
</pre>