[Workbench] collection#show is unresponsive for a large collection
When trying to view collection su92l-4zz18-qww94nsw428dm7o, it bogs down Firefox and eventually brings up a 'Warning: Unresponsive script' popup asking me whether I want to stop the script.
If I click on 'continue' it looks like it finishes loading but clicking on the 'Provenance graph' does not show anything.
I also see from the breadcrumbs at the top that it's name 'Generate Tile Library' from my 'Home' project, but when looking at the 'Projects' dropdown I don't see the project or collection.
In general the page is unresponsive enough to be effectively unusable.
#3 Updated by Sarah Guthrie over 4 years ago
Large collection problems do not only extend to workbench, they also can cause tasks reading in these collections to fail:
This is related to Bug #5901
Parallelizing tasks that read from a large collection fail when reading the collection with a probability proportional to (the size of the collection) * (the number of tasks trying to access the collection) (Normally, all tasks in that batch fail with the same error)
arvados.errors.NotFoundError: Failed to retrieve collection 'f72bcd1c744cac964ca4bda88824c781+81001337' from either API server
(<HttpError 504 when requesting https://su92l.arvadosapi.com/arvados/v1/collections/f72bcd1c744cac964ca4bda88824c781%2B81001337?alt=json returned "Gateway Time-out">) or
Keep (f72bcd1c744cac964ca4bda88824c781+81001337 not found:
http://keep7.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep9.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep3.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep5.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep8.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep6.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep2.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep1.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep4.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep6.su92l.arvadosapi.com:25108/ responded with 403 HTTP/1.1 403 Forbidden
Log file for an example: https://workbench.su92l.arvadosapi.com/collections/su92l-4zz18-xydgpbil659fca6
Pipeline example: https://workbench.su92l.arvadosapi.com/pipeline_instances/su92l-d1hrv-8ihysd9h7ctpbed