Bug #5902
closed
[Workbench] collection#show is unresponsive for a large collection
Description
When trying to view collection su92l-4zz18-qww94nsw428dm7o, it bogs down Firefox and eventually brings up a 'Warning: Unresponsive script' popup asking me whether I want to stop the script.
If I click on 'continue' it looks like it finishes loading but clicking on the 'Provenance graph' does not show anything.
I also see from the breadcrumbs at the top that it's name 'Generate Tile Library' from my 'Home' project, but when looking at the 'Projects' dropdown I don't see the project or collection.
In general the page is unresponsive enough to be effectively unusable.
Updated by Abram Connelly over 9 years ago
UPDATE: The project name looks to be not owned by be but by Sally Guthrie (I see it under her directory on the keep mounts 'shared' directory portion) and this is probably why I can't see it in my 'Projects' dropdown.
Updated by Abram Connelly over 9 years ago
Also, this collection might have been copied from tb05z and might not have any provenance in terms of pipelines creating it on su92l.
Updated by Sarah Guthrie over 9 years ago
Large collection problems do not only extend to workbench, they also can cause tasks reading in these collections to fail:
This is related to Bug #5901
Parallelizing tasks that read from a large collection fail when reading the collection with a probability proportional to (the size of the collection) * (the number of tasks trying to access the collection) (Normally, all tasks in that batch fail with the same error)
arvados.errors.NotFoundError: Failed to retrieve collection 'f72bcd1c744cac964ca4bda88824c781+81001337' from either API server
(<HttpError 504 when requesting https://su92l.arvadosapi.com/arvados/v1/collections/f72bcd1c744cac964ca4bda88824c781%2B81001337?alt=json returned "Gateway Time-out">) or
Keep (f72bcd1c744cac964ca4bda88824c781+81001337 not found:
http://keep7.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep9.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep3.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep5.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep8.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep6.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep2.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep1.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep4.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep6.su92l.arvadosapi.com:25108/ responded with 403 HTTP/1.1 403 ForbiddenLog file for an example: https://workbench.su92l.arvadosapi.com/collections/su92l-4zz18-xydgpbil659fca6
Pipeline example: https://workbench.su92l.arvadosapi.com/pipeline_instances/su92l-d1hrv-8ihysd9h7ctpbed
Updated by Brett Smith over 9 years ago
- Subject changed from Large collection has many issues to [Workbench] collection#show is unresponsive for a large collection
- Category set to Workbench
- Target version changed from Bug Triage to Arvados Future Sprints
Updated by Ward Vandewege over 3 years ago
- Target version deleted (
Arvados Future Sprints)
Updated by