Bug #5902

[Workbench] collection#show is unresponsive for a large collection

Added by Abram Connelly over 4 years ago. Updated over 4 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Workbench
Target version:
Start date:
05/04/2015
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

When trying to view collection su92l-4zz18-qww94nsw428dm7o, it bogs down Firefox and eventually brings up a 'Warning: Unresponsive script' popup asking me whether I want to stop the script.

If I click on 'continue' it looks like it finishes loading but clicking on the 'Provenance graph' does not show anything.

I also see from the breadcrumbs at the top that it's name 'Generate Tile Library' from my 'Home' project, but when looking at the 'Projects' dropdown I don't see the project or collection.

In general the page is unresponsive enough to be effectively unusable.


Related issues

Related to Arvados - Bug #5901: [API] Improve performance of large requests in parallelNew05/04/2015

History

#1 Updated by Abram Connelly over 4 years ago

UPDATE: The project name looks to be not owned by be but by Sally Guthrie (I see it under her directory on the keep mounts 'shared' directory portion) and this is probably why I can't see it in my 'Projects' dropdown.

#2 Updated by Abram Connelly over 4 years ago

Also, this collection might have been copied from tb05z and might not have any provenance in terms of pipelines creating it on su92l.

#3 Updated by Sarah Guthrie over 4 years ago

Large collection problems do not only extend to workbench, they also can cause tasks reading in these collections to fail:

This is related to Bug #5901

Parallelizing tasks that read from a large collection fail when reading the collection with a probability proportional to (the size of the collection) * (the number of tasks trying to access the collection) (Normally, all tasks in that batch fail with the same error)

arvados.errors.NotFoundError: Failed to retrieve collection 'f72bcd1c744cac964ca4bda88824c781+81001337' from either API server

(<HttpError 504 when requesting https://su92l.arvadosapi.com/arvados/v1/collections/f72bcd1c744cac964ca4bda88824c781%2B81001337?alt=json returned "Gateway Time-out">) or
Keep (f72bcd1c744cac964ca4bda88824c781+81001337 not found:
http://keep7.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep9.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep3.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep5.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep8.su92l.arvadosapi.com:25107/ responded with 403 HTTP/1.1 403 Forbidden
http://keep6.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep2.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep1.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep4.su92l.arvadosapi.com:25107/ responded with 404 HTTP/1.1 404 Not Found
http://keep6.su92l.arvadosapi.com:25108/ responded with 403 HTTP/1.1 403 Forbidden

Log file for an example: https://workbench.su92l.arvadosapi.com/collections/su92l-4zz18-xydgpbil659fca6
Pipeline example: https://workbench.su92l.arvadosapi.com/pipeline_instances/su92l-d1hrv-8ihysd9h7ctpbed

#4 Updated by Brett Smith over 4 years ago

  • Subject changed from Large collection has many issues to [Workbench] collection#show is unresponsive for a large collection
  • Category set to Workbench
  • Target version changed from Bug Triage to Arvados Future Sprints

Also available in: Atom PDF