https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422015-05-04T20:37:11ZArvadosArvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=241602015-05-04T20:37:11ZAbram Connellyabram.connelly@gmail.com
<ul></ul><p>UPDATE: The project name looks to be not owned by be but by Sally Guthrie (I see it under her directory on the keep mounts 'shared' directory portion) and this is probably why I can't see it in my 'Projects' dropdown.</p> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=241612015-05-04T20:39:40ZAbram Connellyabram.connelly@gmail.com
<ul></ul><p>Also, this collection might have been copied from tb05z and might not have any provenance in terms of pipelines creating it on su92l.</p> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=245982015-05-12T20:05:12ZSarah Guthriesallyeguthrie@gmail.com
<ul></ul><p>Large collection problems do not only extend to workbench, they also can cause tasks reading in these collections to fail:</p>
<p>This is related to Bug <a class="issue tracker-1 status-1 priority-4 priority-default" title="Bug: [API] Improve performance of large requests in parallel (New)" href="https://dev.arvados.org/issues/5901">#5901</a></p>
<p>Parallelizing tasks that read from a large collection fail when reading the collection with a probability proportional to (the size of the collection) * (the number of tasks trying to access the collection) (Normally, all tasks in that batch fail with the same error)</p>
<blockquote>
<p>arvados.errors.NotFoundError: Failed to retrieve collection 'f72bcd1c744cac964ca4bda88824c781+81001337' from either API server</p>
<blockquote>
<p>(<HttpError 504 when requesting <a class="external" href="https://su92l.arvadosapi.com/arvados/v1/collections/f72bcd1c744cac964ca4bda88824c781%2B81001337?alt=json">https://su92l.arvadosapi.com/arvados/v1/collections/f72bcd1c744cac964ca4bda88824c781%2B81001337?alt=json</a> returned "Gateway Time-out">) or<br />Keep (f72bcd1c744cac964ca4bda88824c781+81001337 not found: <br /><a class="external" href="http://keep7.su92l.arvadosapi.com:25107/">http://keep7.su92l.arvadosapi.com:25107/</a> responded with 403 HTTP/1.1 403 Forbidden <br /><a class="external" href="http://keep9.su92l.arvadosapi.com:25107/">http://keep9.su92l.arvadosapi.com:25107/</a> responded with 403 HTTP/1.1 403 Forbidden<br /><a class="external" href="http://keep3.su92l.arvadosapi.com:25107/">http://keep3.su92l.arvadosapi.com:25107/</a> responded with 404 HTTP/1.1 404 Not Found<br /><a class="external" href="http://keep5.su92l.arvadosapi.com:25107/">http://keep5.su92l.arvadosapi.com:25107/</a> responded with 404 HTTP/1.1 404 Not Found<br /><a class="external" href="http://keep8.su92l.arvadosapi.com:25107/">http://keep8.su92l.arvadosapi.com:25107/</a> responded with 403 HTTP/1.1 403 Forbidden<br /><a class="external" href="http://keep6.su92l.arvadosapi.com:25107/">http://keep6.su92l.arvadosapi.com:25107/</a> responded with 404 HTTP/1.1 404 Not Found<br /><a class="external" href="http://keep2.su92l.arvadosapi.com:25107/">http://keep2.su92l.arvadosapi.com:25107/</a> responded with 404 HTTP/1.1 404 Not Found<br /><a class="external" href="http://keep1.su92l.arvadosapi.com:25107/">http://keep1.su92l.arvadosapi.com:25107/</a> responded with 404 HTTP/1.1 404 Not Found<br /><a class="external" href="http://keep4.su92l.arvadosapi.com:25107/">http://keep4.su92l.arvadosapi.com:25107/</a> responded with 404 HTTP/1.1 404 Not Found<br /><a class="external" href="http://keep6.su92l.arvadosapi.com:25108/">http://keep6.su92l.arvadosapi.com:25108/</a> responded with 403 HTTP/1.1 403 Forbidden</p>
</blockquote>
<p>Log file for an example: <a class="external" href="https://workbench.su92l.arvadosapi.com/collections/su92l-4zz18-xydgpbil659fca6">https://workbench.su92l.arvadosapi.com/collections/su92l-4zz18-xydgpbil659fca6</a><br />Pipeline example: <a class="external" href="https://workbench.su92l.arvadosapi.com/pipeline_instances/su92l-d1hrv-8ihysd9h7ctpbed">https://workbench.su92l.arvadosapi.com/pipeline_instances/su92l-d1hrv-8ihysd9h7ctpbed</a></p>
</blockquote> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=246192015-05-13T16:12:21ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Subject</strong> changed from <i>Large collection has many issues</i> to <i>[Workbench] collection#show is unresponsive for a large collection</i></li><li><strong>Category</strong> set to <i>Workbench</i></li><li><strong>Target version</strong> changed from <i>Bug Triage</i> to <i>Arvados Future Sprints</i></li></ul> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=949992021-07-07T18:29:33ZWard Vandewegeward@curii.com
<ul><li><strong>Target version</strong> deleted (<del><i>Arvados Future Sprints</i></del>)</li></ul> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=1122532023-02-14T22:24:42ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Release</strong> set to <i>60</i></li></ul> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=1236072024-03-01T21:16:04ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> set to <i>Future</i></li></ul> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=1238412024-03-01T22:35:40ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Closed</i></li></ul> Arvados - Bug #5902: [Workbench] collection#show is unresponsive for a large collectionhttps://dev.arvados.org/issues/5902?journal_id=1241152024-03-13T18:40:12ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> deleted (<del><i>Future</i></del>)</li></ul>