https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422019-12-04T16:33:36ZArvadosArvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=795372019-12-04T16:33:36ZTom Morristfmorris@veritasgenetics.com
<ul><li><strong>Assigned To</strong> set to <i>Ward Vandewege</i></li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=801952020-01-02T15:49:50ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> changed from <i>2020-01-02 Sprint</i> to <i>2020-01-15 Sprint</i></li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=801972020-01-02T15:59:49ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Assigned To</strong> deleted (<del><i>Ward Vandewege</i></del>)</li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=802062020-01-02T16:18:03ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Assigned To</strong> set to <i>Peter Amstutz</i></li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=802332020-01-02T19:04:06ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Category</strong> set to <i>API</i></li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=805322020-01-08T17:08:16ZTom Cleggtom@curii.com
<ul><li><strong>Release</strong> set to <i>22</i></li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=805352020-01-08T17:09:50ZTom Cleggtom@curii.com
<ul><li><strong>Assigned To</strong> changed from <i>Peter Amstutz</i> to <i>Tom Clegg</i></li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=806052020-01-14T19:50:35ZTom Cleggtom@curii.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul><p>Deleting the (modified_at desc, uuid) index doesn't seem appealing -- it's likely to make different queries slow.</p>
<p>It may be possible to tune postgresql's statistics / query planner so it chooses the appropriate index.</p>
<p>I suspect the easiest short term solution/workaround is for the client to specify order=uuid or order=(requesting_container_uuid, uuid), rather than using the default order=(modified_at desc, uuid).</p>
<p>I'm guessing the client is workbench or workbench2?</p> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=806242020-01-15T15:50:13ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Target version</strong> changed from <i>2020-01-15 Sprint</i> to <i>2020-01-29 Sprint</i></li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=809202020-01-16T20:20:54ZTom Cleggtom@curii.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-3 priority-4 priority-default closed parent" href="/issues/15672">Bug #15672</a>: List of subprocesses limited in process view</i> added</li></ul> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=809282020-01-16T21:36:29ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>I have checked wb2 code and I haven't found code making a request with a 'requesting_container_uuid in [some list]' filter. In fact, current wb2's master branch would fail to show a big workflow because it makes a request with a filter too big to be used on a GET query.</p> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=813962020-01-28T20:10:57ZTom Cleggtom@curii.com
<ul></ul><p>15902-slow-query @ <a class="changeset" title="15902: Adjust order to avoid poorly optimized query. When many requesting_container_uuid values ..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/9fc2ff5583fc31c9f75f80dcf7258bed63084568">9fc2ff5583fc31c9f75f80dcf7258bed63084568</a> -- <a class="external" href="https://ci.arvados.org/view/Developer/job/developer-run-tests/1710/"<a href="https://ci.arvados.org/view/Developer/job/developer-run-tests/1710/">developer-run-tests: #1710 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=1710" alt="" /></a></a></p> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=813982020-01-28T20:36:02ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>This LGTM, waiting for tests to finish before merging.</p> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=814002020-01-28T21:28:10ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>Re-running wb integration tests just in case</p>
<p><a class="external" href="https://ci.arvados.org/job/developer-run-tests-apps-workbench-integration/1811/"<a href="https://ci.arvados.org/job/developer-run-tests-apps-workbench-integration/1811/">developer-run-tests-apps-workbench-integration: #1811 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests-apps-workbench-integration&build=1811" alt="" /></a></a></p> Arvados - Bug #15902: Very slow query for large workflowshttps://dev.arvados.org/issues/15902?journal_id=814012020-01-28T22:51:28ZAnonymous
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p>Applied in changeset <a class="changeset" title="Merge branch '15902-slow-query' Closes #15902 Arvados-DCO-1.1-Signed-off-by: Lucas Di Pentima <..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/405017353d0a74ef28288744957fd362df98c0e2">arvados|405017353d0a74ef28288744957fd362df98c0e2</a>.</p>