https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422019-04-10T16:05:35ZArvadosArvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=732202019-04-10T16:05:35ZTom Morristfmorris@veritasgenetics.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=732212019-04-10T16:05:49ZTom Morristfmorris@veritasgenetics.com
<ul><li><strong>Assigned To</strong> set to <i>Eric Biagiotti</i></li></ul> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=732222019-04-10T16:06:14ZTom Morristfmorris@veritasgenetics.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-6 status-3 priority-4 priority-default closed parent" href="/issues/14484">Idea #14484</a>: [API Server] Return collection size and number of files in collection record</i> added</li></ul> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=732292019-04-10T16:21:18ZTom Morristfmorris@veritasgenetics.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>New</i></li><li><strong>Assigned To</strong> deleted (<del><i>Eric Biagiotti</i></del>)</li><li><strong>Target version</strong> changed from <i>2019-04-24 Sprint</i> to <i>To Be Groomed</i></li></ul> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=739762019-05-01T14:55:34ZTom Morristfmorris@veritasgenetics.com
<ul><li><strong>Blocked by</strong> <i><a class="issue tracker-6 status-3 priority-4 priority-default closed" href="/issues/15180">Idea #15180</a>: [Spike] Test migration on production database</i> added</li></ul> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=750442019-05-31T18:48:39ZWard Vandewegeward@curii.com
<ul><li><strong>Category</strong> set to <i>API</i></li><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>Assigned To</strong> set to <i>Ward Vandewege</i></li><li><strong>Target version</strong> changed from <i>To Be Groomed</i> to <i>2019-06-05 Sprint</i></li></ul> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=750452019-05-31T18:54:20ZWard Vandewegeward@curii.com
<ul></ul><p>15093-move-collection-update-out-of-band up for review at <a class="changeset" title="Move the population of the new columns on the collections table to a standalone script that shoul..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/0d8adf9bb22e169fb47d64ca19045283ff5fafd1">0d8adf9bb22e169fb47d64ca19045283ff5fafd1</a></p> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=750462019-05-31T19:21:50ZEric Biagiotti
<ul></ul><p>Ward Vandewege wrote:</p>
<blockquote>
<p>15093-move-collection-update-out-of-band up for review at <a class="changeset" title="Move the population of the new columns on the collections table to a standalone script that shoul..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/0d8adf9bb22e169fb47d64ca19045283ff5fafd1">0d8adf9bb22e169fb47d64ca19045283ff5fafd1</a></p>
</blockquote>
<p>Just a minor note. Because of the addition of the <code>file_count=0</code> in the where clause, the <code>distinct_pdh_count</code> query could potentially return a number greater than the total number of pdhs processed and the logging in <code>group_pdhs_for_multiple_transactions</code> would be inaccurate. This doesn't affect actual collection processing though. Could just add the same where clause to <code>distinct_pdh_count</code> query.</p>
<p>Otherwise, this LGTM.</p> Arvados - Idea #15093: Work with Ops to decide best DB migration strategy for collection file count & sizehttps://dev.arvados.org/issues/15093?journal_id=750492019-05-31T20:09:45ZWard Vandewegeward@curii.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>100</i></li></ul><p>Applied in changeset <a class="changeset" title="Merge branch '15093-move-collection-update-out-of-band' into 1.4-dev closes #15093 Arvados-DCO-..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/d7775a8a4f85771a4bf2ac6165561f0d4393060a">arvados|d7775a8a4f85771a4bf2ac6165561f0d4393060a</a>.</p>