https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422020-12-16T14:44:08ZArvadosArvados - Bug #17175: arv-boot sometimes fail to start (ie: WB2 integration tests)https://dev.arvados.org/issues/17175?journal_id=894522020-12-16T14:44:08ZLucas Di Pentimalucas.dipentima@curii.com
<ul><li><strong>Target version</strong> changed from <i>2020-12-16 Sprint</i> to <i>2021-01-06 Sprint</i></li></ul> Arvados - Bug #17175: arv-boot sometimes fail to start (ie: WB2 integration tests)https://dev.arvados.org/issues/17175?journal_id=895242020-12-28T20:42:17ZTom Cleggtom@curii.com
<ul><li><strong>Assigned To</strong> changed from <i>Lucas Di Pentima</i> to <i>Tom Clegg</i></li><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul><p>17175-boot-fail-rake-seed @ <a class="changeset" title="17175: Wait for seedDatabase before starting railsapi. If the rake task and the app start concur..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/e4a6240bf2ca163c36a4357ef0f80958c40bd39a">e4a6240bf2ca163c36a4357ef0f80958c40bd39a</a> -- <a class="external" href="https://ci.arvados.org/view/Developer/job/developer-run-tests/2237/"<a href="https://ci.arvados.org/view/Developer/job/developer-run-tests/2237/">developer-run-tests: #2237 <img src="https://ci.arvados.org/buildStatus/icon?job=developer-run-tests&build=2237" alt="" /></a></a></p>
<pre>
If the rake task and the app start concurrently, they both try to set
up the database seeds. The exclusive-locking mechanism in
services/api/app/lib/current_api_client.rb doesn't cover this case
because the rake task and app don't use the same cache. If the app
commits the database seeds between the rake task's "check existing"
and "commit" steps, commit fails and the rake task aborts.
</pre>
<p>(also included a fix for the logging labels that were showing the first argument ("-l" or "-D") instead of the program name ("initdb" or "postgres") in the setuidgid-wrapper case)</p> Arvados - Bug #17175: arv-boot sometimes fail to start (ie: WB2 integration tests)https://dev.arvados.org/issues/17175?journal_id=895302020-12-29T15:25:55ZTom Cleggtom@curii.com
<ul></ul><p>The database errors in the issue description are normal -- it seems we have a number of "FATAL" logs that are actually harmless -- but the attached <code>arvados-failed.log</code> file shows [what I think is] the rake-vs.-app race problem.</p> Arvados - Bug #17175: arv-boot sometimes fail to start (ie: WB2 integration tests)https://dev.arvados.org/issues/17175?journal_id=895312020-12-29T15:28:01ZLucas Di Pentimalucas.dipentima@curii.com
<ul></ul><p>The fix LGTM, I was suffering around 50% of failed test runs on <code>lib/controller</code> but after merging your branch the failures are gone. Thanks!</p> Arvados - Bug #17175: arv-boot sometimes fail to start (ie: WB2 integration tests)https://dev.arvados.org/issues/17175?journal_id=896042021-01-06T14:52:47ZTom Cleggtom@curii.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li></ul><p>Applied in changeset <a class="changeset" title="Merge branch '17175-boot-fail-rake-seed' fixes #17175 Arvados-DCO-1.1-Signed-off-by: Tom Clegg ..." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/1ce3429c4005567a450a28f774e3f543010cd5c6">arvados|1ce3429c4005567a450a28f774e3f543010cd5c6</a>.</p> Arvados - Bug #17175: arv-boot sometimes fail to start (ie: WB2 integration tests)https://dev.arvados.org/issues/17175?journal_id=986092021-11-16T16:47:43ZPeter Amstutzpeter.amstutz@curii.com
<ul><li><strong>Release</strong> set to <i>41</i></li></ul>