https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422016-04-27T20:01:03ZArvadosArvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=383772016-04-27T20:01:03ZTom Cleggtom@curii.com
<ul><li><strong>Target version</strong> set to <i>2016-05-11 sprint</i></li></ul> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=383792016-04-27T20:01:22ZTom Cleggtom@curii.com
<ul><li><strong>Assigned To</strong> set to <i>Peter Amstutz</i></li><li><strong>Story points</strong> set to <i>1.0</i></li></ul> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=383902016-04-27T20:25:39ZRadhika Chippadaradhika@curoverse.com
<ul><li><strong>Assigned To</strong> changed from <i>Peter Amstutz</i> to <i>Radhika Chippada</i></li></ul> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=384052016-04-28T13:31:20ZTom Cleggtom@curii.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/38405/diff?detail_id=37476">diff</a>)</li></ul> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=385572016-05-03T13:40:38ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p><a class="external" href="http://slurm.schedmd.com/sbatch.html">http://slurm.schedmd.com/sbatch.html</a></p>
<p>--mem=<MB></p>
<p>--cpus-per-task=<ncpus></p> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=385622016-05-03T14:13:02ZTom Cleggtom@curii.com
<ul><li><strong>Description</strong> updated (<a title="View differences" href="/journals/38562/diff?detail_id=37599">diff</a>)</li></ul> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=386122016-05-03T18:52:22ZRadhika Chippadaradhika@curoverse.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=386142016-05-03T19:16:59ZRadhika Chippadaradhika@curoverse.com
<ul></ul><p>The story description said: (1) The Container record's runtime_constraints hash is expected to have a numeric value for each element, (2) Every Container record is guaranteed to have a value for "ram" and "vcpus" by the time it's eligible for dispatch.</p>
<ul>
<li>Based on this, I updated the slurm dispatch code to expect these numeric runtime_constraints in the Container record and pass them to sbatch command.</li>
</ul>
<ul>
<li>I used strconv.Itoa to pass the numeric values as strings to sbatch. Please let me know if this needs any corrections.</li>
</ul>
<p>Commit <a class="changeset" title="8017: pass ram and vcpus runtime_constraints from Container to sbatch command." href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/f1adedeba07502273d39084d4ff3645b30067579">f1adedeb</a></p> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=388082016-05-09T14:12:14ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>A careful reading of the SLURM page suggests that we should be using --mem-per-cpu instead of --mem. So, you need to divide <code>ram</code> by the number of cpus and round up. Also, the slurm --mem-per-cpu option takes MegaBytes but the crunch v2 API gives RAM in bytes. You need to divide by 2^20 and round up.</p> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=388182016-05-09T16:10:00ZRadhika Chippadaradhika@curoverse.com
<ul></ul><p>Thanks Peter. Updated per note 9 at <a class="changeset" title="8017: mem-per-cpu" href="https://dev.arvados.org/projects/arvados/repository/arvados/revisions/b5e2bbb94cd7e121d4b8d83af86ef0ab0c449dcf">b5e2bbb9</a></p> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=388442016-05-10T14:49:33ZPeter Amstutzpeter.amstutz@curii.com
<ul></ul><p>One more tweak, this should be int64 instead of int because int in Go can be either 32 or 64 bits.</p>
<pre>
RuntimeConstraints map[string]int `json:"runtime_constraints"`
</pre> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=388562016-05-10T16:12:05ZRadhika Chippadaradhika@curoverse.com
<ul></ul><p>Updated to RuntimeConstraints to use int64. Thanks.</p> Arvados - Feature #8017: [Crunch2] support runtime constraintshttps://dev.arvados.org/issues/8017?journal_id=388782016-05-10T17:40:09ZRadhika Chippadaradhika@curoverse.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Resolved</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>100</i></li></ul><p>Applied in changeset arvados|commit:a32c69b81296860a30cc33909226d9294f411adf.</p>