Feature #14713

crunch-dispatch-slurm uses cluster config file

Added by Peter Amstutz 6 months ago. Updated 3 days ago.

Status:
In Progress
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
07/18/2019
Due date:
% Done:

0%

Estimated time:
(Total: 0.00 h)
Story points:
1.0

Subtasks

Task #15439: Review 14713-cds-new-configIn ProgressPeter Amstutz


Related issues

Related to Arvados - Story #13648: [Epic] Use one cluster configuration file for all componentsNew

Associated revisions

Revision f0549691
Added by Peter Amstutz 7 days ago

Merge branch '14713-fix-master' refs #14713

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

History

#1 Updated by Peter Amstutz 6 months ago

  • Status changed from New to In Progress

#2 Updated by Peter Amstutz 6 months ago

  • Status changed from In Progress to New

#3 Updated by Peter Amstutz 6 months ago

  • Related to Story #13648: [Epic] Use one cluster configuration file for all components added

#4 Updated by Peter Amstutz 6 months ago

  • Tracker changed from Bug to Feature

#5 Updated by Lucas Di Pentima 6 months ago

Based on the documentation at https://doc.arvados.org/install/crunch2-slurm/install-dispatch.html

We may have multiple dispatchers so I think we would need a section for them, identified by hostname. AuthToken was included inside an individual dispatcher section because the docs say that every dispatcher should have its own token.

NodeProfiles:
  apiserver:
    Dispatcher: slurm1
Timers:
  MinRetryPeriod: 30s
  ContainerDispatchPollInterval: 10s (already listed on the wiki)
Dispatchers:
  slurm1:
    AuthToken: zzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz
    KeepServiceURIs:
      1: http://127.0.0.1:25107
    PrioritySpread: 1000
    SbatchArguments:
      partition: PartitionName
    CrunchRunParams:
      cgroup-parent-subsystem: memory
      container-enable-networking: always
      container-network-mode: host
    ReserveExtraRAM: 268435456

#6 Updated by Tom Morris 6 months ago

  • Target version changed from To Be Groomed to Arvados Future Sprints
  • Story points set to 1.0

#7 Updated by Tom Morris 19 days ago

  • Target version changed from Arvados Future Sprints to 2019-07-17 Sprint

#8 Updated by Tom Morris 19 days ago

  • Assigned To set to Peter Amstutz

#9 Updated by Peter Amstutz 7 days ago

  • Status changed from New to In Progress

#10 Updated by Peter Amstutz 5 days ago

  • Target version changed from 2019-07-17 Sprint to 2019-07-31 Sprint

#12 Updated by Eric Biagiotti 3 days ago

Peter Amstutz wrote:

14713-cds-new-config @ 726881f8950e4f361193a612c66c90ca9535e81a

https://ci.curoverse.com/view/Developer/job/developer-run-tests/1401/

I reviewed the code and don't have any comments, but there are some test failures on jenkins that need a look.

Also available in: Atom PDF