Project

General

Profile

Actions

Idea #9780

closed

[Crunch2] crunch-dispatch-slurm only dispatches containers that meet specific runtime constraint criteria

Added by Brett Smith over 7 years ago. Updated about 4 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
08/12/2016
Due date:
Story points:
-

Description

Cluster administrators want to be able to dispatch work to SLURM with different options based on the size of the work. For example, very-high-RAM jobs should go to a particular SLURM partition.

Implementation plan: run multiple dispatchers that are configured to accept different sets of containers based on their runtime constraints. Administrators can then configure those dispatchers with different SbatchArguments to dispatch jobs differently based on the runtime constraints.

Add configuration options to crunch-dispatch-slurm that encode a series of conditions on container runtime_constraints. The dispatcher only tries to dispatch containers that meet all of the configured conditions.

Actions

Also available in: Atom PDF