Project

General

Profile

Idea #9780

Updated by Brett Smith over 7 years ago

Cluster administrators want to be able to dispatch work to SLURM with different options based on the size of the work.    For example, very-high-RAM jobs should go to a particular SLURM partition. 

 Implementation plan: run multiple dispatchers that are configured to accept different sets of containers based on their runtime constraints.    Administrators can then configure those dispatchers with different @SbatchArguments@ to dispatch jobs differently based on the runtime constraints. 

 Add configuration options to crunch-dispatch-slurm that encode a series of conditions on container runtime_constraints.    The dispatcher only tries to dispatch containers that meet all of the configured conditions.

Back