Project

General

Profile

Actions

Idea #20237

open

fair scheduling in cloud dispatcher

Added by Peter Amstutz about 1 year ago. Updated 12 months ago.

Status:
New
Priority:
Normal
Assigned To:
Category:
Crunch
Target version:
Story points:
-

Description

Customer expressed desire that when a workflow is submitted and then a new workflow is submitted later while the 1st workflow is still running, the dispatcher/scheduler should allocate scare resources between both workflows instead of the current priority system which is mostly first-come-first-served.

The scenario, as portrayed, is if there is a 5000 sample batch running, and another user submits a 10 sample test run, the 2nd user should not have to wait for the entire 5000 sample batch to complete before their run can make any progress.

Actions #1

Updated by Peter Amstutz about 1 year ago

  • Description updated (diff)
Actions #2

Updated by Peter Amstutz about 1 year ago

  • Description updated (diff)
Actions #3

Updated by Peter Amstutz 12 months ago

  • Assigned To set to Brett Smith

Brett will take a look at the literature about HPC scheduling and see if there's anything we can learn from it.

Actions

Also available in: Atom PDF