Project

General

Profile

Actions
Copy link

Feature #4528

closed

[Crunch] Dynamic task allocation based on job size determined at runtime

Added by Bryan Cosca about 10 years ago. Updated almost 5 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Crunch
Target version:
-
Story points:
-

Description

This doesn't work with tasks because I run out of memory often and need to parallelize between nodes instead of cores. ie. Haplotype caller and qr1hi-8i9sb-v57c4f1crumgppf

Related issues

Related to Arvados - Idea #3603: [Crunch] Design good Crunch task API, including considerations about "jobs-within-jobs" and "reusable tasks" ideasClosed08/27/2014Actions
Actions
Copy link
 #1

Updated by Brett Smith almost 10 years ago

  • Subject changed from Crunch/Run-command is able to allocate n-nodes based on how many samples you want to parallelize to [Crunch] Dynamic task allocation based on job size determined at runtime
  • Category set to Crunch
Actions
Copy link
 #2

Updated by Peter Amstutz almost 5 years ago

  • Status changed from New to Closed
Actions
Copy link

Also available in: Atom PDF