Story #8857

[CWL] arvados-cwl-runner additional options for job reuse

Added by Peter Amstutz about 5 years ago. Updated about 5 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
03/31/2016
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
0.5

Description

Want to be able to provide a command line flag to attempt more aggressive re-use of past jobs by ignoring changes in docker images.


Subtasks

Task #8858: Review 8857-cwl-job-reuseResolvedSarah Guthrie

Associated revisions

Revision 75ed52bf
Added by Peter Amstutz about 5 years ago

Merge branch '8857-cwl-job-reuse' closes #8857

Revision 9c3de737 (diff)
Added by Peter Amstutz about 5 years ago

Add args.ignore_docker_for_reuse=False to cwl-runner crunch script. refs #8857

History

#1 Updated by Peter Amstutz about 5 years ago

  • Description updated (diff)

#2 Updated by Peter Amstutz about 5 years ago

  • Target version set to 2016-04-13 sprint

#3 Updated by Peter Amstutz about 5 years ago

  • Status changed from New to In Progress

#4 Updated by Sarah Guthrie about 5 years ago

  • Assigned To set to Peter Amstutz

#5 Updated by Peter Amstutz about 5 years ago

I figured out why ignoring docker wasn't reusing jobs. #8815 also removed the "crunchrunner" field, which means the script_parameters are not the same. The API server requires that two jobs have the same script_parameters for reuse so the custom filter added in this story that allows us to ignore changes in the docker image doesn't apply in your specific case.

#6 Updated by Peter Amstutz about 5 years ago

The good news is since #8815 removes the need to have the "crunchrunner" field in script_parameters, this specific problem won't be a problem in the future.

#7 Updated by Peter Amstutz about 5 years ago

  • Status changed from In Progress to Resolved
  • % Done changed from 0 to 100

Applied in changeset arvados|commit:75ed52bfd557502aa04d413cdfb4f798af7cec66.

Also available in: Atom PDF