Story #12666

--ignore-docker-for-reuse not passed to crunch v2 jobs started via --submit --no-wait

Added by Brad Chapman about 1 year ago. Updated 8 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Start date:
11/27/2017
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

I often make use of `--ignore-docker-for-reuse` during bcbio runs since I'll fix bugs, re-create and re-upload the bcbio Docker container, and then want to pick up the previous pipeline where it failed previously. This flag doesn't seem to get propagated to crunch v2 jobs sent with `--submit --no-wait`. Here's a job where it was included in the local command line but not present in the remote command:

https://cloud.curoverse.com/container_requests/qr1hi-xvhdp-hla84phxl1izc2p

and after changing only the Docker container, without updating the CWL, jobs don't take advantage of previous re-use. I'd be happy to try to put together a test case if it isn't easy to track down why this doesn't get propagated.

Associated revisions

Revision 5c0c6c7d (diff)
Added by Peter Amstutz 10 months ago

13090: Pass through --eval-timeout to container command line.

Also adds a check so that --ignore-docker-for-reuse can't be used with
containers, refs #12666

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

History

#1 Updated by Tom Morris about 1 year ago

  • Target version set to To Be Groomed

#2 Updated by Tom Morris about 1 year ago

  • Target version changed from To Be Groomed to 2017-12-20 Sprint

#3 Updated by Peter Amstutz about 1 year ago

  • Assigned To set to Peter Amstutz

#4 Updated by Peter Amstutz about 1 year ago

  • Tracker changed from Bug to Story
  • Target version changed from 2017-12-20 Sprint to Arvados Future Sprints

#5 Updated by Tom Morris 11 months ago

  • Assigned To deleted (Peter Amstutz)
  • Target version changed from Arvados Future Sprints to To Be Groomed

#6 Updated by Peter Amstutz 10 months ago

At first glace this would be easy but actually the problem is that crunch2 doesn't have a way of specifying "reuse container, but ignore Docker image".

Also available in: Atom PDF