Project

General

Profile

Actions

Idea #12666

open

--ignore-docker-for-reuse not passed to crunch v2 jobs started via --submit --no-wait

Added by Brad Chapman over 6 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Start date:
Due date:
Story points:
-
Release:
Release relationship:
Auto

Description

I often make use of `--ignore-docker-for-reuse` during bcbio runs since I'll fix bugs, re-create and re-upload the bcbio Docker container, and then want to pick up the previous pipeline where it failed previously. This flag doesn't seem to get propagated to crunch v2 jobs sent with `--submit --no-wait`. Here's a job where it was included in the local command line but not present in the remote command:

https://cloud.curoverse.com/container_requests/qr1hi-xvhdp-hla84phxl1izc2p

and after changing only the Docker container, without updating the CWL, jobs don't take advantage of previous re-use. I'd be happy to try to put together a test case if it isn't easy to track down why this doesn't get propagated.

Actions #1

Updated by Tom Morris over 6 years ago

  • Target version set to To Be Groomed
Actions #2

Updated by Tom Morris over 6 years ago

  • Target version changed from To Be Groomed to 2017-12-20 Sprint
Actions #3

Updated by Peter Amstutz over 6 years ago

  • Assigned To set to Peter Amstutz
Actions #4

Updated by Peter Amstutz over 6 years ago

  • Tracker changed from Bug to Idea
  • Target version changed from 2017-12-20 Sprint to Arvados Future Sprints
Actions #5

Updated by Tom Morris over 6 years ago

  • Assigned To deleted (Peter Amstutz)
  • Target version changed from Arvados Future Sprints to To Be Groomed
Actions #6

Updated by Peter Amstutz about 6 years ago

At first glace this would be easy but actually the problem is that crunch2 doesn't have a way of specifying "reuse container, but ignore Docker image".

Actions #7

Updated by Peter Amstutz almost 3 years ago

  • Target version deleted (To Be Groomed)
Actions #8

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions #9

Updated by Peter Amstutz about 2 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF