Story #9046

[Crunch2] Can issue container request to pull and import Docker images

Added by Brett Smith over 5 years ago. Updated 3 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

Goal: system can get Docker images from external registries into Arvados instead of only doing it on the client side. For example, submitting a container request through Workbench.

  • Requires a way to submit container requests that are permitted to do Docker operations like "pull" and "save".
  • To pull from external Docker registry, container cannot be firewalled
  • Implemented as either alternate mode for crunch-run (pull/save instead of run) with a special format container request (TBD, but potentially command "crunch pull")
Rejected implementation alternative:
  • alternate task runner (crunch-pull?) with new table for docker image requests?

Related issues

Related to Arvados - Bug #10696: [CWL] Tries to run docker inside container where docker is not available, gives IOErrorNew

Related to Arvados Epics - Story #13080: Create/upload workflows through WorkbenchNew03/01/202206/30/2022

Related to Arvados - Story #11162: [GA4GH] Support workflow execution APIResolved05/11/2018

Has duplicate Arvados - Story #11742: [API Server] Support for pulling Docker images and uploading them to KeepDuplicate

Has duplicate Arvados - Story #11724: Pull Docker images without requiring Docker on clientNew

History

#1 Updated by Peter Amstutz over 4 years ago

  • Description updated (diff)

#2 Updated by Tom Morris over 4 years ago

  • Description updated (diff)
  • Target version set to 2017-06-21 sprint
  • Story points set to 2.0
  • Release deleted (11)

#3 Updated by Peter Amstutz over 4 years ago

  • Subject changed from [Crunch2] Running CWL issues a container request to download and register required Docker images to [Crunch2] Can issue container request to download and register Docker images

#4 Updated by Peter Amstutz over 4 years ago

  • Subject changed from [Crunch2] Can issue container request to download and register Docker images to [Crunch2] Can issue container request to pull and import Docker images

#5 Updated by Peter Amstutz over 4 years ago

For this to be useful, arvados-cwl-runner support is also required. Should probably be a separate task on this ticket?

#6 Updated by Peter Amstutz over 4 years ago

Another way to go is to contribute support for exporting docker tarballs to https://github.com/projectatomic/skopeo

#8 Updated by Tom Morris over 4 years ago

  • Target version changed from 2017-06-21 sprint to Arvados Future Sprints

#9 Updated by Tom Morris over 3 years ago

  • Related to Story #13080: Create/upload workflows through Workbench added

#11 Updated by Peter Amstutz over 3 years ago

  • Related to Story #11162: [GA4GH] Support workflow execution API added

#12 Updated by Peter Amstutz over 3 years ago

  • Has duplicate Story #11724: Pull Docker images without requiring Docker on client added

#13 Updated by Peter Amstutz over 2 years ago

  • Target version changed from Arvados Future Sprints to To Be Groomed

#14 Updated by Peter Amstutz over 2 years ago

  • Story points deleted (2.0)

#16 Updated by Peter Amstutz 3 months ago

  • Target version deleted (To Be Groomed)

Also available in: Atom PDF