Project

General

Profile

Actions
Copy link

Idea #9046

closed

[Crunch2] Can issue container request to pull and import Docker images

Added by Brett Smith about 8 years ago. Updated over 1 year ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
Story points:
-

Description

Goal: system can get Docker images from external registries into Arvados instead of only doing it on the client side. For example, submitting a container request through Workbench.

  • Requires a way to submit container requests that are permitted to do Docker operations like "pull" and "save".
  • To pull from external Docker registry, container cannot be firewalled
  • Implemented as either alternate mode for crunch-run (pull/save instead of run) with a special format container request (TBD, but potentially command "crunch pull")
Rejected implementation alternative:
  • alternate task runner (crunch-pull?) with new table for docker image requests?

Related issues

Related to Arvados - Bug #10696: [CWL] Tries to run docker inside container where docker is not available, gives IOErrorNewActions
Related to Arvados Epics - Idea #13080: Create/upload workflows through WorkbenchNewActions
Related to Arvados - Idea #11162: [GA4GH] Support workflow execution APIResolvedPeter Amstutz05/11/2018Actions
Has duplicate Arvados - Idea #11742: [API Server] Support for pulling Docker images and uploading them to KeepDuplicateActions
Has duplicate Arvados - Idea #11724: Pull Docker images without requiring Docker on clientResolvedTom Clegg12/06/2022Actions
Actions
Copy link
 #1

Updated by Peter Amstutz about 7 years ago

  • Description updated (diff)
Actions
Copy link
 #2

Updated by Tom Morris almost 7 years ago

  • Description updated (diff)
  • Target version set to 2017-06-21 sprint
  • Story points set to 2.0
  • Release deleted (11)
Actions
Copy link
 #3

Updated by Peter Amstutz almost 7 years ago

  • Subject changed from [Crunch2] Running CWL issues a container request to download and register required Docker images to [Crunch2] Can issue container request to download and register Docker images
Actions
Copy link
 #4

Updated by Peter Amstutz almost 7 years ago

  • Subject changed from [Crunch2] Can issue container request to download and register Docker images to [Crunch2] Can issue container request to pull and import Docker images
Actions
Copy link
 #5

Updated by Peter Amstutz almost 7 years ago

For this to be useful, arvados-cwl-runner support is also required. Should probably be a separate task on this ticket?

Actions
Copy link
 #6

Updated by Peter Amstutz almost 7 years ago

Another way to go is to contribute support for exporting docker tarballs to https://github.com/projectatomic/skopeo

Actions
Copy link
 #8

Updated by Tom Morris almost 7 years ago

  • Target version changed from 2017-06-21 sprint to Arvados Future Sprints
Actions
Copy link
 #9

Updated by Tom Morris about 6 years ago

  • Related to Idea #13080: Create/upload workflows through Workbench added
Actions
Copy link
 #11

Updated by Peter Amstutz almost 6 years ago

  • Related to Idea #11162: [GA4GH] Support workflow execution API added
Actions
Copy link
 #12

Updated by Peter Amstutz almost 6 years ago

  • Has duplicate Idea #11724: Pull Docker images without requiring Docker on client added
Actions
Copy link
 #13

Updated by Peter Amstutz about 5 years ago

  • Target version changed from Arvados Future Sprints to To Be Groomed
Actions
Copy link
 #14

Updated by Peter Amstutz about 5 years ago

  • Story points deleted (2.0)
Actions
Copy link
 #16

Updated by Peter Amstutz almost 3 years ago

  • Target version deleted (To Be Groomed)
Actions
Copy link
 #17

Updated by Tom Clegg over 1 year ago

  • Status changed from New to Closed

see #11724

Actions
Copy link

Also available in: Atom PDF