Story #16447

Improve container image handling

Added by Peter Amstutz over 1 year ago. Updated about 2 months ago.

Status:
In Progress
Priority:
Normal
Assigned To:
-
Target version:
-
Start date:
10/01/2021
Due date:
01/31/2022
% Done:

0%

Estimated time:
Story points:
-
Release:
Release relationship:
Auto

Description

We want to improve UX for common workflows like:
  • Use Workbench2 (and no shell node) to run a workflow that depends on docker images that are available on dockerhub
  • Build an image from a Dockerfile or git repo, and use that image to run Arvados containers without pushing it to dockerhub
  • Build an image and share it with other users on your cluster without pushing it to dockerhub
  • Share a project that contains a workflow execution plus all of the docker images needed to re-run it even after the referenced images on dockerhub/arvados have been updated or removed
Outline of tentative implementation strategy
  • Each cluster has a "docker images" project. Any user with username X can use arv-keepdocker (or a new arvados-client command?) to save docker images in a subproject named X. A container request with container image "arvados:X/Y" will use the image saved in the collection named Y in the subproject named X, subject to usual permissions.
  • A container request with container image "docker:abc/def" causes Arvados to fetch/update "abc/def" from dockerhub into an arvados collection, and use that collection PDH as the image in the resulting container.

History

#1 Updated by Peter Amstutz over 1 year ago

  • Start date set to 06/01/2021
  • Due date set to 09/01/2021

#2 Updated by Peter Amstutz 8 months ago

  • Start date changed from 06/01/2021 to 01/01/2021
  • Due date changed from 09/01/2021 to 06/30/2021

#3 Updated by Peter Amstutz 8 months ago

  • Status changed from New to In Progress

#4 Updated by Peter Amstutz 7 months ago

  • Start date changed from 01/01/2021 to 09/01/2021
  • Due date changed from 06/30/2021 to 12/31/2021

#5 Updated by Tom Clegg 3 months ago

  • Description updated (diff)

#6 Updated by Peter Amstutz about 2 months ago

  • Start date changed from 09/01/2021 to 10/01/2021
  • Due date changed from 12/31/2021 to 01/31/2022

Also available in: Atom PDF