Project

General

Profile

Actions

Bug #14710

open

[Workbench] Child containers run on federated clusters do not show up

Added by Peter Amstutz over 5 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Story points:
3.0
Release:
Release relationship:
Auto

Description

Child containers are determined by querying for container requests where requested_by_container_uuid matches the parent container. This does not work for federated workflows, because (a) containers run on remote clusters don't set requested_by_container_uuid and (b) even if it was set, we don't have an easy way to query remotes (requires either #14374 or generalizing javascript multi-site search feature).

Solution:

  1. When controller creates a remote container request, it can supply requested_by_container_uuid
  2. Controller records the uuid of the remote container request, and saves a cache copy of container request record in the local database with the appropriate requested_by_container_uuid
  3. The client can filter on requested_by_container_uuid in the local database and get both local and remote container requests.
  4. When a client makes a list or get request that returns remote objects, fetch the latest records from the remote cluster and merge the updated records into the response. (And update the cached copy?)

What should the owner_uuid by on the cache copy?


Related issues

Related to Arvados - Idea #14374: Multi-site (federated) object search in controllerNewActions
Related to Arvados Workbench 2 - Feature #15278: [Workbench 2] Search for & execute workflows defined on federated clustersNewActions
Related to Arvados - Feature #15457: [Controller] Delegate new container requests to other clusters based on location of input dataNewActions
Actions #1

Updated by Peter Amstutz over 5 years ago

  • Status changed from New to In Progress
Actions #2

Updated by Peter Amstutz over 5 years ago

  • Description updated (diff)
Actions #3

Updated by Tom Morris over 5 years ago

  • Status changed from In Progress to New
Actions #4

Updated by Tom Morris about 5 years ago

  • Related to Idea #14374: Multi-site (federated) object search in controller added
Actions #5

Updated by Peter Amstutz about 5 years ago

  • Description updated (diff)
Actions #6

Updated by Peter Amstutz about 5 years ago

  • Description updated (diff)
Actions #7

Updated by Peter Amstutz about 5 years ago

  • Description updated (diff)
  • Story points set to 3.0
Actions #8

Updated by Tom Morris about 5 years ago

  • Target version changed from To Be Groomed to Arvados Future Sprints
Actions #9

Updated by Peter Amstutz almost 5 years ago

  • Related to Idea #15455: Outputs of workflow runs get put into a default location other than the user's home project added
Actions #10

Updated by Peter Amstutz almost 5 years ago

  • Related to Feature #15278: [Workbench 2] Search for & execute workflows defined on federated clusters added
Actions #11

Updated by Peter Amstutz almost 5 years ago

  • Related to deleted (Idea #15455: Outputs of workflow runs get put into a default location other than the user's home project)
Actions #12

Updated by Tom Clegg almost 5 years ago

  • Related to Feature #15457: [Controller] Delegate new container requests to other clusters based on location of input data added
Actions #13

Updated by Peter Amstutz over 4 years ago

  • Release set to 20
  • Target version deleted (Arvados Future Sprints)
Actions #14

Updated by Peter Amstutz about 1 year ago

  • Release changed from 20 to 60
Actions #15

Updated by Peter Amstutz about 2 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF