Project

General

Profile

Federation implementation roadmap » History » Version 8

Tom Clegg, 08/21/2018 06:14 PM

1 1 Tom Clegg
h1. Federation implementation roadmap
2
3 6 Tom Clegg
Use a remote-hosted workflow #13493
4 1 Tom Clegg
5
* When retrieving a workflow record for arvados-cwl-runner, API server notices workflow UUID is remote, and fetches it with salted token (instead of looking in local DB)
6
7 5 Tom Clegg
Mount remote-hosted collection (read-only) - [[Federated collections]]
8 1 Tom Clegg
9 7 Peter Amstutz
* (controller) fetch remote-hosted container by UUID (similar to workflow case) (#13993)
10
* (controller) rewrite locators in manifest to indicate remote cluster  (#13993)
11
* (keepstore) if locator indicates remote cluster and data does not exist locally (or local signature is not supplied), fetch from remote using salted token (#13994)
12 5 Tom Clegg
13
Mount remote-hosted collection (read-only) in a container
14
15 8 Tom Clegg
* When creating a container to satisfy a CR, Rails API assumes any PDH appearing in the CR mounts is OK.
16
* When running the container, arv-mount (and any other client) will go through the controller to get the collection, and the controller will search the federation for any PDH not found (or not readable by the acting user) in the local DB.
17 1 Tom Clegg
18
Run some portions of a CWL workflow on a remote cluster
19
20
* When submitting container requests, a-c-r follows workflow/commandline/input UUID hints to choose a cluster
21
* Either a-c-r handles the multi-cluster stuff itself, or it submits CRs with "submit to cluster X" flag, and the API server acts as a proxy