Story #15580

[CWL] Register workflow and run from git repo

Added by Peter Amstutz about 1 month ago. Updated about 1 month ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

For additional background, see discussion on #15535

Want to run user CWL from git commit to an arvados-managed git repo. This is because the preferred development process is to store your CWL in a git repo, because git is good for managing code over time.

At CLI: detect when being run with the CWD inside a git repo. Get the current revision. Determine the repo uuid by looking at repo remotes. Make sure the working directory doesn't have uncommitted changes, and check that the current version is pushed. Submit a container request that mounts the git repo at the current version and runs the workflow.

At workbench: to register workflow record, create a wrapper workflow that has the same input/output interface as the workflow, with a single step with a run line like:

run: arv-git:repo/revision/file

To submit the workflow, workbench introspects the step and sets up the correct git mount.


Related issues

Related to Arvados - Story #15535: [CWL] Run from original CWL, not packedNew

History

#1 Updated by Peter Amstutz about 1 month ago

  • Status changed from New to In Progress

#2 Updated by Peter Amstutz about 1 month ago

  • Related to Story #15535: [CWL] Run from original CWL, not packed added

#3 Updated by Peter Amstutz about 1 month ago

  • Status changed from In Progress to New
  • Description updated (diff)

#4 Updated by Peter Amstutz about 1 month ago

  • Description updated (diff)

Also available in: Atom PDF