Project

General

Profile

Actions

Idea #15580

open

[CWL] Register workflow and run from git repo

Added by Peter Amstutz over 5 years ago. Updated 9 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Start date:
Due date:
Story points:
-
Release:
Release relationship:
Auto

Description

For additional background, see discussion on #15535

Want to run user CWL from git commit to an arvados-managed git repo. This is because the preferred development process is to store your CWL in a git repo, because git is good for managing code over time.

At CLI: detect when being run with the CWD inside a git repo. Get the current revision. Determine the repo uuid by looking at repo remotes. Make sure the working directory doesn't have uncommitted changes, and check that the current version is pushed. Submit a container request that mounts the git repo at the current version and runs the workflow.

At workbench: to register workflow record, create a wrapper workflow that has the same input/output interface as the workflow, with a single step with a run line like:

run: arv-git:repo/revision/file

To submit the workflow, workbench introspects the step and sets up the correct git mount.


Related issues

Related to Arvados - Idea #15535: [CWL] Run from original CWL, not packedResolvedActions
Actions #1

Updated by Peter Amstutz over 5 years ago

  • Status changed from New to In Progress
Actions #2

Updated by Peter Amstutz over 5 years ago

  • Related to Idea #15535: [CWL] Run from original CWL, not packed added
Actions #3

Updated by Peter Amstutz over 5 years ago

  • Description updated (diff)
  • Status changed from In Progress to New
Actions #4

Updated by Peter Amstutz over 5 years ago

  • Description updated (diff)
Actions #5

Updated by Peter Amstutz over 3 years ago

  • Target version deleted (To Be Groomed)
Actions #6

Updated by Peter Amstutz almost 2 years ago

  • Release set to 60
Actions #7

Updated by Peter Amstutz 9 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF