Story #12060

[CWL] Run from composer

Added by Peter Amstutz about 2 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

Goal: have arvados-cwl-runner execute CWL files from a git branch as written, avoiding the "packing" step.

Execution:

  1. crunch-run can mount git repositories (#8311)
  2. arvados-cwl-runner, running inside container, uploads file references to Keep and updates internal workflow references to maintain job reuse.

UI:

  1. User loads the CWL file in Composer
  2. Pushes a "Run" button
  3. Composer creates a container request
    1. Puts minimal input description in "workflow.json" where workbench knows to look for it
    2. Put real workflow at a different mount point with reference to git repo & commit
    3. Command line references real workflow
  4. Composer opens workbench page for container request in a new tab

Related issues

Blocked by Arvados - Feature #8311: [Crunch2] git tree mount pointsResolved12/14/2017

Associated revisions

Revision 335b2d29 (diff)
Added by Peter Amstutz over 1 year ago

Add Content-Type to Access-Control-Allow-Headers CORS headers refs #12060

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

Revision 6d4667c5 (diff)
Added by Peter Amstutz over 1 year ago

Fix Access-Control-Allow-Headers CORS header tests refs #12060

Arvados-DCO-1.1-Signed-off-by: Peter Amstutz <>

History

#1 Updated by Peter Amstutz about 2 years ago

  • Description updated (diff)

#2 Updated by Peter Amstutz about 2 years ago

  • Description updated (diff)

#3 Updated by Peter Amstutz about 2 years ago

  • Description updated (diff)

#4 Updated by Peter Amstutz about 2 years ago

  • Description updated (diff)

#5 Updated by Tom Morris almost 2 years ago

  • Target version set to Arvados Future Sprints

#6 Updated by Peter Amstutz almost 2 years ago

  • Description updated (diff)

#7 Updated by Tom Morris over 1 year ago

  • Target version changed from Arvados Future Sprints to To Be Groomed

#8 Updated by Peter Amstutz over 1 year ago

  • Target version changed from To Be Groomed to 2017-12-20 Sprint

#9 Updated by Peter Amstutz over 1 year ago

  • Assigned To set to Peter Amstutz

#10 Updated by Peter Amstutz over 1 year ago

  • Description updated (diff)

The cwlviewer has a scheme for permalinks to CWL files hosted in git:

https://github.com/common-workflow-language/cwlviewer/wiki/Permalinks

#11 Updated by Peter Amstutz over 1 year ago

  • Subject changed from [CWL] Run directly from git to [CWL] Run from composer

#12 Updated by Peter Amstutz over 1 year ago

  • Status changed from New to In Progress

#13 Updated by Peter Amstutz over 1 year ago

  • Status changed from In Progress to Resolved

Works, merged.

Also available in: Atom PDF