Project

General

Profile

Actions

Idea #12060

closed

[CWL] Run from composer

Added by Peter Amstutz over 6 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Start date:
Due date:
Story points:
-

Description

Goal: have arvados-cwl-runner execute CWL files from a git branch as written, avoiding the "packing" step.

Execution:

  1. crunch-run can mount git repositories (#8311)
  2. arvados-cwl-runner, running inside container, uploads file references to Keep and updates internal workflow references to maintain job reuse.

UI:

  1. User loads the CWL file in Composer
  2. Pushes a "Run" button
  3. Composer creates a container request
    1. Puts minimal input description in "workflow.json" where workbench knows to look for it
    2. Put real workflow at a different mount point with reference to git repo & commit
    3. Command line references real workflow
  4. Composer opens workbench page for container request in a new tab

Related issues

Blocked by Arvados - Feature #8311: [Crunch2] git tree mount pointsResolvedTom Clegg12/14/2017Actions
Actions #1

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)
Actions #2

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)
Actions #3

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)
Actions #4

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)
Actions #5

Updated by Tom Morris over 6 years ago

  • Target version set to Arvados Future Sprints
Actions #6

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)
Actions #7

Updated by Tom Morris over 6 years ago

  • Target version changed from Arvados Future Sprints to To Be Groomed
Actions #8

Updated by Peter Amstutz over 6 years ago

  • Target version changed from To Be Groomed to 2017-12-20 Sprint
Actions #9

Updated by Peter Amstutz over 6 years ago

  • Assigned To set to Peter Amstutz
Actions #10

Updated by Peter Amstutz over 6 years ago

  • Description updated (diff)

The cwlviewer has a scheme for permalinks to CWL files hosted in git:

https://github.com/common-workflow-language/cwlviewer/wiki/Permalinks

Actions #11

Updated by Peter Amstutz over 6 years ago

  • Subject changed from [CWL] Run directly from git to [CWL] Run from composer
Actions #12

Updated by Peter Amstutz over 6 years ago

  • Status changed from New to In Progress
Actions #13

Updated by Peter Amstutz over 6 years ago

  • Status changed from In Progress to Resolved

Works, merged.

Actions

Also available in: Atom PDF