Feature #20825
Updated by Peter Amstutz over 1 year ago
Sort of like arv:RunInSingleContainer, we would like an option to take an invocation of a subworkflow and have it run with a separate workflow runner, e.g. arv:SeparateRunner.
The goal is for each subworkflow to show up as a separate step under the main workflow in workbench for ease of monitoring and debugging.
# Need to be able to submit each runner separately
# Need to be able to have custom names for the steps
# Support reuse of the subworkflow as a unit (without re-executing the workflow runner) if the subworkflow inputs/code haven't changed
Nice to haves:
# Feature to trap a failed step and produce null output, so that downstream steps can run even when some scattered subworkflows have failed.
Note: this is a way of incrementally achieving some of the goals of #20532, but doesn't do anything about the overhead of having lots of separate cwl-runner process.