Feature #20825
Updated by Peter Amstutz 10 months ago
Sort of like arv:RunInSingleContainer, we would like an option to take an invocation of a subworkflow and have it run with a separate workflow runner, e.g. arv:SeparateRunner. The goal is for each subworkflow to show up as a separate step under the main workflow in workbench for ease of monitoring and debugging. # Need to be able to submit each runner separately # Need to be able to have custom names for the steps # Support reuse of the subworkflow as a unit (without re-executing the workflow runner) if the subworkflow inputs/code haven't changed Nice to haves: # Feature to trap a failed step and produce null output, so that downstream steps can run even when some scattered subworkflows have failed. Note: this is a way of incrementally achieving some of the goals of #20532, but doesn't do anything about the overhead of having lots of separate arvados-cwl-runner cwl-runner process.