Common Workflow Language integration with Arvados » History » Version 4

Peter Amstutz, 08/08/2016 02:35 PM

1 1 Peter Amstutz
h1. Common Workflow Language integration with Arvados
2 1 Peter Amstutz
3 3 Peter Amstutz
The main integration is @arvados-cwl-runner@.  This tool is used both as a client to submit a job to run the workflow (@arvados-cwl-runner --submit@) and for running the workflow directly (@arvados-cwl-runner --local@).  When the user starts a CWL workflow from workbench, it functions similar to @--submit@ mode.
4 2 Peter Amstutz
5 2 Peter Amstutz
Because submit mode works by creating a "runner" job whose purpose is to manage execution of the workflow, it requires an @arvados/jobs@ Docker image with an up-to-date @arvados-cwl-runner@.
6 2 Peter Amstutz
7 2 Peter Amstutz
When running a workflow, the workflow runner:
8 2 Peter Amstutz
# creates a job for each workflow steps
9 2 Peter Amstutz
# submits it
10 2 Peter Amstutz
# waits for it to complete
11 2 Peter Amstutz
# gets the output collection for the job 
12 2 Peter Amstutz
# computes the CWL output object for the workflow step.
13 2 Peter Amstutz
14 1 Peter Amstutz
!cwl-arvados-flow-submit.png!