Project

General

Profile

Common Workflow Language integration with Arvados » History » Revision 4

Revision 3 (Peter Amstutz, 08/08/2016 02:35 PM) → Revision 4/7 (Peter Amstutz, 08/08/2016 02:35 PM)

h1. Common Workflow Language integration with Arvados 

 The main integration is @arvados-cwl-runner@.    This tool is used both as a client to submit a job to run the workflow (@arvados-cwl-runner --submit@) and for running the workflow directly (@arvados-cwl-runner --local@).    When the user starts a CWL workflow from workbench, it functions similar to @--submit@ mode. 

 Because submit mode works by creating a "runner" job whose purpose is to manage execution of the workflow, it requires an @arvados/jobs@ Docker image with an up-to-date @arvados-cwl-runner@. 

 When running a workflow, the workflow runner: 
 # creates a job for each workflow steps 
 # submits it 
 # waits for it to complete 
 # gets the output collection for the job  
 # computes the CWL output object for the workflow step. 

 !cwl-arvados-flow-local.png! 

 !cwl-arvados-flow-submit.png!