Project

General

Profile

Running Common Workflow Language (CWL) workflows on Arvados » History » Revision 3

Revision 2 (Peter Amstutz, 11/12/2015 02:31 PM) → Revision 3/4 (Peter Amstutz, 11/12/2015 02:31 PM)

h1. Running Common Workflow Language (CWL) workflows on Arvados 

 "Common Workflow Language (CWL)":http://commonwl.org is an emerging standard for describing portable, cross-platform workflows.    The Arvados project has been involved in this effort from the very beginning, and is pleased to offer preliminary support for running CWL in Arvados. 

 The Arvados CWL runner is located at "arvados/sdk/cwl" in the Arvados source tree.    The Python package is called "arvados-cwl-runner".    You can also install from PyPi: 

 <pre> 
 $ pip install arvados-cwl-runner 
 </pre> 

 If you are using a shell account on a Curoverse-hosted cluster, your environment is already set up.    Otherwise, first [set up your environment](http://doc.arvados.org/user/reference/api-tokens.html) (see also [[Arvswitch]] to help manage your Arvados credentials.) 

 If a pipeline inputs refer to local files, they will be uploaded before running the pipeline.    You can also reference files already in Keep by prefixing "keep:" for example "keep:d341a6f1db391a780d694e240e95e475+3805/lobstr_v3.0.2_hg19_ref/lobSTR_ref.fasta". 

 See the "lobSTR":https://github.com/common-workflow-language/workflows/blob/master/workflows/lobSTR/ [lobSTR](https://github.com/common-workflow-language/workflows/blob/master/workflows/lobSTR/) pipeline for an example.