Project

General

Profile

Idea #8645

Updated by Peter Amstutz about 8 years ago

Goal: In crunch v2, users can easily treat a pipeline instance and its resources as a single unit for permissions and replication purposes.    This consists of: 

 * Inputs collections 
 * Docker images 
 * Git repositories 
 * Container requests 
 * Container logs 
 * Output collections 

 When running a pipeline, a new group of type "pipeline" is created.    Inputs are copied to the pipeline group and outputs are owned by the pipeline group. 

 Pipelines get special treatment in Workbench. 

 Allow git repository objects to be owned by projects and pipelines.    Support efficient cloning of the repository on the backend (similar to the github "fork this repo" button). 

 Could have API support to enforce pipelines as "read only" once they are completed running so they can't be changed. 

 Benefits: 

 * Everything is in one place, making provenance and sharing much easier 
 * Limited sharing easy to reason about: copying pipeline and then delete the parts you don't want to share. 

Back