Project

General

Profile

Actions

Bug #19688

closed

Launch registered workflows faster

Added by Peter Amstutz 3 months ago. Updated about 1 month ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
CWL
Target version:
Start date:
11/14/2022
Due date:
% Done:

100%

Estimated time:
(Total: 0.00 h)
Story points:
-
Release relationship:
Auto

Description

Launching very large registered workflows is slow and this is a big problem. Related, registered workflows can be huge records that make project list responses slow.

Fast launch

Assume that the workflow has been fully processed. Make a fast path which takes the workflow as-is and constructs a container request.

Lightweight records

Copy the input and output sections into a wrapper workflow. The wrapper workflow has one step that invokes the real workflow, which is stored in a collection.


Files


Subtasks 1 (0 open1 closed)

Task #19719: Review 19688-cwl-fast-pathResolvedLucas Di Pentima11/14/2022

Actions

Related issues

Related to Arvados Epics - Story #17848: CWL runner improvementsIn Progress07/01/202106/30/2023

Actions
Related to Arvados - Bug #19699: HTTP download creates collections with too-long names, needs flag to run in runner process after submissionResolvedPeter Amstutz11/14/2022

Actions
Actions

Also available in: Atom PDF