Project

General

Profile

Actions

Bug #18618

open

Reusing workflows/steps is too slow

Added by Ward Vandewege over 1 year ago. Updated 4 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-
Release:
Release relationship:
Auto

Description

Arvados takes too long to figure out if a workflow or step has already been run and can be reused.

A user reported that it can take ~1 minute for that determination to be made.

Actions #1

Updated by Ward Vandewege over 1 year ago

  • Description updated (diff)
  • Subject changed from It takes too long for job reuse cache hits to be returned to Reusing workflows/steps is too slow
Actions #2

Updated by Peter Amstutz over 1 year ago

They could try increasing the number of submit threads, eg --thread-count=4

Actions #4

Updated by Peter Amstutz 4 months ago

  • Release set to 60
Actions #5

Updated by Brett Smith 4 months ago

IMO we should close this as NEEDSINFO. I doubt we're going to be able to take action on this without more information about where the slowness was (a-c-r, API server, whatever) and what the workflow looked like. And I'm guessing there's no way to get that information now.

Actions

Also available in: Atom PDF