Project

General

Profile

Actions

Bug #12568

closed

[CWL] Cap size of collection cache

Added by Peter Amstutz over 6 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Story points:
-

Description

The collection cache in arvados-cwl-runner is unbounded. When running workflows with many very large collections, this can result in gigabytes of RAM usage (requiring larger nodes for the workflow runner) and difficult to debug out of memory failures. It should manage the collection cache in order to cap RAM usage.


Subtasks 1 (0 open1 closed)

Task #12569: Review 12568-cwl-collection-cacheResolvedPeter Amstutz11/07/2017Actions
Actions

Also available in: Atom PDF