Project

General

Profile

Actions

Idea #14923

open

[CWL] Reduce memory footprint by using webdav to get file/dir listings in collections (instead of Python SDK)

Added by Tom Clegg about 5 years ago. Updated 28 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

The hope is to reduce arvados-cwl-runner's memory requirement enough to run several a-c-r containers at once on a single low-cost node (see #14922).

Depending on how much work this is to implement/test, it may be worth first instrumenting a-c-r and predicting the impact on memory footprint and runtime (e.g., webdav cache hits will be slower than in-process Python SDK cache hits).

Actions #1

Updated by Peter Amstutz over 2 years ago

  • Target version deleted (To Be Groomed)
Actions #2

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions #3

Updated by Peter Amstutz 28 days ago

  • Target version set to Future
Actions

Also available in: Atom PDF