Project

General

Profile

Actions

Feature #12345

open

[CWL] Use arv-put collection caching for file uploads

Added by Peter Amstutz about 5 years ago. Updated about 5 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

arvados-cwl-runner uses arvados.commands.run.uploadfiles() to handle file uploads. However, this uploads all files every time. Arv-put has a local metadata cache for resuming uploads that may be usable here to avoid re-uploading local files that have already been uploaded and are unchanged.


Related issues

Related to Arvados - Story #11163: [GA4GH] Participate in DREAM workflow interoperability activitiesResolvedPeter Amstutz

Actions
Actions #1

Updated by Peter Amstutz about 5 years ago

  • Tracker changed from Bug to Feature
  • Description updated (diff)
Actions

Also available in: Atom PDF