Project

General

Profile

Actions

Feature #12345

open

[CWL] Use arv-put collection caching for file uploads

Added by Peter Amstutz about 7 years ago. Updated 9 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

arvados-cwl-runner uses arvados.commands.run.uploadfiles() to handle file uploads. However, this uploads all files every time. Arv-put has a local metadata cache for resuming uploads that may be usable here to avoid re-uploading local files that have already been uploaded and are unchanged.


Related issues

Related to Arvados - Idea #11163: [GA4GH] Participate in DREAM workflow interoperability activitiesResolvedPeter AmstutzActions
Actions #1

Updated by Peter Amstutz about 7 years ago

  • Tracker changed from Bug to Feature
  • Description updated (diff)
Actions #2

Updated by Peter Amstutz almost 2 years ago

  • Release set to 60
Actions #3

Updated by Peter Amstutz 9 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF