Feature #12345

[CWL] Use arv-put collection caching for file uploads

Added by Peter Amstutz over 4 years ago. Updated over 4 years ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

arvados-cwl-runner uses arvados.commands.run.uploadfiles() to handle file uploads. However, this uploads all files every time. Arv-put has a local metadata cache for resuming uploads that may be usable here to avoid re-uploading local files that have already been uploaded and are unchanged.


Related issues

Related to Arvados - Story #11163: [GA4GH] Participate in DREAM workflow interoperability activitiesResolved

History

#1 Updated by Peter Amstutz over 4 years ago

  • Tracker changed from Bug to Feature
  • Description updated (diff)

Also available in: Atom PDF