Project

General

Profile

Actions

Idea #9463

closed

[SDKs] Change arv-put to use the Collection class under the hood

Added by Brett Smith almost 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Story points:
0.5

Description

Right now arv-put does uploads using the CollectionWriter class. Reimplement it so that it uploads using the Collection class rather than CollectionWriter.

There should be no UI or UX changes as part of this story. No new command line switches, no new output. The organization of files inside collections should remain as it is now. It is OK if the implementation divides blocks differently than the current version, as long as the end result is the same when you re-get the collection.

Doing this will enable further development we're interested in like #8910.

Acceptance criteria:

  • Must maintain existing command line behavior.
  • Must be able to resume from interrupted upload, including the middle of large files
  • On resume, must detect if previously uploaded files on disk have changed and re-upload
  • If saving a partial collection, must not save it under the user-provided destination name and project (either save the manifest locally, or alter the destination name when saving an incomplete collection, like rsync)

Subtasks 2 (0 open2 closed)

Task #9468: Review 9463-change-arvput-use-collection-classResolvedLucas Di Pentima07/11/2016Actions
Task #9631: Write new tests on Python SDK arv_put.ArvPutUploadJob classResolvedLucas Di Pentima07/19/2016Actions

Related issues

Blocks Arvados - Bug #8910: [SDK] arv-put should save manifest text on API errorResolvedLucas Di PentimaActions
Blocked by Arvados - Bug #9701: [SDKs] Python SDK Collection class should pack small files into large data blocksResolvedLucas Di Pentima08/03/2016Actions
Actions

Also available in: Atom PDF