Feature #17351

[arv-put] Storage classes revisit

Added by Nico César 2 months ago. Updated 18 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Keep
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

Goals of this ticket:
  • to define the command line arguments to specify storage clases
  • to have all the expected behaviour for arv-put
  • to add to the documentation this behaviour
  • to add necesary tests to make sure we comply with this behaviour
to discuss:
  • shall we migrate arv-put to Go in this instance or is this a future work?

Current command line arguments (arvados 2.1.0) :

arv-put --help 
usage: arv-put [-h] [--version] [--normalize | --dry-run]
               [--as-stream | --stream | --as-manifest | --in-manifest | --manifest | --as-raw | --raw]
               [--update-collection UUID] [--use-filename FILENAME]
               [--filename FILENAME] [--portable-data-hash] [--replication N]
               [--storage-classes STORAGE_CLASSES] [--threads N]
               [--exclude PATTERN] [--follow-links | --no-follow-links]
               [--trash-at YYYY-MM-DDTHH:MM | --trash-after DAYS]
               [--project-uuid UUID] [--name NAME]
               [--progress | --no-progress | --batch-progress] [--silent]
               [--resume | --no-resume] [--cache | --no-cache]
               [--retries RETRIES]
               [path [path ...]]
(..)
  --replication N       Set the replication level for the new collection: how
                        many different physical storage devices (e.g., disks)
                        should have a copy of each data block. Default is to
                        use the server-provided default (if any) or 2.
  --storage-classes STORAGE_CLASSES
                        Specify comma separated list of storage classes to be
                        used when saving data to Keep.

base casecase

arv-put --replication N  --storage-classes STORAGE_CLASSES directory

Expected behaviour: ...

updating an existing collection

arv-put --replication N  --storage-classes STORAGE_CLASSES directory --update-collection zzzzz-4zz18-xxxxxxxxxxxxxxx

Expected behaviour: ...

giving conflicting options for resume transaction

arv-put --replication N  --storage-classes STORAGE_CLASSES directory
arv-put --replication M  --storage-classes DIFFERENT_STORAGE_CLASSES directory --resume

Expected behaviour: ...


Related issues

Related to Arvados Epics - Story #16107: Storage classesNew03/01/202106/30/2021

History

#1 Updated by Nico César 2 months ago

#2 Updated by Nico César 2 months ago

  • Target version set to To Be Groomed
  • Category set to Keep

#3 Updated by Nico César 2 months ago

  • Description updated (diff)
  • Subject changed from [arv-put] [and other keep clients] Storage tiers design to [arv-put] Storage tiers design

#4 Updated by Nico César 2 months ago

  • Description updated (diff)

#5 Updated by Nico César 2 months ago

  • Subject changed from [arv-put] Storage tiers design to [arv-put] Storage classes revisit

#6 Updated by Nico César 2 months ago

  • Subject changed from [arv-put] Storage classes revisit to [arv-put] Storage tiers design

#7 Updated by Nico César 2 months ago

  • Subject changed from [arv-put] Storage tiers design to [arv-put] Storage classes revisit

#8 Updated by Lucas Di Pentima about 1 month ago

  • Target version changed from To Be Groomed to 2021-04-14 sprint

#9 Updated by Peter Amstutz 18 days ago

  • Target version changed from 2021-04-14 sprint to 2021-05-26 sprint

Also available in: Atom PDF