Story #17465

Support writing blocks to correct storage classes in Python SDK

Added by Peter Amstutz about 1 month ago. Updated 18 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
SDKs
Target version:
Start date:
Due date:
% Done:

0%

Estimated time:
(Total: 0.00 h)
Story points:
-

Description

Depends on #13382

The client is responsible for keeping track of how many replicas have been written for each storage class. If one storage class is satisfied but not another, the satisfied one can be removed from the X-Keep-Storage-Classes list. The overall write is a success if all storage classes were satisfied, and a failure if any of the storage classes could not be satisfied.

Add as an option to Python keepclient and Collection class.

"We are not expecting to skip servers, we just need to send the storage classes and know when we are done"

Keepclient code in Go and Python SDK support:

Setting storage classes to use when uploading a block
Passing storage classes in the X-Keep-Storage-Classes header

The client is responsible for keeping track of how many replicas have been written for each storage class. If one storage class is satisfied but not another, the satisfied one can be removed from the X-Keep-Storage-Classes list. The overall write is a success if all storage classes were satisfied, and a failure if any of the storage classes could not be satisfied.


Subtasks

Task #17511: ReviewNew


Related issues

Related to Arvados Epics - Story #16107: Storage classesNew03/01/202106/30/2021

Blocked by Arvados - Feature #13382: [keepstore] Write new blocks to appropriate storage classResolved04/02/2021

History

#1 Updated by Peter Amstutz about 1 month ago

#2 Updated by Peter Amstutz about 1 month ago

  • Description updated (diff)

#3 Updated by Peter Amstutz about 1 month ago

  • Description updated (diff)

#4 Updated by Peter Amstutz about 1 month ago

  • Target version set to 2021-04-14 sprint

#5 Updated by Peter Amstutz 19 days ago

  • Category set to SDKs

#6 Updated by Lucas Di Pentima 18 days ago

  • Assigned To set to Lucas Di Pentima

#7 Updated by Peter Amstutz 18 days ago

  • Target version changed from 2021-04-14 sprint to 2021-05-12 sprint
  • Assigned To deleted (Lucas Di Pentima)

#8 Updated by Lucas Di Pentima 18 days ago

  • Blocked by Feature #13382: [keepstore] Write new blocks to appropriate storage class added

Also available in: Atom PDF