Project

General

Profile

Actions

Idea #17465

closed

Support writing blocks to correct storage classes in Python SDK

Added by Peter Amstutz about 3 years ago. Updated over 2 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
SDKs
Target version:
Story points:
-
Release relationship:
Auto

Description

Depends on #13382

The client is responsible for keeping track of how many replicas have been written for each storage class. If one storage class is satisfied but not another, the satisfied one can be removed from the X-Keep-Storage-Classes list. The overall write is a success if all storage classes were satisfied, and a failure if any of the storage classes could not be satisfied.

Add as an option to Python keepclient and Collection class.

"We are not expecting to skip servers, we just need to send the storage classes and know when we are done"

Keepclient code in Go and Python SDK support:

Setting storage classes to use when uploading a block
Passing storage classes in the X-Keep-Storage-Classes header

The client is responsible for keeping track of how many replicas have been written for each storage class. If one storage class is satisfied but not another, the satisfied one can be removed from the X-Keep-Storage-Classes list. The overall write is a success if all storage classes were satisfied, and a failure if any of the storage classes could not be satisfied.

  • Collection instance knows the storage classes
  • Storage classes are passed to the block manager instance
  • Block manager passes storage classes to the put() call via a new optional parameter

Subtasks 1 (0 open1 closed)

Task #17511: Review 17465-pysdk-storage-classes-supportResolvedLucas Di Pentima06/01/2021Actions

Related issues

Related to Arvados Epics - Idea #16107: Storage classesResolved03/01/202109/30/2021Actions
Related to Arvados - Feature #17351: [arv-put] Storage classesResolvedLucas Di Pentima06/03/2021Actions
Blocked by Arvados - Feature #13382: [keepstore] Write new blocks to appropriate storage classResolvedTom Clegg04/02/2021Actions
Blocks Arvados - Feature #17572: arv-mount understands storage classesResolvedLucas Di Pentima06/21/2021Actions
Actions

Also available in: Atom PDF