Project

General

Profile

Actions

Keep storage tiers » History » Revision 2

« Previous | Revision 2/13 (diff) | Next »
Tom Clegg, 04/28/2017 12:46 AM


Keep storage tiers

Typically, an Arvados cluster has access to multiple storage devices with different cost/performance trade-offs.

Examples:
  • Local SSD
  • Local HDD
  • Object storage service provided by cloud vendor
  • Slower or less reliable object storage service provided by same cloud vendor

Users should be able to specify a minimum storage tier for each collection. Arvados should ensure that every data block referenced by a collection is stored at the specified tier or better.

The cluster administrator should be able to specify a default tier, and assign a tier number to each storage device.

It should be possible to configure multiple storage devices at the same tier: for example, this allows blocks to be distributed more or less uniformly across multiple cloud storage buckets for performance reasons.

Updated by Tom Clegg over 7 years ago · 13 revisions