Project

General

Profile

Keep storage tiers » History » Revision 2

Revision 1 (Tom Clegg, 04/27/2017 08:02 PM) → Revision 2/13 (Tom Clegg, 04/28/2017 12:46 AM)

h1. Keep storage tiers 

 Typically, an Arvados cluster has access to multiple several classes of storage devices with different cost/performance trade-offs. 

 Examples: 
 * Local SSD 
 * Local HDD 
 * Object storage service provided by cloud vendor 
 * Slower or less reliable object storage service provided by same cloud vendor 

 Users should be able to specify a minimum storage tier for each collection. Arvados should ensure that every data block referenced by a collection is stored at the specified tier _or better_. 

 The cluster administrator should be able to specify a default tier, and assign a tier number to each storage device. 

 It should be possible to configure multiple storage devices at the same tier: for example, this allows blocks to be distributed more or less uniformly across multiple cloud storage buckets for performance reasons.