Feature #12996

[SDKs] CollectionFS should repack highly fragmented files

Added by Tom Clegg over 1 year ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

Currently, a sequence of alternating "write" and "snapshot" operations will result in a very fragmented collection (i.e., lots of small blocks).

#10181 is one real-world example of this pattern.

CollectionFS should provide an API for repacking fragmented file data. This should also be invoked automatically in certain circumstances (e.g., when a file is already highly fragmented during a sync/snapshot).


Related issues

Related to Arvados - Feature #10181: Crunch job output logging improvement storiesResolved02/16/2017

History

#1 Updated by Tom Clegg over 1 year ago

  • Related to Feature #10181: Crunch job output logging improvement stories added

Also available in: Atom PDF