Project

General

Profile

Actions

Support #18894

closed

[document] how Keep manifest size can be predicted/calculated

Added by Ward Vandewege about 2 years ago. Updated almost 2 years ago.

Status:
Resolved
Priority:
Normal
Assigned To:
Category:
-
Target version:
Due date:
Story points:
-
Release relationship:
Auto

Description

Peter wrote this up a while ago, it should be added to the documentation at https://doc.arvados.org/architecture/manifest-format.html

=================================================================================================================
Here's a formula for estimating manifest size, assuming efficiently packed blocks. This is including the block signatures, which makes it bigger than the size of the manifest in the database, because that is what is actually transferred to/from the API server and stored in RAM by arv-mount.

sum(size of all directory paths)
+ (total data size / 64 MB) * 94
+ sum(size of all file names)
+ sum(number of files * 20) =================================================================================================================


Subtasks 1 (0 open1 closed)

Task #19016: Review 18894-manifest-size-doc ResolvedPeter Amstutz04/15/2022Actions
Actions

Also available in: Atom PDF