Project

General

Profile

Actions

Idea #16446

open

Manifest format improvements

Added by Peter Amstutz almost 4 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
Start date:
Due date:
Story points:
-
Release:
Release relationship:
Auto

Description

Need to be able to scale manifests to arbitrarily large amounts of data. Currently the 128 MB default request size limit becomes an issue.

Some possible approaches

  • Ability to "mount" another manifest at a directory to support really huge collections
  • API ability to get/put single stream (files in a directory) at a time

Related issues

Related to Arvados - Feature #19198: Feature to normalize and re-pack manifest so that same content always has same hashNewActions
Actions

Also available in: Atom PDF