Project

General

Profile

Actions

Story #16446

open

Manifest format improvements

Added by Peter Amstutz over 2 years ago. Updated 8 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
-
Start date:
10/01/2022
Due date:
03/31/2023 (Due in about 8 months)
% Done:

0%

Estimated time:
Story points:
-
Release:
Release relationship:
Auto

Description

Need to be able to scale manifests to arbitrarily large amounts of data. Currently the 128 MB default request size limit becomes an issue.

Some possible approaches

  • Ability to "mount" another manifest at a directory to support really huge collections
  • API ability to get/put single stream (files in a directory) at a time

Related issues

Related to Arvados - Feature #19198: Feature to normalize and re-pack manifest so that same content always has same hashNew

Actions
Actions #1

Updated by Peter Amstutz over 2 years ago

  • Start date set to 08/01/2021
  • Due date set to 11/01/2021
Actions #2

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 08/01/2021 to 01/01/2022
  • Due date changed from 11/01/2021 to 03/31/2022
Actions #3

Updated by Peter Amstutz 11 months ago

  • Start date changed from 01/01/2022 to 01/01/2023
  • Due date changed from 03/31/2022 to 06/30/2023
Actions #4

Updated by Peter Amstutz 3 months ago

  • Subject changed from Manifest format v2 to Manifest format improvements
Actions #5

Updated by Peter Amstutz 3 months ago

  • Description updated (diff)
Actions #6

Updated by Peter Amstutz 3 months ago

  • Start date changed from 01/01/2023 to 07/01/2022
  • Due date changed from 06/30/2023 to 12/31/2022
Actions #7

Updated by Peter Amstutz 3 months ago

  • Start date changed from 07/01/2022 to 01/01/2023
  • Due date changed from 12/31/2022 to 06/30/2023
  • Description updated (diff)
Actions #8

Updated by Peter Amstutz 3 months ago

  • Start date changed from 01/01/2023 to 06/01/2022
  • Due date changed from 06/30/2023 to 12/31/2022
Actions #9

Updated by Peter Amstutz 2 months ago

  • Start date changed from 06/01/2022 to 07/01/2022
Actions #10

Updated by Peter Amstutz 2 months ago

  • Related to Feature #19198: Feature to normalize and re-pack manifest so that same content always has same hash added
Actions #11

Updated by Peter Amstutz 8 days ago

  • Start date changed from 07/01/2022 to 10/01/2022
  • Due date changed from 12/31/2022 to 03/31/2023
Actions

Also available in: Atom PDF