Project

General

Profile

Actions
Copy link

Idea #16446

open

Manifest format improvements

Added by Peter Amstutz over 4 years ago. Updated 9 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
Arvados - Future
Start date:
Due date:
Story points:
-
Release:
Epics
Release relationship:
Auto

Description

Need to be able to scale manifests to arbitrarily large amounts of data. Currently the 128 MB default request size limit becomes an issue.

Some possible approaches

  • Ability to "mount" another manifest at a directory to support really huge collections
  • API ability to get/put single stream (files in a directory) at a time

Related issues

Related to Arvados - Feature #19198: Feature to normalize and re-pack manifest so that same content always has same hashNewActions
Actions
Copy link
 #1

Updated by Peter Amstutz over 4 years ago

  • Start date set to 08/01/2021
  • Due date set to 11/01/2021
Actions
Copy link
 #2

Updated by Peter Amstutz almost 4 years ago

  • Start date changed from 08/01/2021 to 01/01/2022
  • Due date changed from 11/01/2021 to 03/31/2022
Actions
Copy link
 #3

Updated by Peter Amstutz about 3 years ago

  • Start date changed from 01/01/2022 to 01/01/2023
  • Due date changed from 03/31/2022 to 06/30/2023
Actions
Copy link
 #4

Updated by Peter Amstutz over 2 years ago

  • Subject changed from Manifest format v2 to Manifest format improvements
Actions
Copy link
 #5

Updated by Peter Amstutz over 2 years ago

  • Description updated (diff)
Actions
Copy link
 #6

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 01/01/2023 to 07/01/2022
  • Due date changed from 06/30/2023 to 12/31/2022
Actions
Copy link
 #7

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 07/01/2022 to 01/01/2023
  • Due date changed from 12/31/2022 to 06/30/2023
  • Description updated (diff)
Actions
Copy link
 #8

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 01/01/2023 to 06/01/2022
  • Due date changed from 06/30/2023 to 12/31/2022
Actions
Copy link
 #9

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 06/01/2022 to 07/01/2022
Actions
Copy link
 #10

Updated by Peter Amstutz over 2 years ago

  • Related to Feature #19198: Feature to normalize and re-pack manifest so that same content always has same hash added
Actions
Copy link
 #11

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 07/01/2022 to 10/01/2022
  • Due date changed from 12/31/2022 to 03/31/2023
Actions
Copy link
 #12

Updated by Peter Amstutz about 2 years ago

  • Start date changed from 10/01/2022 to 03/01/2023
  • Due date changed from 03/31/2023 to 07/31/2023
Actions
Copy link
 #13

Updated by Peter Amstutz almost 2 years ago

  • Start date changed from 03/01/2023 to 07/01/2023
  • Due date changed from 07/31/2023 to 12/31/2023
Actions
Copy link
 #14

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 07/01/2023 to 09/01/2023
Actions
Copy link
 #15

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 09/01/2023 to 01/01/2024
  • Due date changed from 12/31/2023 to 03/31/2024
Actions
Copy link
 #16

Updated by Peter Amstutz 11 months ago

  • Start date changed from 01/01/2024 to 01/01/2025
  • Due date changed from 03/31/2024 to 03/31/2025
Actions
Copy link
 #18

Updated by Peter Amstutz 9 months ago

  • Target version set to Future
Actions
Copy link

Also available in: Atom PDF