Project

General

Profile

Actions

Idea #18342

open

Keep performance optimization

Added by Tom Clegg over 2 years ago. Updated 3 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
-
Start date:
08/01/2023
Due date:
05/30/2024 (45 days late)
Story points:
-
Release:
Release relationship:
Auto

Related issues

Related to Arvados - Idea #17699: Design new keepstore internal architecture that supports efficient streaming & range requestsIn ProgressTom CleggActions
Related to Arvados - Feature #16519: [keepstore] optimize md5sum calculationsNewActions
Related to Arvados - Feature #2960: Keepstore can stream GET and PUT requests using keep-gateway APIResolvedTom CleggActions
Related to Arvados - Feature #16518: [keep] Allow clients to set a header to disable md5sum calculations in keepstoreNewActions
Related to Arvados - Feature #18961: Go FileSystem / FUSE mount supports block prefetchClosedTom CleggActions
Related to Arvados - Feature #20318: Go SDK supports local filesystem-backed data cacheResolvedTom CleggActions
Related to Arvados - Idea #20693: Design for server side coordination of multiple writers to a collectionResolvedTom Clegg05/24/2024Actions
Related to Arvados - Feature #20736: expand & collect keepstore and keepweb performance metricsNewActions
Related to Arvados - Feature #20995: Prefetch small files when scanning a collection directoryDuplicateTom CleggActions
Related to Arvados - Idea #13110: [WebDAV] WebDAV performance enhancementsNewActions
Related to Arvados - Idea #20692: keep-web can pack multiple small files into a single blockNewActions
Related to Arvados - Feature #21606: configurable keep-web output buffer to reduce delay between blocksResolvedTom CleggActions
Related to Arvados - Feature #21701: replace_files requests can refer to "current version" and "provided manifest_text" as sourcesResolvedTom CleggActions
Related to Arvados - Feature #21702: keep-web uses replace_files API to add/replace/rename/remove files atomicallyNewActions
Actions #1

Updated by Tom Clegg over 2 years ago

  • Project changed from Arvados to Arvados Epics
Actions #2

Updated by Tom Clegg over 2 years ago

  • Start date set to 01/01/2022
  • Due date set to 07/01/2022
  • Subject changed from [Epic] Stream Keep data to minimize latency and memory usage to Stream Keep data to minimize latency and memory usage
Actions #3

Updated by Peter Amstutz over 2 years ago

  • Related to Idea #17699: Design new keepstore internal architecture that supports efficient streaming & range requests added
Actions #4

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 01/01/2022 to 03/01/2022
  • Due date changed from 07/01/2022 to 09/30/2022
Actions #5

Updated by Peter Amstutz over 2 years ago

  • Related to Feature #16519: [keepstore] optimize md5sum calculations added
Actions #6

Updated by Peter Amstutz over 2 years ago

  • Related to Feature #2960: Keepstore can stream GET and PUT requests using keep-gateway API added
Actions #7

Updated by Peter Amstutz over 2 years ago

  • Related to Feature #16518: [keep] Allow clients to set a header to disable md5sum calculations in keepstore added
Actions #8

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 03/01/2022 to 06/01/2022
  • Due date changed from 09/30/2022 to 12/30/2022
Actions #9

Updated by Peter Amstutz about 2 years ago

  • Start date changed from 06/01/2022 to 08/01/2022
  • Due date changed from 12/30/2022 to 02/28/2023
Actions #10

Updated by Peter Amstutz almost 2 years ago

  • Start date changed from 08/01/2022 to 09/01/2022
  • Due date changed from 02/28/2023 to 03/31/2023
Actions #11

Updated by Peter Amstutz almost 2 years ago

  • Start date changed from 09/01/2022 to 12/30/2022
  • Due date changed from 03/31/2023 to 06/30/2023
Actions #12

Updated by Peter Amstutz almost 2 years ago

  • Due date changed from 06/30/2023 to 03/31/2023
Actions #13

Updated by Peter Amstutz almost 2 years ago

  • Start date changed from 12/30/2022 to 01/01/2023
Actions #14

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 01/01/2023 to 03/01/2023
  • Due date changed from 03/31/2023 to 07/31/2023
Actions #15

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 03/01/2023 to 06/01/2023
  • Due date changed from 07/31/2023 to 10/31/2023
Actions #16

Updated by Peter Amstutz about 1 year ago

  • Start date changed from 06/01/2023 to 09/01/2023
  • Due date changed from 10/31/2023 to 12/31/2023
Actions #17

Updated by Peter Amstutz about 1 year ago

  • Start date changed from 09/01/2023 to 12/31/2023
  • Due date changed from 12/31/2023 to 03/31/2024
Actions #18

Updated by Peter Amstutz about 1 year ago

  • Start date changed from 12/31/2023 to 08/01/2023
  • Due date changed from 03/31/2024 to 10/31/2023
Actions #19

Updated by Peter Amstutz about 1 year ago

  • Subject changed from Stream Keep data to minimize latency and memory usage to Keep performance optimization
Actions #20

Updated by Peter Amstutz about 1 year ago

  • Subject changed from Keep performance optimization to Keep performance optimization
Actions #21

Updated by Peter Amstutz about 1 year ago

  • Related to Feature #18961: Go FileSystem / FUSE mount supports block prefetch added
Actions #25

Updated by Peter Amstutz about 1 year ago

  • Related to Feature #20318: Go SDK supports local filesystem-backed data cache added
Actions #26

Updated by Peter Amstutz about 1 year ago

  • Related to Idea #20693: Design for server side coordination of multiple writers to a collection added
Actions #27

Updated by Peter Amstutz about 1 year ago

  • Related to Feature #20736: expand & collect keepstore and keepweb performance metrics added
Actions #28

Updated by Peter Amstutz 10 months ago

  • Related to Feature #20995: Prefetch small files when scanning a collection directory added
Actions #29

Updated by Peter Amstutz 10 months ago

  • Related to Idea #13110: [WebDAV] WebDAV performance enhancements added
Actions #30

Updated by Tom Clegg 10 months ago

  • Related to Idea #20692: keep-web can pack multiple small files into a single block added
Actions #31

Updated by Peter Amstutz 6 months ago

  • Due date changed from 10/31/2023 to 03/31/2024
Actions #33

Updated by Tom Clegg 4 months ago

  • Related to Feature #21606: configurable keep-web output buffer to reduce delay between blocks added
Actions #34

Updated by Tom Clegg 3 months ago

  • Related to Feature #21701: replace_files requests can refer to "current version" and "provided manifest_text" as sources added
Actions #35

Updated by Tom Clegg 3 months ago

  • Related to Feature #21702: keep-web uses replace_files API to add/replace/rename/remove files atomically added
Actions #36

Updated by Peter Amstutz 3 months ago

  • Due date changed from 03/31/2024 to 06/30/2024
Actions #37

Updated by Peter Amstutz 3 months ago

  • Due date changed from 06/30/2024 to 05/30/2024
Actions

Also available in: Atom PDF