Project

General

Profile

Actions
Copy link

Idea #18342

open

Keep performance optimization

Added by Tom Clegg about 3 years ago. Updated 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Target version:
-
Start date:
08/01/2023
Due date:
12/31/2024 (Due in 0 days)
Story points:
-
Release:
Epics
Release relationship:
Auto

Related issues 15 (6 open — 9 closed)

Related to Arvados - Idea #17699: Design new keepstore internal architecture that supports efficient streaming & range requestsIn ProgressTom CleggActions
Related to Arvados - Feature #16519: [keepstore] optimize md5sum calculationsNewActions
Related to Arvados - Feature #2960: Keepstore can stream GET and PUT requests using keep-gateway APIResolvedTom CleggActions
Related to Arvados - Feature #16518: [keep] Allow clients to set a header to disable md5sum calculations in keepstoreNewActions
Related to Arvados - Feature #18961: Go FileSystem / FUSE mount supports block prefetchClosedTom CleggActions
Related to Arvados - Feature #20318: Go SDK supports local filesystem-backed data cacheResolvedTom CleggActions
Related to Arvados - Idea #20693: Design for server side coordination of multiple writers to a collectionResolvedTom Clegg05/24/2024Actions
Related to Arvados - Feature #20736: expand & collect keepstore and keepweb performance metricsNewActions
Related to Arvados - Feature #20995: Prefetch small files when scanning a collection directoryDuplicateTom CleggActions
Related to Arvados - Idea #13110: [WebDAV] WebDAV performance enhancementsNewActions
Related to Arvados - Idea #20692: keep-web can pack multiple small files into a single blockNewActions
Related to Arvados - Feature #21606: configurable keep-web output buffer to reduce delay between blocksResolvedTom CleggActions
Related to Arvados - Feature #21701: replace_files requests can refer to "current version" and "provided manifest_text" as sourcesResolvedTom CleggActions
Related to Arvados - Feature #21702: keep-web uses replace_files API to add/replace/rename/remove files atomicallyResolvedTom Clegg09/25/2024Actions
Related to Arvados - Idea #20996: Efficient packing of small files into blocks in keep-webResolvedTom Clegg11/13/2024Actions
Actions
Copy link
 #1

Updated by Tom Clegg about 3 years ago

  • Project changed from Arvados to Arvados Epics
Actions
Copy link
 #2

Updated by Tom Clegg about 3 years ago

  • Start date set to 01/01/2022
  • Due date set to 07/01/2022
  • Subject changed from [Epic] Stream Keep data to minimize latency and memory usage to Stream Keep data to minimize latency and memory usage
Actions
Copy link
 #3

Updated by Peter Amstutz about 3 years ago

  • Related to Idea #17699: Design new keepstore internal architecture that supports efficient streaming & range requests added
Actions
Copy link
 #4

Updated by Peter Amstutz about 3 years ago

  • Start date changed from 01/01/2022 to 03/01/2022
  • Due date changed from 07/01/2022 to 09/30/2022
Actions
Copy link
 #5

Updated by Peter Amstutz about 3 years ago

  • Related to Feature #16519: [keepstore] optimize md5sum calculations added
Actions
Copy link
 #6

Updated by Peter Amstutz about 3 years ago

  • Related to Feature #2960: Keepstore can stream GET and PUT requests using keep-gateway API added
Actions
Copy link
 #7

Updated by Peter Amstutz about 3 years ago

  • Related to Feature #16518: [keep] Allow clients to set a header to disable md5sum calculations in keepstore added
Actions
Copy link
 #8

Updated by Peter Amstutz almost 3 years ago

  • Start date changed from 03/01/2022 to 06/01/2022
  • Due date changed from 09/30/2022 to 12/30/2022
Actions
Copy link
 #9

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 06/01/2022 to 08/01/2022
  • Due date changed from 12/30/2022 to 02/28/2023
Actions
Copy link
 #10

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 08/01/2022 to 09/01/2022
  • Due date changed from 02/28/2023 to 03/31/2023
Actions
Copy link
 #11

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 09/01/2022 to 12/30/2022
  • Due date changed from 03/31/2023 to 06/30/2023
Actions
Copy link
 #12

Updated by Peter Amstutz over 2 years ago

  • Due date changed from 06/30/2023 to 03/31/2023
Actions
Copy link
 #13

Updated by Peter Amstutz over 2 years ago

  • Start date changed from 12/30/2022 to 01/01/2023
Actions
Copy link
 #14

Updated by Peter Amstutz almost 2 years ago

  • Start date changed from 01/01/2023 to 03/01/2023
  • Due date changed from 03/31/2023 to 07/31/2023
Actions
Copy link
 #15

Updated by Peter Amstutz almost 2 years ago

  • Start date changed from 03/01/2023 to 06/01/2023
  • Due date changed from 07/31/2023 to 10/31/2023
Actions
Copy link
 #16

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 06/01/2023 to 09/01/2023
  • Due date changed from 10/31/2023 to 12/31/2023
Actions
Copy link
 #17

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 09/01/2023 to 12/31/2023
  • Due date changed from 12/31/2023 to 03/31/2024
Actions
Copy link
 #18

Updated by Peter Amstutz over 1 year ago

  • Start date changed from 12/31/2023 to 08/01/2023
  • Due date changed from 03/31/2024 to 10/31/2023
Actions
Copy link
 #19

Updated by Peter Amstutz over 1 year ago

  • Subject changed from Stream Keep data to minimize latency and memory usage to Keep performance optimization
Actions
Copy link
 #20

Updated by Peter Amstutz over 1 year ago

  • Subject changed from Keep performance optimization to Keep performance optimization
Actions
Copy link
 #21

Updated by Peter Amstutz over 1 year ago

  • Related to Feature #18961: Go FileSystem / FUSE mount supports block prefetch added
Actions
Copy link
 #25

Updated by Peter Amstutz over 1 year ago

  • Related to Feature #20318: Go SDK supports local filesystem-backed data cache added
Actions
Copy link
 #26

Updated by Peter Amstutz over 1 year ago

  • Related to Idea #20693: Design for server side coordination of multiple writers to a collection added
Actions
Copy link
 #27

Updated by Peter Amstutz over 1 year ago

  • Related to Feature #20736: expand & collect keepstore and keepweb performance metrics added
Actions
Copy link
 #28

Updated by Peter Amstutz over 1 year ago

  • Related to Feature #20995: Prefetch small files when scanning a collection directory added
Actions
Copy link
 #29

Updated by Peter Amstutz over 1 year ago

  • Related to Idea #13110: [WebDAV] WebDAV performance enhancements added
Actions
Copy link
 #30

Updated by Tom Clegg over 1 year ago

  • Related to Idea #20692: keep-web can pack multiple small files into a single block added
Actions
Copy link
 #31

Updated by Peter Amstutz 12 months ago

  • Due date changed from 10/31/2023 to 03/31/2024
Actions
Copy link
 #33

Updated by Tom Clegg 10 months ago

  • Related to Feature #21606: configurable keep-web output buffer to reduce delay between blocks added
Actions
Copy link
 #34

Updated by Tom Clegg 9 months ago

  • Related to Feature #21701: replace_files requests can refer to "current version" and "provided manifest_text" as sources added
Actions
Copy link
 #35

Updated by Tom Clegg 9 months ago

  • Related to Feature #21702: keep-web uses replace_files API to add/replace/rename/remove files atomically added
Actions
Copy link
 #36

Updated by Peter Amstutz 8 months ago

  • Due date changed from 03/31/2024 to 06/30/2024
Actions
Copy link
 #37

Updated by Peter Amstutz 8 months ago

  • Due date changed from 06/30/2024 to 05/30/2024
Actions
Copy link
 #38

Updated by Peter Amstutz 2 months ago

  • Due date changed from 05/30/2024 to 12/31/2024
Actions
Copy link
 #39

Updated by Tom Clegg about 2 months ago

  • Related to Idea #20996: Efficient packing of small files into blocks in keep-web added
Actions
Copy link

Also available in: Atom PDF