Project

General

Profile

Actions
Copy link

Feature #16518

open

[keep] Allow clients to set a header to disable md5sum calculations in keepstore

Added by Ward Vandewege almost 4 years ago. Updated about 2 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Future
Story points:
-
Release:
Postponed
Release relationship:
Auto

Description

The md5sum calculation in Keepstore is expensive. In most cases, the client does it too, so it doesn't make sense for Keepstore to calculate the md5sum for the data being read from its backend. Allow the client to set a header to disable it on demand.

Should this also apply to PUTs ?

What should the default setting be? Should it be configurable with a config parameter?

Related issues

Related to Arvados - Feature #16519: [keepstore] optimize md5sum calculationsNewActions
Related to Arvados - Feature #16513: Get reference Keep performance numbers for Keep-on-S3ResolvedWard Vandewege06/15/2020Actions
Related to Arvados Epics - Idea #18342: Keep performance optimizationNew08/01/202305/30/2024Actions
Actions
Copy link
 #1

Updated by Ward Vandewege almost 4 years ago

  • Blocks Idea #16516: Run Keepstore on local compute nodes added
Actions
Copy link
 #2

Updated by Ward Vandewege almost 4 years ago

  • Related to Feature #16519: [keepstore] optimize md5sum calculations added
Actions
Copy link
 #3

Updated by Ward Vandewege almost 4 years ago

  • Related to Feature #16513: Get reference Keep performance numbers for Keep-on-S3 added
Actions
Copy link
 #4

Updated by Peter Amstutz over 2 years ago

  • Related to Idea #18342: Keep performance optimization added
Actions
Copy link
 #5

Updated by Peter Amstutz over 2 years ago

  • Blocks deleted (Idea #16516: Run Keepstore on local compute nodes)
Actions
Copy link
 #6

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions
Copy link
 #7

Updated by Peter Amstutz about 2 months ago

  • Target version set to Future
Actions
Copy link

Also available in: Atom PDF