Project

General

Profile

Actions

Idea #8181

open

[Keepstore] Support a portable data challenge API

Added by Brett Smith about 8 years ago. Updated 27 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

Keepstore gives the client a salt. The client returns some hash including that salt plus the original data to prove it has the original data. If the client does so successfully, Keepstore discloses whether or not it has the block, and returns a newly signed block locator. Upload clients can use this to avoid uploading blocks that already exist on the destination.

Alternatively: add a 'trust keep clients' flag in config.yml, which site admins could enable to allow client-side hashing, and let the keepstores trust the client-provided hashes.

The ideal solution here is probably a slider that is a % of the data that the client needs to prove it has, before keepstore will trust its hashes. It could be set to zero in a situation where there is a lot of trust, and probably to some reasonable % by default (25? 50?).

What we gain from this story would be avoiding the need to re-upload data if it already exists in Keep.

Actions #1

Updated by Brett Smith about 8 years ago

  • Target version set to Arvados Future Sprints
Actions #2

Updated by Ward Vandewege almost 4 years ago

  • Target version changed from Arvados Future Sprints to To Be Groomed
Actions #3

Updated by Ward Vandewege almost 4 years ago

  • Description updated (diff)
Actions #4

Updated by Ward Vandewege almost 4 years ago

  • Description updated (diff)
Actions #5

Updated by Peter Amstutz over 2 years ago

  • Target version deleted (To Be Groomed)
Actions #6

Updated by Peter Amstutz about 1 year ago

  • Release set to 60
Actions #7

Updated by Peter Amstutz 27 days ago

  • Target version set to Future
Actions

Also available in: Atom PDF