Story #8181

[Keepstore] Support a portable data challenge API

Added by Brett Smith almost 5 years ago. Updated 6 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
Start date:
01/11/2016
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

Keepstore gives the client a salt. The client returns some hash including that salt plus the original data to prove it has the original data. If the client does so successfully, Keepstore discloses whether or not it has the block, and returns a newly signed block locator. Upload clients can use this to avoid uploading blocks that already exist on the destination.

Alternatively: add a 'trust keep clients' flag in config.yml, which site admins could enable to allow client-side hashing, and let the keepstores trust the client-provided hashes.

The ideal solution here is probably a slider that is a % of the data that the client needs to prove it has, before keepstore will trust its hashes. It could be set to zero in a situation where there is a lot of trust, and probably to some reasonable % by default (25? 50?).

What we gain from this story would be avoiding the need to re-upload data if it already exists in Keep.

History

#1 Updated by Brett Smith almost 5 years ago

  • Target version set to Arvados Future Sprints

#2 Updated by Ward Vandewege 6 months ago

  • Target version changed from Arvados Future Sprints to To Be Groomed

#3 Updated by Ward Vandewege 6 months ago

  • Description updated (diff)

#4 Updated by Ward Vandewege 6 months ago

  • Description updated (diff)

Also available in: Atom PDF