Project

General

Profile

Actions

Feature #3734

open

[Keep] Keepstore and keepproxy support HTTP Range requests

Added by Tim Pierce about 10 years ago. Updated 9 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
Keep
Target version:
Story points:
2.0
Release:
Release relationship:
Auto

Description

If a request has a Range header, read only the desired portion from the data volume, and return the segment with appropriate HTTP status (206) and headers (e.g., Content-Length: 10001, Content-Range: 1234-11234/100000).

Skip hash verification (this would be impossible without reading the whole block). If a client needs to verify content hashes, it can either retrieve the whole block ahead of time and compute the checksums of each segment, or retrieve ranges in order and compute the hash piecewise.


Related issues

Related to Arvados - Bug #3663: [SDKs] Python CollectionReader should return at least one byte to caller per block read from Keep.ResolvedTim Pierce09/04/2014Actions
Related to Arvados - Feature #8228: [SDKs] [FUSE] Python SDK and arv-mount use Range requests when a caller requests part of a block that has been ejected from the cacheNewActions
Actions #1

Updated by Ward Vandewege about 10 years ago

  • Story points set to 1.0
Actions #2

Updated by Ward Vandewege about 10 years ago

  • Subject changed from Keep supports partial content to [Keep] Keep supports partial content
Actions #3

Updated by Tom Clegg about 10 years ago

  • Target version changed from Arvados Future Sprints to 2014-10-08 sprint
Actions #4

Updated by Brett Smith about 10 years ago

  • Assigned To set to Brett Smith
Actions #5

Updated by Tom Clegg about 10 years ago

  • Target version changed from 2014-10-08 sprint to Arvados Future Sprints
Actions #6

Updated by Ward Vandewege about 10 years ago

  • Target version changed from Arvados Future Sprints to 2014-10-29 sprint
Actions #7

Updated by Tom Clegg about 10 years ago

  • Subject changed from [Keep] Keep supports partial content to [Keep] Keepstore, keepproxy, and Python SDK use HTTP Range to retrieve partial content where appropriate
  • Story points changed from 1.0 to 2.0
Actions #8

Updated by Tom Clegg about 10 years ago

  • Target version changed from 2014-10-29 sprint to Arvados Future Sprints
Actions #9

Updated by Tom Clegg almost 9 years ago

  • Subject changed from [Keep] Keepstore, keepproxy, and Python SDK use HTTP Range to retrieve partial content where appropriate to [Keep] Keepstore and keepproxy support HTTP Range requests
  • Description updated (diff)
Actions #10

Updated by Tom Morris about 8 years ago

  • Assigned To changed from Brett Smith to Tom Morris
Actions #11

Updated by Tom Morris almost 8 years ago

  • Assigned To deleted (Tom Morris)
Actions #12

Updated by Stanislaw Adaszewski over 4 years ago

Dear Team, Could we please assign a higher priority to this issue? Keepweb is extremely slow while keepproxy performs decently but is handicapped by the lack of Ranges support. It is quite a basic thing to have. Thank you in advance. Best regards, -- Stanislaw

Actions #13

Updated by Stanislaw Adaszewski over 4 years ago

Speaking strictly only in private capacity here. This issue is very high on my wish list.

Actions #14

Updated by Ward Vandewege over 3 years ago

  • Target version deleted (Arvados Future Sprints)
Actions #15

Updated by Peter Amstutz almost 2 years ago

  • Release set to 60
Actions #16

Updated by Peter Amstutz 9 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF