Story #11167

[Workbench] Remove arv-get file download fallback

Added by Peter Amstutz 27 days ago. Updated 1 day ago.

Status:NewStart date:
Priority:NormalDue date:
Assignee:-% Done:

0%

Category:-
Target version:Arvados Future Sprints
Story points1.0
Velocity based estimate-

Description

Currently, if keep-web isn't configured, Workbench will fallback to arv-get and Rails streaming to serve files. However, this is a very bad fallback:

  1. It fails silently if calling arv-get doesn't work
  2. It ties up a workbench worker for the duration of the download
  3. It doesn't report content-length, so user agents are unable to render a progress bar or determine if the entire file was transferred.
  4. It sometimes silently drops out in the middle of downloads
  5. It sometimes consumes huge amount of RAM, crashing the workbench server.
  6. It can't handle [some?] range requests

Instead we should:
- Workbench should refuse start if keep-web is not configured
- Documentation should be updated to emphasize that keep-web is mandatory, Workbench config for keep-web, and the new Workbench startup failure mode
- Remove the arv-get fallback code and adjust any related tests

History

#1 Updated by Peter Amstutz 27 days ago

  • Description updated (diff)

#2 Updated by Tom Clegg 27 days ago

  • Description updated (diff)

#3 Updated by Tom Morris 23 days ago

  • Description updated (diff)
  • Target version set to 2017-03-15 sprint
  • Story points set to 1.0

#4 Updated by Tom Morris 22 days ago

  • Target version changed from 2017-03-15 sprint to Arvados Future Sprints

Also available in: Atom PDF