Bug #4218

[Keep] Improve speed of /index requests

Added by Tim Pierce almost 3 years ago. Updated 4 months ago.

Status:ClosedStart date:10/15/2014
Priority:NormalDue date:
Assignee:-% Done:

0%

Category:Keep
Target version:-
Story points0.5
Velocity based estimate-

Description

/index on a large production machine takes well over a minute to complete.

This could be a result of having to stat() each file in order to get the modification timestamp.

Additionally, the IndexHandler currently builds the entire response in memory before writing the response to the user. To minimize client timeout issues, it should emit each file as it is found, or one prefix-directory at a time.

History

#1 Updated by Tim Pierce almost 3 years ago

  • Story points set to 0.5

#2 Updated by Tom Clegg over 2 years ago

  • Subject changed from [Keep] /index requests are very slow to [Keep] Improve speed of /index requests
  • Description updated (diff)

#3 Updated by Tom Clegg 4 months ago

  • Status changed from New to Closed

#4 Updated by Tom Clegg 4 months ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF