Bug #4218

[Keep] Improve speed of /index requests

Added by Tim Pierce over 3 years ago. Updated about 1 year ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
Keep
Target version:
-
Start date:
10/15/2014
Due date:
% Done:

0%

Estimated time:
Story points:
0.5

Description

/index on a large production machine takes well over a minute to complete.

This could be a result of having to stat() each file in order to get the modification timestamp.

Additionally, the IndexHandler currently builds the entire response in memory before writing the response to the user. To minimize client timeout issues, it should emit each file as it is found, or one prefix-directory at a time.

History

#1 Updated by Tim Pierce over 3 years ago

  • Story points set to 0.5

#2 Updated by Tom Clegg over 3 years ago

  • Subject changed from [Keep] /index requests are very slow to [Keep] Improve speed of /index requests
  • Description updated (diff)

#3 Updated by Tom Clegg about 1 year ago

  • Status changed from New to Closed

#4 Updated by Tom Clegg about 1 year ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF