Bug #3855

[SDK] New keep mount is very slow on initial usage

Added by Abram Connelly about 3 years ago. Updated 9 months ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
09/11/2014
Due date:
% Done:

0%

Estimated time:
Story points:
1.0

Description

On shell nodes, I find doing some simple tasks, like changing directories and listing files, is extremely slow. After some initial slowdown, it looks like it speeds up and subsequent actions are much faster, but initially they are very slow.

For example, doing the initial action for the first time:

$ cd ~/keep
$ ls
by_id  by_tag  home  README  share

took upwards of 60s or more.

Even though the 'by_id' directory didn't have any files in it, doing an initial 'ls' and 'cd' was also very slow.

History

#1 Updated by Ward Vandewege about 3 years ago

  • Subject changed from New keep mount is very slow on initial usage to [SDK] New keep mount is very slow on initial usage

#2 Updated by Ward Vandewege about 3 years ago

  • Description updated (diff)

#3 Updated by Tom Clegg about 3 years ago

  • Target version set to Arvados Future Sprints

#4 Updated by Tom Clegg about 3 years ago

  • Story points set to 1.0

#5 Updated by Ward Vandewege almost 3 years ago

As of 91abe26 it is still slow. This is a project with 885 collections:

$ time ls keep/shared/Harvard\ PGP\:\ participant\ originated\ data/
Tapestry--my.pgp-hms.org--UserFile--10
...
Tapestry--my.pgp-hms.org--UserFile--996
Tapestry--my.pgp-hms.org--UserFile--997
Tapestry--my.pgp-hms.org--UserFile--998
Tapestry--my.pgp-hms.org--UserFile--999

real    0m54.187s
user    0m0.020s
sys    0m0.032s

#6 Updated by Tom Clegg 9 months ago

  • Status changed from New to Closed

#7 Updated by Tom Clegg 9 months ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF