Project

General

Profile

Actions

Bug #3855

closed

[SDK] New keep mount is very slow on initial usage

Added by Abram Connelly over 9 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Story points:
1.0

Description

On shell nodes, I find doing some simple tasks, like changing directories and listing files, is extremely slow. After some initial slowdown, it looks like it speeds up and subsequent actions are much faster, but initially they are very slow.

For example, doing the initial action for the first time:

$ cd ~/keep
$ ls
by_id  by_tag  home  README  share

took upwards of 60s or more.

Even though the 'by_id' directory didn't have any files in it, doing an initial 'ls' and 'cd' was also very slow.

Actions #1

Updated by Ward Vandewege over 9 years ago

  • Subject changed from New keep mount is very slow on initial usage to [SDK] New keep mount is very slow on initial usage
Actions #2

Updated by Ward Vandewege over 9 years ago

  • Description updated (diff)
Actions #3

Updated by Tom Clegg over 9 years ago

  • Target version set to Arvados Future Sprints
Actions #4

Updated by Tom Clegg over 9 years ago

  • Story points set to 1.0
Actions #5

Updated by Ward Vandewege about 9 years ago

As of 91abe26 it is still slow. This is a project with 885 collections:

$ time ls keep/shared/Harvard\ PGP\:\ participant\ originated\ data/
Tapestry--my.pgp-hms.org--UserFile--10
...
Tapestry--my.pgp-hms.org--UserFile--996
Tapestry--my.pgp-hms.org--UserFile--997
Tapestry--my.pgp-hms.org--UserFile--998
Tapestry--my.pgp-hms.org--UserFile--999

real    0m54.187s
user    0m0.020s
sys    0m0.032s
Actions #6

Updated by Tom Clegg about 7 years ago

  • Status changed from New to Closed
Actions #7

Updated by Tom Clegg about 7 years ago

  • Target version deleted (Arvados Future Sprints)
Actions

Also available in: Atom PDF