Project

General

Profile

Actions

Bug #13607

open

[arv-mount] avoid excessive memory consumption of idle arv-mounts

Added by Nico César over 6 years ago. Updated 10 months ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
FUSE
Target version:
Story points:
-
Release:
Release relationship:
Auto

Description

I noticed several arv-mounts killed

$ dmesg | grep 'Out of'
[11983650.641067] Out of memory: Kill process 101941 (python3) score 420 or sacrifice child
[11983650.708218] Out of memory: Kill process 101941 (python3) score 420 or sacrifice child
[11983651.444473] Out of memory: Kill process 101941 (python3) score 420 or sacrifice child

then I noticed that some simple "ls" on the keep mount will make a load of 1 and it was unable to exit. them memory ballooning is caused by 90 days old arv-mounts that had no use in the last 89 days.

Is there a way to shrink the memory usage in arv-mount that are idle?

Actions #1

Updated by Nico César over 6 years ago

  • Category set to FUSE
  • Target version set to To Be Groomed
Actions #2

Updated by Nico César over 6 years ago

  • Subject changed from [arv-mount] to [arv-mount] avoind excesive memory consumption of idle arv-mounts
Actions #3

Updated by Peter Amstutz over 6 years ago

It says it is killing python3 but I don't think the FUSE mount is using python3?

Actions #5

Updated by Peter Amstutz over 6 years ago

Separately from the soft memory limits it uses to clear the cache, it keeps the last 4 collections hot in the cache (regardless of how much memory they take up). We could release those if the mount has been idle for a while, but only if the kernel cache has forgotten them as well.

If we had stable inode numbering (#12664) then we could release things from the cache regardless of whether the kernel is still hanging on to it or not.

We could greatly reduce the overall footprint with incremental manifest loading (#12314), but that comes with complexity costs.

Actions #6

Updated by Tom Clegg over 6 years ago

  • Subject changed from [arv-mount] avoind excesive memory consumption of idle arv-mounts to [arv-mount] avoid excessive memory consumption of idle arv-mounts
Actions #7

Updated by Peter Amstutz over 3 years ago

  • Target version deleted (To Be Groomed)
Actions #8

Updated by Peter Amstutz almost 2 years ago

  • Release set to 60
Actions #9

Updated by Peter Amstutz 10 months ago

  • Target version set to Future
Actions

Also available in: Atom PDF