Bug #8541
closed
[NodeManager] Use sys.exc_clear() to release exception tracebacks
Description
According to the discussion at http://cosmicpercolator.com/2016/01/13/exception-leaks-in-python-2-and-3/ exceptions can keep stack frames live far past when they are no longer needed, which may be the cause of our memory leaks.
Audit exception handling in node manager and use sys.exc_clear() discard exception tracebacks where possible.
Related issues
Updated by Brett Smith about 8 years ago
- Target version set to Arvados Future Sprints
Updated by Peter Amstutz about 8 years ago
#8543 is another line of inquiry related to exceptions possibly sticking around for much longer than they should.
Updated by Brett Smith about 8 years ago
Our current thinking is that #8543 has improved the situation enough (based on RSS) that this should no longer be necessary, right?
Updated by Peter Amstutz about 8 years ago
Yes. While it's still possible it's holding onto some exceptions unnecessarily, it looks like #8543 solved the primary memory leak, so this ticket is low priority.
Updated by Ward Vandewege almost 3 years ago
- Target version deleted (
Arvados Future Sprints)