Bug #8541

[NodeManager] Use sys.exc_clear() to release exception tracebacks

Added by Peter Amstutz almost 6 years ago. Updated 5 months ago.

Assigned To:
Target version:
Start date:
Due date:
% Done:


Estimated time:
Story points:


According to the discussion at http://cosmicpercolator.com/2016/01/13/exception-leaks-in-python-2-and-3/ exceptions can keep stack frames live far past when they are no longer needed, which may be the cause of our memory leaks.

Audit exception handling in node manager and use sys.exc_clear() discard exception tracebacks where possible.

Related issues

Related to Arvados - Story #8543: [NodeManager] Don't use Futures when not expecting a replyResolved03/04/2016


#1 Updated by Peter Amstutz almost 6 years ago

  • Description updated (diff)

#2 Updated by Brett Smith almost 6 years ago

  • Target version set to Arvados Future Sprints

#3 Updated by Peter Amstutz almost 6 years ago

#8543 is another line of inquiry related to exceptions possibly sticking around for much longer than they should.

#4 Updated by Brett Smith over 5 years ago

Our current thinking is that #8543 has improved the situation enough (based on RSS) that this should no longer be necessary, right?

#5 Updated by Peter Amstutz over 5 years ago

Yes. While it's still possible it's holding onto some exceptions unnecessarily, it looks like #8543 solved the primary memory leak, so this ticket is low priority.

#6 Updated by Peter Amstutz 8 months ago

  • Status changed from New to Closed

#7 Updated by Ward Vandewege 5 months ago

  • Target version deleted (Arvados Future Sprints)

Also available in: Atom PDF