https://dev.arvados.org/https://dev.arvados.org/favicon.ico?15576888422016-04-06T14:49:22ZArvadosArvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=374822016-04-06T14:49:22ZBrett Smithbrett.smith@curii.com
<ul></ul><p>Note that Node Manager's retry code logs the full traceback for every exception it handles. The fact that a traceback appeared, by itself, doesn't mean that the exception was unhandled.</p> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=374832016-04-06T14:59:40ZBrett Smithbrett.smith@curii.com
<ul></ul><p>The ShutdownActor and MonitorActor were stopped immediately after the exception:</p>
<pre>2016-04-02_12:03:45.59123 2016-04-02 12:03:45 pykka[55464] DEBUG: Unregistered ComputeNodeMonitorActor (urn:uuid:ed769f41-f414-4db9-bafb-2826815a445e)
2016-04-02_12:03:45.59125 2016-04-02 12:03:45 pykka[55464] DEBUG: Stopped ComputeNodeMonitorActor (urn:uuid:ed769f41-f414-4db9-bafb-2826815a445e)
2016-04-02_12:03:45.59142 2016-04-02 12:03:45 pykka[55464] DEBUG: Unregistered ComputeNodeShutdownActor (urn:uuid:2c32c6e7-80a6-4d92-8270-feddab943501)
2016-04-02_12:03:45.59157 2016-04-02 12:03:45 pykka[55464] DEBUG: Stopped ComputeNodeShutdownActor (urn:uuid:2c32c6e7-80a6-4d92-8270-feddab943501)
</pre> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=374852016-04-06T15:04:29ZNico César
<ul></ul><p>Brett Smith wrote:</p>
<blockquote>
<p>Note that Node Manager's retry code logs the full traceback for every exception it handles. The fact that a traceback appeared, by itself, doesn't mean that the exception was unhandled.</p>
</blockquote>
<p>Yes. You're right about this. Actually in #8896 we can see that at 2016-04-06 03:40:23 nodes were coming up as expected.</p>
<p>I think we can close this ticket since it's a false positive for the symptoms of "nodemanager being wedged",</p>
<p>Personally I would like not to see tracebacks on the log file. But it's a much lower priority issue regarding that.</p> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=374862016-04-06T15:07:23ZBrett Smithbrett.smith@curii.com
<ul></ul><p>Nico Cesar wrote:</p>
<blockquote>
<p>Brett Smith wrote:</p>
<blockquote>
<p>Note that Node Manager's retry code logs the full traceback for every exception it handles. The fact that a traceback appeared, by itself, doesn't mean that the exception was unhandled.</p>
</blockquote>
<p>Yes. You're right about this. Actually in #8896 we can see that at 2016-04-06 03:40:23 nodes were coming up as expected.</p>
</blockquote>
<p>Yeah. It looks like what happened is that Libcloud timed out waiting for a response to its shutdown request, but Azure did receive and act on the request, and Node Manager noticed this through the cloud node listings.</p>
<blockquote>
<p>Personally I would like not to see tracebacks on the log file. But it's a much lower priority issue regarding that.</p>
</blockquote>
<p>We can make the ticket about that, sure.</p> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=374872016-04-06T15:10:34ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Tracker</strong> changed from <i>Bug</i> to <i>Idea</i></li><li><strong>Subject</strong> changed from <i>[NODEMANAGER] libcloud.common.azure.AzureResponse was a LibcloudError. Nodemanager wedged</i> to <i>[Node Manager] Less logging of tracebacks for routine exceptions</i></li><li><strong>Description</strong> updated (<a title="View differences" href="/journals/37487/diff?detail_id=36621">diff</a>)</li></ul> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=379012016-04-14T18:47:57ZNico César
<ul></ul><p>see #8996 for another warning that shouldn't appear</p> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=379142016-04-14T23:51:52ZBrett Smithbrett.smith@curii.com
<ul><li><strong>Target version</strong> set to <i>Arvados Future Sprints</i></li></ul> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=877802020-10-07T15:26:31ZWard Vandewegeward@curii.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Closed</i></li></ul> Arvados - Idea #8894: [Node Manager] Less logging of tracebacks for routine exceptionshttps://dev.arvados.org/issues/8894?journal_id=885102020-11-04T17:19:32ZWard Vandewegeward@curii.com
<ul><li><strong>Target version</strong> deleted (<del><i>Arvados Future Sprints</i></del>)</li></ul>