Bug #8825: [Keepstore] many connections in CLOSE_WAIT - Arvados

Actions

Copy link

Bug #8825

closed

[Keepstore] many connections in CLOSE_WAIT

Added by Ward Vandewege almost 9 years ago. Updated almost 8 years ago.

Status:

Resolved

Priority:

Normal

Assigned To:

Category:

Target version:

Story points:

Description

The keepstores on su92l have been piling up connections in CLOSE_WAIT state. For example, keep26:

keep26.su92l:~# lsof -p 36853 | grep CLOSE_WAIT
keepstore 36853 root    5u  IPv6 5053220      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38095 (CLOSE_WAIT)
keepstore 36853 root    7u  IPv6 5036819      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43320 (CLOSE_WAIT)
keepstore 36853 root    8u  IPv6 5069632      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35264 (CLOSE_WAIT)
keepstore 36853 root   10u  IPv6 5072995      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39121 (CLOSE_WAIT)
keepstore 36853 root   11u  IPv6 5043315      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34177 (CLOSE_WAIT)
keepstore 36853 root   12u  IPv6 5072983      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44838 (CLOSE_WAIT)
keepstore 36853 root   14u  IPv6 5072993      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45886 (CLOSE_WAIT)
keepstore 36853 root   15u  IPv6 5069930      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55377 (CLOSE_WAIT)
keepstore 36853 root   17u  IPv6 5073010      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35282 (CLOSE_WAIT)
keepstore 36853 root   18u  IPv6 5073012      0t0    TCP keep26.su92l.arvadosapi.com:25107->git.su92l.arvadosapi.com:34172 (CLOSE_WAIT)
keepstore 36853 root   24u  IPv6 5043317      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:37907 (CLOSE_WAIT)
keepstore 36853 root   25u  IPv6 5073014      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45904 (CLOSE_WAIT)
keepstore 36853 root   28u  IPv6 5069934      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37853 (CLOSE_WAIT)
keepstore 36853 root   29u  IPv6 5027357      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43091 (CLOSE_WAIT)
keepstore 36853 root   30u  IPv6 5075001      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37335 (CLOSE_WAIT)
keepstore 36853 root   31u  IPv6 5053340      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34180 (CLOSE_WAIT)
keepstore 36853 root   33u  IPv6 5035233      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43458 (CLOSE_WAIT)
keepstore 36853 root   35u  IPv6 5053406      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44141 (CLOSE_WAIT)
keepstore 36853 root   36u  IPv6 5036821      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43575 (CLOSE_WAIT)
keepstore 36853 root   37u  IPv6 5043319      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34192 (CLOSE_WAIT)
keepstore 36853 root   39u  IPv6 5027198      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37259 (CLOSE_WAIT)
keepstore 36853 root   40u  IPv6 5039209      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute33.su92l.arvadosapi.com:43821 (CLOSE_WAIT)
keepstore 36853 root   44u  IPv6 5047029      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38113 (CLOSE_WAIT)
keepstore 36853 root   48u  IPv6 5034966      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute28.su92l.arvadosapi.com:58369 (CLOSE_WAIT)
keepstore 36853 root   49u  IPv6 5027312      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43021 (CLOSE_WAIT)
keepstore 36853 root   53u  IPv6 5035123      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute28.su92l.arvadosapi.com:58354 (CLOSE_WAIT)
keepstore 36853 root   55u  IPv6 5039309      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute28.su92l.arvadosapi.com:58458 (CLOSE_WAIT)
keepstore 36853 root   57u  IPv6 5035266      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43507 (CLOSE_WAIT)
keepstore 36853 root   63u  IPv6 5033617      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:42884 (CLOSE_WAIT)
keepstore 36853 root   66u  IPv6 5035149      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute54.su92l.arvadosapi.com:58749 (CLOSE_WAIT)
keepstore 36853 root   67u  IPv6 5035171      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute60.su92l.arvadosapi.com:57881 (CLOSE_WAIT)
keepstore 36853 root   68u  IPv6 5038168      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute56.su92l.arvadosapi.com:43108 (CLOSE_WAIT)
keepstore 36853 root   69u  IPv6 5034222      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38160 (CLOSE_WAIT)
keepstore 36853 root   73u  IPv6 5038198      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute56.su92l.arvadosapi.com:43116 (CLOSE_WAIT)
keepstore 36853 root   74u  IPv6 5035237      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43144 (CLOSE_WAIT)
keepstore 36853 root   81u  IPv6 5035272      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33528 (CLOSE_WAIT)
keepstore 36853 root   85u  IPv6 5039518      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute63.su92l.arvadosapi.com:59442 (CLOSE_WAIT)
keepstore 36853 root   88u  IPv6 5040440      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33579 (CLOSE_WAIT)
keepstore 36853 root   96u  IPv6 5027800      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33675 (CLOSE_WAIT)
keepstore 36853 root   97u  IPv6 5038593      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43158 (CLOSE_WAIT)
keepstore 36853 root   99u  IPv6 5036817      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34245 (CLOSE_WAIT)
keepstore 36853 root  101u  IPv6 5035247      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute54.su92l.arvadosapi.com:58796 (CLOSE_WAIT)
keepstore 36853 root  102u  IPv6 5047014      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44089 (CLOSE_WAIT)
keepstore 36853 root  103u  IPv6 5035292      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37509 (CLOSE_WAIT)
keepstore 36853 root  104u  IPv6 5035294      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37510 (CLOSE_WAIT)
keepstore 36853 root  105u  IPv6 5035319      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43548 (CLOSE_WAIT)
keepstore 36853 root  106u  IPv6 5035302      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33559 (CLOSE_WAIT)
keepstore 36853 root  107u  IPv6 5035326      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute63.su92l.arvadosapi.com:59480 (CLOSE_WAIT)
keepstore 36853 root  108u  IPv6 5035249      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43171 (CLOSE_WAIT)
keepstore 36853 root  110u  IPv6 5035251      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33479 (CLOSE_WAIT)
keepstore 36853 root  112u  IPv6 5035328      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43341 (CLOSE_WAIT)
keepstore 36853 root  115u  IPv6 5035253      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:55974 (CLOSE_WAIT)
keepstore 36853 root  116u  IPv6 5035155      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute54.su92l.arvadosapi.com:58756 (CLOSE_WAIT)
keepstore 36853 root  121u  IPv6 5027448      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38324 (CLOSE_WAIT)
keepstore 36853 root  122u  IPv6 5027367      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37421 (CLOSE_WAIT)
keepstore 36853 root  123u  IPv6 5037744      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43115 (CLOSE_WAIT)
keepstore 36853 root  124u  IPv6 5037806      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37427 (CLOSE_WAIT)
keepstore 36853 root  125u  IPv6 5027373      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38956 (CLOSE_WAIT)
keepstore 36853 root  128u  IPv6 5040104      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56031 (CLOSE_WAIT)
keepstore 36853 root  129u  IPv6 5047037      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44060 (CLOSE_WAIT)
keepstore 36853 root  130u  IPv6 5035254      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34183 (CLOSE_WAIT)
keepstore 36853 root  132u  IPv6 5038855      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37469 (CLOSE_WAIT)
keepstore 36853 root  138u  IPv6 5040161      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37532 (CLOSE_WAIT)
keepstore 36853 root  139u  IPv6 5040195      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute13.su92l.arvadosapi.com:45752 (CLOSE_WAIT)
keepstore 36853 root  140u  IPv6 5027450      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43298 (CLOSE_WAIT)
keepstore 36853 root  142u  IPv6 5027459      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33607 (CLOSE_WAIT)
keepstore 36853 root  144u  IPv6 5035367      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37564 (CLOSE_WAIT)
keepstore 36853 root  145u  IPv6 5035369      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43369 (CLOSE_WAIT)
keepstore 36853 root  146u  IPv6 5040936      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37570 (CLOSE_WAIT)
keepstore 36853 root  147u  IPv6 5040946      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37572 (CLOSE_WAIT)
keepstore 36853 root  149u  IPv6 5041014      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute33.su92l.arvadosapi.com:43912 (CLOSE_WAIT)
keepstore 36853 root  150u  IPv6 5041044      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute33.su92l.arvadosapi.com:43916 (CLOSE_WAIT)
keepstore 36853 root  152u  IPv6 5041058      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34292 (CLOSE_WAIT)
keepstore 36853 root  153u  IPv6 5027465      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute54.su92l.arvadosapi.com:58886 (CLOSE_WAIT)
keepstore 36853 root  154u  IPv6 5035384      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute33.su92l.arvadosapi.com:43925 (CLOSE_WAIT)
keepstore 36853 root  155u  IPv6 5035386      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33626 (CLOSE_WAIT)
keepstore 36853 root  156u  IPv6 5041228      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37597 (CLOSE_WAIT)
keepstore 36853 root  157u  IPv6 5041234      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56074 (CLOSE_WAIT)
keepstore 36853 root  161u  IPv6 5041404      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43414 (CLOSE_WAIT)
keepstore 36853 root  164u  IPv6 5041473      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33640 (CLOSE_WAIT)
keepstore 36853 root  167u  IPv6 5052913      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38080 (CLOSE_WAIT)
keepstore 36853 root  168u  IPv6 5041565      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33644 (CLOSE_WAIT)
keepstore 36853 root  171u  IPv6 5035415      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43442 (CLOSE_WAIT)
keepstore 36853 root  177u  IPv6 5027490      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33662 (CLOSE_WAIT)
keepstore 36853 root  179u  IPv6 5042028      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37629 (CLOSE_WAIT)
keepstore 36853 root  180u  IPv6 5042030      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37631 (CLOSE_WAIT)
keepstore 36853 root  181u  IPv6 5035433      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute61.su92l.arvadosapi.com:41317 (CLOSE_WAIT)
keepstore 36853 root  182u  IPv6 5035435      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54733 (CLOSE_WAIT)
keepstore 36853 root  183u  IPv6 5042053      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54734 (CLOSE_WAIT)
keepstore 36853 root  184u  IPv6 5047031      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38115 (CLOSE_WAIT)
keepstore 36853 root  185u  IPv6 5042067      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43467 (CLOSE_WAIT)
keepstore 36853 root  186u  IPv6 5042154      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34330 (CLOSE_WAIT)
keepstore 36853 root  187u  IPv6 5035646      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37644 (CLOSE_WAIT)
keepstore 36853 root  188u  IPv6 5037025      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56109 (CLOSE_WAIT)
keepstore 36853 root  189u  IPv6 5035660      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37646 (CLOSE_WAIT)
keepstore 36853 root  191u  IPv6 5037027      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43646 (CLOSE_WAIT)
keepstore 36853 root  193u  IPv6 5042360      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43657 (CLOSE_WAIT)
keepstore 36853 root  197u  IPv6 5044328      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43536 (CLOSE_WAIT)
keepstore 36853 root  198u  IPv6 5042368      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33704 (CLOSE_WAIT)
keepstore 36853 root  200u  IPv6 5037035      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37667 (CLOSE_WAIT)
keepstore 36853 root  201u  IPv6 5037037      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43541 (CLOSE_WAIT)
keepstore 36853 root  202u  IPv6 5042372      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute33.su92l.arvadosapi.com:43990 (CLOSE_WAIT)
keepstore 36853 root  203u  IPv6 5037039      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33717 (CLOSE_WAIT)
keepstore 36853 root  205u  IPv6 5044645      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54798 (CLOSE_WAIT)
keepstore 36853 root  206u  IPv6 5044675      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43553 (CLOSE_WAIT)
keepstore 36853 root  207u  IPv6 5037041      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34377 (CLOSE_WAIT)
keepstore 36853 root  209u  IPv6 5037043      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37686 (CLOSE_WAIT)
keepstore 36853 root  210u  IPv6 5037045      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54804 (CLOSE_WAIT)
keepstore 36853 root  211u  IPv6 5037047      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33733 (CLOSE_WAIT)
keepstore 36853 root  213u  IPv6 5042402      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37694 (CLOSE_WAIT)
keepstore 36853 root  214u  IPv6 5037051      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56146 (CLOSE_WAIT)
keepstore 36853 root  215u  IPv6 5037053      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37698 (CLOSE_WAIT)
keepstore 36853 root  217u  IPv6 5044981      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute56.su92l.arvadosapi.com:43297 (CLOSE_WAIT)
keepstore 36853 root  218u  IPv6 5045103      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33745 (CLOSE_WAIT)
keepstore 36853 root  219u  IPv6 5042422      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38460 (CLOSE_WAIT)
keepstore 36853 root  221u  IPv6 5043211      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43590 (CLOSE_WAIT)
keepstore 36853 root  223u  IPv6 5042440      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33765 (CLOSE_WAIT)
keepstore 36853 root  224u  IPv6 5042442      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37731 (CLOSE_WAIT)
keepstore 36853 root  225u  IPv6 5046351      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43718 (CLOSE_WAIT)
keepstore 36853 root  226u  IPv6 5046353      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33778 (CLOSE_WAIT)
keepstore 36853 root  228u  IPv6 5045604      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54837 (CLOSE_WAIT)
keepstore 36853 root  229u  IPv6 5045654      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute63.su92l.arvadosapi.com:39325 (CLOSE_WAIT)
keepstore 36853 root  230u  IPv6 5046359      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43623 (CLOSE_WAIT)
keepstore 36853 root  231u  IPv6 5045708      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34418 (CLOSE_WAIT)
keepstore 36853 root  232u  IPv6 5045726      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54844 (CLOSE_WAIT)
keepstore 36853 root  233u  IPv6 5045736      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37749 (CLOSE_WAIT)
keepstore 36853 root  235u  IPv6 5042460      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43629 (CLOSE_WAIT)
keepstore 36853 root  236u  IPv6 5045800      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33796 (CLOSE_WAIT)
keepstore 36853 root  237u  IPv6 5045826      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43737 (CLOSE_WAIT)
keepstore 36853 root  238u  IPv6 5046373      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37757 (CLOSE_WAIT)
keepstore 36853 root  239u  IPv6 5045896      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37760 (CLOSE_WAIT)
keepstore 36853 root  240u  IPv6 5045910      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43743 (CLOSE_WAIT)
keepstore 36853 root  241u  IPv6 5046375      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56182 (CLOSE_WAIT)
keepstore 36853 root  242u  IPv6 5043221      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33803 (CLOSE_WAIT)
keepstore 36853 root  243u  IPv6 5043223      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute33.su92l.arvadosapi.com:44053 (CLOSE_WAIT)
keepstore 36853 root  244u  IPv6 5042490      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33814 (CLOSE_WAIT)
keepstore 36853 root  245u  IPv6 5046386      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38500 (CLOSE_WAIT)
keepstore 36853 root  246u  IPv6 5046388      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37775 (CLOSE_WAIT)
keepstore 36853 root  247u  IPv6 5042498      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43666 (CLOSE_WAIT)
keepstore 36853 root  248u  IPv6 5046400      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute56.su92l.arvadosapi.com:43354 (CLOSE_WAIT)
keepstore 36853 root  249u  IPv6 5042502      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33828 (CLOSE_WAIT)
keepstore 36853 root  250u  IPv6 5042507      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37787 (CLOSE_WAIT)
keepstore 36853 root  251u  IPv6 5047597      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33836 (CLOSE_WAIT)
keepstore 36853 root  252u  IPv6 5047667      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54877 (CLOSE_WAIT)
keepstore 36853 root  253u  IPv6 5042521      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43691 (CLOSE_WAIT)
keepstore 36853 root  254u  IPv6 5047777      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34465 (CLOSE_WAIT)
keepstore 36853 root  255u  IPv6 5047791      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54884 (CLOSE_WAIT)
keepstore 36853 root  256u  IPv6 5047801      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37800 (CLOSE_WAIT)
keepstore 36853 root  257u  IPv6 5042537      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33857 (CLOSE_WAIT)
keepstore 36853 root  258u  IPv6 5046403      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37820 (CLOSE_WAIT)
keepstore 36853 root  259u  IPv6 5047955      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37823 (CLOSE_WAIT)
keepstore 36853 root  260u  IPv6 5046405      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56220 (CLOSE_WAIT)
keepstore 36853 root  261u  IPv6 5048009      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43789 (CLOSE_WAIT)
keepstore 36853 root  262u  IPv6 5046411      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43790 (CLOSE_WAIT)
keepstore 36853 root  263u  IPv6 5046413      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43727 (CLOSE_WAIT)
keepstore 36853 root  265u  IPv6 5046422      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33868 (CLOSE_WAIT)
keepstore 36853 root  266u  IPv6 5046424      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33875 (CLOSE_WAIT)
keepstore 36853 root  267u  IPv6 5048279      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute33.su92l.arvadosapi.com:44097 (CLOSE_WAIT)
keepstore 36853 root  268u  IPv6 5046431      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38535 (CLOSE_WAIT)
keepstore 36853 root  272u  IPv6 5046441      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43743 (CLOSE_WAIT)
keepstore 36853 root  273u  IPv6 5048517      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33889 (CLOSE_WAIT)
keepstore 36853 root  274u  IPv6 5046443      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37849 (CLOSE_WAIT)
keepstore 36853 root  275u  IPv6 5042574      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33897 (CLOSE_WAIT)
keepstore 36853 root  277u  IPv6 5046447      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54917 (CLOSE_WAIT)
keepstore 36853 root  279u  IPv6 5046453      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34503 (CLOSE_WAIT)
keepstore 36853 root  280u  IPv6 5046455      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54925 (CLOSE_WAIT)
keepstore 36853 root  281u  IPv6 5043240      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43764 (CLOSE_WAIT)
keepstore 36853 root  282u  IPv6 5048837      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37863 (CLOSE_WAIT)
keepstore 36853 root  283u  IPv6 5042597      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37865 (CLOSE_WAIT)
keepstore 36853 root  284u  IPv6 5046458      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37868 (CLOSE_WAIT)
keepstore 36853 root  286u  IPv6 5046462      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56258 (CLOSE_WAIT)
keepstore 36853 root  287u  IPv6 5046464      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33928 (CLOSE_WAIT)
keepstore 36853 root  288u  IPv6 5046466      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33932 (CLOSE_WAIT)
keepstore 36853 root  289u  IPv6 5046468      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33934 (CLOSE_WAIT)
keepstore 36853 root  291u  IPv6 5049249      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43846 (CLOSE_WAIT)
keepstore 36853 root  292u  IPv6 5046486      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38574 (CLOSE_WAIT)
keepstore 36853 root  293u  IPv6 5046488      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43807 (CLOSE_WAIT)
keepstore 36853 root  295u  IPv6 5042627      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43815 (CLOSE_WAIT)
keepstore 36853 root  296u  IPv6 5046501      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33949 (CLOSE_WAIT)
keepstore 36853 root  297u  IPv6 5046503      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37882 (CLOSE_WAIT)
keepstore 36853 root  300u  IPv6 5043247      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37883 (CLOSE_WAIT)
keepstore 36853 root  301u  IPv6 5043249      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43826 (CLOSE_WAIT)
keepstore 36853 root  302u  IPv6 5043251      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43875 (CLOSE_WAIT)
keepstore 36853 root  303u  IPv6 5049669      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33959 (CLOSE_WAIT)
keepstore 36853 root  305u  IPv6 5043255      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54959 (CLOSE_WAIT)
keepstore 36853 root  308u  IPv6 5042636      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34547 (CLOSE_WAIT)
keepstore 36853 root  309u  IPv6 5049863      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:54967 (CLOSE_WAIT)
keepstore 36853 root  310u  IPv6 5046524      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43855 (CLOSE_WAIT)
keepstore 36853 root  311u  IPv6 5049929      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37896 (CLOSE_WAIT)
keepstore 36853 root  312u  IPv6 5042643      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37901 (CLOSE_WAIT)
keepstore 36853 root  316u  IPv6 5046531      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33990 (CLOSE_WAIT)
keepstore 36853 root  318u  IPv6 5043268      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:33997 (CLOSE_WAIT)
keepstore 36853 root  319u  IPv6 5050345      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56303 (CLOSE_WAIT)
keepstore 36853 root  320u  IPv6 5042677      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38611 (CLOSE_WAIT)
keepstore 36853 root  325u  IPv6 5050497      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43882 (CLOSE_WAIT)
keepstore 36853 root  327u  IPv6 5042689      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34018 (CLOSE_WAIT)
keepstore 36853 root  328u  IPv6 5042691      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37934 (CLOSE_WAIT)
keepstore 36853 root  330u  IPv6 5042695      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37939 (CLOSE_WAIT)
keepstore 36853 root  331u  IPv6 5042697      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34026 (CLOSE_WAIT)
keepstore 36853 root  332u  IPv6 5046546      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43904 (CLOSE_WAIT)
keepstore 36853 root  333u  IPv6 5046548      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:55011 (CLOSE_WAIT)
keepstore 36853 root  334u  IPv6 5046570      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34592 (CLOSE_WAIT)
keepstore 36853 root  335u  IPv6 5046576      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:55022 (CLOSE_WAIT)
keepstore 36853 root  336u  IPv6 5046602      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37954 (CLOSE_WAIT)
keepstore 36853 root  337u  IPv6 5042715      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:43938 (CLOSE_WAIT)
keepstore 36853 root  338u  IPv6 5046632      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43920 (CLOSE_WAIT)
keepstore 36853 root  342u  IPv6 5042722      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43925 (CLOSE_WAIT)
keepstore 36853 root  343u  IPv6 5046724      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37960 (CLOSE_WAIT)
keepstore 36853 root  344u  IPv6 5042724      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37961 (CLOSE_WAIT)
keepstore 36853 root  350u  IPv6 5046945      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34048 (CLOSE_WAIT)
keepstore 36853 root  351u  IPv6 5042805      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute28.su92l.arvadosapi.com:55144 (CLOSE_WAIT)
keepstore 36853 root  352u  IPv6 5042827      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34056 (CLOSE_WAIT)
keepstore 36853 root  353u  IPv6 5042835      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute54.su92l.arvadosapi.com:33434 (CLOSE_WAIT)
keepstore 36853 root  355u  IPv6 5042874      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34063 (CLOSE_WAIT)
keepstore 36853 root  356u  IPv6 5042912      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38648 (CLOSE_WAIT)
keepstore 36853 root  358u  IPv6 5042995      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56345 (CLOSE_WAIT)
keepstore 36853 root  359u  IPv6 5053782      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44169 (CLOSE_WAIT)
keepstore 36853 root  360u  IPv6 5046953      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43956 (CLOSE_WAIT)
keepstore 36853 root  362u  IPv6 5043149      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:37997 (CLOSE_WAIT)
keepstore 36853 root  363u  IPv6 5046957      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34077 (CLOSE_WAIT)
keepstore 36853 root  366u  IPv6 5046963      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38003 (CLOSE_WAIT)
keepstore 36853 root  367u  IPv6 5051482      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34085 (CLOSE_WAIT)
keepstore 36853 root  369u  IPv6 5051549      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:55052 (CLOSE_WAIT)
keepstore 36853 root  370u  IPv6 5046964      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:43989 (CLOSE_WAIT)
keepstore 36853 root  372u  IPv6 5046968      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34635 (CLOSE_WAIT)
keepstore 36853 root  373u  IPv6 5046970      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:55062 (CLOSE_WAIT)
keepstore 36853 root  374u  IPv6 5043289      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44006 (CLOSE_WAIT)
keepstore 36853 root  376u  IPv6 5043291      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38032 (CLOSE_WAIT)
keepstore 36853 root  378u  IPv6 5043297      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38045 (CLOSE_WAIT)
keepstore 36853 root  382u  IPv6 5043301      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44043 (CLOSE_WAIT)
keepstore 36853 root  384u  IPv6 5052160      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34110 (CLOSE_WAIT)
keepstore 36853 root  385u  IPv6 5052198      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34124 (CLOSE_WAIT)
keepstore 36853 root  386u  IPv6 5052200      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38053 (CLOSE_WAIT)
keepstore 36853 root  387u  IPv6 5046993      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute25.su92l.arvadosapi.com:38683 (CLOSE_WAIT)
keepstore 36853 root  388u  IPv6 5043303      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34134 (CLOSE_WAIT)
keepstore 36853 root  389u  IPv6 5047000      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44055 (CLOSE_WAIT)
keepstore 36853 root  390u  IPv6 5052372      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute10.su92l.arvadosapi.com:56385 (CLOSE_WAIT)
keepstore 36853 root  392u  IPv6 5047003      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38062 (CLOSE_WAIT)
keepstore 36853 root  393u  IPv6 5043305      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34141 (CLOSE_WAIT)
keepstore 36853 root  395u  IPv6 5052553      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38068 (CLOSE_WAIT)
keepstore 36853 root  396u  IPv6 5047005      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34149 (CLOSE_WAIT)
keepstore 36853 root  397u  IPv6 5052631      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:55095 (CLOSE_WAIT)
keepstore 36853 root  398u  IPv6 5052649      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44024 (CLOSE_WAIT)
keepstore 36853 root  399u  IPv6 5047007      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44075 (CLOSE_WAIT)
keepstore 36853 root  400u  IPv6 5047009      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute26.su92l.arvadosapi.com:55103 (CLOSE_WAIT)
keepstore 36853 root  401u  IPv6 5052772      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute58.su92l.arvadosapi.com:34683 (CLOSE_WAIT)
keepstore 36853 root  403u  IPv6 5053663      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38120 (CLOSE_WAIT)
keepstore 36853 root  404u  IPv6 5047035      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34203 (CLOSE_WAIT)
keepstore 36853 root  405u  IPv6 5047039      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44065 (CLOSE_WAIT)
keepstore 36853 root  406u  IPv6 5047042      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44174 (CLOSE_WAIT)
keepstore 36853 root  407u  IPv6 5043325      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38136 (CLOSE_WAIT)
keepstore 36853 root  408u  IPv6 5054024      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44091 (CLOSE_WAIT)
keepstore 36853 root  409u  IPv6 5054026      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44186 (CLOSE_WAIT)
keepstore 36853 root  410u  IPv6 5054139      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44190 (CLOSE_WAIT)
keepstore 36853 root  411u  IPv6 5043331      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38161 (CLOSE_WAIT)
keepstore 36853 root  412u  IPv6 5054404      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34237 (CLOSE_WAIT)
keepstore 36853 root  413u  IPv6 5047052      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34246 (CLOSE_WAIT)
keepstore 36853 root  414u  IPv6 5047054      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38010 (CLOSE_WAIT)
keepstore 36853 root  415u  IPv6 5043336      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44219 (CLOSE_WAIT)
keepstore 36853 root  416u  IPv6 5054629      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34255 (CLOSE_WAIT)
keepstore 36853 root  417u  IPv6 5047058      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38170 (CLOSE_WAIT)
keepstore 36853 root  418u  IPv6 5047060      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38175 (CLOSE_WAIT)
keepstore 36853 root  419u  IPv6 5054767      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34262 (CLOSE_WAIT)
keepstore 36853 root  420u  IPv6 5047063      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44230 (CLOSE_WAIT)
keepstore 36853 root  421u  IPv6 5047074      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44243 (CLOSE_WAIT)
keepstore 36853 root  422u  IPv6 5047076      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38195 (CLOSE_WAIT)
keepstore 36853 root  423u  IPv6 5043342      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44132 (CLOSE_WAIT)
keepstore 36853 root  424u  IPv6 5047079      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44263 (CLOSE_WAIT)
keepstore 36853 root  425u  IPv6 5043344      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44272 (CLOSE_WAIT)
keepstore 36853 root  426u  IPv6 5043434      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38217 (CLOSE_WAIT)
keepstore 36853 root  427u  IPv6 5055360      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38222 (CLOSE_WAIT)
keepstore 36853 root  428u  IPv6 5055373      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38074 (CLOSE_WAIT)
keepstore 36853 root  429u  IPv6 5050899      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34317 (CLOSE_WAIT)
keepstore 36853 root  430u  IPv6 5055380      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44299 (CLOSE_WAIT)
keepstore 36853 root  431u  IPv6 5055382      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34318 (CLOSE_WAIT)
keepstore 36853 root  432u  IPv6 5055390      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38240 (CLOSE_WAIT)
keepstore 36853 root  433u  IPv6 5047102      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34326 (CLOSE_WAIT)
keepstore 36853 root  434u  IPv6 5055401      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44312 (CLOSE_WAIT)
keepstore 36853 root  435u  IPv6 5055405      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34336 (CLOSE_WAIT)
keepstore 36853 root  436u  IPv6 5047108      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38273 (CLOSE_WAIT)
keepstore 36853 root  437u  IPv6 5055413      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44324 (CLOSE_WAIT)
keepstore 36853 root  438u  IPv6 5055415      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44171 (CLOSE_WAIT)
keepstore 36853 root  439u  IPv6 5055422      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44347 (CLOSE_WAIT)
keepstore 36853 root  440u  IPv6 5055429      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44358 (CLOSE_WAIT)
keepstore 36853 root  441u  IPv6 5055439      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38286 (CLOSE_WAIT)
keepstore 36853 root  442u  IPv6 5056612      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38294 (CLOSE_WAIT)
keepstore 36853 root  443u  IPv6 5055461      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44369 (CLOSE_WAIT)
keepstore 36853 root  444u  IPv6 5055463      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34367 (CLOSE_WAIT)
keepstore 36853 root  445u  IPv6 5055465      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38129 (CLOSE_WAIT)
keepstore 36853 root  446u  IPv6 5056871      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44387 (CLOSE_WAIT)
keepstore 36853 root  447u  IPv6 5055467      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34369 (CLOSE_WAIT)
keepstore 36853 root  448u  IPv6 5056901      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38307 (CLOSE_WAIT)
keepstore 36853 root  449u  IPv6 5050914      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34377 (CLOSE_WAIT)
keepstore 36853 root  450u  IPv6 5055471      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38308 (CLOSE_WAIT)
keepstore 36853 root  451u  IPv6 5050916      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44403 (CLOSE_WAIT)
keepstore 36853 root  452u  IPv6 5050917      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34392 (CLOSE_WAIT)
keepstore 36853 root  453u  IPv6 5057217      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38320 (CLOSE_WAIT)
keepstore 36853 root  454u  IPv6 5050919      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44207 (CLOSE_WAIT)
keepstore 36853 root  455u  IPv6 5057537      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44420 (CLOSE_WAIT)
keepstore 36853 root  456u  IPv6 5057335      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44432 (CLOSE_WAIT)
keepstore 36853 root  457u  IPv6 5057558      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34408 (CLOSE_WAIT)
keepstore 36853 root  458u  IPv6 5057449      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44444 (CLOSE_WAIT)
keepstore 36853 root  459u  IPv6 5057564      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38333 (CLOSE_WAIT)
keepstore 36853 root  460u  IPv6 5057570      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38339 (CLOSE_WAIT)
keepstore 36853 root  461u  IPv6 5057575      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44473 (CLOSE_WAIT)
keepstore 36853 root  462u  IPv6 5058760      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38179 (CLOSE_WAIT)
keepstore 36853 root  463u  IPv6 5058761      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34437 (CLOSE_WAIT)
keepstore 36853 root  464u  IPv6 5055584      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37279 (CLOSE_WAIT)
keepstore 36853 root  465u  IPv6 5058767      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34442 (CLOSE_WAIT)
keepstore 36853 root  466u  IPv6 5058769      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44499 (CLOSE_WAIT)
keepstore 36853 root  467u  IPv6 5058771      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34446 (CLOSE_WAIT)
keepstore 36853 root  468u  IPv6 5055590      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44505 (CLOSE_WAIT)
keepstore 36853 root  469u  IPv6 5057593      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34455 (CLOSE_WAIT)
keepstore 36853 root  470u  IPv6 5057595      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38377 (CLOSE_WAIT)
keepstore 36853 root  471u  IPv6 5059647      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44244 (CLOSE_WAIT)
keepstore 36853 root  472u  IPv6 5059669      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44525 (CLOSE_WAIT)
keepstore 36853 root  473u  IPv6 5059687      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38381 (CLOSE_WAIT)
keepstore 36853 root  474u  IPv6 5059776      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44542 (CLOSE_WAIT)
keepstore 36853 root  475u  IPv6 5059909      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44550 (CLOSE_WAIT)
keepstore 36853 root  476u  IPv6 5060006      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38397 (CLOSE_WAIT)
keepstore 36853 root  477u  IPv6 5057612      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38400 (CLOSE_WAIT)
keepstore 36853 root  478u  IPv6 5057614      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44558 (CLOSE_WAIT)
keepstore 36853 root  479u  IPv6 5058788      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34483 (CLOSE_WAIT)
keepstore 36853 root  480u  IPv6 5058795      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44564 (CLOSE_WAIT)
keepstore 36853 root  481u  IPv6 5060343      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34496 (CLOSE_WAIT)
keepstore 36853 root  482u  IPv6 5055603      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38223 (CLOSE_WAIT)
keepstore 36853 root  483u  IPv6 5058804      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34501 (CLOSE_WAIT)
keepstore 36853 root  484u  IPv6 5058806      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34507 (CLOSE_WAIT)
keepstore 36853 root  485u  IPv6 5058808      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37325 (CLOSE_WAIT)
keepstore 36853 root  486u  IPv6 5058810      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44597 (CLOSE_WAIT)
keepstore 36853 root  487u  IPv6 5060539      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44607 (CLOSE_WAIT)
keepstore 36853 root  488u  IPv6 5060669      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34520 (CLOSE_WAIT)
keepstore 36853 root  489u  IPv6 5057848      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38423 (CLOSE_WAIT)
keepstore 36853 root  490u  IPv6 5057898      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44281 (CLOSE_WAIT)
keepstore 36853 root  491u  IPv6 5057958      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44619 (CLOSE_WAIT)
keepstore 36853 root  492u  IPv6 5058008      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38431 (CLOSE_WAIT)
keepstore 36853 root  493u  IPv6 5058046      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44632 (CLOSE_WAIT)
keepstore 36853 root  494u  IPv6 5059006      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38439 (CLOSE_WAIT)
keepstore 36853 root  495u  IPv6 5055838      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44650 (CLOSE_WAIT)
keepstore 36853 root  496u  IPv6 5055840      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38460 (CLOSE_WAIT)
keepstore 36853 root  497u  IPv6 5059009      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38468 (CLOSE_WAIT)
keepstore 36853 root  498u  IPv6 5059011      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44660 (CLOSE_WAIT)
keepstore 36853 root  499u  IPv6 5059013      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44662 (CLOSE_WAIT)
keepstore 36853 root  500u  IPv6 5061770      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34571 (CLOSE_WAIT)
keepstore 36853 root  501u  IPv6 5059025      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34574 (CLOSE_WAIT)
keepstore 36853 root  502u  IPv6 5061852      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34575 (CLOSE_WAIT)
keepstore 36853 root  503u  IPv6 5059027      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37366 (CLOSE_WAIT)
keepstore 36853 root  504u  IPv6 5061884      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44694 (CLOSE_WAIT)
keepstore 36853 root  505u  IPv6 5059029      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44704 (CLOSE_WAIT)
keepstore 36853 root  506u  IPv6 5059031      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34581 (CLOSE_WAIT)
keepstore 36853 root  507u  IPv6 5059033      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38329 (CLOSE_WAIT)
keepstore 36853 root  508u  IPv6 5055853      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34587 (CLOSE_WAIT)
keepstore 36853 root  509u  IPv6 5062044      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38498 (CLOSE_WAIT)
keepstore 36853 root  510u  IPv6 5062062      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44330 (CLOSE_WAIT)
keepstore 36853 root  511u  IPv6 5059035      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44721 (CLOSE_WAIT)
keepstore 36853 root  512u  IPv6 5055859      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44735 (CLOSE_WAIT)
keepstore 36853 root  513u  IPv6 5055861      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44749 (CLOSE_WAIT)
keepstore 36853 root  514u  IPv6 5055863      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38526 (CLOSE_WAIT)
keepstore 36853 root  515u  IPv6 5059048      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38538 (CLOSE_WAIT)
keepstore 36853 root  516u  IPv6 5062603      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44763 (CLOSE_WAIT)
keepstore 36853 root  517u  IPv6 5059050      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44766 (CLOSE_WAIT)
keepstore 36853 root  518u  IPv6 5062860      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34620 (CLOSE_WAIT)
keepstore 36853 root  519u  IPv6 5060854      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37417 (CLOSE_WAIT)
keepstore 36853 root  520u  IPv6 5055869      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34625 (CLOSE_WAIT)
keepstore 36853 root  521u  IPv6 5060868      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38558 (CLOSE_WAIT)
keepstore 36853 root  522u  IPv6 5059057      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34633 (CLOSE_WAIT)
keepstore 36853 root  523u  IPv6 5059059      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34637 (CLOSE_WAIT)
keepstore 36853 root  524u  IPv6 5062898      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44809 (CLOSE_WAIT)
keepstore 36853 root  525u  IPv6 5055871      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38560 (CLOSE_WAIT)
keepstore 36853 root  526u  IPv6 5059065      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38373 (CLOSE_WAIT)
keepstore 36853 root  527u  IPv6 5059063      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44817 (CLOSE_WAIT)
keepstore 36853 root  528u  IPv6 5062905      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38565 (CLOSE_WAIT)
keepstore 36853 root  529u  IPv6 5062907      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44366 (CLOSE_WAIT)
keepstore 36853 root  530u  IPv6 5062918      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44824 (CLOSE_WAIT)
keepstore 36853 root  531u  IPv6 5062921      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44833 (CLOSE_WAIT)
keepstore 36853 root  532u  IPv6 5055877      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44851 (CLOSE_WAIT)
keepstore 36853 root  533u  IPv6 5062923      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38581 (CLOSE_WAIT)
keepstore 36853 root  535u  IPv6 5061507      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38588 (CLOSE_WAIT)
keepstore 36853 root  536u  IPv6 5059148      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44861 (CLOSE_WAIT)
keepstore 36853 root  537u  IPv6 5061509      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44874 (CLOSE_WAIT)
keepstore 36853 root  538u  IPv6 5062946      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34687 (CLOSE_WAIT)
keepstore 36853 root  539u  IPv6 5059398      0t0    TCP keep26.su92l.arvadosapi.com:25107->git.su92l.arvadosapi.com:56730 (CLOSE_WAIT)
keepstore 36853 root  540u  IPv6 5062948      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34688 (CLOSE_WAIT)
keepstore 36853 root  541u  IPv6 5055884      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37453 (CLOSE_WAIT)
keepstore 36853 root  542u  IPv6 5062950      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34695 (CLOSE_WAIT)
keepstore 36853 root  543u  IPv6 5062952      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38615 (CLOSE_WAIT)
keepstore 36853 root  544u  IPv6 5062956      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34708 (CLOSE_WAIT)
keepstore 36853 root  545u  IPv6 5062958      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44891 (CLOSE_WAIT)
keepstore 36853 root  546u  IPv6 5061515      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38424 (CLOSE_WAIT)
keepstore 36853 root  547u  IPv6 5063743      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38622 (CLOSE_WAIT)
keepstore 36853 root  548u  IPv6 5063749      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38624 (CLOSE_WAIT)
keepstore 36853 root  549u  IPv6 5063759      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44911 (CLOSE_WAIT)
keepstore 36853 root  550u  IPv6 5062964      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44403 (CLOSE_WAIT)
keepstore 36853 root  551u  IPv6 5062966      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44920 (CLOSE_WAIT)
keepstore 36853 root  552u  IPv6 5062971      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44934 (CLOSE_WAIT)
keepstore 36853 root  553u  IPv6 5062975      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44945 (CLOSE_WAIT)
keepstore 36853 root  554u  IPv6 5062976      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38639 (CLOSE_WAIT)
keepstore 36853 root  555u  IPv6 5064290      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44963 (CLOSE_WAIT)
keepstore 36853 root  556u  IPv6 5062993      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44972 (CLOSE_WAIT)
keepstore 36853 root  557u  IPv6 5064528      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34754 (CLOSE_WAIT)
keepstore 36853 root  558u  IPv6 5063007      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34761 (CLOSE_WAIT)
keepstore 36853 root  559u  IPv6 5063009      0t0    TCP keep26.su92l.arvadosapi.com:25107->git.su92l.arvadosapi.com:41083 (CLOSE_WAIT)
keepstore 36853 root  560u  IPv6 5063016      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37489 (CLOSE_WAIT)
keepstore 36853 root  561u  IPv6 5063018      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38667 (CLOSE_WAIT)
keepstore 36853 root  562u  IPv6 5063020      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34765 (CLOSE_WAIT)
keepstore 36853 root  563u  IPv6 5061540      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34770 (CLOSE_WAIT)
keepstore 36853 root  564u  IPv6 5063023      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34778 (CLOSE_WAIT)
keepstore 36853 root  565u  IPv6 5061542      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:44995 (CLOSE_WAIT)
keepstore 36853 root  566u  IPv6 5063026      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38674 (CLOSE_WAIT)
keepstore 36853 root  567u  IPv6 5064798      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44438 (CLOSE_WAIT)
keepstore 36853 root  568u  IPv6 5063030      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38519 (CLOSE_WAIT)
keepstore 36853 root  569u  IPv6 5064939      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44461 (CLOSE_WAIT)
keepstore 36853 root  570u  IPv6 5064951      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38682 (CLOSE_WAIT)
keepstore 36853 root  571u  IPv6 5064969      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45030 (CLOSE_WAIT)
keepstore 36853 root  572u  IPv6 5061544      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45035 (CLOSE_WAIT)
keepstore 36853 root  573u  IPv6 5063036      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45046 (CLOSE_WAIT)
keepstore 36853 root  574u  IPv6 5063046      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38687 (CLOSE_WAIT)
keepstore 36853 root  575u  IPv6 5063053      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45057 (CLOSE_WAIT)
keepstore 36853 root  576u  IPv6 5065348      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45072 (CLOSE_WAIT)
keepstore 36853 root  577u  IPv6 5065362      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38691 (CLOSE_WAIT)
keepstore 36853 root  578u  IPv6 5061550      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45088 (CLOSE_WAIT)
keepstore 36853 root  579u  IPv6 5065660      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34817 (CLOSE_WAIT)
keepstore 36853 root  580u  IPv6 5063086      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38704 (CLOSE_WAIT)
keepstore 36853 root  581u  IPv6 5063088      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34825 (CLOSE_WAIT)
keepstore 36853 root  582u  IPv6 5061552      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37550 (CLOSE_WAIT)
keepstore 36853 root  583u  IPv6 5055910      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34829 (CLOSE_WAIT)
keepstore 36853 root  584u  IPv6 5061554      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34837 (CLOSE_WAIT)
keepstore 36853 root  585u  IPv6 5061558      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45112 (CLOSE_WAIT)
keepstore 36853 root  586u  IPv6 5061560      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37028 (CLOSE_WAIT)
keepstore 36853 root  587u  IPv6 5065838      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38723 (CLOSE_WAIT)
keepstore 36853 root  588u  IPv6 5065984      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44501 (CLOSE_WAIT)
keepstore 36853 root  589u  IPv6 5061562      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38733 (CLOSE_WAIT)
keepstore 36853 root  590u  IPv6 5066042      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45143 (CLOSE_WAIT)
keepstore 36853 root  591u  IPv6 5055912      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38592 (CLOSE_WAIT)
keepstore 36853 root  592u  IPv6 5055914      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34853 (CLOSE_WAIT)
keepstore 36853 root  593u  IPv6 5061566      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45163 (CLOSE_WAIT)
keepstore 36853 root  594u  IPv6 5061568      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44517 (CLOSE_WAIT)
keepstore 36853 root  595u  IPv6 5061570      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45169 (CLOSE_WAIT)
keepstore 36853 root  596u  IPv6 5066205      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38755 (CLOSE_WAIT)
keepstore 36853 root  597u  IPv6 5061572      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45180 (CLOSE_WAIT)
keepstore 36853 root  598u  IPv6 5066397      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45186 (CLOSE_WAIT)
keepstore 36853 root  599u  IPv6 5066467      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38765 (CLOSE_WAIT)
keepstore 36853 root  600u  IPv6 5066510      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45201 (CLOSE_WAIT)
keepstore 36853 root  601u  IPv6 5063127      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55115 (CLOSE_WAIT)
keepstore 36853 root  602u  IPv6 5063132      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34881 (CLOSE_WAIT)
keepstore 36853 root  603u  IPv6 5063134      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38777 (CLOSE_WAIT)
keepstore 36853 root  604u  IPv6 5063138      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34885 (CLOSE_WAIT)
keepstore 36853 root  605u  IPv6 5063140      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37590 (CLOSE_WAIT)
keepstore 36853 root  606u  IPv6 5066806      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34888 (CLOSE_WAIT)
keepstore 36853 root  607u  IPv6 5063148      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34896 (CLOSE_WAIT)
keepstore 36853 root  608u  IPv6 5061578      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37068 (CLOSE_WAIT)
keepstore 36853 root  609u  IPv6 5063150      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45221 (CLOSE_WAIT)
keepstore 36853 root  610u  IPv6 5066896      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38785 (CLOSE_WAIT)
keepstore 36853 root  611u  IPv6 5063165      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38633 (CLOSE_WAIT)
keepstore 36853 root  612u  IPv6 5063167      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45238 (CLOSE_WAIT)
keepstore 36853 root  613u  IPv6 5063173      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45254 (CLOSE_WAIT)
keepstore 36853 root  614u  IPv6 5067260      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38804 (CLOSE_WAIT)
keepstore 36853 root  615u  IPv6 5067294      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34916 (CLOSE_WAIT)
keepstore 36853 root  616u  IPv6 5061585      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36307 (CLOSE_WAIT)
keepstore 36853 root  617u  IPv6 5061592      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45286 (CLOSE_WAIT)
keepstore 36853 root  618u  IPv6 5067352      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44568 (CLOSE_WAIT)
keepstore 36853 root  619u  IPv6 5067382      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45293 (CLOSE_WAIT)
keepstore 36853 root  620u  IPv6 5067445      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45296 (CLOSE_WAIT)
keepstore 36853 root  621u  IPv6 5067572      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38821 (CLOSE_WAIT)
keepstore 36853 root  622u  IPv6 5067586      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45308 (CLOSE_WAIT)
keepstore 36853 root  623u  IPv6 5063188      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55155 (CLOSE_WAIT)
keepstore 36853 root  624u  IPv6 5061596      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38830 (CLOSE_WAIT)
keepstore 36853 root  625u  IPv6 5063194      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38833 (CLOSE_WAIT)
keepstore 36853 root  626u  IPv6 5063203      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37628 (CLOSE_WAIT)
keepstore 36853 root  627u  IPv6 5063205      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34955 (CLOSE_WAIT)
keepstore 36853 root  628u  IPv6 5061597      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37107 (CLOSE_WAIT)
keepstore 36853 root  629u  IPv6 5061599      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34963 (CLOSE_WAIT)
keepstore 36853 root  630u  IPv6 5067952      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38842 (CLOSE_WAIT)
keepstore 36853 root  631u  IPv6 5067978      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45329 (CLOSE_WAIT)
keepstore 36853 root  632u  IPv6 5061605      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45349 (CLOSE_WAIT)
keepstore 36853 root  633u  IPv6 5061607      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38685 (CLOSE_WAIT)
keepstore 36853 root  634u  IPv6 5068299      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45365 (CLOSE_WAIT)
keepstore 36853 root  635u  IPv6 5061612      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34982 (CLOSE_WAIT)
keepstore 36853 root  636u  IPv6 5063225      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38855 (CLOSE_WAIT)
keepstore 36853 root  637u  IPv6 5068377      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36348 (CLOSE_WAIT)
keepstore 36853 root  638u  IPv6 5055946      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:34990 (CLOSE_WAIT)
keepstore 36853 root  639u  IPv6 5068434      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45379 (CLOSE_WAIT)
keepstore 36853 root  640u  IPv6 5068512      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45404 (CLOSE_WAIT)
keepstore 36853 root  641u  IPv6 5068564      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45409 (CLOSE_WAIT)
keepstore 36853 root  642u  IPv6 5063256      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44632 (CLOSE_WAIT)
keepstore 36853 root  643u  IPv6 5061627      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45424 (CLOSE_WAIT)
keepstore 36853 root  644u  IPv6 5063258      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55194 (CLOSE_WAIT)
keepstore 36853 root  645u  IPv6 5069826      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38887 (CLOSE_WAIT)
keepstore 36853 root  646u  IPv6 5068875      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38901 (CLOSE_WAIT)
keepstore 36853 root  647u  IPv6 5068861      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44646 (CLOSE_WAIT)
keepstore 36853 root  648u  IPv6 5068939      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35015 (CLOSE_WAIT)
keepstore 36853 root  649u  IPv6 5068919      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37680 (CLOSE_WAIT)
keepstore 36853 root  650u  IPv6 5069002      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37158 (CLOSE_WAIT)
keepstore 36853 root  651u  IPv6 5069020      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38909 (CLOSE_WAIT)
keepstore 36853 root  652u  IPv6 5063264      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45450 (CLOSE_WAIT)
keepstore 36853 root  653u  IPv6 5063280      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45469 (CLOSE_WAIT)
keepstore 36853 root  654u  IPv6 5069834      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38922 (CLOSE_WAIT)
keepstore 36853 root  655u  IPv6 5063284      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45478 (CLOSE_WAIT)
keepstore 36853 root  656u  IPv6 5069837      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35048 (CLOSE_WAIT)
keepstore 36853 root  657u  IPv6 5069839      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38761 (CLOSE_WAIT)
keepstore 36853 root  658u  IPv6 5063292      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36387 (CLOSE_WAIT)
keepstore 36853 root  659u  IPv6 5063330      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35052 (CLOSE_WAIT)
keepstore 36853 root  660u  IPv6 5055958      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45494 (CLOSE_WAIT)
keepstore 36853 root  661u  IPv6 5055960      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45501 (CLOSE_WAIT)
keepstore 36853 root  662u  IPv6 5069455      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38942 (CLOSE_WAIT)
keepstore 36853 root  663u  IPv6 5063533      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35061 (CLOSE_WAIT)
keepstore 36853 root  664u  IPv6 5063567      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45537 (CLOSE_WAIT)
keepstore 36853 root  665u  IPv6 5063610      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45545 (CLOSE_WAIT)
keepstore 36853 root  666u  IPv6 5069466      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55247 (CLOSE_WAIT)
keepstore 36853 root  667u  IPv6 5069468      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38951 (CLOSE_WAIT)
keepstore 36853 root  668u  IPv6 5070966      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38956 (CLOSE_WAIT)
keepstore 36853 root  669u  IPv6 5069478      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37716 (CLOSE_WAIT)
keepstore 36853 root  670u  IPv6 5069480      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35079 (CLOSE_WAIT)
keepstore 36853 root  671u  IPv6 5055966      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44686 (CLOSE_WAIT)
keepstore 36853 root  672u  IPv6 5071085      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37194 (CLOSE_WAIT)
keepstore 36853 root  673u  IPv6 5055972      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44697 (CLOSE_WAIT)
keepstore 36853 root  674u  IPv6 5071101      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:38975 (CLOSE_WAIT)
keepstore 36853 root  675u  IPv6 5055978      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45573 (CLOSE_WAIT)
keepstore 36853 root  676u  IPv6 5069504      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35114 (CLOSE_WAIT)
keepstore 36853 root  677u  IPv6 5071439      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45600 (CLOSE_WAIT)
keepstore 36853 root  678u  IPv6 5071343      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44710 (CLOSE_WAIT)
keepstore 36853 root  679u  IPv6 5071453      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35104 (CLOSE_WAIT)
keepstore 36853 root  680u  IPv6 5055981      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44721 (CLOSE_WAIT)
keepstore 36853 root  681u  IPv6 5071536      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45620 (CLOSE_WAIT)
keepstore 36853 root  682u  IPv6 5069514      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45676 (CLOSE_WAIT)
keepstore 36853 root  683u  IPv6 5071579      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36437 (CLOSE_WAIT)
keepstore 36853 root  684u  IPv6 5071621      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35121 (CLOSE_WAIT)
keepstore 36853 root  685u  IPv6 5071718      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45641 (CLOSE_WAIT)
keepstore 36853 root  686u  IPv6 5069851      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45635 (CLOSE_WAIT)
keepstore 36853 root  687u  IPv6 5069859      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35130 (CLOSE_WAIT)
keepstore 36853 root  688u  IPv6 5069516      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55284 (CLOSE_WAIT)
keepstore 36853 root  689u  IPv6 5069518      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39020 (CLOSE_WAIT)
keepstore 36853 root  690u  IPv6 5069524      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45685 (CLOSE_WAIT)
keepstore 36853 root  691u  IPv6 5072082      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39026 (CLOSE_WAIT)
keepstore 36853 root  693u  IPv6 5069528      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37752 (CLOSE_WAIT)
keepstore 36853 root  694u  IPv6 5069532      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35148 (CLOSE_WAIT)
keepstore 36853 root  695u  IPv6 5072199      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37230 (CLOSE_WAIT)
keepstore 36853 root  696u  IPv6 5069540      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39044 (CLOSE_WAIT)
keepstore 36853 root  697u  IPv6 5069542      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45700 (CLOSE_WAIT)
keepstore 36853 root  698u  IPv6 5069864      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39038 (CLOSE_WAIT)
keepstore 36853 root  699u  IPv6 5072541      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45718 (CLOSE_WAIT)
keepstore 36853 root  701u  IPv6 5069576      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44764 (CLOSE_WAIT)
keepstore 36853 root  702u  IPv6 5069876      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44765 (CLOSE_WAIT)
keepstore 36853 root  703u  IPv6 5072575      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45722 (CLOSE_WAIT)
keepstore 36853 root  704u  IPv6 5072683      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36473 (CLOSE_WAIT)
keepstore 36853 root  705u  IPv6 5069588      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35190 (CLOSE_WAIT)
keepstore 36853 root  706u  IPv6 5072669      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45735 (CLOSE_WAIT)
keepstore 36853 root  707u  IPv6 5072812      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45749 (CLOSE_WAIT)
keepstore 36853 root  708u  IPv6 5069586      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35184 (CLOSE_WAIT)
keepstore 36853 root  709u  IPv6 5069595      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45754 (CLOSE_WAIT)
keepstore 36853 root  712u  IPv6 5056117      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35198 (CLOSE_WAIT)
keepstore 36853 root  713u  IPv6 5056203      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45776 (CLOSE_WAIT)
keepstore 36853 root  714u  IPv6 5069892      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55320 (CLOSE_WAIT)
keepstore 36853 root  715u  IPv6 5072896      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39075 (CLOSE_WAIT)
keepstore 36853 root  716u  IPv6 5069600      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39080 (CLOSE_WAIT)
keepstore 36853 root  717u  IPv6 5072903      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45790 (CLOSE_WAIT)
keepstore 36853 root  718u  IPv6 5069900      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35224 (CLOSE_WAIT)
keepstore 36853 root  720u  IPv6 5069902      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37813 (CLOSE_WAIT)
keepstore 36853 root  721u  IPv6 5072915      0t0    TCP keep26.su92l.arvadosapi.com:25107->git.su92l.arvadosapi.com:53543 (CLOSE_WAIT)
keepstore 36853 root  722u  IPv6 5072917      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39087 (CLOSE_WAIT)
keepstore 36853 root  723u  IPv6 5069610      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39095 (CLOSE_WAIT)
keepstore 36853 root  724u  IPv6 5069608      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37291 (CLOSE_WAIT)
keepstore 36853 root  725u  IPv6 5074024      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45807 (CLOSE_WAIT)
keepstore 36853 root  726u  IPv6 5069612      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35237 (CLOSE_WAIT)
keepstore 36853 root  727u  IPv6 5072943      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45828 (CLOSE_WAIT)
keepstore 36853 root  728u  IPv6 5069916      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45833 (CLOSE_WAIT)
keepstore 36853 root  729u  IPv6 5072946      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36510 (CLOSE_WAIT)
keepstore 36853 root  730u  IPv6 5072953      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45844 (CLOSE_WAIT)
keepstore 36853 root  731u  IPv6 5069920      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35251 (CLOSE_WAIT)
keepstore 36853 root  732u  IPv6 5074409      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45849 (CLOSE_WAIT)
keepstore 36853 root  733u  IPv6 5074439      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44823 (CLOSE_WAIT)
keepstore 36853 root  734u  IPv6 5072971      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45869 (CLOSE_WAIT)
keepstore 36853 root  735u  IPv6 5072969      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35258 (CLOSE_WAIT)
keepstore 36853 root  736u  IPv6 5075019      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39151 (CLOSE_WAIT)
keepstore 36853 root  737u  IPv6 5074927      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39134 (CLOSE_WAIT)
keepstore 36853 root  738u  IPv6 5073043      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38913 (CLOSE_WAIT)
keepstore 36853 root  739u  IPv6 5075275      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45942 (CLOSE_WAIT)
keepstore 36853 root  740u  IPv6 5073032      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45926 (CLOSE_WAIT)
keepstore 36853 root  741u  IPv6 5069938      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45947 (CLOSE_WAIT)
keepstore 36853 root  742u  IPv6 5073063      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36570 (CLOSE_WAIT)
keepstore 36853 root  744u  IPv6 5069942      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45958 (CLOSE_WAIT)
keepstore 36853 root  745u  IPv6 5069948      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45971 (CLOSE_WAIT)
keepstore 36853 root  746u  IPv6 5069650      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35321 (CLOSE_WAIT)
keepstore 36853 root  747u  IPv6 5069950      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35330 (CLOSE_WAIT)
keepstore 36853 root  748u  IPv6 5073086      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39188 (CLOSE_WAIT)
keepstore 36853 root  749u  IPv6 5075777      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55421 (CLOSE_WAIT)
keepstore 36853 root  750u  IPv6 5073088      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45990 (CLOSE_WAIT)
keepstore 36853 root  751u  IPv6 5073090      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:45995 (CLOSE_WAIT)
keepstore 36853 root  753u  IPv6 5069953      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44897 (CLOSE_WAIT)
keepstore 36853 root  754u  IPv6 5069955      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35351 (CLOSE_WAIT)
keepstore 36853 root  755u  IPv6 5069957      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35352 (CLOSE_WAIT)
keepstore 36853 root  756u  IPv6 5073100      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37891 (CLOSE_WAIT)
keepstore 36853 root  757u  IPv6 5069959      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46020 (CLOSE_WAIT)
keepstore 36853 root  758u  IPv6 5069965      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39203 (CLOSE_WAIT)
keepstore 36853 root  759u  IPv6 5076047      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37373 (CLOSE_WAIT)
keepstore 36853 root  760u  IPv6 5073112      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:35181 (CLOSE_WAIT)
keepstore 36853 root  761u  IPv6 5073114      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:35182 (CLOSE_WAIT)
keepstore 36853 root  762u  IPv6 5069967      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39205 (CLOSE_WAIT)
keepstore 36853 root  763u  IPv6 5069969      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:35186 (CLOSE_WAIT)
keepstore 36853 root  764u  IPv6 5073123      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46040 (CLOSE_WAIT)
keepstore 36853 root  765u  IPv6 5076312      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35367 (CLOSE_WAIT)
keepstore 36853 root  766u  IPv6 5076330      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46058 (CLOSE_WAIT)
keepstore 36853 root  768u  IPv6 5076348      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:38975 (CLOSE_WAIT)
keepstore 36853 root  769u  IPv6 5069975      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46066 (CLOSE_WAIT)
keepstore 36853 root  770u  IPv6 5069977      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36610 (CLOSE_WAIT)
keepstore 36853 root  771u  IPv6 5073151      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46076 (CLOSE_WAIT)
keepstore 36853 root  772u  IPv6 5076542      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35378 (CLOSE_WAIT)
keepstore 36853 root  774u  IPv6 5073169      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46097 (CLOSE_WAIT)
keepstore 36853 root  775u  IPv6 5069979      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35386 (CLOSE_WAIT)
keepstore 36853 root  776u  IPv6 5073193      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39239 (CLOSE_WAIT)
keepstore 36853 root  777u  IPv6 5076827      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55459 (CLOSE_WAIT)
keepstore 36853 root  778u  IPv6 5073197      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46113 (CLOSE_WAIT)
keepstore 36853 root  779u  IPv6 5069983      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35401 (CLOSE_WAIT)
keepstore 36853 root  781u  IPv6 5073217      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44963 (CLOSE_WAIT)
keepstore 36853 root  782u  IPv6 5073219      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37945 (CLOSE_WAIT)
keepstore 36853 root  783u  IPv6 5073352      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35407 (CLOSE_WAIT)
keepstore 36853 root  784u  IPv6 5073539      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37423 (CLOSE_WAIT)
keepstore 36853 root  785u  IPv6 5070103      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46137 (CLOSE_WAIT)
keepstore 36853 root  786u  IPv6 5073549      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39256 (CLOSE_WAIT)
keepstore 36853 root  788u  IPv6 5070268      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46145 (CLOSE_WAIT)
keepstore 36853 root  790u  IPv6 5073572      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46159 (CLOSE_WAIT)
keepstore 36853 root  791u  IPv6 5077125      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46169 (CLOSE_WAIT)
keepstore 36853 root  792u  IPv6 5073579      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46177 (CLOSE_WAIT)
keepstore 36853 root  793u  IPv6 5070533      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36652 (CLOSE_WAIT)
keepstore 36853 root  794u  IPv6 5070539      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39282 (CLOSE_WAIT)
keepstore 36853 root  795u  IPv6 5078124      0t0    TCP keep26.su92l.arvadosapi.com:25107->shell.su92l.arvadosapi.com:39032 (CLOSE_WAIT)
keepstore 36853 root  797u  IPv6 5077127      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35434 (CLOSE_WAIT)
keepstore 36853 root  798u  IPv6 5077131      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46196 (CLOSE_WAIT)
keepstore 36853 root  799u  IPv6 5073591      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46195 (CLOSE_WAIT)
keepstore 36853 root  800u  IPv6 5078128      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35449 (CLOSE_WAIT)
keepstore 36853 root  803u  IPv6 5079078      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39302 (CLOSE_WAIT)
keepstore 36853 root  804u  IPv6 5077141      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55509 (CLOSE_WAIT)
keepstore 36853 root  806u  IPv6 5078135      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35464 (CLOSE_WAIT)
keepstore 36853 root  807u  IPv6 5073617      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:37981 (CLOSE_WAIT)
keepstore 36853 root  808u  IPv6 5077143      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:44998 (CLOSE_WAIT)
keepstore 36853 root  809u  IPv6 5078137      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:36310 (CLOSE_WAIT)
keepstore 36853 root  810u  IPv6 5073626      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:36317 (CLOSE_WAIT)
keepstore 36853 root  811u  IPv6 5073628      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:36319 (CLOSE_WAIT)
keepstore 36853 root  812u  IPv6 5078139      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35470 (CLOSE_WAIT)
keepstore 36853 root  813u  IPv6 5078141      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45004 (CLOSE_WAIT)
keepstore 36853 root  814u  IPv6 5078143      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45023 (CLOSE_WAIT)
keepstore 36853 root  815u  IPv6 5078145      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46235 (CLOSE_WAIT)
keepstore 36853 root  816u  IPv6 5079378      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37460 (CLOSE_WAIT)
keepstore 36853 root  817u  IPv6 5078147      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39316 (CLOSE_WAIT)
keepstore 36853 root  818u  IPv6 5077151      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46247 (CLOSE_WAIT)
keepstore 36853 root  819u  IPv6 5078149      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46250 (CLOSE_WAIT)
keepstore 36853 root  820u  IPv6 5077155      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39324 (CLOSE_WAIT)
keepstore 36853 root  821u  IPv6 5073656      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46272 (CLOSE_WAIT)
keepstore 36853 root  822u  IPv6 5073658      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46277 (CLOSE_WAIT)
keepstore 36853 root  823u  IPv6 5073660      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46289 (CLOSE_WAIT)
keepstore 36853 root  824u  IPv6 5078151      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36703 (CLOSE_WAIT)
keepstore 36853 root  825u  IPv6 5078157      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35497 (CLOSE_WAIT)
keepstore 36853 root  826u  IPv6 5078155      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39334 (CLOSE_WAIT)
keepstore 36853 root  827u  IPv6 5077161      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46306 (CLOSE_WAIT)
keepstore 36853 root  828u  IPv6 5077163      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46317 (CLOSE_WAIT)
keepstore 36853 root  829u  IPv6 5077165      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35510 (CLOSE_WAIT)
keepstore 36853 root  830u  IPv6 5077167      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39346 (CLOSE_WAIT)
keepstore 36853 root  831u  IPv6 5078366      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37761 (CLOSE_WAIT)
keepstore 36853 root  832u  IPv6 5077171      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55547 (CLOSE_WAIT)
keepstore 36853 root  833u  IPv6 5078166      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38018 (CLOSE_WAIT)
keepstore 36853 root  834u  IPv6 5080349      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35526 (CLOSE_WAIT)
keepstore 36853 root  835u  IPv6 5078167      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35530 (CLOSE_WAIT)
keepstore 36853 root  836u  IPv6 5077174      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45067 (CLOSE_WAIT)
keepstore 36853 root  837u  IPv6 5078169      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:36593 (CLOSE_WAIT)
keepstore 36853 root  838u  IPv6 5077182      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:36595 (CLOSE_WAIT)
keepstore 36853 root  839u  IPv6 5078171      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:36596 (CLOSE_WAIT)
keepstore 36853 root  840u  IPv6 5078173      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37497 (CLOSE_WAIT)
keepstore 36853 root  841u  IPv6 5073687      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39361 (CLOSE_WAIT)
keepstore 36853 root  842u  IPv6 5073689      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46354 (CLOSE_WAIT)
keepstore 36853 root  843u  IPv6 5080593      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46371 (CLOSE_WAIT)
keepstore 36853 root  844u  IPv6 5080627      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46375 (CLOSE_WAIT)
keepstore 36853 root  845u  IPv6 5080733      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35548 (CLOSE_WAIT)
keepstore 36853 root  846u  IPv6 5077184      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46395 (CLOSE_WAIT)
keepstore 36853 root  847u  IPv6 5080804      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46404 (CLOSE_WAIT)
keepstore 36853 root  848u  IPv6 5073706      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36739 (CLOSE_WAIT)
keepstore 36853 root  849u  IPv6 5080834      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46417 (CLOSE_WAIT)
keepstore 36853 root  851u  IPv6 5073710      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39384 (CLOSE_WAIT)
keepstore 36853 root  852u  IPv6 5078176      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39389 (CLOSE_WAIT)
keepstore 36853 root  853u  IPv6 5077190      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35562 (CLOSE_WAIT)
keepstore 36853 root  854u  IPv6 5077194      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46433 (CLOSE_WAIT)
keepstore 36853 root  855u  IPv6 5073726      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46434 (CLOSE_WAIT)
keepstore 36853 root  856u  IPv6 5081172      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35573 (CLOSE_WAIT)
keepstore 36853 root  857u  IPv6 5077196      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55583 (CLOSE_WAIT)
keepstore 36853 root  858u  IPv6 5077200      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38075 (CLOSE_WAIT)
keepstore 36853 root  859u  IPv6 5077206      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45104 (CLOSE_WAIT)
keepstore 36853 root  860u  IPv6 5078187      0t0    TCP keep26.su92l.arvadosapi.com:25107->git.su92l.arvadosapi.com:53939 (CLOSE_WAIT)
keepstore 36853 root  861u  IPv6 5082146      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39419 (CLOSE_WAIT)
keepstore 36853 root  862u  IPv6 5082168      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35591 (CLOSE_WAIT)
keepstore 36853 root  863u  IPv6 5082191      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37557 (CLOSE_WAIT)
keepstore 36853 root  864u  IPv6 5082215      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46474 (CLOSE_WAIT)
keepstore 36853 root  865u  IPv6 5082233      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35595 (CLOSE_WAIT)
keepstore 36853 root  866u  IPv6 5082359      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46492 (CLOSE_WAIT)
keepstore 36853 root  867u  IPv6 5082389      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46495 (CLOSE_WAIT)
keepstore 36853 root  868u  IPv6 5081270      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46521 (CLOSE_WAIT)
keepstore 36853 root  869u  IPv6 5082544      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36775 (CLOSE_WAIT)
keepstore 36853 root  870u  IPv6 5082570      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46530 (CLOSE_WAIT)
keepstore 36853 root  871u  IPv6 5078193      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46538 (CLOSE_WAIT)
keepstore 36853 root  872u  IPv6 5082685      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35621 (CLOSE_WAIT)
keepstore 36853 root  873u  IPv6 5082695      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35622 (CLOSE_WAIT)
keepstore 36853 root  875u  IPv6 5082849      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39458 (CLOSE_WAIT)
keepstore 36853 root  876u  IPv6 5078195      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46555 (CLOSE_WAIT)
keepstore 36853 root  877u  IPv6 5078197      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46564 (CLOSE_WAIT)
keepstore 36853 root  878u  IPv6 5081272      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39467 (CLOSE_WAIT)
keepstore 36853 root  879u  IPv6 5081278      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55647 (CLOSE_WAIT)
keepstore 36853 root  880u  IPv6 5078203      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38116 (CLOSE_WAIT)
keepstore 36853 root  881u  IPv6 5078205      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35646 (CLOSE_WAIT)
keepstore 36853 root  882u  IPv6 5083184      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45140 (CLOSE_WAIT)
keepstore 36853 root  883u  IPv6 5078210      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39479 (CLOSE_WAIT)
keepstore 36853 root  884u  IPv6 5081280      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37597 (CLOSE_WAIT)
keepstore 36853 root  885u  IPv6 5077223      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35653 (CLOSE_WAIT)
keepstore 36853 root  886u  IPv6 5083348      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46590 (CLOSE_WAIT)
keepstore 36853 root  887u  IPv6 5078213      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35659 (CLOSE_WAIT)
keepstore 36853 root  888u  IPv6 5083494      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46604 (CLOSE_WAIT)
keepstore 36853 root  889u  IPv6 5077225      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46608 (CLOSE_WAIT)
keepstore 36853 root  890u  IPv6 5078229      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46627 (CLOSE_WAIT)
keepstore 36853 root  891u  IPv6 5077232      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46633 (CLOSE_WAIT)
keepstore 36853 root  892u  IPv6 5083684      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36836 (CLOSE_WAIT)
keepstore 36853 root  893u  IPv6 5083772      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35676 (CLOSE_WAIT)
keepstore 36853 root  894u  IPv6 5077234      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35682 (CLOSE_WAIT)
keepstore 36853 root  895u  IPv6 5078240      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46660 (CLOSE_WAIT)
keepstore 36853 root  896u  IPv6 5078372      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35899 (CLOSE_WAIT)
keepstore 36853 root  897u  IPv6 5078244      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46674 (CLOSE_WAIT)
keepstore 36853 root  898u  IPv6 5077239      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55687 (CLOSE_WAIT)
keepstore 36853 root  899u  IPv6 5078256      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38154 (CLOSE_WAIT)
keepstore 36853 root  900u  IPv6 5077245      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46692 (CLOSE_WAIT)
keepstore 36853 root  901u  IPv6 5084248      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45176 (CLOSE_WAIT)
keepstore 36853 root  902u  IPv6 5077247      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39522 (CLOSE_WAIT)
keepstore 36853 root  903u  IPv6 5077249      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39526 (CLOSE_WAIT)
keepstore 36853 root  904u  IPv6 5077251      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37636 (CLOSE_WAIT)
keepstore 36853 root  905u  IPv6 5078258      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35721 (CLOSE_WAIT)
keepstore 36853 root  906u  IPv6 5078266      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46734 (CLOSE_WAIT)
keepstore 36853 root  907u  IPv6 5084634      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46735 (CLOSE_WAIT)
keepstore 36853 root  908u  IPv6 5077258      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35734 (CLOSE_WAIT)
keepstore 36853 root  909u  IPv6 5078276      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39547 (CLOSE_WAIT)
keepstore 36853 root  910u  IPv6 5084746      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46746 (CLOSE_WAIT)
keepstore 36853 root  911u  IPv6 5084752      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35739 (CLOSE_WAIT)
keepstore 36853 root  912u  IPv6 5084758      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46753 (CLOSE_WAIT)
keepstore 36853 root  913u  IPv6 5078278      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36876 (CLOSE_WAIT)
keepstore 36853 root  914u  IPv6 5077262      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46756 (CLOSE_WAIT)
keepstore 36853 root  915u  IPv6 5078280      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35747 (CLOSE_WAIT)
keepstore 36853 root  916u  IPv6 5084914      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35752 (CLOSE_WAIT)
keepstore 36853 root  917u  IPv6 5085027      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46784 (CLOSE_WAIT)
keepstore 36853 root  918u  IPv6 5085049      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46787 (CLOSE_WAIT)
keepstore 36853 root  919u  IPv6 5085279      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55725 (CLOSE_WAIT)
keepstore 36853 root  920u  IPv6 5085297      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38207 (CLOSE_WAIT)
keepstore 36853 root  921u  IPv6 5081292      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45214 (CLOSE_WAIT)
keepstore 36853 root  922u  IPv6 5081294      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39570 (CLOSE_WAIT)
keepstore 36853 root  923u  IPv6 5085412      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39574 (CLOSE_WAIT)
keepstore 36853 root  924u  IPv6 5085450      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37686 (CLOSE_WAIT)
keepstore 36853 root  925u  IPv6 5085521      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35775 (CLOSE_WAIT)
keepstore 36853 root  926u  IPv6 5081296      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46815 (CLOSE_WAIT)
keepstore 36853 root  927u  IPv6 5081298      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46822 (CLOSE_WAIT)
keepstore 36853 root  928u  IPv6 5077274      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35788 (CLOSE_WAIT)
keepstore 36853 root  929u  IPv6 5085851      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46841 (CLOSE_WAIT)
keepstore 36853 root  930u  IPv6 5078300      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36915 (CLOSE_WAIT)
keepstore 36853 root  931u  IPv6 5078302      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39599 (CLOSE_WAIT)
keepstore 36853 root  932u  IPv6 5078304      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46865 (CLOSE_WAIT)
keepstore 36853 root  933u  IPv6 5085901      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46866 (CLOSE_WAIT)
keepstore 36853 root  934u  IPv6 5081300      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46876 (CLOSE_WAIT)
keepstore 36853 root  935u  IPv6 5085940      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35806 (CLOSE_WAIT)
keepstore 36853 root  936u  IPv6 5086012      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35810 (CLOSE_WAIT)
keepstore 36853 root  937u  IPv6 5078319      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46897 (CLOSE_WAIT)
keepstore 36853 root  938u  IPv6 5078321      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46899 (CLOSE_WAIT)
keepstore 36853 root  939u  IPv6 5081312      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55776 (CLOSE_WAIT)
keepstore 36853 root  940u  IPv6 5086385      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38244 (CLOSE_WAIT)
keepstore 36853 root  941u  IPv6 5086415      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45265 (CLOSE_WAIT)
keepstore 36853 root  943u  IPv6 5086536      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37725 (CLOSE_WAIT)
keepstore 36853 root  944u  IPv6 5078335      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35837 (CLOSE_WAIT)
keepstore 36853 root  946u  IPv6 5086788      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39635 (CLOSE_WAIT)
keepstore 36853 root  947u  IPv6 5086814      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46933 (CLOSE_WAIT)
keepstore 36853 root  948u  IPv6 5077286      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46935 (CLOSE_WAIT)
keepstore 36853 root  949u  IPv6 5078343      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:36965 (CLOSE_WAIT)
keepstore 36853 root  950u  IPv6 5078345      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39645 (CLOSE_WAIT)
keepstore 36853 root  951u  IPv6 5081314      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46954 (CLOSE_WAIT)
keepstore 36853 root  952u  IPv6 5086983      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46966 (CLOSE_WAIT)
keepstore 36853 root  953u  IPv6 5087021      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35866 (CLOSE_WAIT)
keepstore 36853 root  954u  IPv6 5087895      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47031 (CLOSE_WAIT)
keepstore 36853 root  955u  IPv6 5081318      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46985 (CLOSE_WAIT)
keepstore 36853 root  956u  IPv6 5087089      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35871 (CLOSE_WAIT)
keepstore 36853 root  957u  IPv6 5078352      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:46994 (CLOSE_WAIT)
keepstore 36853 root  958u  IPv6 5078354      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35881 (CLOSE_WAIT)
keepstore 36853 root  959u  IPv6 5078356      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47009 (CLOSE_WAIT)
keepstore 36853 root  960u  IPv6 5087444      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55815 (CLOSE_WAIT)
keepstore 36853 root  961u  IPv6 5087462      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38280 (CLOSE_WAIT)
keepstore 36853 root  962u  IPv6 5087492      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45301 (CLOSE_WAIT)
keepstore 36853 root  963u  IPv6 5087533      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35892 (CLOSE_WAIT)
keepstore 36853 root  964u  IPv6 5087962      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47047 (CLOSE_WAIT)
keepstore 36853 root  965u  IPv6 5088022      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:37001 (CLOSE_WAIT)
keepstore 36853 root  966u  IPv6 5078375      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47050 (CLOSE_WAIT)
keepstore 36853 root  967u  IPv6 5081320      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47070 (CLOSE_WAIT)
keepstore 36853 root  968u  IPv6 5078377      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47076 (CLOSE_WAIT)
keepstore 36853 root  969u  IPv6 5081322      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35919 (CLOSE_WAIT)
keepstore 36853 root  970u  IPv6 5078379      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39694 (CLOSE_WAIT)
keepstore 36853 root  972u  IPv6 5081324      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47094 (CLOSE_WAIT)
keepstore 36853 root  973u  IPv6 5088181      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35925 (CLOSE_WAIT)
keepstore 36853 root  975u  IPv6 5088288      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39701 (CLOSE_WAIT)
keepstore 36853 root  976u  IPv6 5088366      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47106 (CLOSE_WAIT)
keepstore 36853 root  977u  IPv6 5088403      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35937 (CLOSE_WAIT)
keepstore 36853 root  979u  IPv6 5077307      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55852 (CLOSE_WAIT)
keepstore 36853 root  980u  IPv6 5088591      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45338 (CLOSE_WAIT)
keepstore 36853 root  981u  IPv6 5088619      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38338 (CLOSE_WAIT)
keepstore 36853 root  982u  IPv6 5088704      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35948 (CLOSE_WAIT)
keepstore 36853 root  983u  IPv6 5078394      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37820 (CLOSE_WAIT)
keepstore 36853 root  984u  IPv6 5088992      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47129 (CLOSE_WAIT)
keepstore 36853 root  985u  IPv6 5089061      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47144 (CLOSE_WAIT)
keepstore 36853 root  986u  IPv6 5089067      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35970 (CLOSE_WAIT)
keepstore 36853 root  987u  IPv6 5081337      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:37038 (CLOSE_WAIT)
keepstore 36853 root  988u  IPv6 5077314      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47145 (CLOSE_WAIT)
keepstore 36853 root  989u  IPv6 5077320      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47159 (CLOSE_WAIT)
keepstore 36853 root  990u  IPv6 5077322      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47171 (CLOSE_WAIT)
keepstore 36853 root  991u  IPv6 5078407      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47182 (CLOSE_WAIT)
keepstore 36853 root  992u  IPv6 5078409      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35981 (CLOSE_WAIT)
keepstore 36853 root  993u  IPv6 5089277      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35986 (CLOSE_WAIT)
keepstore 36853 root  994u  IPv6 5089318      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47200 (CLOSE_WAIT)
keepstore 36853 root  995u  IPv6 5081339      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39744 (CLOSE_WAIT)
keepstore 36853 root  996u  IPv6 5089456      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47206 (CLOSE_WAIT)
keepstore 36853 root  997u  IPv6 5078419      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:35997 (CLOSE_WAIT)
keepstore 36853 root  998u  IPv6 5077328      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:38299 (CLOSE_WAIT)
keepstore 36853 root  999u  IPv6 5089655      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:38300 (CLOSE_WAIT)
keepstore 36853 root 1000u  IPv6 5078425      0t0    TCP keep26.su92l.arvadosapi.com:25107->workbench.su92l.arvadosapi.com:38301 (CLOSE_WAIT)
keepstore 36853 root 1001u  IPv6 5089678      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute11.su92l.arvadosapi.com:55910 (CLOSE_WAIT)
keepstore 36853 root 1002u  IPv6 5089680      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45374 (CLOSE_WAIT)
keepstore 36853 root 1003u  IPv6 5081341      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38385 (CLOSE_WAIT)
keepstore 36853 root 1004u  IPv6 5089730      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39763 (CLOSE_WAIT)
keepstore 36853 root 1005u  IPv6 5089859      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:36011 (CLOSE_WAIT)
keepstore 36853 root 1006u  IPv6 5081343      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute4.su92l.arvadosapi.com:37863 (CLOSE_WAIT)
keepstore 36853 root 1007u  IPv6 5078460      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47234 (CLOSE_WAIT)
keepstore 36853 root 1008u  IPv6 5078462      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47249 (CLOSE_WAIT)
keepstore 36853 root 1009u  IPv6 5078465      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47259 (CLOSE_WAIT)
keepstore 36853 root 1010u  IPv6 5090269      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute6.su92l.arvadosapi.com:37099 (CLOSE_WAIT)
keepstore 36853 root 1011u  IPv6 5077340      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47275 (CLOSE_WAIT)
keepstore 36853 root 1012u  IPv6 5090299      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47281 (CLOSE_WAIT)
keepstore 36853 root 1013u  IPv6 5090313      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47286 (CLOSE_WAIT)
keepstore 36853 root 1014u  IPv6 5090382      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:36038 (CLOSE_WAIT)
keepstore 36853 root 1015u  IPv6 5078477      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:36048 (CLOSE_WAIT)
keepstore 36853 root 1016u  IPv6 5090452      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47309 (CLOSE_WAIT)
keepstore 36853 root 1017u  IPv6 5078479      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:36050 (CLOSE_WAIT)
keepstore 36853 root 1018u  IPv6 5078486      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute1.su92l.arvadosapi.com:39790 (CLOSE_WAIT)
keepstore 36853 root 1019u  IPv6 5078488      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute2.su92l.arvadosapi.com:47314 (CLOSE_WAIT)
keepstore 36853 root 1020u  IPv6 5090584      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute19.su92l.arvadosapi.com:36057 (CLOSE_WAIT)
keepstore 36853 root 1021u  IPv6 5078500      0t0    TCP keep26.su92l.arvadosapi.com:25107->git.su92l.arvadosapi.com:48045 (CLOSE_WAIT)
keepstore 36853 root 1022u  IPv6 5078503      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute55.su92l.arvadosapi.com:45424 (CLOSE_WAIT)
keepstore 36853 root 1023u  IPv6 5077350      0t0    TCP keep26.su92l.arvadosapi.com:25107->compute9.su92l.arvadosapi.com:38423 (CLOSE_WAIT)
keep26.su92l:~# free
             total       used       free     shared    buffers     cached
Mem:      14361132   14002216     358916      17704      25800   12280084
-/+ buffers/cache:    1696332   12664800

keepstore version: 0.1.20160215154939.3920b0d-1

The effect in the keepstore logs is not pretty:

2016-03-29_21:22:17.50018 2016/03/29 21:22:17 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:18.50050 2016/03/29 21:22:18 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:19.50084 2016/03/29 21:22:19 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:20.50119 2016/03/29 21:22:20 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:21.50154 2016/03/29 21:22:21 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:22.50184 2016/03/29 21:22:22 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:23.50217 2016/03/29 21:22:23 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:24.50251 2016/03/29 21:22:24 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:25.50287 2016/03/29 21:22:25 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:26.50315 2016/03/29 21:22:26 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:27.50350 2016/03/29 21:22:27 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:28.50387 2016/03/29 21:22:28 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s
2016-03-29_21:22:29.50411 2016/03/29 21:22:29 http: Accept error: accept tcp [::]:25107: too many open files; retrying in 1s

The process was running with a soft ulimit of 1024, a hard one of 4096. I'm going to increase those limits on su92l as a workaround.

This looks like a keepstore bug, cf. http://unix.derkeiler.com/Mailing-Lists/SunManagers/2006-01/msg00367.html

We have corresponding arv-get processes getting stuck, as you'd expect.

We're only noticing this on su92l (2 or 3 times in the last week; once on keep26, once on keep27). We happen to be running with a very low max-buffers there, it is set to 16.

Subtasks 2 (0 open — 2 closed)

Related issues 2 (0 open — 2 closed)

Actions

Copy link

Updated by Ward Vandewege almost 9 years ago

Description updated (diff)

Actions

Copy link

Updated by Ward Vandewege almost 9 years ago

Description updated (diff)

Actions

Copy link

Updated by Ward Vandewege almost 9 years ago

Description updated (diff)

Actions

Copy link

Updated by Ward Vandewege almost 9 years ago

Description updated (diff)

Actions

Copy link

Updated by Brett Smith almost 9 years ago

Target version set to 2016-04-13 sprint

Actions

Copy link

Updated by Peter Amstutz almost 9 years ago

Assigned To set to Peter Amstutz

Actions

Copy link

Updated by Brett Smith almost 9 years ago

Target version changed from 2016-04-13 sprint to Arvados Future Sprints

Actions

Copy link

Updated by Tom Clegg almost 9 years ago

This could be related to the fact that we don't use Go's http server's "CloseNotifier" facility, so we have a lot of goroutines that are waiting (for disk, serialize, buffers, or blob store) even though they are servicing clients who have already given up.

It's also worth checking for usage errors along the lines of "forgot to Close() a response/request body". Surely (?) this problem would have come up much sooner if we had this sort of bug on the happy path, but there could well be leaks on unhappy paths.

Actions

Copy link

Updated by Brett Smith almost 9 years ago

Correlate the netstat output with the keepstore logs to try to figure out if there's some obvious pattern to the affected requests. e.g., are they all GET, or all PUT.

We can get debug output from keepstore and figure out if there's some pattern there; e.g., if there's a goroutine attached to all of these request handlers. (If so, then the request queue is super backed up. If not, we just forgot to close it somewhere.)

We could try to artificially create this by running a test keepstore somewhere with a really low -max-buffers and really low open files ulimit.

Tom to write down specific steps of what to do next time we see a keepstore in this situation, whether under artificial testing or production use.

Actions

Copy link

#10

Updated by Ward Vandewege almost 9 years ago

In the end I doubled max_buffers to 32 on su92l, but didn't adapt the file ulimits (soft or hard). We have not seen the problem again since then.

Actions

Copy link

#11

Updated by Tom Clegg almost 9 years ago

Seeing that "drop abandoned unserved connections" is likely to involve a bunch of refactoring, here are some things we can investigate before/while sorting that out.

Get more debug info¶

When this happens again, here are some bits of info that might shed light on what's really happening inside keepstore.

Are all buffers in use?

curl http://localhost:25107/status.json provides a bunch of json, the most interesting part being

...
"BufferPool":{"BytesAllocated":134217728,"BuffersMax":32,"BuffersInUse":0
...

If BuffersInUse<BuffersMax then keepstore isn't very busy. If there are many more netstat entries than BuffersInUse, this starts to look more like a file descriptor / socket leak (forgot to Close() somewhere).

How many goroutines?

Currently keepstore doesn't offer the pprof debug info. We should add it:
- import _ "net/http/pprof"
- now /debug/pprof/goroutine?debug=1 shows a stack trace for each running goroutine.
This would be better evidence about whether those netstat entries correspond to queued/abandoned requests, vs. leaks.

Add a "max clients" limit¶

With (say) 128 buffers and 256 clients connected, 128 clients will be waiting for buffers. Some of them will probably give up before getting a response, possibly even before keepstore starts handling their requests. It might be better to respond 503. This should be easy to implement in a configurable way (perhaps defaulting to -max-clients=0 meaning no limit).

Check CloseNotifier after reserving a buffer¶

With a bit of refactoring (less than the full CloseNotifier story), we could move the bufferpool allocation step up from volume to handler. This would mean a bit less code in each volume implementation, which is good. We would have to either add a MightExist() method to each volume (return false if the block definitely doesn't exist), or accept a slight performance regression in that unix volumes would no longer be able to respond 404 without reserving a data buffer. With this change, we could check CloseNotifier in GetBlockHandler:

if the client hangs up before we get a buffer, don't bother getting a buffer or doing any more work.
if the client hangs up after we get a buffer, but before we finish reading data from disk/blob storage, this doesn't help us -- for this, we'd have to pass the CloseNotifier channel into each volume's Get method.

In cases where this would have helped, keepstore logs won't indicate any errors (GetBlockHandler doesn't notice or log anything when resp.Write(block) fails). If we adjust LoggingResponseWriter to log bytes actually written to the network (according to stdlib) instead of bytes sent to Write(), and/or log something when Write() returns an error, we would start to see evidence of clients that don't receive all of the data they requested.

Check CloseNotifier in PutBlockHandler¶

Detecting abandoned PUT requests is already pretty accessible: PutBlockHandler() has the http.Request object at the point where it waits for bufs.Get().

In cases where this would have helped, we should see PUT requests with 500 responses in the keepstore logs: if the client hung up while we were waiting in bufs.Get(), then io.ReadFull() on the next line should return an error. source:services/keepstore/handlers.go#L120

    buf := bufs.Get(int(req.ContentLength))
    _, err := io.ReadFull(req.Body, buf)
    if err != nil {
        http.Error(resp, err.Error(), 500)
        bufs.Put(buf)
        return
    }

Actions

Copy link

#12

Updated by Tom Clegg almost 9 years ago

The -max-clients option seems easy, and should address the problem we started with, i.e., "too many open files".

The CloseNotifier work is also worth doing, so clients don't consume keepstore resources even after they've timed out while waiting in the queue, and hung up.

Actions

Copy link

#13