Feature #18174

[servers] add logging with automatic rotation to user-specified directory

Added by Ward Vandewege 29 days ago. Updated 29 days ago.

Status:
New
Priority:
Normal
Assigned To:
-
Category:
-
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:
Story points:
-

Description

We've established that Journald simply can not handle the amount of logging output some of our services produce (e.g. arvados-controller).

There are of course ways around that, e.g. on our high volume sites we have a systemd override file like this:

[Service]
Type=simple
ExecStart=
ExecStart=/bin/bash -ce "exec /usr/bin/arvados-controller 2>&1 | /usr/bin/rotatelogs -f /var/log/arvados/%%Y%%m%%d-arvados-controller.log 86400" 

It would be nice to build this into arvados-server. It looks like this library might work with some tweaks: https://github.com/natefinch/lumberjack.

The idea is to default to logging as we do now, but by setting a logging directory value in the config file, we would start logging date-stamped files in that directory and auto-rotating them (configurable) after a default of 30 days.

History

#1 Updated by Ward Vandewege 29 days ago

  • Description updated (diff)

Also available in: Atom PDF