Validate bosh logrotate are picking up / rotating any generated YB logs in /var/vcap/sys/log/*
aegershman opened this issue · comments
Evaluate whether bosh logrotate is handling log rotation
bosh agent's logrotate works on files named *.log, whereas here are example of logs accumulating on a tserver (don't mind the invalid-user):
tserver/771892ec-4640-4849-b8df-a88a3a9627ed:/var/vcap/sys/log/yb-tserver# ls
bpm.log
post-deploy.stderr.log
post-deploy.stdout.log
post-start.stderr.log
post-start.stdout.log
tserver-info
tserver-info-cql
tserver-info-redis
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.ERROR.20200410-195703.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200409-180118.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200411-003947.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200411-052947.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200411-101953.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200411-151006.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200411-200012.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200412-005009.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200412-054003.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200412-102957.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.INFO.20200412-151958.7
yb-tserver.9ec20f2a-7854-4d35-a5a3-3b76df525fd8.invalid-user.log.WARNING.20200409-180119.7
yb-tserver.ERROR
yb-tserver.INFO
yb-tserver.stderr.log
yb-tserver.stdout.log
yb-tserver.WARNING
notice how the naming of those yb-tserver logs wouldn't match the *.log format
((... maybe check log_stop_retaining_min_disk_mb? log_max_seconds_to_retain? those might have to do with WAL, haven't checked ref yet))