y-scope / clp

Compressed Log Processor (CLP) is a free log management tool capable of compressing text logs and searching the compressed logs without decompression.

Home Page:https://yscope.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

compression_scheduler doesn't report failure with partially invalid input paths

haiqi96 opened this issue · comments

Bug

When handling compression job with multiple input paths, the compression scheduler silently log and skip any input that doesn't resolve to any real on disk path.

The compression is only marked as failure if none of the input paths resolve to valid path, otherwise CLP will skip compressing any invalid input path and report success.

We should update the reporting system so that we can report this kind of case as partially fail.

CLP version

469019e

Environment

Ubuntu 22.04

Reproduction steps

  • Build and start a CLP package
  • run ./sbin/compress.sh <valid_path> <invalid_path>
  • An error log can be observed in compression schdeuler log, but the compression returns success