listener - make a log that logs every bit of data rather than in the last hour or so
bgwalter opened this issue · comments
this will log all the CPU, network, memory, and disk space
keeping this data around won't hurt and if you are taking 10 measurements every 30 seconds, and each measurement is approx 64 bytes, you have 640 bytes/minute * 60 minutes * 24 hours, or 921,600 bytes/day. the log could be rolled once a week just to keep it below 8MB. (e.g. listener.log becomes listener.log.1, and a new listener.log is started). this way you keep "soft state" (just like asking the chunkservers what chunks they have) in case there is a centralized loss of listener data.
also, it would likely make sense to include timestamps in the listener log for each measurement, to make storing in a database easier and less guessworky
and this is acknowledging timestamps between machines may be a little off
in our experience, this was ok
Got it. I'll start working on this tonight.
should this be closed??
Now just needs to be verified
Verified