listener - make a log that logs every bit of data rather than in the last hour or so

[brendon walter]

this will log all the CPU, network, memory, and disk space

[Andrew Cencini]

keeping this data around won't hurt and if you are taking 10 measurements every 30 seconds, and each measurement is approx 64 bytes, you have 640 bytes/minute * 60 minutes * 24 hours, or 921,600 bytes/day. the log could be rolled once a week just to keep it below 8MB. (e.g. listener.log becomes listener.log.1, and a new listener.log is started). this way you keep "soft state" (just like asking the chunkservers what chunks they have) in case there is a centralized loss of listener data.

[Andrew Cencini]

also, it would likely make sense to include timestamps in the listener log for each measurement, to make storing in a database easier and less guessworky

[Andrew Cencini]

and this is acknowledging timestamps between machines may be a little off

[Andrew Cencini]

in our experience, this was ok

[brendon walter]

Got it. I'll start working on this tonight.

[Andrew Cencini]

should this be closed??

[brendon walter]

Now just needs to be verified

[Beth Escuda]

Verified