add pulse data

[Jeff McAffer]

We have various stats for queues flowing out but not much on crawler loops etc. The idea being that we generate a regular pulse of stats around how many calls, ... Need to reconcile this with the logging and app insights infrastructure