Information on Timer Class

[Vineeth S]

I have a question regarding the implementation of the Timer class. In the line here, it is said that if the verbosity level is high the time is not measured. But in many places, like here, the time is measured and displayed in the final output.

What am I missing here?

[Thijs Vogels]

Hello,

What's your setting for config["log_verbosity"]?

powersgd/train.py

Line 76 in 3f4eb8d

 timer = Timer(verbosity_level=config["log_verbosity"], log_fn=metric) 

The idea is that timing measurements like

powersgd/gradient_reducers.py

Line 57 in 3f4eb8d

 with self.timer("reduce.norms", verbosity=2): 

are active when this global setting log_verbosity is at least as high as the verbosity value of the timer.

[Vineeth S]

The value of config["log_verbosity"] is 2. For some reason, I believed that self.verbosity_level was 1. It was a mistake on my end.
Thank you for the clarification.