Function-Call Overhead

[Douglas G. Moore]

The entropy measures are written for maximum code reuse. The advantage of this is that it makes maintenance easier, but it comes with a cost. For example, inform_shannon uses inform_shannon_si in a tight loop. The function-call overhead means we loose performance.

Maintainability is a higher priority than performance, but the gain in performance (~2x) is worth the mild loss in maintainability.