A python library for information-theoretic computations based on NumPy
Includes computation of
- Entropy of random variable
- Conditional entropy
- Kullback–Leibler divergence (KL-divergence)
- Mutual information
- Blahut-Arimoto algorithm for computing channel capacity