azad-academy / kl_cross_entropy

Learning Tutorial on KL-Divergence and Cross Entropy

Cross Entropy vs KL-Divergence

This is a tutorial on KL-divergence and Cross Entropy. The full tutorial is available on medium article.

Requirements

• Python >= 3.7
• Numpy

The tutorial 📃

The full tutorial is available on medium.

https://azad-wolf.medium.com/why-is-cross-entropy-equal-to-kl-divergence-d4d2ec413864