History of Kullback-Leibler divergences between probability distributions

 Title: Kullback-Leibler divergences between probability distributions-Definition: For probability measures $P$ and $Q$ with $P$ absolutely continuous with-  respect to $Q$, the Kullback-Leibler divergence CITE{WikiKL}, or relative entropy,-  is $D(P\|Q)=\int \log(\mathrm{d}P/\mathrm{d}Q)\,\mathrm{d}P$. This table gives it-  as one number in two conventions, the logarithmic units `nats` and `bits`, for ordered-  pairs of named one-dimensional distributions in SciPy standard forms.+Definition: For probability measures $P$ absolutely continuous with respect to $Q$,+  the Kullback-Leibler divergence CITE{WikiKL} is $D(P\|Q)=\int\log(\mathrm{d}P/\mathrm{d}Q)\,\mathrm{d}P$.+  The table gives it in nats and bits, two conventions for the same number, for SciPy+  standard one-dimensional distribution pairs. Tags: - probability theory