Kullback-Leibler divergence

$D_{KL}(P\parallel Q)={\sum }_{x}P(x)\log (\frac{P(x)}{Q(x)}),fortwo[[probabilitydistribution]]s$P,Q$.