正向KL散度与反向KL散度

KL散度的公式是 K L [ p ( x ) ∣ ∣ q ( x ) ] = ∫ x p ( x ) l o g p ( x ) q ( x ) d x KL[p(x)||q(x)] = \int_{x}p(x)log{p(x) \over q(x)}dx KL[p(x)∣∣q(x)]=∫x​p(x)logq(x)p(x)​dx 假设真实分布为 p ( x ) p(x) p(x)，我们想用分布 q

>>阅读原文<<