Training supervised image synthesis models requires a critic to compare two
images: the ground truth to the result. Yet, this basic functionality remains
an open problem. A popular line of approaches uses the L1 (mean absolute error)
loss, either in the pixel or the feature space of pretrained deep networks.
However, we observe that these losses tend to produce overly blurry and grey
images, and other techniques such as GANs need to be employed to fight these
artifacts. In this work, we introduce an information theory based approach to
measuring similarity between two images. We argue that a good reconstruction
should have high mutual information with the ground truth. This view enables
learning a lightweight critic to "calibrate" a feature space in a contrastive
manner, such that reconstructions of corresponding spatial patches are brought
together, while other patches are repulsed. We show that our formulation
immediately boosts the perceptual realism of output images when used as a
drop-in replacement for the L1 loss, with or without an additional GAN loss.

本研究提出了一种基于信息论的方法来衡量两张图片之间的相似度，能够学习出轻量的 critic 来校准特征空间，从而实现对应空间的图像重建和非对应空间的图像排斥，这种方法能够代替 L1 loss 用在有或者没有 GAN loss 的基于监督的图像合成模型中，从而显著提升了合成图片的感知逼真度。