We introduce a new architecture called a conditional invertible neural network (cINN), and use it to address the task of diverse image-to-image translation for natural images. This is not easily possible with existing INN models due to some fundamental limitations. The cINN combines the purely generative INN model with an unconstrained feed-forward network, which efficiently preprocesses the conditioning image into maximally informative features. All parameters of a cINN are jointly optimized with a stable, maximum likelihood-based training procedure. Even though INN-based models have received far less attention in the literature than GANs, they have been shown to have some remarkable properties absent in GANs, e.g. apparent immunity to mode collapse. We find that our cINNs leverage these properties for image-to-image translation, demonstrated on day to night translation and image colorization. Furthermore, we take advantage of our bidirectional cINN architecture to explore and manipulate emergent properties of the latent space, such as changing the image style in an intuitive way.

介绍了一种新的结构，称为条件可逆神经网络（cINN），并将其用于解决自然图像的多样化图像到图像的转化任务。cINN结合了纯生成INN模型和一个无限制的前馈网络，有效地将调节图像预处理为最大信息特征。通过最大似然优化，稳定地联合优化cINN的所有参数。利用双向cINN结构，进一步探索和操作潜在空间的新兴属性，例如以直观的方式更改图像风格。

基于条件逆神经网络的多样化图像到图像转换