In this paper, we tackle the challenging task of Panoramic Image-to-Image
translation (Pano-I2I) for the first time. This task is difficult due to the
geometric distortion of panoramic images and the lack of a panoramic image
dataset with diverse conditions, like weather or time. To address these
challenges, we propose a panoramic distortion-aware I2I model that preserves
the structure of the panoramic images while consistently translating their
global style referenced from a pinhole image. To mitigate the distortion issue
in naive 360 panorama translation, we adopt spherical positional embedding to
our transformer encoders, introduce a distortion-free discriminator, and apply
sphere-based rotation for augmentation and its ensemble. We also design a
content encoder and a style encoder to be deformation-aware to deal with a
large domain gap between panoramas and pinhole images, enabling us to work on
diverse conditions of pinhole images. In addition, considering the large
discrepancy between panoramas and pinhole images, our framework decouples the
learning procedure of the panoramic reconstruction stage from the translation
stage. We show distinct improvements over existing I2I models in translating
the StreetLearn dataset in the daytime into diverse conditions. The code will
be publicly available online for our community.

本文提出了一种全景图像 - 图像转换的畸变感知模型，采用球形位置编码器和无畸变鉴别器，利用变形感知编码器和样式编码器处理全景图像和针孔图像的大领域差异，并且将全景图像的重构阶段与转换阶段分开学习，取得了不错的效果。