In most existing learning systems, images are typically viewed as 2D pixel
arrays. However, in another paradigm gaining popularity, a 2D image is
represented as an implicit neural representation (INR) - an MLP that predicts
an RGB pixel value given its (x,y) coordinate. In this paper, we propose two
novel architectural techniques for building INR-based image decoders:
factorized multiplicative modulation and multi-scale INRs, and use them to
build a state-of-the-art continuous image GAN. Previous attempts to adapt INRs
for image generation were limited to MNIST-like datasets and do not scale to
complex real-world data. Our proposed INR-GAN architecture improves the
performance of continuous image generators by several times, greatly reducing
the gap between continuous image GANs and pixel-based ones. Apart from that, we
explore several exciting properties of the INR-based decoders, like
out-of-the-box superresolution, meaningful image-space interpolation,
accelerated inference of low-resolution images, an ability to extrapolate
outside of image boundaries, and strong geometric prior. The project page is
located at this https URL

本文提出了两个新的神经表示架构用于建立以 INR 为基础的图像解码器，并将其用于构建最先进的连续图像生成对抗网络（GAN）。此外，本文还探索了 INR 解码器的几个有趣性质，包括超分辨率、有意义的图像空间插值、低分辨率图像的加速推理、在图像边界之外推断的能力和强大的几何先验。