Generative Adversarial Networks (GANs) have become the gold standard when it
comes to learning generative models for high-dimensional distributions. Since
their advent, numerous variations of GANs have been introduced in the
literature, primarily focusing on utilization of novel loss functions,
optimization/regularization strategies and network architectures. In this
paper, we turn our attention to the generator and investigate the use of
high-order polynomials as an alternative class of universal function
approximators. Concretely, we propose PolyGAN, where we model the data
generator by means of a high-order polynomial whose unknown parameters are
naturally represented by high-order tensors. We introduce two tensor
decompositions that significantly reduce the number of parameters and show how
they can be efficiently implemented by hierarchical neural networks that only
employ linear/convolutional blocks. We exhibit for the first time that by using
our approach a GAN generator can approximate the data distribution without
using any activation functions. Thorough experimental evaluation on both
synthetic and real data (images and 3D point clouds) demonstrates the merits of
PolyGAN against the state of the art.

本文介绍了 PolyGAN，它使用高阶多项式作为数据生成器，并通过使用两种张量分解来减少参数数量并展示了如何有效地实现分层神经网络，从而在不使用激活函数的情况下逼近数据分布，该方法在合成和真实数据（图像和 3D 点云）上的实验评估证明了 PolyGAN 相对于现有技术的优点。