Generative adversarial networks (GANs) with clustered latent spaces can
perform conditional generation in a completely unsupervised manner. In the real
world, the salient attributes of unlabeled data can be imbalanced. However,
most of existing unsupervised conditional GANs cannot cluster attributes of
these data in their latent spaces properly because they assume uniform
distributions of the attributes. To address this problem, we theoretically
derive Stein latent optimization that provides reparameterizable gradient
estimations of the latent distribution parameters assuming a Gaussian mixture
prior in a continuous latent space. Structurally, we introduce an encoder
network and novel unsupervised conditional contrastive loss to ensure that data
generated from a single mixture component represent a single attribute. We
confirm that the proposed method, named Stein Latent Optimization for GANs
(SLOGAN), successfully learns balanced or imbalanced attributes and achieves
state-of-the-art unsupervised conditional generation performance even in the
absence of attribute information (e.g., the imbalance ratio). Moreover, we
demonstrate that the attributes to be learned can be manipulated using a small
amount of probe data.

本文介绍了一种命名为 SLOGAN 的新方法，通过引入编码网络和无监督条件对比损失来确保单个混合分量生成的数据代表单个属性，成功地学习了平衡或不平衡的属性，并在缺少属性信息（例如不平衡比）的情况下实现最新的无监督条件生成性能。