Robust generalization to new concepts has long remained a distinctive feature of human intelligence. However, recent progress in deep generative models has now led to neural architectures capable of synthesizing novel instances of unknown visual concepts from a single training example. Yet, a more precise comparison between these models and humans is not possible because existing performance metrics for generative models (i.e., FID, IS, likelihood) are not appropriate for the one-shot generation scenario. Here, we propose a new framework to evaluate one-shot generative models along two axes: sample recognizability vs. diversity (i.e., intra-class variability). Using this framework, we perform a systematic evaluation of representative one-shot generative models on the Omniglot handwritten dataset. We first show that GAN-like and VAE-like models fall on opposite ends of the diversity-recognizability space. Extensive analyses of the effect of key model parameters further revealed that spatial attention and context integration have a linear contribution to the diversity-recognizability trade-off. In contrast, disentanglement transports the model along a parabolic curve that could be used to maximize recognizability. Using the diversity-recognizability framework, we were able to identify models and parameters that closely approximate human data.

本文提出了一种新的评估单次生成模型的框架，用于比较其与人类生成的差异，确定其代表人体模型的模型以及模型参数。该框架通过对样本可识别性和样本多样性（即类内差异）两个方面进行评估，并对代表性单次生成模型在 Omniglot 手写数据集上进行了详细地分析。研究表明，GAN 型和 VAE 型模型的多样性和可识别性具有互补性，同时，空间注意和上下文整合在多样性和可识别性之间具有线性贡献，而解缠效应则能沿着拱形曲线传递模型，从而最大化可识别性。评估结果可用于推动人工智能技术的发展。

多样性 vs. 可识别性: 一次性生成模型中的类人泛化