Recent advances in text-to-image models have opened new frontiers in
human-centric generation. However, these models cannot be directly employed to
generate images with consistent newly coined identities. In this work, we
propose CharacterFactory, a framework that allows sampling new characters with
consistent identities in the latent space of GANs for diffusion models. More
specifically, we consider the word embeddings of celeb names as ground truths
for the identity-consistent generation task and train a GAN model to learn the
mapping from a latent space to the celeb embedding space. In addition, we
design a context-consistent loss to ensure that the generated identity
embeddings can produce identity-consistent images in various contexts.
Remarkably, the whole model only takes 10 minutes for training, and can sample
infinite characters end-to-end during inference. Extensive experiments
demonstrate excellent performance of the proposed CharacterFactory on character
creation in terms of identity consistency and editability. Furthermore, the
generated characters can be seamlessly combined with the off-the-shelf
image/video/3D diffusion models. We believe that the proposed CharacterFactory
is an important step for identity-consistent character generation. Project page
is available at: this https URL

在这项工作中，我们提出了 CharacterFactory，这是一个允许在 GAN 的潜在空间中采样具有一致身份的新字符的框架，并且设计了一个上下文一致性损失函数来确保生成的身份嵌入在不同上下文中能产生一致身份的图像。