The manifold hypothesis states that high-dimensional data can be modeled as
lying on or near a low-dimensional, nonlinear manifold. Variational
Autoencoders (VAEs) approximate this manifold by learning mappings from
low-dimensional latent vectors to high-dimensional data while encouraging a
global structure in the latent space through the use of a specified prior
distribution. When this prior does not match the structure of the true data
manifold, it can lead to a less accurate model of the data. To resolve this
mismatch, we introduce the Variational Autoencoder with Learned Latent
Structure (VAELLS) which incorporates a learnable manifold model into the
latent space of a VAE. This enables us to learn the nonlinear manifold
structure from the data and use that structure to define a prior in the latent
space. The integration of a latent manifold model not only ensures that our
prior is well-matched to the data, but also allows us to define generative
transformation paths in the latent space and describe class manifolds with
transformations stemming from examples of each class. We validate our model on
examples with known latent structure and also demonstrate its capabilities on a
real-world dataset.

本文提出了一种新型的 Variational Autoencoder with Learned Latent Structure（VAELLS）模型，该模型融合了可学习的流形模型，使得先验分布与数据流形匹配，并允许定义潜在空间中的生成变换路径，同时尝试在已知潜在结构的情况下进行验证，并展示了该模型在现实世界数据集上的性能。