Deep latent-variable models learn representations of high-dimensional data in
an unsupervised manner. A number of recent efforts have focused on learning
representations that disentangle statistically independent axes of variation by
introducing modifications to the standard objective function. These approaches
generally assume a simple diagonal Gaussian prior and as a result are not able
to reliably disentangle discrete factors of variation. We propose a two-level
hierarchical objective to control relative degree of statistical independence
between blocks of variables and individual variables within blocks. We derive
this objective as a generalization of the evidence lower bound, which allows us
to explicitly represent the trade-offs between mutual information between data
and representation, KL divergence between representation and prior, and
coverage of the support of the empirical data distribution. Experiments on a
variety of datasets demonstrate that our objective can not only disentangle
discrete variables, but that doing so also improves disentanglement of other
variables and, importantly, generalization even to unseen combinations of
factors.

本研究提出了一种两级分层目标函数来控制变量块和块内个体变量之间的相对统计独立程度，以通过非监督学习从高维数据中学习无监督表示，实验结果显示该目标函数可以解开离散变量，并提高其他变量的解开程度和泛化能力。