Disentangled and invariant representations are two critical goals of
representation learning and many approaches have been proposed to achieve
either one of them. However, those two goals are actually complementary to each
other so that we propose a framework to accomplish both of them simultaneously.
We introduce a weakly supervised signal to learn disentangled representation
which consists of three splits containing predictive, known nuisance and
unknown nuisance information respectively. Furthermore, we incorporate
contrastive method to enforce representation invariance. Experiments shows that
the proposed method outperforms state-of-the-art (SOTA) methods on four
standard benchmarks and shows that the proposed method can have better
adversarial defense ability comparing to other methods without adversarial
training.

提出了一种弱监督信号和对比方法相结合的框架来同时学习解缠和不变表示，实验证明该方法在四个标准基准上均优于现有最先进方法，且无需对抗训练即具有更好的对抗防御能力。