Single-view 3D shape reconstruction is an important but challenging problem, mainly for two reasons. First, as shape annotation is very expensive to acquire, current methods rely on synthetic data, in which ground-truth 3D annotation is easy to obtain. However, this results in domain adaptation problem when applied to natural images. The second challenge is that it exists multiple shapes that can explain a given 2D image. In this paper, we propose a framework to improve over these challenges using adversarial training. On one hand, we impose domain-confusion between natural and synthetic image representations to reduce the distribution gap. On the other hand, we impose the reconstruction to be `realistic' by forcing it to lie on a (learned) manifold of realistic object shapes. Moreover, our experiments show that these constraints improve performance by a large margin over a baseline reconstruction model. We achieve results competitive with the state of the art using only RGB images and with a much simpler architecture.

本文提出了一种基于对抗训练的框架来解决单视角3D形状重建中存在的挑战，该框架通过降低自然和合成图像之间的差异、迫使重建在逼真的物体形状流形上以及实施其他约束来改进性能。实验结果表明，该方法优于基线模型，且采用简化模型即可达到与最先进方法相当的结果。

领域自适应的单视角三维重建