The use of simulated virtual environments to train deep convolutional neural
networks (CNN) is a currently active practice to reduce the
(real)data-hungriness of the deep CNN models, especially in application domains
in which large scale real data and/or groundtruth acquisition is difficult or
laborious. Recent approaches have attempted to harness the capabilities of
existing video games, animated movies to provide training data with high
precision groundtruth. However, a stumbling block is in how one can certify
generalization of the learned models and their usefulness in real world data
sets. This opens up fundamental questions such as: What is the role of
photorealism of graphics simulations in training CNN models? Are the trained
models valid in reality? What are possible ways to reduce the performance bias?
In this work, we begin to address theses issues systematically in the context
of urban semantic understanding with CNNs. Towards this end, we (a) propose a
simple probabilistic urban scene model, (b) develop a parametric rendering tool
to synthesize the data with groundtruth, followed by (c) a systematic
exploration of the impact of level-of-realism on the generality of the trained
CNN model to real world; and domain adaptation concepts to minimize the
performance bias.

该论文研究使用虚拟环境训练 CNN 模型的有效性，并针对城市语义理解提出了一种简单的概率场景模型，开发了参数化渲染工具进行数据综合，并系统地探索了真实感水平对 CNN 模型普适性的影响以及域自适应概念，以减少性能偏差。