Unlike popular modularized framework, end-to-end autonomous driving seeks to
solve the perception, decision and control problems in an integrated way, which
can be more adapting to new scenarios and easier to generalize at scale.
However, existing end-to-end approaches are often lack of interpretability, and
can only deal with simple driving tasks like lane keeping. In this paper, we
propose an interpretable deep reinforcement learning method for end-to-end
autonomous driving, which is able to handle complex urban scenarios. A
sequential latent environment model is introduced and learned jointly with the
reinforcement learning process. With this latent model, a semantic birdeye mask
can be generated, which is enforced to connect with a certain intermediate
property in today's modularized framework for the purpose of explaining the
behaviors of learned policy. The latent space also significantly reduces the
sample complexity of reinforcement learning. Comparison tests with a simulated
autonomous car in CARLA show that the performance of our method in urban
scenarios with crowded surrounding vehicles dominates many baselines including
DQN, DDPG, TD3 and SAC. Moreover, through masked outputs, the learned policy is
able to provide a better explanation of how the car reasons about the driving
environment. The codes and videos of this work are available at our github repo
and project website.

该研究提出了一种解决复杂城市场景下的自动驾驶问题的可解释性深度强化学习方法，在学习过程中引入了序贯潜在环境模型，并生成了语义鸟瞰遮罩，以解释学习策略的行为。实验结果显示，该方法在城市场景中的表现优于 DQN、DDPG、TD3 和 SAC 等基线模型。