In recent years, autonomous driving algorithms using low-cost vehicle-mounted
cameras have attracted increasing endeavors from both academia and industry.
There are multiple fronts to these endeavors, including object detection on
roads, 3-D reconstruction etc., but in this work we focus on a vision-based
model that directly maps raw input images to steering angles using deep
networks. This represents a nascent research topic in computer vision. The
technical contributions of this work are three-fold. First, the model is
learned and evaluated on real human driving videos that are time-synchronized
with other vehicle sensors. This differs from many prior models trained from
synthetic data in racing games. Second, state-of-the-art models, such as
PilotNet, mostly predict the wheel angles independently on each video frame,
which contradicts common understanding of driving as a stateful process.
Instead, our proposed model strikes a combination of spatial and temporal cues,
jointly investigating instantaneous monocular camera observations and vehicle's
historical states. This is in practice accomplished by inserting
carefully-designed recurrent units (e.g., LSTM and Conv-LSTM) at proper network
layers. Third, to facilitate the interpretability of the learned model, we
utilize a visual back-propagation scheme for discovering and visualizing image
regions crucially influencing the final steering prediction. Our experimental
study is based on about 6 hours of human driving data provided by Udacity.
Comprehensive quantitative evaluations demonstrate the effectiveness and
robustness of our model, even under scenarios like drastic lighting changes and
abrupt turning. The comparison with other state-of-the-art models clearly
reveals its superior performance in predicting the due wheel angle for a
self-driving car.

本文研究利用低成本车载摄像头进行自主驾驶算法，并通过深度神经网络将原始输入图像直接映射到方向盘角度的视觉模型，提出了一种结合空间和时间线索的模型，有助于解释学习到的模型，通过分析人类驾驶数据，比较了此模型与其他自主驾驶车辆状态先进模型的性能差异。