This paper develops a decentralized reinforcement learning (RL) scheme for
multi-intersection adaptive traffic signal control (TSC), called "CVLight",
that leverages data collected from connected vehicles (CVs). The state and
reward design facilitates coordination among agents and considers travel delays
collected by CVs. A novel algorithm, Asymmetric Advantage Actor-critic
(Asym-A2C), is proposed where both CV and non-CV information is used to train
the critic network, while only CV information is used to execute optimal signal
timing. Comprehensive experiments show the superiority of CVLight over
state-of-the-art algorithms under a 2-by-2 synthetic road network with various
traffic demand patterns and penetration rates. The learned policy is then
visualized to further demonstrate the advantage of Asym-A2C. A pre-train
technique is applied to improve the scalability of CVLight, which significantly
shortens the training time and shows the advantage in performance under a
5-by-5 road network. A case study is performed on a 2-by-2 road network located
in State College, Pennsylvania, USA, to further demonstrate the effectiveness
of the proposed algorithm under real-world scenarios. Compared to other
baseline models, the trained CVLight agent can efficiently control multiple
intersections solely based on CV data and achieve the best performance,
especially under low CV penetration rates.

本研究提出了一种名为 CVLight 的分散式增强学习方案，应用于多交叉口自适应交通信号控制，利用了来自互联车辆的数据，提出了新算法 Asym-A2C，通过全面的实验，证明 CVLight 在各种交通需求和覆盖率下都优于现有算法，并展示了 Asym-A2C 的优势。