22,297 research outputs found
Towards Robust Deep Reinforcement Learning for Traffic Signal Control: Demand Surges, Incidents and Sensor Failures
Reinforcement learning (RL) constitutes a promising solution for alleviating
the problem of traffic congestion. In particular, deep RL algorithms have been
shown to produce adaptive traffic signal controllers that outperform
conventional systems. However, in order to be reliable in highly dynamic urban
areas, such controllers need to be robust with the respect to a series of
exogenous sources of uncertainty. In this paper, we develop an open-source
callback-based framework for promoting the flexible evaluation of different
deep RL configurations under a traffic simulation environment. With this
framework, we investigate how deep RL-based adaptive traffic controllers
perform under different scenarios, namely under demand surges caused by special
events, capacity reductions from incidents and sensor failures. We extract
several key insights for the development of robust deep RL algorithms for
traffic control and propose concrete designs to mitigate the impact of the
considered exogenous uncertainties.Comment: 8 page
CoLight: Learning Network-level Cooperation for Traffic Signal Control
Cooperation among the traffic signals enables vehicles to move through
intersections more quickly. Conventional transportation approaches implement
cooperation by pre-calculating the offsets between two intersections. Such
pre-calculated offsets are not suitable for dynamic traffic environments. To
enable cooperation of traffic signals, in this paper, we propose a model,
CoLight, which uses graph attentional networks to facilitate communication.
Specifically, for a target intersection in a network, CoLight can not only
incorporate the temporal and spatial influences of neighboring intersections to
the target intersection, but also build up index-free modeling of neighboring
intersections. To the best of our knowledge, we are the first to use graph
attentional networks in the setting of reinforcement learning for traffic
signal control and to conduct experiments on the large-scale road network with
hundreds of traffic signals. In experiments, we demonstrate that by learning
the communication, the proposed model can achieve superior performance against
the state-of-the-art methods.Comment: 10 pages. Proceedings of the 28th ACM International on Conference on
Information and Knowledge Management. ACM, 201
- …