An efficient one-step-ahead optimal control for urban signalized traffic networks based on an averaged Cell-Transmission model

International audience— This paper presents a model for large urban traffic networks, based on the well-known macroscopic Cell Transmission Model. We start by describing the dynamics of traffic flow at signalized intersections. Then we develop an average-based approximation of such a system, that we use to build our control algorithm as a linear optimization problem. Simulation results validate the averaged approach and show the effectiveness of the proposed control strategy

Towards scalable optimal traffic control

International audienceThis paper deals with scalable control of traffic lights in urban traffic networks. Optimization is done in real time, so as to take into account variable traffic demands.At each cycle of the traffic lights, the optimization concerns times instants where each traffic light starts and ends its green phase: this allows to describe both the duty-cycle and the phase shifts.First, we formulate a global optimization problem, which can be cast as a mixed-integer linear program. To overcome the complexity of this centralized approach, we also propose a decentralized suboptimal algorithm, whose simplicity allows on-line implementation. Simulations show the effectiveness of the proposed strategies

Modeling, Control, and Impact Analysis of The Next Generation Transportation System

This dissertation aims to develop a systematic tool designated for connected and autonomous vehicles, integrating the simulation of traffic dynamics, traffic control strategies, and impact analysis at the network level. The first part of the dissertation is devoted to the traffic flow modeling of connected vehicles. This task is the foundation step for transportation planning, optimized network design, efficient traffic control strategies, etc, of the next generation transportation system. Chapter 2 proposes a cell-based simulation approach to model the proactive driving behavior of connected vehicles. Firstly, a state variable of connected vehicle is introduced to track the trajectory of connected vehicles. Then the exit flow of cells containing connected vehicles is adjusted to simulate the proactive driving behavior, such that the traffic light is green when the connected vehicle arrives at the signalized intersection. Extensive numerical simulation results consistently show that the presence of connected vehicles contributes significantly to the smoothing of traffic flow and vehicular emission reductions in the network. Chapter 3 proposes an optimal estimation approach to calibrate connected vehicles\u27 car-following behavior in a mixed traffic environment. Particularly, the state-space system dynamics is captured by the simplified car-following model with disturbances, where the trajectory of non-connected vehicles are considered as unknown states and the trajectory of connected vehicles are considered as measurements with errors. Objective of the reformulation is to obtain an optimal estimation of states and model parameters simultaneously. It is shown that the customized state-space model is identifiable with the mild assumption that the disturbance covariance of the state update process is diagonal. Then a modified Expectation-Maximization (EM) algorithm based on Kalman smoother is developed to solve the optimal estimation problem. The second part of the dissertation is on traffic control strategies. This task drives the next generation transportation system to a better performance state in terms of safety, mobility, travel time saving, vehicular emission reduction, etc. Chapter 4 develops a novel reinforcement learning algorithm for the challenging coordinated signal control problem. Traffic signals are modeled as intelligent agents interacting with the stochastic traffic environment. The model is built on the framework of coordinated reinforcement learning. The Junction Tree Algorithm based reinforcement learning is proposed to obtain an exact inference of the best joint actions for all the coordinated intersections. The algorithm is implemented and tested with a network containing 18 signalized intersections from a microscopic traffic simulator. Chapter 5 develops a novel linear programming formulation for autonomous intersection control (LPAIC) accounting for traffic dynamics within a connected vehicle environment. Firstly, a lane based bi-level optimization model is introduced to propagate traffic flows in the network. Then the bi-level optimization model is transformed to the linear programming formulation by relaxing the nonlinear constraints with a set of linear inequalities. One special feature of the LPAIC formulation is that the entries of the constraint matrix has only values in {-1, 0, 1}. Moreover, it is proved that the constraint matrix is totally unimodular, the optimal solution exists and contains only integer values. Further, it shows that traffic flows from different lanes pass through the conflict points of the intersection safely and there are no holding flows in the solution. Three numerical case studies are conducted to demonstrate the properties and effectiveness of the LPAIC formulation to solve autonomous intersection control. The third part of the dissertation moves on to the impact analysis of connected vehicles and autonomous vehicles at the network level. This task assesses the positive and negative impacts of the system and provides guidance on transportation planning, traffic control, transportation budget spending, etc. In this part, the impact of different penetration rates of connected vehicle and autonomous vehicles is revealed on the network efficiency of a transportation system. Chapter 6 sets out to model an efficient and fair transportation system accounting for both departure time choice and route choice of a general multi OD network within a dynamic traffic assignment environment. Firstly, a bi-level optimization formulation is introduced based on the link-based traffic flow model. The upper level of the formulation minimizes the total system travel time, whereas the lower level captures traffic flow propagation and the user equilibrium constraint. Then the bi-level formulation is relaxed to a linear programming formulation that produces a lower bound of an efficient and fair system state. An efficient iterative algorithm is proposed to obtain the exact solution. It is shown that the number of iterations is bounded, and the output traffic flow solution is efficient and fair. Finally, two numerical cases (including a single OD network and a multi-OD network) are conducted to demonstrate the performance of the algorithm. The results consistently show that the travel time of different departure rates of the same OD pair are identical and the algorithm converges within two iterations across all test scenarios

Towards scalable optimal traffic control

International audienceThis paper deals with scalable control of traffic lights in urban traffic networks. Optimization is done in real time, so as to take into account variable traffic demands.At each cycle of the traffic lights, the optimization concerns times instants where each traffic light starts and ends its green phase: this allows to describe both the duty-cycle and the phase shifts.First, we formulate a global optimization problem, which can be cast as a mixed-integer linear program. To overcome the complexity of this centralized approach, we also propose a decentralized suboptimal algorithm, whose simplicity allows on-line implementation. Simulations show the effectiveness of the proposed strategies

Deep learning for real-time traffic signal control on urban networks

Real-time traffic signal controls are frequently challenged by (1) uncertain knowledge about the traffic states; (2) need for efficient computation to allow timely decisions; (3) multiple objectives such as traffic delays and vehicle emissions that are difficult to optimize; and (4) idealized assumptions about data completeness and quality that are often made in developing many theoretical signal control models. This thesis addresses these challenges by proposing two real-time signal control frameworks based on deep learning techniques, followed by extensive simulation tests that verifies their effectiveness in view of the aforementioned challenges. The first method, called the Nonlinear Decision Rule (NDR), defines a nonlinear mapping between network states and signal control parameters to network performances based on prevailing traffic conditions, and such a mapping is optimized via off-line simulation. The NDR is instantiated with two neural networks: feedforward neural network (FFNN) and recurrent neural network (RNN), which have different ways of processing traffic information in the near past. The NDR is implemented and tested within microscopic traffic simulation (S-Paramics) for a real-world network in West Glasgow, where the off-line training of the NDR amounts to a simulation-based optimization procedure aiming to reduce delay, CO2 and black carbon emissions. Extensive tests are performed to assess the NDR framework, not only in terms of its effectiveness in optimizing different traffic and environmental objectives, but also in relation to local vs. global benefits, trade-off between delay and emissions, impact of sensor locations, and different levels of network saturation. The second method, called the Advanced Reinforcement Learning (ARL), employs the potential-based reward shaping function using Q-learning and 3rd party advisor to enhance its performance over conventional reinforcement learning. The potential-based reward shaping in this thesis obtains an opinion from the 3rd party advisor when calculating reward. This technique can resolve the problem of sparse reward and slow learning speed. The ARL is tested with a range of existing reinforcement learning methods. The results clearly show that ARL outperforms the other models in almost all the scenarios. Lastly, this thesis evaluates the impact of information availability and quality on different real-time signal control methods, including the two proposed ones. This is driven by the observation that most responsive signal control models in the literature tend to make idealized assumptions on the quality and availability of data. This research shows the varying levels of performance deterioration of different signal controllers in the presence of missing data, data noise, and different data types. Such knowledge and insights are crucial for real-world implementation of these signal control methods.Open Acces

Cyber Security of Traffic Signal Control Systems with Connected Vehicles

Our world is becoming increasingly connected through smart technologies. The same trend is emerging in transportation systems, wherein connected vehicles (CVs) and transportation infrastructure are being connected through advanced wireless communication technologies. CVs have great potential to improve a variety of mobility applications, including traffic signal control (TSC), a critical component in urban traffic operations. CV-based TSC (CV-TSC) systems use trajectory data to make more informed control decisions, therefore can accommodate real-time traffic fluctuations more efficiently. However, vehicle-infrastructure connectivity opens new doors to potential cyber attacks. Malicious attackers can potentially send falsified trajectory data to CV-TSC systems and influence signal control decisions. The benefit of CV-TSC systems can be realized only if the systems are secure in cyberspace. Although many CV-TSC systems have been developed within the past decade, few consider cyber security in their system design. It remains unclear exactly how vulnerable CV-TSC systems are, how cyber attacks may be perpetrated, and how engineers can mitigate cyber attacks and protect CV-TSC systems. Therefore, this dissertation aims to systematically understand the cyber security problems facing CV-TSC systems under falsified data attacks and provide a countermeasure to safeguard CV-TSC systems. These objectives are accomplished through four studies. The first study evaluates the effects of falsified data attacks on TSC systems. Two TSC systems are considered: a conventional actuated TSC system and an adaptive CV-TSC system. Falsified data attacks are assumed to change the input data to these systems and therefore influence control decisions. Numerical examples show that both systems are vulnerable to falsified data attacks. The second study investigates how falsified data attacks may be perpetrated in a realistic setting. Different from prior research, this study considers a more realistic but challenging black-box attack scenario, in which the signal control model is unavailable to the attacker. Under this constraint, the attacker has to learn the signal control model using a surrogate model. The surrogate model predicts signal timing plans based on critical traffic features extracted from CV data. The attacker can generate falsified CV data (i.e., falsified vehicle trajectories) to alter the values of critical traffic features and thus influence signal control decisions. In the third study, a data-driven method is proposed to protect CV-TSC systems from falsified data attacks. Falsified trajectories are behaviorally distinct from normal trajectories because they must accomplish a certain attack goal; thus, the problem of identifying falsified trajectories is considered an abnormal trajectory identification problem. A trajectory-embedding model is developed to generate vector representations of trajectory data. The similarity (distance) between each pair of trajectories can be computed based on these vector representations. Hierarchical clustering is then applied to identify abnormal (i.e., falsified) trajectories. In the final study, a testing platform is built upon a virtual traffic simulator and real-world transportation infrastructure in Mcity. The testing platform integrates the attack study and defense study in a unified framework and is used to evaluate the real-world impact of cyber attacks on CV-TSC systems and the effectiveness of defense strategies.PHDCivil EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/162931/1/edhuang_1.pd

Field Implementation of Freeway Control

This dissertation presents a series of traffic management studies including freeway and intersection traffic modeling, estimation, control methodologies and field implementation tests. First, a traffic flow prediction method that combines the most recent traffic data with historical traffic data is studied. An autoregressive moving average with exogenous input (ARMAX) model is estimated on-line based on the most recent vehicle detector station (VDS) data. Results obtained using empirical freeway mainline and on-ramp data show that this method outperforms methods that rely only on the historical average of the data to perform a prediction, especially during days with unusual traffic flow demands. Second, two freeway control strategies: coordinated ramp metering (CRM) and variable speed advisory (VSA) are investigated and implemented in field tests. In the control of CRM study, the freeway is modeled by the cell transmission model (CTM) and the control problem is solved by the model predictive control (MPC) scheme. The proposed CRM is deployed in a segment of California State Route 99 Northbound (SR-99N) for a five-week field test. The test results shows that the freeway efficiency can be improved by 7.25% for morning peak hours. In the VSA control study, an advisory speed limit control is designed by using traffic flow stabilization of the Lighthill-Whitham-Richards (LWR) model. The proposed VSA is deployed in a segment of California State Route 78 Eastbound (SR-78E) for a five-week field test. The test results shows that the freeway efficiency can be improved by 8.71% for morning peak hours. Both control strategies indicate freeway efficiency improvement in congested traffic. Third, the large-scale signalized intersection traffic network control by offset optimization is also studied. The traffic network is described by a directed graph and the traffic dynamic is represented by continuous-time fluid queue model with sinusoidal arrival and departure rate assumption. The original non-convex offset optimization problem can be relaxed into a semidefinite program (SDP). The Burer-Monteiro (BM) method is used for solving the large SDP to avoid conic constraints. Two real-world traffic simulation networks, respectively in Manhattan, NY and in Pasadena, CA are constructed for demonstrating the BM method. Numerical simulation results indicate that BM method has good scalability and it can efficiently recover optimal solutions of the SDP

Proceedings of the 4th Symposium on Management of Future Motorway and Urban Traffic Systems 2022

The 4th Symposium on Management of Future Motorway and Urban Traffic Systems (MFTS) was held in Dresden, Germany, from November 30th to December 2nd, 2022. Organized by the Chair of Traffic Process Automation (VPA) at the “Friedrich List” Faculty of Transport and Traffic Sciences of the TU Dresden, the proceedings of this conference are published as volume 9 in the Chair’s publication series “Verkehrstelematik” and contain a large part of the presented conference extended abstracts. The focus of the MFTS conference 2022 was cooperative management of multimodal transport and reflected the vision of the professorship to be an internationally recognized group in ITS research and education with the goal of optimizing the operation of multimodal transport systems. In 14 MFTS sessions, current topics in demand and traffic management, traffic control in conventional, connected and automated transport, connected and autonomous vehicles, traffic flow modeling and simulation, new and shared mobility systems, digitization, and user behavior and safety were discussed. In addition, special sessions were organized, for example on “Human aspects in traffic modeling and simulation” and “Lesson learned from Covid19 pandemic”, whose descriptions and analyses are also included in these proceedings.:1 Connected and Automated Vehicles 1.1 Traffic-based Control of Truck Platoons on Freeways 1.2 A Lateral Positioning Strategy for Connected and Automated Vehicles in Lane-free Traffic 1.3 Simulation Methods for Mixed Legacy-Autonomous Mainline Train Operations 1.4 Can Dedicated Lanes for Automated Vehicles on Urban Roads Improve Traffic Efficiency? 1.5 GLOSA System with Uncertain Green and Red Signal Phases 2 New Mobility Systems 2.1 A New Model for Electric Vehicle Mobility and Energy Consumption in Urban Traffic Networks 2.2 Shared Autonomous Vehicles Implementation for a Disrupted Public Transport Network 3 Traffic Flow and Simulation 3.1 Multi-vehicle Stochastic Fundamental Diagram Consistent with Transportations Systems Theory 3.2 A RoundD-like Roundabout Scenario in CARLA Simulator 3.3 Multimodal Performance Evaluation of Urban Traffic Control: A Microscopic Simulation Study 3.4 A MILP Framework to Solve the Sustainable System Optimum with Link MFD Functions 3.5 On How Traffic Signals Impact the Fundamental Diagrams of Urban Roads 4 Traffic Control in Conventional Traffic 4.1 Data-driven Methods for Identifying Travel Conditions Based on Traffic and Weather Characteristics 4.2 AI-based Multi-class Traffic Model Oriented to Freeway Traffic Control 4.3 Exploiting Deep Learning and Traffic Models for Freeway Traffic Estimation 4.4 Automatic Design of Optimal Actuated Traffic Signal Control with Transit Signal Priority 4.5 A Deep Reinforcement Learning Approach for Dynamic Traffic Light Control with Transit Signal Priority 4.6 Towards Efficient Incident Detection in Real-time Traffic Management 4.7 Dynamic Cycle Time in Traffic Signal of Cyclic Max-Pressure Control 5 Traffic Control with Autonomous Vehicles 5.1 Distributed Ordering and Optimization for Intersection Management with Connected and Automated Vehicles 5.2 Prioritization of an Automated Shuttle for V2X Public Transport at a Signalized Intersection – a Real-life Demonstration 6 User Behaviour and Safety 6.1 Local Traffic Safety Analyzer (LTSA) - Improved Road Safety and Optimized Signal Control for Future Urban Intersections 7 Demand and Traffic Management 7.1 A Stochastic Programming Method for OD Estimation Using LBSN Check-in Data 7.2 Delineation of Traffic Analysis Zone for Public Transportation OD Matrix Estimation Based on Socio-spatial Practices 8 Workshops 8.1 How to Integrate Human Aspects Into Engineering Science of Transport and Traffic? - a Workshop Report about Discussions on Social Contextualization of Mobility 8.2 Learning from Covid: How Can we Predict Mobility Behaviour in the Face of Disruptive Events? – How to Investigate the Mobility of the FutureDas 4. Symposium zum Management zukünftiger Autobahn- und Stadtverkehrssysteme (MFTS) fand vom 30. November bis 2. Dezember 2022 in Dresden statt und wurde vom Lehrstuhl für Verkehrsprozessautomatisierung (VPA) an der Fakultät Verkehrswissenschaften„Friedrich List“ der TU Dresden organisiert. Der Tagungsband erscheint als Band 9 in der Schriftenreihe „Verkehrstelematik“ des Lehrstuhls und enthält einen Großteil der vorgestellten Extended-Abstracts des Symposiums. Der Schwerpunkt des MFTS-Symposiums 2022 lag auf dem kooperativen Management multimodalen Verkehrs und spiegelte die Vision der Professur wider, eine international anerkannte Gruppe in der ITS-Forschung und -Ausbildung mit dem Ziel der Optimierung des Betriebs multimodaler Transportsysteme zu sein. In 14 MFTS-Sitzungen wurden aktuelle Themen aus den Bereichen Nachfrage- und Verkehrsmanagement, Verkehrssteuerung im konventionellen, vernetzten und automatisierten Verkehr, vernetzte und autonome Fahrzeuge, Verkehrsflussmodellierung und -simulation, neue und geteilte Mobilitätssysteme, Digitalisierung sowie Nutzerverhalten und Sicherheit diskutiert. Darüber hinaus wurden Sondersitzungen organisiert, beispielsweise zu „Menschlichen Aspekten bei der Verkehrsmodellierung und -simulation“ und „Lektionen aus der Covid-19-Pandemie“, deren Beschreibungen und Analysen ebenfalls in diesen Tagungsband einfließen.:1 Connected and Automated Vehicles 1.1 Traffic-based Control of Truck Platoons on Freeways 1.2 A Lateral Positioning Strategy for Connected and Automated Vehicles in Lane-free Traffic 1.3 Simulation Methods for Mixed Legacy-Autonomous Mainline Train Operations 1.4 Can Dedicated Lanes for Automated Vehicles on Urban Roads Improve Traffic Efficiency? 1.5 GLOSA System with Uncertain Green and Red Signal Phases 2 New Mobility Systems 2.1 A New Model for Electric Vehicle Mobility and Energy Consumption in Urban Traffic Networks 2.2 Shared Autonomous Vehicles Implementation for a Disrupted Public Transport Network 3 Traffic Flow and Simulation 3.1 Multi-vehicle Stochastic Fundamental Diagram Consistent with Transportations Systems Theory 3.2 A RoundD-like Roundabout Scenario in CARLA Simulator 3.3 Multimodal Performance Evaluation of Urban Traffic Control: A Microscopic Simulation Study 3.4 A MILP Framework to Solve the Sustainable System Optimum with Link MFD Functions 3.5 On How Traffic Signals Impact the Fundamental Diagrams of Urban Roads 4 Traffic Control in Conventional Traffic 4.1 Data-driven Methods for Identifying Travel Conditions Based on Traffic and Weather Characteristics 4.2 AI-based Multi-class Traffic Model Oriented to Freeway Traffic Control 4.3 Exploiting Deep Learning and Traffic Models for Freeway Traffic Estimation 4.4 Automatic Design of Optimal Actuated Traffic Signal Control with Transit Signal Priority 4.5 A Deep Reinforcement Learning Approach for Dynamic Traffic Light Control with Transit Signal Priority 4.6 Towards Efficient Incident Detection in Real-time Traffic Management 4.7 Dynamic Cycle Time in Traffic Signal of Cyclic Max-Pressure Control 5 Traffic Control with Autonomous Vehicles 5.1 Distributed Ordering and Optimization for Intersection Management with Connected and Automated Vehicles 5.2 Prioritization of an Automated Shuttle for V2X Public Transport at a Signalized Intersection – a Real-life Demonstration 6 User Behaviour and Safety 6.1 Local Traffic Safety Analyzer (LTSA) - Improved Road Safety and Optimized Signal Control for Future Urban Intersections 7 Demand and Traffic Management 7.1 A Stochastic Programming Method for OD Estimation Using LBSN Check-in Data 7.2 Delineation of Traffic Analysis Zone for Public Transportation OD Matrix Estimation Based on Socio-spatial Practices 8 Workshops 8.1 How to Integrate Human Aspects Into Engineering Science of Transport and Traffic? - a Workshop Report about Discussions on Social Contextualization of Mobility 8.2 Learning from Covid: How Can we Predict Mobility Behaviour in the Face of Disruptive Events? – How to Investigate the Mobility of the Futur

Estimation and Control of Traffic Relying on Vehicular Connectivity

Vehicular traffic flow is essential, yet complicated to analyze. It describes the interplay among vehicles and with the infrastructure. A better understanding of traf-fic would benefit both individuals and the whole society in terms of improving safety, energy efficiency, and reducing environmental impacts. A large body of research ex-ists on estimation and control of vehicular traffic in which, however, vehicles were assumed not to be able to share information due to the limits of technology. With the development of wireless communication and various sensor devices, Connected Vehicles(CV) are emerging which are able to detect, access, and share information with each other and with the infrastructure in real time. Connected Vehicle Technology (CVT) has been attracting more and more attentions from different fields. The goal of this dissertation is to develop approaches to estimate and control vehicular traffic as well as individual vehicles relying on CVT. On one hand, CVT sig-nificantly enriches the data from individuals and the traffic, which contributes to the accuracy of traffic estimation algorithms. On the other hand, CVT enables commu-nication and information sharing between vehicles and infrastructure, and therefore allows vehicles to achieve better control and/or coordination among themselves and with smart infrastructure. The first part of this dissertation focused on estimation of traffic on freeways and city streets. We use data available from on road sensors and also from probe One of the most important traffic performance measures is travel time. How-ever it is affected by various factors, and freeways and arterials have different travel time characteristics. In this dissertation we first propose a stochastic model-based approach to freeway travel-time prediction. The approach uses the Link-Node Cell Transmission Model (LN-CTM) to model traffic and provides a probability distribu-tion for travel time. The probability distribution is generated using a Monte Carlo simulation and an Online Expectation Maximization clustering algorithm. Results show that the approach is able to generate a reasonable multimodal distribution for travel-time. For arterials, this dissertation presents methods for estimating statistics of travel time by utilizing sparse vehicular probe data. A public data feed from transit buses in the City of San Francisco is used. We divide each link into shorter segments, and propose iterative methods for allocating travel time statistics to each segment. Inspired by K-mean and Expectation Maximization (EM) algorithms, we iteratively update the mean and variance of travel time for each segment based on historical probe data until convergence. Based on segment travel time statistics, we then pro-pose a method to estimate the maximum likelihood trajectory (MLT) of a probe vehicle in between two data updates on arterial roads. The results are compared to high frequency ground truth data in multiple scenarios, which demonstrate the effectiveness of the proposed approach. The second part of this dissertation emphasize on control approaches enabled by vehicular connectivity. Estimation and prediction of surrounding vehicle behaviors and upcoming traffic makes it possible to improve driving performance. We first propose a Speed Advisory System for arterial roads, which utilizes upcoming traffi