Constrained dynamic control of traffic junctions

Excessive traffic in our urban environments has detrimental effects on our health, economy and standard of living. To mitigate this problem, an adaptive traffic lights signalling scheme is developed and tested in this paper. This scheme is based on a state space representation of traffic dynamics, controlled via a dynamic programme. To minimise implementation costs, only one loop detector is assumed at each link. The comparative advantages of the proposed system over optimal fixed time control are highlighted through an example. Results will demonstrate the flexibility of the system when applied to different junctions. Monte Carlo runs of the developed scheme highlight the consistency and repeatability of these results.peer-reviewe

An MDP decomposition approach for traffic control at isolated signalized intersections

This article presents a novel approach for the dynamic control of a signalized intersection. At the intersection, there is a number of arrival flows of cars, each having a single queue (lane). The set of all flows is partitioned into disjoint combinations of nonconflicting flows that will receive green together. The dynamic control of the traffic lights is based on the numbers of cars waiting in the queues. The problem concerning when to switch (and which combination to serve next) is modeled as a Markovian decision process in discrete time. For large intersections (i.e., intersections with a large number of flows), the number of states becomes tremendously large, prohibiting straightforward optimization using value iteration or policy iteration. Starting from an optimal (or nearly optimal) fixed-cycle strategy, a one-step policy improvement is proposed that is easy to compute and is shown to give a close to optimal strategy for the dynamic proble

Traffic signal control using queueing theory

Traffic signal control has drawn considerable attention in the literatures thanks to its ability to improve the mobility of urban networks. Queueing models are capable of capturing performance or effectiveness of a queueing system. In this report, SOCPs (second order cone program) are proposed based on different queueing models as pre-timed signal control techniques to minimize total travel delay. Stochastic programs are developed in order to handle the uncertainties in the arrival rates. In addition, the superiority of the proposed model over Webster’s model has been validated in a microscopic traffic simulation software named CORSIM.Statistic

Control y simulación de tráfico urbano en Colombia: Estado del arte

Las condiciones actuales de la movilidad en Colombia generan interrogantes acerca de qué tan apropiadas son las estrategias de control de tráfico aplicadas en las redes urbanas del país. Con esto en mente, se plantea una revisión de las estrategias de control y plataformas de simulación de sistemas de tráfico más utilizadas en Colombia y en otras partes del mundo; con el propósito de caracterizar el nivel de desarrollo del país en el estudio e implementación de estrategias de control de tráfico urbano y, posteriormente, formular propuestas orientadas hacia la mejora de la movilidad urbana en el país./ The current mobility conditions in Colombia give place to questions about the suitability of the traffic control strategies applied on the Colombian urban networks. Therefore, a review of the control strategies and simulation platforms used in Colombia and around the world is shown. This is done to characterize the level of development of the country, in terms of research and implementation of such control strategies and, furthermore, to formulate proposals oriented towards the improvement of the Colombian urban mobility

Road Artery Traffic Light Optimization with Use of the Reinforcement Learning

The basic principle of optimal traffic control is the appropriate real-time response to dynamic traffic flow changes. Signal plan efficiency depends on a large number of input parameters. An actuated signal system can adjust very well to traffic conditions, but cannot fully adjust to stochastic traffic volume oscillation. Due to the complexity of the problem analytical methods are not applicable for use in real time, therefore the purpose of this paper is to introduce heuristic method suitable for traffic light optimization in real time. With the evolution of artificial intelligence new possibilities for solving complex problems have been introduced. The goal of this paper is to demonstrate that the use of the Q learning algorithm for traffic lights optimization is suitable. The Q learning algorithm was verified on a road artery with three intersections. For estimation of the effectiveness and efficiency of the proposed algorithm comparison with an actuated signal plan was carried out. The results (average delay per vehicle and the number of vehicles that left road network) show that Q learning algorithm outperforms the actuated signal controllers. The proposed algorithm converges to the minimal delay per vehicle regardless of the stochastic nature of traffic. In this research the impact of the model parameters (learning rate, exploration rate, influence of communication between agents and reward type) on algorithm effectiveness were analysed as well.</p

Iterative Learning Control with Forgetting Factor for Urban Road Network

In order to improve the traffic condition, a novel iterative learning control (ILC) algorithm with forgetting factor for urban road network is proposed by using the repeat characteristics of traffic flow in this paper. Rigorous analysis shows that the proposed ILC algorithm can guarantee the asymptotic convergence. Through iterative learning control of the traffic signals, the number of vehicles on each road in the network can gradually approach the desired level, thereby preventing oversaturation and traffic congestion. The introduced forgetting factor can effectively adjust the control input according to the states of the system and filter along the direction of the iteration. The results show that the forgetting factor has an important effect on the robustness of the system. The theoretical analysis and experimental simulations are given to verify the validity of the proposed method