Kooperativno upravljanje priljevnim tokovima na urbanim autocestama zasnovano na strojnom učenju

To cope with today’s urban motorway congestions and the inability to increase motorway capacity in urban environments requires the implementation of advanced control methods. These methods are an integral part of Intelligent Transportation Systems (ITS). An ITS essentially integrates information and communication technology to solve the congestion problems. Ramp metering (RM) and Variable Speed Limit Control (VSLC) are some of the most widely used urban motorway traffic control methods. RM provide direct influence over the on-ramp flows by using specialized traffic lights, while the VSLC control speed of mainstream flow by using variable messaging signs. A dedicated algorithm for RM or VSLC uses sensory data form an urban motorway to compute actions that will have a positive impact on both types of traffic flow. This study will focus on the cooperation of an RM and a VSLC systems, and the integration of several different RM algorithms into a single algorithm called INTEGRA. The algorithm is created by using the Adaptive Neuro-fuzzy Inference System (ANFIS) as an instance of machine learning techniques. Furthermore, INTGERA is expanded in order to integrate its original functionality with a recurrent neural network for traffic demand prediction. As the final step, this doctoral thesis will provide evaluation of different criteria for learning dataset functional setup, based on which ANFIS neural network of INTEGRA will be learned. Results of all mentioned approaches will be compared and discussed in relation with other commonly used urban motorway control methods.Glavnina istraživanja u ovom doktorskom radu vezana je upravo za upravljanje priljevnim tokovima s posebnim naglaskom na kooperaciju s drugim sustavima upravljanja prometom, te primjeni strojnog učenja. Također, u kooperaciji s upravljanjem priljevnih tokova razmatrat će se druge upravljačke metode kao što su sustav zabrane prometovanja određenim prometnim trakama, te potpuno ili djelomično upravljanje vozilima opremljenim posebnim računalnim jedinicama. Od strane autora predložen je neuro-neizraziti okvir za učenje koji omogućuje integraciju različitih strategija upravljanja priljevnim tokovima. CTMSIM makro-simulacijski alat koji je izrađen u Matlab programskom okruženju korišten je u simulaciji odabranih metoda upravljanja prometom na urbanim autocestama. Simulator je proširen od strana autora kako bi podržao kooperativno upravljanje priljevnim tokovima, kao i sustav za promjenjivo ograničenje brzina vozila

Kooperativno upravljanje priljevnim tokovima na urbanim autocestama zasnovano na strojnom učenju

To cope with today’s urban motorway congestions and the inability to increase motorway capacity in urban environments requires the implementation of advanced control methods. These methods are an integral part of Intelligent Transportation Systems (ITS). An ITS essentially integrates information and communication technology to solve the congestion problems. Ramp metering (RM) and Variable Speed Limit Control (VSLC) are some of the most widely used urban motorway traffic control methods. RM provide direct influence over the on-ramp flows by using specialized traffic lights, while the VSLC control speed of mainstream flow by using variable messaging signs. A dedicated algorithm for RM or VSLC uses sensory data form an urban motorway to compute actions that will have a positive impact on both types of traffic flow. This study will focus on the cooperation of an RM and a VSLC systems, and the integration of several different RM algorithms into a single algorithm called INTEGRA. The algorithm is created by using the Adaptive Neuro-fuzzy Inference System (ANFIS) as an instance of machine learning techniques. Furthermore, INTGERA is expanded in order to integrate its original functionality with a recurrent neural network for traffic demand prediction. As the final step, this doctoral thesis will provide evaluation of different criteria for learning dataset functional setup, based on which ANFIS neural network of INTEGRA will be learned. Results of all mentioned approaches will be compared and discussed in relation with other commonly used urban motorway control methods.Glavnina istraživanja u ovom doktorskom radu vezana je upravo za upravljanje priljevnim tokovima s posebnim naglaskom na kooperaciju s drugim sustavima upravljanja prometom, te primjeni strojnog učenja. Također, u kooperaciji s upravljanjem priljevnih tokova razmatrat će se druge upravljačke metode kao što su sustav zabrane prometovanja određenim prometnim trakama, te potpuno ili djelomično upravljanje vozilima opremljenim posebnim računalnim jedinicama. Od strane autora predložen je neuro-neizraziti okvir za učenje koji omogućuje integraciju različitih strategija upravljanja priljevnim tokovima. CTMSIM makro-simulacijski alat koji je izrađen u Matlab programskom okruženju korišten je u simulaciji odabranih metoda upravljanja prometom na urbanim autocestama. Simulator je proširen od strana autora kako bi podržao kooperativno upravljanje priljevnim tokovima, kao i sustav za promjenjivo ograničenje brzina vozila

Kooperativno upravljanje priljevnim tokovima na urbanim autocestama zasnovano na strojnom učenju

To cope with today’s urban motorway congestions and the inability to increase motorway capacity in urban environments requires the implementation of advanced control methods. These methods are an integral part of Intelligent Transportation Systems (ITS). An ITS essentially integrates information and communication technology to solve the congestion problems. Ramp metering (RM) and Variable Speed Limit Control (VSLC) are some of the most widely used urban motorway traffic control methods. RM provide direct influence over the on-ramp flows by using specialized traffic lights, while the VSLC control speed of mainstream flow by using variable messaging signs. A dedicated algorithm for RM or VSLC uses sensory data form an urban motorway to compute actions that will have a positive impact on both types of traffic flow. This study will focus on the cooperation of an RM and a VSLC systems, and the integration of several different RM algorithms into a single algorithm called INTEGRA. The algorithm is created by using the Adaptive Neuro-fuzzy Inference System (ANFIS) as an instance of machine learning techniques. Furthermore, INTGERA is expanded in order to integrate its original functionality with a recurrent neural network for traffic demand prediction. As the final step, this doctoral thesis will provide evaluation of different criteria for learning dataset functional setup, based on which ANFIS neural network of INTEGRA will be learned. Results of all mentioned approaches will be compared and discussed in relation with other commonly used urban motorway control methods.Glavnina istraživanja u ovom doktorskom radu vezana je upravo za upravljanje priljevnim tokovima s posebnim naglaskom na kooperaciju s drugim sustavima upravljanja prometom, te primjeni strojnog učenja. Također, u kooperaciji s upravljanjem priljevnih tokova razmatrat će se druge upravljačke metode kao što su sustav zabrane prometovanja određenim prometnim trakama, te potpuno ili djelomično upravljanje vozilima opremljenim posebnim računalnim jedinicama. Od strane autora predložen je neuro-neizraziti okvir za učenje koji omogućuje integraciju različitih strategija upravljanja priljevnim tokovima. CTMSIM makro-simulacijski alat koji je izrađen u Matlab programskom okruženju korišten je u simulaciji odabranih metoda upravljanja prometom na urbanim autocestama. Simulator je proširen od strana autora kako bi podržao kooperativno upravljanje priljevnim tokovima, kao i sustav za promjenjivo ograničenje brzina vozila

Robust Observability, Control, & Economics of Complex Cyber-Physical Networks

This dissertation deals with various aspects of cyber-physical system. As an example of cyber physical systems, we take transportation networks and solve various problems, namely: 1) Network Observability Problem, 2) Network Control Problem, and 3) Network Economics Problem. We have divided the dissertation into three parts which solve these three problems separately. First part of the dissertation presents a novel approach for studying the observability problem on a general network topology of a traffic network. We develop a new framework which investigates observability in terms of flow information on arcs and the routing information. Second part of the dissertation presents a feedback control design for a coordinated ramp metering problem for two consecutive on-ramps. We design a traffic allocation scheme for ramps based on Godunov’s numerical method and using distributed model. Third part of the dissertation presents a novel approach to model Vehicle Miles Traveled (VMT) dynamics and establish a methodology for designing an optimal VMT tax rate. An Optimal control problem is formulated by designing a cost function which aims to maximize the generated revenue while keeping the tax rate as low as possible. Using optimal control theory, a solution is provided to this problem. To the best knowledge of authors all the three problems have not been solved using the methods proposed in this dissertation, and hence they are a novel contribution to the field

On Learning based Parameter Calibration and Ramp Metering of freeway Traffic Systems

Ph.DDOCTOR OF PHILOSOPH

Neurofuzzy control to address stochastic variation in actuated-coordinated systems at closely-spaced intersections

This dissertation documents a method of addressing stochastic variation at closely-spaced signalized intersections using neurofuzzy control. Developed on the conventional actuated-coordinated control system, the neurofuzzy traffic signal control keeps the advantage of the conventional control system. Beyond this, the neurofuzzy signal control coordinates the coordinated phase with one of the non-coordinated phases with no reduction of the green band assigned to the coordination along the arterial, reduces variations of traffic signal times in the cycle caused by early return to green , hence, makes more sufficient utilization of green time at closely-spaced intersections. The neurofuzzy signal control system manages a non-coordinated movement in order to manage queue spillbacks and variations of signal timings.Specifically, the neurofuzzy controller establishes a secondary coordination between the upstream coordinated phase (through phase) and the downstream non-coordinated phase (left turn phase) based on real-time traffic demand. Under the fuzzy logic signal control, the traffic from the upstream intersection can arrive and join the queue at the downstream left turn lane and be served, and hence, less possibly be blocked on the downstream left turn lane. This secondary coordination favors left turn progression and, hence, reduces the queue spillbacks. The fuzzy logic method overcomes the natural disadvantage of currently widely used actuated-coordinated traffic signal control in that the fuzzy logic method could coordinate a coordinated movement with a non-coordinated movement. The experiment was conducted and evaluated using a simulation model created using the microscopic simulation program - VISSIM.The neurofuzzy control algorithm was coded with MATLAB which interacts with the traffic simulation model via VISSIM\u27s COM interface. The membership functions in the neurofuzzy signal control system were calibrated using reinforcement learning to further the performance. Comparisons were made between the trained neurofuzzy control, the untrained neurofuzzy control, and the conventional actuated-coordinated control under five different traffic volumes. The simulation results indicated that the trained neurofuzzy signal control outperformed the other two for each traffic case. Comparing to the conventional actuated-coordinated control, the trained neurofuzzy signal control reduced the average delay by 7% and the average number of stops by 6% under the original traffic volume; as traffic volume increasing to 120%, the reductions doubled

Adaptive dynamic programming with eligibility traces and complexity reduction of high-dimensional systems

This dissertation investigates the application of a variety of computational intelligence techniques, particularly clustering and adaptive dynamic programming (ADP) designs especially heuristic dynamic programming (HDP) and dual heuristic programming (DHP). Moreover, a one-step temporal-difference (TD(0)) and n-step TD (TD(λ)) with their gradients are utilized as learning algorithms to train and online-adapt the families of ADP. The dissertation is organized into seven papers. The first paper demonstrates the robustness of model order reduction (MOR) for simulating complex dynamical systems. Agglomerative hierarchical clustering based on performance evaluation is introduced for MOR. This method computes the reduced order denominator of the transfer function by clustering system poles in a hierarchical dendrogram. Several numerical examples of reducing techniques are taken from the literature to compare with our work. In the second paper, a HDP is combined with the Dyna algorithm for path planning. The third paper uses DHP with an eligibility trace parameter (λ) to track a reference trajectory under uncertainties for a nonholonomic mobile robot by using a first-order Sugeno fuzzy neural network structure for the critic and actor networks. In the fourth and fifth papers, a stability analysis for a model-free action-dependent HDP(λ) is demonstrated with batch- and online-implementation learning, respectively. The sixth work combines two different gradient prediction levels of critic networks. In this work, we provide a convergence proofs. The seventh paper develops a two-hybrid recurrent fuzzy neural network structures for both critic and actor networks. They use a novel n-step gradient temporal-difference (gradient of TD(λ)) of an advanced ADP algorithm called value-gradient learning (VGL(λ)), and convergence proofs are given. Furthermore, the seventh paper is the first to combine the single network adaptive critic with VGL(λ). --Abstract, page iv

A Systematic Survey of Control Techniques and Applications: From Autonomous Vehicles to Connected and Automated Vehicles

Vehicle control is one of the most critical challenges in autonomous vehicles (AVs) and connected and automated vehicles (CAVs), and it is paramount in vehicle safety, passenger comfort, transportation efficiency, and energy saving. This survey attempts to provide a comprehensive and thorough overview of the current state of vehicle control technology, focusing on the evolution from vehicle state estimation and trajectory tracking control in AVs at the microscopic level to collaborative control in CAVs at the macroscopic level. First, this review starts with vehicle key state estimation, specifically vehicle sideslip angle, which is the most pivotal state for vehicle trajectory control, to discuss representative approaches. Then, we present symbolic vehicle trajectory tracking control approaches for AVs. On top of that, we further review the collaborative control frameworks for CAVs and corresponding applications. Finally, this survey concludes with a discussion of future research directions and the challenges. This survey aims to provide a contextualized and in-depth look at state of the art in vehicle control for AVs and CAVs, identifying critical areas of focus and pointing out the potential areas for further exploration