Deep learning for real-time traffic signal control on urban networks

Real-time traffic signal controls are frequently challenged by (1) uncertain knowledge about the traffic states; (2) need for efficient computation to allow timely decisions; (3) multiple objectives such as traffic delays and vehicle emissions that are difficult to optimize; and (4) idealized assumptions about data completeness and quality that are often made in developing many theoretical signal control models. This thesis addresses these challenges by proposing two real-time signal control frameworks based on deep learning techniques, followed by extensive simulation tests that verifies their effectiveness in view of the aforementioned challenges. The first method, called the Nonlinear Decision Rule (NDR), defines a nonlinear mapping between network states and signal control parameters to network performances based on prevailing traffic conditions, and such a mapping is optimized via off-line simulation. The NDR is instantiated with two neural networks: feedforward neural network (FFNN) and recurrent neural network (RNN), which have different ways of processing traffic information in the near past. The NDR is implemented and tested within microscopic traffic simulation (S-Paramics) for a real-world network in West Glasgow, where the off-line training of the NDR amounts to a simulation-based optimization procedure aiming to reduce delay, CO2 and black carbon emissions. Extensive tests are performed to assess the NDR framework, not only in terms of its effectiveness in optimizing different traffic and environmental objectives, but also in relation to local vs. global benefits, trade-off between delay and emissions, impact of sensor locations, and different levels of network saturation. The second method, called the Advanced Reinforcement Learning (ARL), employs the potential-based reward shaping function using Q-learning and 3rd party advisor to enhance its performance over conventional reinforcement learning. The potential-based reward shaping in this thesis obtains an opinion from the 3rd party advisor when calculating reward. This technique can resolve the problem of sparse reward and slow learning speed. The ARL is tested with a range of existing reinforcement learning methods. The results clearly show that ARL outperforms the other models in almost all the scenarios. Lastly, this thesis evaluates the impact of information availability and quality on different real-time signal control methods, including the two proposed ones. This is driven by the observation that most responsive signal control models in the literature tend to make idealized assumptions on the quality and availability of data. This research shows the varying levels of performance deterioration of different signal controllers in the presence of missing data, data noise, and different data types. Such knowledge and insights are crucial for real-world implementation of these signal control methods.Open Acces

Improved Self-Adaptive Control Parameters in Differential Evolution Algorithm for Complex Numerical Optimization

芝浦工業大学201

Modeling and Controlling a Hybrid Multi-Agent based Microgrid in Presence of Different Physical and Cyber Components

This dissertation starts with modeling of two different and important parts of the distribution power systems, i.e. distribution line and photovoltaic (PV) systems. Firstly, it studies different approximation methods and develops a new approach for simplification of Carson\u27s equations to model distribution lines for unbalanced power flow and short circuit analysis. The results of applying the proposed method on a three-phase unbalanced distribution system are compared with different existing methods as well as actual impedance values obtained from numerical integration method. Then steady state modeling and optimal placing of multiple PV system are investigated in order to reduce the total loss in the system. The results show the effectiveness of the proposed method in minimizing the total loss in a distribution power system.;The dissertation starts the discussion about microgrid modeling and control by implementing a novel frequency control approach in a microgrid. This study has been carried out step by step by modeling different part of the power system and proposing different algorithms. Firstly, the application of Renewable Energy Sources (RES) accompanied with Energy Storage Systems (ESS) in a hybrid system is studied in the presence of Distributed Generation (DG) resources in Load Frequency Control (LFC) problem of microgrid power system with significant penetration of wind speed disturbances. The next step is to investigate the effect of PHEVs in modelling and controlling the microgid. Therefore, system with different penetrations of PHEVs and different stochastic behaviors of PHEVs is modeled. Different kinds of control approaches, including PI control as conventional method and proposed optimal LQR and dynamic programming methods, have been utilized and the results have been compared with each other. Then, Multi Agent System (MAS) is utilized as a control solution which contributes the cyber aspects of microgrid system. The modeled microgrid along with dynamic models of different components is implemented in a centralized multi-agent based structure. The robustness of the proposed controller has been tested against different frequency changes including cyber attack implications with different timing and severity. New attack detection through learning method is also proposed and tested. The results show improvement in frequency response of the microgrid system using the proposed control method and defense strategy against cyber attacks.;Finally, a new multi-agent based control method along with an advanced secondary voltage and frequency control using Particle Swarm Optimization (PSO) and Adaptive Dynamic Programming (ADP) is proposed and tested in the modeled microgrid considering nonlinear heterogeneous dynamic models of DGs. The results are shown and compared with conventional control approaches and different multi-agent structures. It is observed that the results are improved by using the new multi-agent structure and secondary control method.;In summary, contributions of this dissertation center in three main topics. Firstly, new accurate methods for modeling the distribution line impedance and PV system is developed. Then advanced control and defense strategy method for frequency regulation against cyber intrusions and load changes in a microgrid is proposed. Finally, a new hierarchical multi-agent based control algorithm is designed for secondary voltage and frequency control of the microgrid. (Abstract shortened by ProQuest.)

Intelligent Autonomous Decision-Making and Cooperative Control Technology of High-Speed Vehicle Swarms

This book is a reprint of the Special Issue “Intelligent Autonomous Decision-Making and Cooperative Control Technology of High-Speed Vehicle Swarms”,which was published in Applied Sciences

Information Theory and Its Application in Machine Condition Monitoring

Condition monitoring of machinery is one of the most important aspects of many modern industries. With the rapid advancement of science and technology, machines are becoming increasingly complex. Moreover, an exponential increase of demand is leading an increasing requirement of machine output. As a result, in most modern industries, machines have to work for 24 hours a day. All these factors are leading to the deterioration of machine health in a higher rate than before. Breakdown of the key components of a machine such as bearing, gearbox or rollers can cause a catastrophic effect both in terms of financial and human costs. In this perspective, it is important not only to detect the fault at its earliest point of inception but necessary to design the overall monitoring process, such as fault classification, fault severity assessment and remaining useful life (RUL) prediction for better planning of the maintenance schedule. Information theory is one of the pioneer contributions of modern science that has evolved into various forms and algorithms over time. Due to its ability to address the non-linearity and non-stationarity of machine health deterioration, it has become a popular choice among researchers. Information theory is an effective technique for extracting features of machines under different health conditions. In this context, this book discusses the potential applications, research results and latest developments of information theory-based condition monitoring of machineries

Computational Intelligence in Healthcare

This book is a printed edition of the Special Issue Computational Intelligence in Healthcare that was published in Electronic

Computational Intelligence in Healthcare

The number of patient health data has been estimated to have reached 2314 exabytes by 2020. Traditional data analysis techniques are unsuitable to extract useful information from such a vast quantity of data. Thus, intelligent data analysis methods combining human expertise and computational models for accurate and in-depth data analysis are necessary. The technological revolution and medical advances made by combining vast quantities of available data, cloud computing services, and AI-based solutions can provide expert insight and analysis on a mass scale and at a relatively low cost. Computational intelligence (CI) methods, such as fuzzy models, artificial neural networks, evolutionary algorithms, and probabilistic methods, have recently emerged as promising tools for the development and application of intelligent systems in healthcare practice. CI-based systems can learn from data and evolve according to changes in the environments by taking into account the uncertainty characterizing health data, including omics data, clinical data, sensor, and imaging data. The use of CI in healthcare can improve the processing of such data to develop intelligent solutions for prevention, diagnosis, treatment, and follow-up, as well as for the analysis of administrative processes. The present Special Issue on computational intelligence for healthcare is intended to show the potential and the practical impacts of CI techniques in challenging healthcare applications

Applied Metaheuristic Computing

For decades, Applied Metaheuristic Computing (AMC) has been a prevailing optimization technique for tackling perplexing engineering and business problems, such as scheduling, routing, ordering, bin packing, assignment, facility layout planning, among others. This is partly because the classic exact methods are constrained with prior assumptions, and partly due to the heuristics being problem-dependent and lacking generalization. AMC, on the contrary, guides the course of low-level heuristics to search beyond the local optimality, which impairs the capability of traditional computation methods. This topic series has collected quality papers proposing cutting-edge methodology and innovative applications which drive the advances of AMC

Hybrid Advanced Optimization Methods with Evolutionary Computation Techniques in Energy Forecasting

More accurate and precise energy demand forecasts are required when energy decisions are made in a competitive environment. Particularly in the Big Data era, forecasting models are always based on a complex function combination, and energy data are always complicated. Examples include seasonality, cyclicity, fluctuation, dynamic nonlinearity, and so on. These forecasting models have resulted in an over-reliance on the use of informal judgment and higher expenses when lacking the ability to determine data characteristics and patterns. The hybridization of optimization methods and superior evolutionary algorithms can provide important improvements via good parameter determinations in the optimization process, which is of great assistance to actions taken by energy decision-makers. This book aimed to attract researchers with an interest in the research areas described above. Specifically, it sought contributions to the development of any hybrid optimization methods (e.g., quadratic programming techniques, chaotic mapping, fuzzy inference theory, quantum computing, etc.) with advanced algorithms (e.g., genetic algorithms, ant colony optimization, particle swarm optimization algorithm, etc.) that have superior capabilities over the traditional optimization approaches to overcome some embedded drawbacks, and the application of these advanced hybrid approaches to significantly improve forecasting accuracy