Intelligent and High-Performance Behavior Design of Autonomous Systems via Learning, Optimization and Control

Nowadays, great societal demands have rapidly boosted the development of autonomous systems that densely interact with humans in many application domains, from manufacturing to transportation and from workplaces to daily lives. The shift from isolated working environments to human-dominated space requires autonomous systems to be empowered to handle not only environmental uncertainties such as external vibrations but also interaction uncertainties arising from human behavior which is in nature probabilistic, causal but not strictly rational, internally hierarchical and socially compliant.This dissertation is concerned with the design of intelligent and high-performance behavior of such autonomous systems, leveraging the strength from control, optimization, learning, and cognitive science. The work consists of two parts. In Part I, the problem of high-level hybrid human-machine behavior design is addressed. The goal is to achieve safe, efficient and human-like interaction with people. A framework based on the theory of mind, utility theories and imitation learning is proposed to efficiently represent and learn the complicated behavior of humans. Built upon that, machine behaviors at three different levels - the perceptual level, the reasoning level, and the action level - are designed via imitation learning, optimization, and online adaptation, allowing the system to interpret, reason and behave as human, particularly when a variety of uncertainties exist. Applications to autonomous driving are considered throughout Part I. Part II is concerned with the design of high-performance low-level individual machine behavior in the presence of model uncertainties and external disturbances. Advanced control laws based on adaptation, iterative learning and the internal structures of uncertainties/disturbances are developed to assure that the high-level interactive behaviors can be reliably executed. Applications on robot manipulators and high-precision motion systems are discussed in this part

TMA (Truck Mounted Attenuators) alert system-development and testing

Truck Mounted Attenuators (TMAs) play a crucial role in safety of work zones as they decrease the impact of the crashes, reduce fatalities and injuries, and increase safety. However, there are almost no solid solutions to decrease the number of crashes with the TMA truck while maintaining the safety of the work zone workers. In this study, we aim to alarm the drivers following the TMA truck to avoid collisions and consequently, decrease the number and severity of the crashes. We used Unity 3D as the simulator to create scenarios with a smooth 45- degree and steeper 90-degree curves. Then we ran the simulator with different vehicles volumes and speed, including aggressive drivers in the simulator, and overall, creating different crash scenarios involving TMA trucks making some scenarios that some cars crash with the TMA truck which are rare in real life. Furthermore, computer vision has been used to define a safety zone on simulator videos to automate triggering the alarm when necessary to avoid crashes when vehicles cross the safety zone boundaries on the same lane as the TMA truck. After that, we used field videos from a TMA truck to evaluate our system. Results show that the proposed system achieved an average accuracy of 76.6 percent and 65 percent in simulator videos and TMA field video respectively. The only downside is having a fixed safety zone which causes problems when the geometry of the road changes or the TMA truck rotates to some degree and causes false alarms for the vehicles passing in the other lane. Overall, this system showed promising results and can be implemented in real-time for the TMAs to reduce collisions.Includes bibliographical references

Predicting Trajectory Paths For Collision Avoidance Systems

This work was motivated by the idea of developing a more encompassing collision avoidance system that supported vehicle to vehicle (V2V) and vehicle to infrastructure (V2I) communications. Current systems are mostly based on line of sight sensors that are used to prevent a collision, but these systems would prevent even more accidents if they could detect possible collisions before both vehicles were in line of sight. For this research we concentrated mostly on the aspect of improving the prediction of a vehicle\u27s future trajectory, particularly on non-straight paths. Having an accurate prediction of where the vehicle is heading is crucial for the system to reliably determine possible path intersections of more than one vehicle at the same time. We first evaluated the benefits of merging Global Positioning System (GPS) data with the Geographical Information System (GIS) data to correct improbable predicted positions. We then created a new algorithm called the Dead Reckoning with Dynamic Errors (DRWDE) sensor fusion, which can predict future positions at the rate of its fastest sensor, while improving the handling of accumulated error while some of the sensors are offline for a given period of time. The last part of out research consisted in the evaluation of the use of smartphones\u27 built-in sensors to predict a vehicle\u27s trajectory, as a possible intermediate solution for a vehicle to vehicle (V2V) and vehicle to infrastructure (V2I) communications, until all vehicles have all the necessary sensors and communication infrastructure to fully populate this new system. For the first part of our research, the actual experimental results validated our proposed system, which reduced the position prediction errors during curves to around half of what it would be without the use of GIS data for prediction corrections. The next improvement we worked on was the ability to handle change in noise, depending on unavailable sensor measurements, permitting a flexibility to use any type of sensor and still have the system run at the fastest frequency available. Compared to a more common KF implementation that run at the rate of its slowest sensor (1Hz in our setup), our experimental results showed that our DRWDE (running at 10Hz) yielded more accurate predictions (25-50% improvement) during abrupt changes in the heading of the vehicle. The last part of our research showed that, comparing to results obtained with the vehicle-mounted sensors, some smartphones yield similar prediction errors and can be used to predict a future position

Driver lane change intention inference using machine learning methods.

Lane changing manoeuvre on highway is a highly interactive task for human drivers. The intelligent vehicles and the advanced driver assistance systems (ADAS) need to have proper awareness of the traffic context as well as the driver. The ADAS also need to understand the driver potential intent correctly since it shares the control authority with the human driver. This study provides a research on the driver intention inference, particular focus on the lane change manoeuvre on highways. This report is organised in a paper basis, where each chapter corresponding to a publication, which is submitted or to be submitted. Part Ⅰ introduce the motivation and general methodology framework for this thesis. Part Ⅱ includes the literature survey and the state-of-art of driver intention inference. Part Ⅲ contains the techniques for traffic context perception that focus on the lane detection. A literature review on lane detection techniques and its integration with parallel driving framework is proposed. Next, a novel integrated lane detection system is designed. Part Ⅳ contains two parts, which provides the driver behaviour monitoring system for normal driving and secondary tasks detection. The first part is based on the conventional feature selection methods while the second part introduces an end-to-end deep learning framework. The design and analysis of driver lane change intention inference system for the lane change manoeuvre is proposed in Part Ⅴ. Finally, discussions and conclusions are made in Part Ⅵ. A major contribution of this project is to propose novel algorithms which accurately model the driver intention inference process. Lane change intention will be recognised based on machine learning (ML) methods due to its good reasoning and generalizing characteristics. Sensors in the vehicle are used to capture context traffic information, vehicle dynamics, and driver behaviours information. Machine learning and image processing are the techniques to recognise human driver behaviour.PhD in Transpor

Actuators for Intelligent Electric Vehicles

This book details the advanced actuators for IEVs and the control algorithm design. In the actuator design, the configuration four-wheel independent drive/steering electric vehicles is reviewed. An in-wheel two-speed AMT with selectable one-way clutch is designed for IEV. Considering uncertainties, the optimization design for the planetary gear train of IEV is conducted. An electric power steering system is designed for IEV. In addition, advanced control algorithms are proposed in favour of active safety improvement. A supervision mechanism is applied to the segment drift control of autonomous driving. Double super-resolution network is used to design the intelligent driving algorithm. Torque distribution control technology and four-wheel steering technology are utilized for path tracking and adaptive cruise control. To advance the control accuracy, advanced estimation algorithms are studied in this book. The tyre-road peak friction coefficient under full slip rate range is identified based on the normalized tyre model. The pressure of the electro-hydraulic brake system is estimated based on signal fusion. Besides, a multi-semantic driver behaviour recognition model of autonomous vehicles is designed using confidence fusion mechanism. Moreover, a mono-vision based lateral localization system of low-cost autonomous vehicles is proposed with deep learning curb detection. To sum up, the discussed advanced actuators, control and estimation algorithms are beneficial to the active safety improvement of IEVs

Search-based Test Generation for Automated Driving Systems: From Perception to Control Logic

abstract: Automated driving systems are in an intensive research and development stage, and the companies developing these systems are targeting to deploy them on public roads in a very near future. Guaranteeing safe operation of these systems is crucial as they are planned to carry passengers and share the road with other vehicles and pedestrians. Yet, there is no agreed-upon approach on how and in what detail those systems should be tested. Different organizations have different testing approaches, and one common approach is to combine simulation-based testing with real-world driving. One of the expectations from fully-automated vehicles is never to cause an accident. However, an automated vehicle may not be able to avoid all collisions, e.g., the collisions caused by other road occupants. Hence, it is important for the system designers to understand the boundary case scenarios where an autonomous vehicle can no longer avoid a collision. Besides safety, there are other expectations from automated vehicles such as comfortable driving and minimal fuel consumption. All safety and functional expectations from an automated driving system should be captured with a set of system requirements. It is challenging to create requirements that are unambiguous and usable for the design, testing, and evaluation of automated driving systems. Another challenge is to define useful metrics for assessing the testing quality because in general, it is impossible to test every possible scenario. The goal of this dissertation is to formalize the theory for testing automated vehicles. Various methods for automatic test generation for automated-driving systems in simulation environments are presented and compared. The contributions presented in this dissertation include (i) new metrics that can be used to discover the boundary cases between safe and unsafe driving conditions, (ii) a new approach that combines combinatorial testing and optimization-guided test generation methods, (iii) approaches that utilize global optimization methods and random exploration to generate critical vehicle and pedestrian trajectories for testing purposes, (iv) a publicly-available simulation-based automated vehicle testing framework that enables application of the existing testing approaches in the literature, including the new approaches presented in this dissertation.Dissertation/ThesisDoctoral Dissertation Computer Engineering 201

Feasible, Robust and Reliable Automation and Control for Autonomous Systems

The Special Issue book focuses on highlighting current research and developments in the automation and control field for autonomous systems as well as showcasing state-of-the-art control strategy approaches for autonomous platforms. The book is co-edited by distinguished international control system experts currently based in Sweden, the United States of America, and the United Kingdom, with contributions from reputable researchers from China, Austria, France, the United States of America, Poland, and Hungary, among many others. The editors believe the ten articles published within this Special Issue will be highly appealing to control-systems-related researchers in applications typified in the fields of ground, aerial, maritime vehicles, and robotics as well as industrial audiences