Safety Evaluation Using Counterfactual Simulations: The use of computational driver behavior models in crash avoidance systems and virtual simulations with optimal subsampling

Traffic safety is a problem worldwide. In-vehicle conflict and crash avoidance systems have been under development and assessment for some time, as integral parts of Advanced Driver Assistance Systems (ADAS) and Automated Driving Systems (ADS). Among the methods used to assess conflict and crash avoidance systems developed by the automotive industry, virtual safety assessment methods have been shown to have great potential and efficiency. In fact, scenario generation-based virtual safety assessments play—and are likely to continue to play—a very important role in the assessments of vehicles of all levels of automation. The ultimate aim of this thesis is to improve the safety performance of conflict and crash avoidance systems. This aim is addressed through the use of computational driver models in two different ways. First, by using comfort-zone boundaries in system design, and second, by using a behavior-based crash-causation model together with a novel optimized scenario generation method for virtual safety assessment.The first objective of this thesis is to investigate how a driver model which includes road users’ comfortable behaviors in crash avoidance algorithms impacts the systems’ safety performance and the residual crash characteristics. Chinese car-to-two-wheeler crashes were targeted; Automated Emergency Braking (AEB) algorithms, which comprised the proposed crash avoidance systems, were compared to a traditional AEB algorithm. The proposed algorithms showed larger safety performance benefits. In addition, the similarities in residual crash characteristics regarding impact speed and location after different AEB implementations can potentially simplify the designs of in-crash protection system in future.The second objective is to develop and apply a method for efficient subsampling in crash-causation-model-based scenario generation for virtual safety assessment. The method, which is machine-learning-assisted, actively and iteratively updates the sampling probability based on new simulation results. The crash-causation model is based on off-road glances and a distribution of driver maximum decelerations in critical situations. A simple time-to-collision-based AEB algorithm was used to demonstrate the assessment process as well as the benefits of combining crash-causation-model-based scenario generation and optimal subsampling. The sampling methods are designed to target specific safety benefit indicators, such as impact speed reduction and crash avoidance rate. The results of the study show that the proposed sampling method requires almost 50% fewer simulations than traditional importance sampling.Future work aims to focus on applying the active sampling method to driver-model-based car-to-vulnerable road user (VRU) scenario generation. In addition to assessing conflict and crash avoidance system performance, a novel stopping criterion based on Bayesian future prediction will be further developed and demonstrated for use in experiments (e.g., as part of developing driver models) and virtual simulations (e.g., using driver-behavior-based crash-causation models). This criterion will be able to indicate when studies are unlikely to yield actionable results within the budget available, facilitating the decision to discontinue them while they are being run

Traffic Surveillance and Automated Data Extraction from Aerial Video Using Computer Vision, Artificial Intelligence, and Probabilistic Approaches

In transportation engineering, sufficient, reliable, and diverse traffic data is necessary for effective planning, operations, research, and professional practice. Using aerial imagery to achieve traffic surveillance and collect traffic data is one of the feasible ways that is facilitated by the advances of technologies in many related areas. A great deal of aerial imagery datasets are currently available and more datasets are collected every day for various applications. It will be beneficial to make full and efficient use of the attribute rich imagery as a resource for valid and useful traffic data for many applications in transportation research and practice. In this dissertation, a traffic surveillance system that can collect valid and useful traffic data using quality-limited aerial imagery datasets with diverse characteristics is developed. Two novel approaches, which can achieve robust and accurate performance, are proposed and implemented for this system. The first one is a computer vision-based approach, which uses convolutional neural network (CNN) to detect vehicles in aerial imagery and uses features to track those detections. This approach is capable of detecting and tracking vehicles in the aerial imagery datasets with a very limited quality. Experimental results indicate the performance of this approach is very promising and it can achieve accurate measurements for macroscopic traffic data and is also potential for reliable microscopic traffic data. The second approach is a multiple hypothesis tracking (MHT) approach with innovative kinematics and appearance models (KAM). The implemented MHT module is designed to cooperate with the CNN module in order to extend and improve the vehicle tracking system. Experiments are designed based on a meticulously established synthetic vehicle detection datasets, originally induced scale-agonistic property of MHT, and comprehensively identified metrics for performance evaluation. The experimental results not only indicate that the performance of this approach can be very promising, but also provide solutions for some long-standing problems and reveal the impacts of frame rate, detection noise, and traffic configurations as well as the effects of vehicle appearance information on the performance. The experimental results of both approaches prove the feasibility of traffic surveillance and data collection by detecting and tracking vehicles in aerial video, and indicate the direction of further research as well as solutions to achieve satisfactory performance with existing aerial imagery datasets that have very limited quality and frame rates. This traffic surveillance system has the potential to be transformational in how large area traffic data is collected in the future. Such a system will be capable of achieving wide area traffic surveillance and extracting valid and useful traffic data from wide area aerial video captured with a single platfor

A Safety Control Method of Car-Following Trajectory Planning Based on LSTM

This paper focuses on the potential safety hazards of collision in car-following behaviour generated by deep learning models. Based on an intelligent LSTM model, combined with a Gipps model of safe collision avoidance, a new, Gipps-LSTM model is constructed, which can not only learn the intelligent behaviour of people but also ensure the safety of vehicles. The idea of the Gipps-LSTM model combination is as follows: the concept of a potential collision point (PCP) is introduced, and the LSTM model or Gipps model is controlled and started through a risk judgment algorithm. Dataset 1 and dataset 2 are used to train and simulate the LSTM model and Gipps-LSTM model. The simulation results show that the Gipps-LSTM can solve the problem of partial trajectory collision in the LSTM model simulation. Moreover, the risk level of all trajectories is lower than that of the LSTM model. The safety and stability of the model are verified by multi-vehicle loop simulation and multi-vehicle linear simulation. Compared with the LSTM model, the safety of the Gipps-LSTM model is improved by 42.02%, and the convergence time is reduced by 25 seconds

A Systematic Survey of Control Techniques and Applications: From Autonomous Vehicles to Connected and Automated Vehicles

Vehicle control is one of the most critical challenges in autonomous vehicles (AVs) and connected and automated vehicles (CAVs), and it is paramount in vehicle safety, passenger comfort, transportation efficiency, and energy saving. This survey attempts to provide a comprehensive and thorough overview of the current state of vehicle control technology, focusing on the evolution from vehicle state estimation and trajectory tracking control in AVs at the microscopic level to collaborative control in CAVs at the macroscopic level. First, this review starts with vehicle key state estimation, specifically vehicle sideslip angle, which is the most pivotal state for vehicle trajectory control, to discuss representative approaches. Then, we present symbolic vehicle trajectory tracking control approaches for AVs. On top of that, we further review the collaborative control frameworks for CAVs and corresponding applications. Finally, this survey concludes with a discussion of future research directions and the challenges. This survey aims to provide a contextualized and in-depth look at state of the art in vehicle control for AVs and CAVs, identifying critical areas of focus and pointing out the potential areas for further exploration

Conception of control paradigms for teleoperated driving tasks in urban environments

Development of concepts and computationally efficient motion planning methods for teleoperated drivingEntwicklung von Konzepten und recheneffizienten Bewegungsplanungsmethoden für teleoperiertes Fahre

Nonlinear Modeling and Control of Driving Interfaces and Continuum Robots for System Performance Gains

With the rise of (semi)autonomous vehicles and continuum robotics technology and applications, there has been an increasing interest in controller and haptic interface designs. The presence of nonlinearities in the vehicle dynamics is the main challenge in the selection of control algorithms for real-time regulation and tracking of (semi)autonomous vehicles. Moreover, control of continuum structures with infinite dimensions proves to be difficult due to their complex dynamics plus the soft and flexible nature of the manipulator body. The trajectory tracking and control of automobile and robotic systems requires control algorithms that can effectively deal with the nonlinearities of the system without the need for approximation, modeling uncertainties, and input disturbances. Control strategies based on a linearized model are often inadequate in meeting precise performance requirements. To cope with these challenges, one must consider nonlinear techniques. Nonlinear control systems provide tools and methodologies for enabling the design and realization of (semi)autonomous vehicle and continuum robots with extended specifications based on the operational mission profiles. This dissertation provides an insight into various nonlinear controllers developed for (semi)autonomous vehicles and continuum robots as a guideline for future applications in the automobile and soft robotics field. A comprehensive assessment of the approaches and control strategies, as well as insight into the future areas of research in this field, are presented.First, two vehicle haptic interfaces, including a robotic grip and a joystick, both of which are accompanied by nonlinear sliding mode control, have been developed and studied on a steer-by-wire platform integrated with a virtual reality driving environment. An operator-in-the-loop evaluation that included 30 human test subjects was used to investigate these haptic steering interfaces over a prescribed series of driving maneuvers through real time data logging and post-test questionnaires. A conventional steering wheel with a robust sliding mode controller was used for all the driving events for comparison. Test subjects operated these interfaces for a given track comprised of a double lane-change maneuver and a country road driving event. Subjective and objective results demonstrate that the driver’s experience can be enhanced up to 75.3% with a robotic steering input when compared to the traditional steering wheel during extreme maneuvers such as high-speed driving and sharp turn (e.g., hairpin turn) passing. Second, a cellphone-inspired portable human-machine-interface (HMI) that incorporated the directional control of the vehicle as well as the brake and throttle functionality into a single holistic device will be presented. A nonlinear adaptive control technique and an optimal control approach based on driver intent were also proposed to accompany the mechatronic system for combined longitudinal and lateral vehicle guidance. Assisting the disabled drivers by excluding extensive arm and leg movements ergonomically, the device has been tested in a driving simulator platform. Human test subjects evaluated the mechatronic system with various control configurations through obstacle avoidance and city road driving test, and a conventional set of steering wheel and pedals were also utilized for comparison. Subjective and objective results from the tests demonstrate that the mobile driving interface with the proposed control scheme can enhance the driver’s performance by up to 55.8% when compared to the traditional driving system during aggressive maneuvers. The system’s superior performance during certain vehicle maneuvers and approval received from the participants demonstrated its potential as an alternative driving adaptation for disabled drivers. Third, a novel strategy is designed for trajectory control of a multi-section continuum robot in three-dimensional space to achieve accurate orientation, curvature, and section length tracking. The formulation connects the continuum manipulator dynamic behavior to a virtual discrete-jointed robot whose degrees of freedom are directly mapped to those of a continuum robot section under the hypothesis of constant curvature. Based on this connection, a computed torque control architecture is developed for the virtual robot, for which inverse kinematics and dynamic equations are constructed and exploited, with appropriate transformations developed for implementation on the continuum robot. The control algorithm is validated in a realistic simulation and implemented on a six degree-of-freedom two-section OctArm continuum manipulator. Both simulation and experimental results show that the proposed method could manage simultaneous extension/contraction, bending, and torsion actions on multi-section continuum robots with decent tracking performance (e.g. steady state arc length and curvature tracking error of 3.3mm and 130mm-1, respectively). Last, semi-autonomous vehicles equipped with assistive control systems may experience degraded lateral behaviors when aggressive driver steering commands compete with high levels of autonomy. This challenge can be mitigated with effective operator intent recognition, which can configure automated systems in context-specific situations where the driver intends to perform a steering maneuver. In this article, an ensemble learning-based driver intent recognition strategy has been developed. A nonlinear model predictive control algorithm has been designed and implemented to generate haptic feedback for lateral vehicle guidance, assisting the drivers in accomplishing their intended action. To validate the framework, operator-in-the-loop testing with 30 human subjects was conducted on a steer-by-wire platform with a virtual reality driving environment. The roadway scenarios included lane change, obstacle avoidance, intersection turns, and highway exit. The automated system with learning-based driver intent recognition was compared to both the automated system with a finite state machine-based driver intent estimator and the automated system without any driver intent prediction for all driving events. Test results demonstrate that semi-autonomous vehicle performance can be enhanced by up to 74.1% with a learning-based intent predictor. The proposed holistic framework that integrates human intelligence, machine learning algorithms, and vehicle control can help solve the driver-system conflict problem leading to safer vehicle operations