Systematic Observation of an Expert Driver's Gaze Strategy—An On-Road Case Study

In this paper we present and qualitatively analyze an expert driver’s gaze behavior in natural driving on a real road, with no specific experimental task or instruction. Previous eye tracking research on naturalistic tasks has revealed recurring patterns of gaze behavior that are surprisingly regular and repeatable. Lappi (2016) identified in the literature seven “qualitative laws of gaze behavior in the wild”: recurring patterns that tend to go together, the more so the more naturalistic the setting, all of them expected in extended sequences of fully naturalistic behavior. However, no study to date has observed all in a single experiment. Here, we wanted to do just that: present observations supporting all the “laws” in a single behavioral sequence by a single subject. We discuss the laws in terms of unresolved issues in driver modeling and open challenges for experimental and theoretical development.Peer reviewe

A driver model with supervision aspects

Human driver compensatory reactions -- Driver intelligence and Path Tracking (supervision) -- From human decision making to design of control level -- Vehicle models -- History of driver models -- Controller for car-like mobile robots -- Control problems of vehicle cartesian coordiantes -- Independent speed control with geometric lateral-offset tracking -- Kinematics dynamics and control of a car-like mobile robot -- Looking ahead path tracking of a car-like mobile robot -- Geometric lateral-offset tracking and speed control of a car-like mobile robot -- Equations of motion of a car-like robot using autolev programming

Automotive Collision Warning System Retrofit

In the early 2000s, few automakers began implementing forward collision warning systems in their cars. As technology advanced this system became available on more and more luxury cars. In recent years, this technology has spread to more affordable vehicles driven every day. However, as this technology has only recently advanced to less expensive, more economical cars, older vehicles of the same model may not have this advanced and important safety feature. This project investigates and creates a preliminary design for an affordable, easy-to-install, forward collision warning system that can be retrofitted to vehicles without the system currently installed. Using a density-based spatial clustering of applications with noise (DBSCAN) clustering algorithm, an extended Kalman filter, and a time-to-collision algorithm, a forward collision warning system was developed and simulated using the Insurance Institute of Highway Safety (IIHS) test scenarios. Software testing and implementation was done in MATLAB and has provided a foundation for future hardware implementation using Texas Instruments mmWave automotive radar (AWR1843BOOST)

The influence of system transparency on trust: Evaluating interfaces in a highly automated vehicle

Previous studies indicate that, if an automated vehicle communicates its system status and intended behaviour, it could increase user trust and acceptance. However, it is still unclear what types of interfaces will better portray this type of information. The present study evaluated different configurations of screens comparing how they communicated the possible hazards in the environment (e.g. vulnerable road users), and vehicle behaviours (e.g. intended trajectory). These interfaces were presented in a fully automated vehicle tested by 25 participants in an indoor arena. Surveys and interviews measured trust, usability and experience after users were driven by an automated low-speed pod. Participants experienced four types of interfaces, from a simple journey tracker to a windscreen-wide augmented reality (AR) interface which overlays hazards highlighted in the environment and the trajectory of the vehicle. A combination of the survey and interview data showed a clear preference for the AR windscreen and an animated representation of the environment. The trust in the vehicle featuring these interfaces was significantly higher than pretrial measurements. However, some users questioned if they want to see this information all the time. One additional result was that some users felt motion sick when presented with the more engaging content. This paper provides recommendations for the design of interfaces with the potential to improve trust and user experience within highly automated vehicles

Developing Predictive Models of Driver Behaviour for the Design of Advanced Driving Assistance Systems

World-wide injuries in vehicle accidents have been on the rise in recent years, mainly due to driver error. The main objective of this research is to develop a predictive system for driving maneuvers by analyzing the cognitive behavior (cephalo-ocular) and the driving behavior of the driver (how the vehicle is being driven). Advanced Driving Assistance Systems (ADAS) include different driving functions, such as vehicle parking, lane departure warning, blind spot detection, and so on. While much research has been performed on developing automated co-driver systems, little attention has been paid to the fact that the driver plays an important role in driving events. Therefore, it is crucial to monitor events and factors that directly concern the driver. As a goal, we perform a quantitative and qualitative analysis of driver behavior to find its relationship with driver intentionality and driving-related actions. We have designed and developed an instrumented vehicle (RoadLAB) that is able to record several synchronized streams of data, including the surrounding environment of the driver, vehicle functions and driver cephalo-ocular behavior, such as gaze/head information. We subsequently analyze and study the behavior of several drivers to find out if there is a meaningful relation between driver behavior and the next driving maneuver

Naturalistic Driver Intention and Path Prediction using Machine Learning

Autonomous vehicles are still yet to be available to the public. This is because there are a number of challenges that have not been overcome to ensure that autonomous vehicles can safely and efficiently drive on public roads. Accurate prediction of other vehicles is vital for safe driving, as interacting with other vehicles is unavoidable on public streets. This thesis explores reasons why this problem of scene understanding is still unsolved, and presents methods for driver intention and path prediction. The thesis focuses on intersections, as this is a very complex scenario in which to predict the actions of human drivers. There is very limited data available for intersection studies from the perspective of an autonomous vehicle. This thesis presents a very large dataset of over 23,000 vehicle trajectories, used to validate the algorithms presented in this thesis. This dataset was collected using a lidar based vehicle detection and tracking system onboard a vehicle. Analytics of this data is presented. To determine the intent of vehicle at an intersection, a method for manoeuvre classification through the use of recurrent neural networks is presented. This allows accurate predictions of which destination a vehicle will take at an unsignalised intersection, based on that vehicle's approach. The final contribution of this thesis presents a method for driver path prediction, based on recurrent neural networks. It produces a multi-modal prediction for the vehicle’s path with uncertainty assigned to each mode. The output modes are not hand labelled, but instead learned from the data. This results in there not being a fixed number of output modes. Whilst the application of this method is vehicle prediction, this method shows significant promise to be used in other areas of robotics

A Review of Active Yaw Control System for Vehicle Handling and Stability Enhancement

Yaw stability control systemplays a significant role in vehicle lateral dynamics in order to improve the vehicle handling and stability performances. However, not many researches have been focused on the transient performances improvement of vehicle yaw rate and sideslip tracking control. This paper reviews the vital elements for control system design of an active yaw stability control system; the vehicle dynamic models, control objectives, active chassis control, and control strategies with the focus on identifying suitable criteria for improved transient performances. Each element is discussed and compared in terms of their underlying theory, strengths, weaknesses, and applicability. Based on this, we conclude that the sliding mode control with nonlinear sliding surface based on composite nonlinear feedback is a potential control strategy for improving the transient performances of yaw rate and sideslip tracking control

Tracking Control of Autonomous Vehicles

This thesis intends to design new tracking schemes to enhance the performance and stability of general autonomous vehicles (AVs). Three main types of controllers used for tracking control are investigated. The geometric controller cannot meet high tracking requirements, and control parameters significantly affect its performance. Therefore, an observer-based nonlinear control combined with a particle swarm optimization (PSO) algorithm is developed for low-speed vehicles to track the pre-determined trajectory accurately. A control law featured with self-tuning gains is designed using the backstepping control technique, for which global asymptotic stability is validated. The PSO evaluates tracking performance through the proposed fitness function and generates optimized tuning parameters with fewer iterations, reducing tuning efforts. Velocity and steering tracking could also be rapidly realized by modifying the error weights of the performance evaluation criterion. Based on the proposed yaw error observer (YEO), the problem of the angle measurements being temporarily inaccurate or unavailable is tackled effectively with the given information. Further, existing methods can suffer from complex control algorithms and a lack of tracking stability at high speed. The vehicle's motion is decoupled by considering the Frenet frame. A lateral control law based on the linear-quadratic-regulator (LQR) imposes the tracking errors to converge to zero stably and quickly, providing the optimal solution in real-time due to adaptive gains. Regarding the steady-state errors, they are eliminated through the correction of the feedforward term. Besides, the designed double proportional-integral-derivative (PID) controller realizes not only the longitudinal control but also the velocity tracking

Dynamic scan paths investigations under manual and highly automated driving

Active visual scanning of the scene is a key task-element in all forms of human locomotion. In the field of driving, steering (lateral control) and speed adjustments (longitudinal control) models are largely based on drivers’ visual inputs. Despite knowledge gained on gaze behaviour behind the wheel, our understanding of the sequential aspects of the gaze strategies that actively sample that input remains restricted. Here, we apply scan path analysis to investigate sequences of visual scanning in manual and highly automated simulated driving. Five stereotypical visual sequences were identified under manual driving: forward polling (i.e. far road explorations), guidance, backwards polling (i.e. near road explorations), scenery and speed monitoring scan paths. Previously undocumented backwards polling scan paths were the most frequent. Under highly automated driving backwards polling scan paths relative frequency decreased, guidance scan paths relative frequency increased, and automation supervision specific scan paths appeared. The results shed new light on the gaze patterns engaged while driving. Methodological and empirical questions for future studies are discussed.Active visual scanning of the scene is a key task-element in all forms of human locomotion. In the field of driving, steering (lateral control) and speed adjustments (longitudinal control) models are largely based on drivers’ visual inputs. Despite knowledge gained on gaze behaviour behind the wheel, our understanding of the sequential aspects of the gaze strategies that actively sample that input remains restricted. Here, we apply scan path analysis to investigate sequences of visual scanning in manual and highly automated simulated driving. Five stereotypical visual sequences were identified under manual driving: forward polling (i.e. far road explorations), guidance, backwards polling (i.e. near road explorations), scenery and speed monitoring scan paths. Previously undocumented backwards polling scan paths were the most frequent. Under highly automated driving backwards polling scan paths relative frequency decreased, guidance scan paths relative frequency increased, and automation supervision specific scan paths appeared. The results shed new light on the gaze patterns engaged while driving. Methodological and empirical questions for future studies are discussed.Peer reviewe

Computational driver behavior models for vehicle safety applications

The aim of this thesis is to investigate how human driving behaviors can be formally described in mathematical models intended for online personalization of advanced driver assistance systems (ADAS) or offline virtual safety evaluations. Both longitudinal (braking) and lateral (steering) behaviors in routine driving and emergencies are addressed. Special attention is paid to driver glance behavior in critical situations and the role of peripheral vision.First, a hybrid framework based on autoregressive models with exogenous input (ARX-models) is employed to predict and classify driver control in real time. Two models are suggested, one targeting steering behavior and the other longitudinal control behavior. Although the predictive performance is unsatisfactory, both models can distinguish between different driving styles.Moreover, a basic model for drivers\u27 brake initiation and modulation in critical longitudinal situations (specifically for rear-end conflicts) is constructed. The model is based on a conceptual framework of noisy evidence accumulation and predictive processing. Several model extensions related to gaze behavior are also proposed and successfully fitted to real-world crashes and near-crashes. The influence of gaze direction is further explored in a driving simulator study, showing glance response times to be independent of the glance\u27s visual eccentricity, while brake response times increase for larger gaze angles, as does the rate of missed target detections.Finally, the potential of a set of metrics to quantify subjectively perceived risk in lane departure situations to explain drivers\u27 recovery steering maneuvers was investigated. The most influential factors were the relative yaw angle and splay angle error at steering initiation. Surprisingly, it was observed that drivers often initiated the recovery steering maneuver while looking off-road.To sum up, the proposed models in this thesis facilitate the development of personalized ADASs and contribute to trustworthy virtual evaluations of current, future, and conceptual safety systems. The insights and ideas contribute to an enhanced, human-centric system development, verification, and validation process. In the long term, this will likely lead to improved vehicle safety and a reduced number of severe injuries and fatalities in traffic