Online Driver Distraction Detection Using Long Short-Term Memory

Lane-keeping assistance systems for vehicles may be more acceptable to users if the assistance was adaptive to the driver's state. To adapt systems in this way, a method for detection of driver distraction is needed. Thus, we propose a novel technique for online detection of driver's distraction, modeling the long-range temporal context of driving and head tracking data. We show that long short-term memory (LSTM) recurrent neural networks enable a reliable subject-independent detection of inattention with an accuracy of up to 96.6%. Thereby, our LSTM framework significantly outperforms conventional approaches such as support vector machines (SVMs)

Surrogate in-vehicle information systems and driver behaviour: Effects of visual and cognitive load in simulated rural driving

The underlying aim of HASTE, an EU FP5 project, is the development of a valid, cost-effective and reliable assessment protocol to evaluate the potential distraction of an in-vehicle information system on driving performance. As part of this development, the current study was performed to examine the systematic relationship between primary and secondary task complexity for a specific task modality in a particular driving environment. Two fundamentally distinct secondary tasks (or surrogate in-vehicle information systems, sIVIS) were developed: a visual search task, designed such that it only required visual processing/demand and an auditory continuous memory task, intended to cognitively load drivers without any visual stimulus. A high fidelity, fixed-base driving simulator was used to test 48 participants on a car following task. Virtual traffic scenarios varied in driving demand. Drivers compensated for both types of sIVIS by reducing their speed (this result was more prominent during interaction with the visual task). However, they seemed incapable of fully prioritising the primary driving task over either the visual or cognitive secondary tasks as an increase in sIVIS demand was associated with a reduction in driving performance: drivers showed reduced anticipation of braking requirements and shorter time-to-collision. These results are of potential interest to designers of in-vehicle systems

Context-Aware Driver Distraction Severity Classification using LSTM Network

Advanced Driving Assistance Systems (ADAS) has been a critical component in vehicles and vital to the safety of vehicle drivers and public road transportation systems. In this paper, we present a deep learning technique that classifies drivers’ distraction behaviour using three contextual awareness parameters: speed, manoeuver and event type. Using a video coding taxonomy, we study drivers’ distractions based on events information from Regions of Interest (RoI) such as hand gestures, facial orientation and eye gaze estimation. Furthermore, a novel probabilistic (Bayesian) model based on the Long shortterm memory (LSTM) network is developed for classifying driver’s distraction severity. This paper also proposes the use of frame-based contextual data from the multi-view TeleFOT naturalistic driving study (NDS) data monitoring to classify the severity of driver distractions. Our proposed methodology entails recurrent deep neural network layers trained to predict driver distraction severity from time series data

SigSegment: A Signal-Based Segmentation Algorithm for Identifying Anomalous Driving Behaviours in Naturalistic Driving Videos

In recent years, distracted driving has garnered considerable attention as it continues to pose a significant threat to public safety on the roads. This has increased the need for innovative solutions that can identify and eliminate distracted driving behavior before it results in fatal accidents. In this paper, we propose a Signal-Based anomaly detection algorithm that segments videos into anomalies and non-anomalies using a deep CNN-LSTM classifier to precisely estimate the start and end times of an anomalous driving event. In the phase of anomaly detection and analysis, driver pose background estimation, mask extraction, and signal activity spikes are utilized. A Deep CNN-LSTM classifier was applied to candidate anomalies to detect and classify final anomalies. The proposed method achieved an overlap score of 0.5424 and ranked 9th on the public leader board in the AI City Challenge 2023, according to experimental validation results