Human-Centric Detection and Mitigation Approach for Various Levels of Cell Phone-Based Driver Distractions

abstract: Driving a vehicle is a complex task that typically requires several physical interactions and mental tasks. Inattentive driving takes a driver’s attention away from the primary task of driving, which can endanger the safety of driver, passenger(s), as well as pedestrians. According to several traffic safety administration organizations, distracted and inattentive driving are the primary causes of vehicle crashes or near crashes. In this research, a novel approach to detect and mitigate various levels of driving distractions is proposed. This novel approach consists of two main phases: i.) Proposing a system to detect various levels of driver distractions (low, medium, and high) using a machine learning techniques. ii.) Mitigating the effects of driver distractions through the integration of the distracted driving detection algorithm and the existing vehicle safety systems. In phase- 1, vehicle data were collected from an advanced driving simulator and a visual based sensor (webcam) for face monitoring. In addition, data were processed using a machine learning algorithm and a head pose analysis package in MATLAB. Then the model was trained and validated to detect different human operator distraction levels. In phase 2, the detected level of distraction, time to collision (TTC), lane position (LP), and steering entropy (SE) were used as an input to feed the vehicle safety controller that provides an appropriate action to maintain and/or mitigate vehicle safety status. The integrated detection algorithm and vehicle safety controller were then prototyped using MATLAB/SIMULINK for validation. A complete vehicle power train model including the driver’s interaction was replicated, and the outcome from the detection algorithm was fed into the vehicle safety controller. The results show that the vehicle safety system controller reacted and mitigated the vehicle safety status-in closed loop real-time fashion. The simulation results show that the proposed approach is efficient, accurate, and adaptable to dynamic changes resulting from the driver, as well as the vehicle system. This novel approach was applied in order to mitigate the impact of visual and cognitive distractions on the driver performance.Dissertation/ThesisDoctoral Dissertation Applied Psychology 201

A novel Big Data analytics and intelligent technique to predict driver's intent

Modern age offers a great potential for automatically predicting the driver's intent through the increasing miniaturization of computing technologies, rapid advancements in communication technologies and continuous connectivity of heterogeneous smart objects. Inside the cabin and engine of modern cars, dedicated computer systems need to possess the ability to exploit the wealth of information generated by heterogeneous data sources with different contextual and conceptual representations. Processing and utilizing this diverse and voluminous data, involves many challenges concerning the design of the computational technique used to perform this task. In this paper, we investigate the various data sources available in the car and the surrounding environment, which can be utilized as inputs in order to predict driver's intent and behavior. As part of investigating these potential data sources, we conducted experiments on e-calendars for a large number of employees, and have reviewed a number of available geo referencing systems. Through the results of a statistical analysis and by computing location recognition accuracy results, we explored in detail the potential utilization of calendar location data to detect the driver's intentions. In order to exploit the numerous diverse data inputs available in modern vehicles, we investigate the suitability of different Computational Intelligence (CI) techniques, and propose a novel fuzzy computational modelling methodology. Finally, we outline the impact of applying advanced CI and Big Data analytics techniques in modern vehicles on the driver and society in general, and discuss ethical and legal issues arising from the deployment of intelligent self-learning cars

User-centred car design and the role of feedback in driving

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.A survey of car manufacturers reveals an impressive list of upcoming technologies, the combined effect of which is likely to have a profound impact upon feedback to the driver. Feedback is information that the situation provides back to the driver and is specified with reference to content, source, and timing. Feedback quality is achieved when the information requirements of the task, derived from a new task analysis of driving, are matched to the sources, content, and timing of feedback provided by the environment and the vehicle. An exploratory on-road study begins by observing that better quality feedback is implicated in increasing driver's situational awareness (even though drivers have little self awareness of this fact), and optimising mental workload. The exploratory level of analysis builds into the experimental, whereby a highly controlled simulator study replicates and builds upon these findings. Feedback is again seen to positively influence situational awareness, where changes in driver's confidence ratings as to the presence or absence of feedback information in the simulation were observed, according to the modality of feedback presented. This was achieved with a probe recall paradigm, and using psychophysical techniques as a useful extension to the Situational awareness Global Assessment Technique (SAGAI). Similarly, an analysis of mental workload via the NASA TLX self report questionnaire demonstrates that a combination of visual, steering force feedback and auditory feedback gives rise to lower mental workload, lower driver frustration, and lower, though possibly more realistic self ratings of performance. This knowledge can be discussed with reference to a feedback framework of driving that provides the theoretical backdrop to the key psychological variables implicated in driving task performance. Overall, the findings contribute to knowledge in terms of new and imaginative ways of designing future vehicle technologies in order to maximise safety, efficiency, and enjoyment.This research is funded by the Hamilton Research Studentship

Non-visual Effects of Road Lighting CCT on Driver's Mood, Alertness, Fatigue and Reaction Time: A Comprehensive Neuroergonomic Evaluation Study

Good nighttime road lighting is critical for driving safety. To improve the quality of nighttime road lighting, this study used the triangulation method by fusing "EEG evaluation + subjective evaluation + behavioral evaluation" to qualitatively and quantitatively investigate the response characteristics of different correlated color temperature (CCT) (3500K, 4500K, 5500K, 6500K) on drivers' non-visual indicators (mood, alertness, fatigue and reaction time) under specific driving conditions (monotonous driving; waiting for red light and traffic jam; car-following task). The results showed that the CCT and Task interaction effect is mainly related to individual alertness and reaction time. Individual subjective emotional experience, subjective visual comfort and psychological security are more responsive to changes in CCT than individual mental fatigue and visual fatigue. The subjective and objective evaluation results demonstrated that the EEG evaluation indices used in this study could objectively reflect the response characteristics of various non-visual indicators. The findings also revealed that moderate CCT (4500K) appears to be the most beneficial to drivers in maintaining an ideal state of mind and body during nighttime driving, which is manifested as: good mood experience; it helps drivers maintain a relatively stable level of alterness and to respond quickly to external stimuli; both mental and visual fatigue were relatively low. This study extends nighttime road lighting design research from the perspective of non-visual effects by using comprehensive neuroergonomic evaluation methods, and it provides a theoretical and empirical basis for the future development of a humanized urban road lighting design evaluation system.Comment: 38 pages, 15 figures, 103 conference

Ergonomics of intelligent vehicle braking systems

The present thesis examines the quantitative characteristics of driver braking and pedal operation and discusses the implications for the design of braking support systems for vehicles. After the current status of the relevant research is presented through a literature review, three different methods are employed to examine driver braking microscopically, supplemented by a fourth method challenging the potential to apply the results in an adaptive brake assist system. First, thirty drivers drove an instrumented vehicle for a day each. Pedal inputs were constantly monitored through force, position sensors and a video camera. Results suggested a range of normal braking inputs in terms of brake-pedal force, initial brake-pedal displacement and throttle-release (throttle-off) rate. The inter-personal and intra-personal variability on the main variables was also prominent. [Continues.

A multidisciplinary research approach for experimental applications in road-driver interaction analysis

This doctoral dissertation represents a cluster of the research activities conducted at the DICAM Department of the University of Bologna during a three years Ph.D. course. In relation to the broader research topic of “road safety”, the presented research focuses on the investigation of the interaction between the road and the drivers according to human factor principles and supported by the following strategies: 1) The multidisciplinary structure of the research team covering the following academic disciplines: Civil Engineering, Psychology, Neuroscience and Computer Science Engineering. 2) The development of several experimental real driving tests aimed to provide investigators with knowledge and insights on the relation between the driver and the surrounding road environment by focusing on the behaviour of drivers. 3) The use of innovative technologies for the experimental studies, capable to collect data of the vehicle and on the user: a GPS data recorder, for recording the kinematic parameters of the vehicle; an eye tracking device, for monitoring the drivers’ visual behaviour; a neural helmet, for the detection of drivers’ cerebral activity (electroencephalography, EEG). 4) The use of mathematical-computational methodologies (deep learning) for data analyses from experimental studies. The outcomes of this work consist of new knowledge on the casualties between drivers’ behaviour and road environment to be considered for infrastructure design. In particular, the ground-breaking results are represented by: - the reliability and effectiveness of the methodology based on human EEG signals to objectively measure driver’s mental workload with respect to different road factors; - the successful approach for extracting latent features from multidimensional driving behaviour data using a deep learning technique, obtaining driving colour maps which represent an immediate visualization with potential impacts on road safety

Description of the Integrated Driver Model

DTFH61-89-C-00044A simulation model for predicting driver behavior and system performance when the automobile driver performs concurrent steering and auxiliary in-vehicle tasks is described. This model is an integration of two previously existing computerized models referred to as the "procedural model" and the driver/vehicle model". The procedural component deals primarily with in-vehicle tasks and with the task-selection and attention-allocation procedures, whereas the driver/vehicle component predicts closed-loop continuous control (steering) behavior. Given descriptions of the driving environment and of driver information-processing limitations, the resulting integrated model allows one to predict a variety of performance measures for typical scenarios. These measures include time histories for vehicle state variables such as lane position and steering wheel deflection as well as allocation of visual and cognitive attention. Model calibration and validation are discussed, and use of the model in analyzing complex task situations and in generating human factors guidelines is demonstrated

Monitoring fatigue and drowsiness in motor vehicle occupants using electrocardiogram and heart rate - A systematic review

Introdução: A fadiga é um estado complexo que pode resultar em diminuição da vigilância, frequentemente acompanhada de sonolência. A fadiga durante a condução contribui significativamente para acidentes de trânsito em todo o mundo, destacando-se a necessidade de técnicas de monitorização eficazes. Existem várias tecnologias para aumentar a segurança do condutor e reduzir os riscos de acidentes, como sistemas de deteção de fadiga que podem alertar os condutores à medida que a sonolência se instala. Em particular, a análise dos padrões de frequência cardíaca pode oferecer informações valiosas sobre a condição fisiológica e o nível de vigilância do condutor, permitindo-lhe compreender os seus níveis de fadiga. Esta revisão tem como objetivo estabelecer o estado atual das estratégias de monitorização para ocupantes de veículos, com foco específico na avaliação da fadiga pela frequência cardíaca e variabilidade da frequência cardíaca. Métodos: Realizamos uma pesquisa sistemática da literatura nas bases de dados Web of Science, SCOPUS e Pubmed, utilizando os termos veículo, condutor, monitoração fisiológica, fadiga, sono, eletrocardiograma, frequência cardíaca e variabilidade da frequência cardíaca. Examinamos artigos publicados entre 1 de janeiro de 2018 e 31 de janeiro de 2023. Resultados: Um total de 371 artigos foram identificados, dos quais 71 foram incluídos neste estudo. Entre os artigos incluídos, 57 utilizam o eletrocardiograma (ECG) como sinal adquirido para medir a frequência cardíaca, sendo que a maioria das leituras de ECG foi obtida através de sensores de contacto (n=41), seguidos por sensores vestíveis não invasivos (n=11). Relativamente à validação, 23 artigos não mencionam qualquer tipo de validação, enquanto a maioria se baseia em avaliações subjetivas de fadiga relatadas pelos próprios participantes (n=27) e avaliações feitas por observadores com base em vídeos (n=11). Dos artigos incluídos, apenas 14 englobam um sistema de estimativa de fadiga e sonolência. Alguns relatam um desempenho satisfatórios, no entanto, o tamanho reduzido da amostra limita a abrangência de quaisquer conclusões. Conclusão: Esta revisão destaca o potencial da análise da frequência cardíaca e da instrumentação não invasiva para a monitorização contínua do estado do condutor e deteção de sonolência. Uma das principais questões é a falta de métodos suficientes de validação e estimativa para a fadiga, o que contribui para a insuficiência dos métodos na criação de sistemas de alarme proativos. Esta área apresenta grandes perspetivas, mas ainda está longe de ser implementada de forma fiável.Background: Fatigue is a complex state that can result in decreased alertness, often accompanied by drowsiness. Driving fatigue has become a significant contributor to traffic accidents globally, highlighting the need for effective monitoring techniques. Various technologies exist to enhance driver safety and minimize accident risks, such as fatigue detection systems that can alert drivers as drowsiness sets in. In particular, measuring heart rate patterns may offer valuable insights into the occupant's physiological condition and level of alertness, and may allow them to understand their fatigue levels. This review aims to establish the current state of the art of monitoring strategies for vehicle occupants, specifically focusing on fatigue assessed by heart rate and heart rate variability. Methods: We performed a systematic literature search in the databases of Web Of Science, SCOPUS and Pubmed, using the terms vehicle, driver, physiologic monitoring, fatigue, sleep, electrocardiogram, heart rate and heart rate variability. We examine articles published between 1st of january 2018 and 31st of January 2023. Results: A total of 371 papers were identified from which 71 articles were included in this study. Among the included papers, 57 utilized electrocardiogram (ECG) as the acquired signal for heart rate (HR) measures, with most ECG readings obtained through contact sensors (n=41), followed by non-intrusive wearable sensors (n=11). Regarding validation, 23 papers do not report validation, while the majority rely on subjective self-reported fatigue ratings (n=27) and video-based observer ratings(n=11). From the included papers, only 14 comprise a fatigue and drowsiness estimation system. Some report acceptable performances, but reduced sample size limits the reach of any conclusions. Conclusions: This review highlights the potential of HR analysis and non-intrusive instrumentation for continuous monitoring of driver's status and detecting sleepiness. One major issue is the lack of sufficient validation and estimation methods for fatigue, contributing to the insufficiency of methods in providing proactive alarm systems. This area shows great promise but is still far from being reliably implemented