A novel Big Data analytics and intelligent technique to predict driver's intent

Modern age offers a great potential for automatically predicting the driver's intent through the increasing miniaturization of computing technologies, rapid advancements in communication technologies and continuous connectivity of heterogeneous smart objects. Inside the cabin and engine of modern cars, dedicated computer systems need to possess the ability to exploit the wealth of information generated by heterogeneous data sources with different contextual and conceptual representations. Processing and utilizing this diverse and voluminous data, involves many challenges concerning the design of the computational technique used to perform this task. In this paper, we investigate the various data sources available in the car and the surrounding environment, which can be utilized as inputs in order to predict driver's intent and behavior. As part of investigating these potential data sources, we conducted experiments on e-calendars for a large number of employees, and have reviewed a number of available geo referencing systems. Through the results of a statistical analysis and by computing location recognition accuracy results, we explored in detail the potential utilization of calendar location data to detect the driver's intentions. In order to exploit the numerous diverse data inputs available in modern vehicles, we investigate the suitability of different Computational Intelligence (CI) techniques, and propose a novel fuzzy computational modelling methodology. Finally, we outline the impact of applying advanced CI and Big Data analytics techniques in modern vehicles on the driver and society in general, and discuss ethical and legal issues arising from the deployment of intelligent self-learning cars

Sensor Technologies for Intelligent Transportation Systems

Modern society faces serious problems with transportation systems, including but not limited to traffic congestion, safety, and pollution. Information communication technologies have gained increasing attention and importance in modern transportation systems. Automotive manufacturers are developing in-vehicle sensors and their applications in different areas including safety, traffic management, and infotainment. Government institutions are implementing roadside infrastructures such as cameras and sensors to collect data about environmental and traffic conditions. By seamlessly integrating vehicles and sensing devices, their sensing and communication capabilities can be leveraged to achieve smart and intelligent transportation systems. We discuss how sensor technology can be integrated with the transportation infrastructure to achieve a sustainable Intelligent Transportation System (ITS) and how safety, traffic control and infotainment applications can benefit from multiple sensors deployed in different elements of an ITS. Finally, we discuss some of the challenges that need to be addressed to enable a fully operational and cooperative ITS environment

Fatigue Detection for Ship OOWs Based on Input Data Features, from The Perspective of Comparison with Vehicle Drivers: A Review

Ninety percent of the world’s cargo is transported by sea, and the fatigue of ship officers of the watch (OOWs) contributes significantly to maritime accidents. The fatigue detection of ship OOWs is more difficult than that of vehicles drivers owing to an increase in the automation degree. In this study, research progress pertaining to fatigue detection in OOWs is comprehensively analysed based on a comparison with that in vehicle drivers. Fatigue detection techniques for OOWs are organised based on input sources, which include the physiological/behavioural features of OOWs, vehicle/ship features, and their comprehensive features. Prerequisites for detecting fatigue in OOWs are summarised. Subsequently, various input features applicable and existing applications to the fatigue detection of OOWs are proposed, and their limitations are analysed. The results show that the reliability of the acquired feature data is insufficient for detecting fatigue in OOWs, as well as a non-negligible invasive effect on OOWs. Hence, low-invasive physiological information pertaining to the OOWs, behaviour videos, and multisource feature data of ship characteristics should be used as inputs in future studies to realise quantitative, accurate, and real-time fatigue detections in OOWs on actual ships

A Smart Safety Helmet using IMU and EEG sensors for analysis of worker’s fatigue

It is known that head gesture and mental states can reflect some human behaviors related to a risk of accident when using machine-tools. The research works presented in this paper aim to reduce the number of injury and thus increase worker safety. Instead using camera, this paper presents a Smart Safety Helmet (SSH) in order to track head gestures and mental states of worker able to recognize anomalous behavior. Information extracted from SSH is used for computing risk level of accident (a safety level) for preventing and reducing injury or accidents. The SSH system is an inexpensive, non-intrusive, non-invasive, and non-vision-based system, which consists of 9DOF Inertial Measurement Unit (IMU) and dry EEG electrodes. A haptic device, such as vibrotactile motor, is integrated to the helmet in order to alert the operator when computed risk level (fatigue, high stress or error) reach a threshold. Once the risk level of accident breaks the threshold, a signal will be sent wirelessly to stop the relevant machine tool or process

Physiological-based Driver Monitoring Systems: A Scoping Review

A physiological-based driver monitoring system (DMS) has attracted research interest and has great potential for providing more accurate and reliable monitoring of the driver’s state during a driving experience. Many driving monitoring systems are driver behavior-based or vehicle-based. When these non-physiological based DMS are coupled with physiological-based data analysis from electroencephalography (EEG), electrooculography (EOG), electrocardiography (ECG), and electromyography (EMG), the physical and emotional state of the driver may also be assessed. Drivers’ wellness can also be monitored, and hence, traffic collisions can be avoided. This paper highlights work that has been published in the past five years related to physiological-based DMS. Specifically, we focused on the physiological indicators applied in DMS design and development. Work utilizing key physiological indicators related to driver identification, driver alertness, driver drowsiness, driver fatigue, and drunk driver is identified and described based on the PRISMA Extension for Scoping Reviews (PRISMA-Sc) Framework. The relationship between selected papers is visualized using keyword co-occurrence. Findings were presented using a narrative review approach based on classifications of DMS. Finally, the challenges of physiological-based DMS are highlighted in the conclusion. Doi: 10.28991/CEJ-2022-08-12-020 Full Text: PD

Single channel wireless EEG device for real-time fatigue level detection

© 2015 IEEE. Driver fatigue problem is one of the important factors of traffic accidents. Recent years, many research had investigated that using EEG signals can effectively detect driver's drowsiness level. However, real-time monitoring system is required to apply these fatigue level detection techniques in the practical application, especially in the real-road driving. Therefore, it required less channels, portable and wireless, real-time monitoring and processing techniques for developing the real-time monitoring system. In this study, we develop a single channel wireless EEG device which can real-time detect driver's fatigue level on the mobile device such as smart phone or tablet. The developed device is investigated to obtain a better and precise understanding of brain activities of mental fatigue under driving, which is of great benefit for devolvement of detection of driving fatigue system. This system consists of a Bluetooth-enabled one channel EEG, a regression model, and smartphone, which was a platform recording and transforming the raw EEG data to useful driving status. In the experiment, this was a sustained-attention driving task to implement in a virtual-reality (VR) driving simulator. To training model and develop the system, we were performed for 15 subjects to study Electroencephalography (EEG) brain dynamics by using a mobile and wireless EEG device. Based on the outstanding training results, the leave-one-subject-out cross validation test obtained 90% fatigue detection accuracy. These results indicate that the combination of a smartphone and wireless EEG device constitutes an effective and easy wearable solution for detecting and preventing driver fatigue in real driving environments

Monitoring fatigue and drowsiness in motor vehicle occupants using electrocardiogram and heart rate - A systematic review

Introdução: A fadiga é um estado complexo que pode resultar em diminuição da vigilância, frequentemente acompanhada de sonolência. A fadiga durante a condução contribui significativamente para acidentes de trânsito em todo o mundo, destacando-se a necessidade de técnicas de monitorização eficazes. Existem várias tecnologias para aumentar a segurança do condutor e reduzir os riscos de acidentes, como sistemas de deteção de fadiga que podem alertar os condutores à medida que a sonolência se instala. Em particular, a análise dos padrões de frequência cardíaca pode oferecer informações valiosas sobre a condição fisiológica e o nível de vigilância do condutor, permitindo-lhe compreender os seus níveis de fadiga. Esta revisão tem como objetivo estabelecer o estado atual das estratégias de monitorização para ocupantes de veículos, com foco específico na avaliação da fadiga pela frequência cardíaca e variabilidade da frequência cardíaca. Métodos: Realizamos uma pesquisa sistemática da literatura nas bases de dados Web of Science, SCOPUS e Pubmed, utilizando os termos veículo, condutor, monitoração fisiológica, fadiga, sono, eletrocardiograma, frequência cardíaca e variabilidade da frequência cardíaca. Examinamos artigos publicados entre 1 de janeiro de 2018 e 31 de janeiro de 2023. Resultados: Um total de 371 artigos foram identificados, dos quais 71 foram incluídos neste estudo. Entre os artigos incluídos, 57 utilizam o eletrocardiograma (ECG) como sinal adquirido para medir a frequência cardíaca, sendo que a maioria das leituras de ECG foi obtida através de sensores de contacto (n=41), seguidos por sensores vestíveis não invasivos (n=11). Relativamente à validação, 23 artigos não mencionam qualquer tipo de validação, enquanto a maioria se baseia em avaliações subjetivas de fadiga relatadas pelos próprios participantes (n=27) e avaliações feitas por observadores com base em vídeos (n=11). Dos artigos incluídos, apenas 14 englobam um sistema de estimativa de fadiga e sonolência. Alguns relatam um desempenho satisfatórios, no entanto, o tamanho reduzido da amostra limita a abrangência de quaisquer conclusões. Conclusão: Esta revisão destaca o potencial da análise da frequência cardíaca e da instrumentação não invasiva para a monitorização contínua do estado do condutor e deteção de sonolência. Uma das principais questões é a falta de métodos suficientes de validação e estimativa para a fadiga, o que contribui para a insuficiência dos métodos na criação de sistemas de alarme proativos. Esta área apresenta grandes perspetivas, mas ainda está longe de ser implementada de forma fiável.Background: Fatigue is a complex state that can result in decreased alertness, often accompanied by drowsiness. Driving fatigue has become a significant contributor to traffic accidents globally, highlighting the need for effective monitoring techniques. Various technologies exist to enhance driver safety and minimize accident risks, such as fatigue detection systems that can alert drivers as drowsiness sets in. In particular, measuring heart rate patterns may offer valuable insights into the occupant's physiological condition and level of alertness, and may allow them to understand their fatigue levels. This review aims to establish the current state of the art of monitoring strategies for vehicle occupants, specifically focusing on fatigue assessed by heart rate and heart rate variability. Methods: We performed a systematic literature search in the databases of Web Of Science, SCOPUS and Pubmed, using the terms vehicle, driver, physiologic monitoring, fatigue, sleep, electrocardiogram, heart rate and heart rate variability. We examine articles published between 1st of january 2018 and 31st of January 2023. Results: A total of 371 papers were identified from which 71 articles were included in this study. Among the included papers, 57 utilized electrocardiogram (ECG) as the acquired signal for heart rate (HR) measures, with most ECG readings obtained through contact sensors (n=41), followed by non-intrusive wearable sensors (n=11). Regarding validation, 23 papers do not report validation, while the majority rely on subjective self-reported fatigue ratings (n=27) and video-based observer ratings(n=11). From the included papers, only 14 comprise a fatigue and drowsiness estimation system. Some report acceptable performances, but reduced sample size limits the reach of any conclusions. Conclusions: This review highlights the potential of HR analysis and non-intrusive instrumentation for continuous monitoring of driver's status and detecting sleepiness. One major issue is the lack of sufficient validation and estimation methods for fatigue, contributing to the insufficiency of methods in providing proactive alarm systems. This area shows great promise but is still far from being reliably implemented

Real-time drowsiness detection using wearable, lightweight EEG sensors

Driver drowsiness has always been a major concern for researchers and road use administrators. It has led to countless deaths accounting to significant percentile of deaths world over. Researchers have attempted to determine driver drowsiness using the following measures: (1) subjective measures (2) vehicle-based measures; (3) behavioral measures and (4) physiological measures.;Studies carried out to assess the efficacy of all the four measures, have brought out significant weaknesses in each of these measures. However detailed and comprehensive review has indicated that Physiological Measure namely EEG signal analysis provides most reliable and accurate information on driver drowsiness. In this paper a brief review of systems, and issues associated with them has been discussed with a view to evolve a novel system based on EEG signals especially for use in mine vehicles.;The feasibility of real-time drowsiness detection using commercially available, off-the-shelf, lightweight, wearable EEG sensors is explored. While EEG signals are known to be reliable indicators of fatigue and drowsiness, they have not been used widely due to their size and form factor. But the use of light-weight wearable EEGs alleviates this concern. Spectral analysis of EEG signals from these sensors using support vector machines is shown to classify drowsy states with high accuracy.;The system is validated using data collected on 23 subjects in fresh and drowsy states. The EEG signals are also used to characterize the blink duration and frequency of subjects. However, classification of drowsy states using blink analysis is shown to have lower accuracy than that using spectral analysis

Influence of Task Combination on EEG Spectrum Modulation for Driver Workload Estimation

Dieser Beitrag ist mit Zustimmung des Rechteinhabers aufgrund einer (DFG geförderten) Allianz- bzw. Nationallizenz frei zugänglich.This publication is with permission of the rights owner freely accessible due to an Alliance licence and a national licence (funded by the DFG, German Research Foundation) respectively.Objective: This study investigates the feasibility of using a method based on electroencephalography (EEG) for deriving a driver’s mental workload index. Background: The psychophysiological signals provide sensitive information for human functional states assessment in both laboratory and real-world settings and for building a new communication channel between driver and vehicle that allows for driver workload monitoring. Methods: An experiment combining a lane-change task and n-back task was conducted. The task load levels were manipulated in two dimensions, driving task load and working memory load, with each containing three task load conditions. Results: The frontal theta activity showed significant increases in the working memory load dimension, but differences were not found with the driving task load dimension. However, significant decreases in parietal alpha activity were found when the task load was increased in both dimensions. Task-related differences were also found. The driving task load contributed more to the changes in alpha power, whereas the working memory load contributed more to the changes in theta power. Additionally, these two task load dimensions caused significant interactive effects on both theta and alpha power. Conclusion: These results indicate that EEG technology can provide sensitive information for driver workload detection even if the sensitivities of different EEG parameters tend to be task dependent. Application: One potential future application of this study is to establish a general driver workload estimator that uses EEG signals