Implicit personalization in driving assistance: State-of-the-art and open issues

In recent decades, driving assistance systems have been evolving towards personalization for adapting to different drivers. With the consideration of driving preferences and driver characteristics, these systems become more acceptable and trustworthy. This article presents a survey on recent advances in implicit personalized driving assistance. We classify the collection of work into three main categories: 1) personalized Safe Driving Systems (SDS), 2) personalized Driver Monitoring Systems (DMS), and 3) personalized In-vehicle Information Systems (IVIS). For each category, we provide a comprehensive review of current applications and related techniques along with the discussion of industry status, benefits of personalization, application prospects, and future focal points. Both relevant driving datasets and open issues about personalized driving assistance are discussed to facilitate future research. By creating an organized categorization of the field, we hope that this survey could not only support future research and the development of new technologies for personalized driving assistance but also facilitate the application of these techniques within the driving automation community</h2

A model for inebriation recognition in humans using computer vision

Abstract: Inebriation is a situational impairment caused by the consumption of alcohol affecting the consumer's interaction with the environment around them...M.Sc. (Information Technology

Implicit Personalization in Driving Assistance: State-of-the-Art and Open Issues

In recent decades, driving assistance systems have been evolving towards personalization for adapting to different drivers. With considering personal driving preferences and characteristics, these systems become more acceptable and trustworthy. This paper presents a survey of recent advances in implicit personalized driving assistance. We classify the collection of work into three main categories: 1) personalized Safe Driving Systems (SDS), 2) personalized Driver Monitoring Systems (DMS), and 3) personalized In-vehicle Information Systems (IVIS). For each category, we provide a comprehensive review of current applications and related techniques along with the discussion of industry status, gains of personalization, application prospects, and future focal points. Several existing driving datasets are summarized and open issues of personalized driving assistance are also suggested to facilitate future research. By creating an organized categorization of the field, this survey could not only support future research and the development of new technologies for personalized driving assistance but also facilitate the use of these techniques by researchers within the driving automation community

Survey and synthesis of state of the art in driver monitoring

Road vehicle accidents are mostly due to human errors, and many such accidents could be avoided by continuously monitoring the driver. Driver monitoring (DM) is a topic of growing interest in the automotive industry, and it will remain relevant for all vehicles that are not fully autonomous, and thus for decades for the average vehicle owner. The present paper focuses on the first step of DM, which consists of characterizing the state of the driver. Since DM will be increasingly linked to driving automation (DA), this paper presents a clear view of the role of DM at each of the six SAE levels of DA. This paper surveys the state of the art of DM, and then synthesizes it, providing a unique, structured, polychotomous view of the many characterization techniques of DM. Informed by the survey, the paper characterizes the driver state along the five main dimensions—called here “(sub)states”—of drowsiness, mental workload, distraction, emotions, and under the influence. The polychotomous view of DM is presented through a pair of interlocked tables that relate these states to their indicators (e.g., the eye-blink rate) and the sensors that can access each of these indicators (e.g., a camera). The tables factor in not only the effects linked directly to the driver, but also those linked to the (driven) vehicle and the (driving) environment. They show, at a glance, to concerned researchers, equipment providers, and vehicle manufacturers (1) most of the options they have to implement various forms of advanced DM systems, and (2) fruitful areas for further research and innovation

Design and Application of Wireless Body Sensors

Hörmann T. Design and Application of Wireless Body Sensors. Bielefeld: Universität Bielefeld; 2019

Detection, Prediction and Modelling of Mental Fatigue in Naturalistic Environment

Operator mental fatigue in workplace can result in serious mistakes which have dangerous and life-threatening consequences. Fatigue assessment and prediction are, therefore, considered critical safety requirements that cut across modes and operations of numerous high-risk environments and industries such as nuclear and transportation. However, robust, accurate and timely assessment of fatigue (or alertness) is still a challenging task for many reasons. The majority of operator fatigue studies are still being carried out in simulation environments, overlooking operator's naturalistic behaviour and fatigue growth. Moreover, most of the available systems rely on using a single fatigue-related data source, which is clearly a major drawback that affects operation, performance, accuracy and reliability of the system in case this source fails. With multi-data sources in an integrated system, the system might stop working in the event of losing one or more data sources or at least becomes inaccurate or unreliable. Furthermore, paying no attention to human individual differences working as an operator in mission-critical jobs related to fatigue growth and in response to fatigue deleterious effect is another serious issue with the current fatigue assessment and prediction systems. The research work presented in this thesis proposes a novel fatigue assessment approach, which addresses the aforementioned issues with fatigue detection and prediction system. This is achieved by developing and realising algorithms based on data collected from participants in naturalistic environments. Numerous experiments have been conducted to cover a wide range of fatigue-related tasks which are broadly grouped into two categories: biological and behavioural (performance) experiments. The biological-based experiments employ various data types such as heart rate, skin temperature, skin conductance and heart rate variability. These fatigue-related data types are used to build the proposed fatigue detection system, and the obtained results have demonstrated high accuracy and reliability (94.5% accuracy in naturalistic environments). The behavioural-based category includes two experiments: keyboard typing and driving task. The typing experiments have been carried out using computer keyboard and smartphone virtual keyboard, and have confirmed enhanced operator fatigue detection accuracy (94%). The driving experiments were conducted in naturalistic driving environments, and the used algorithms have demonstrated a new framework for driver fatigue detection using smartphone inertial sensors based on a novel vehicle heading algorithm. A prototype system was designed and built with a modular structure so as to allow the addition of multiple fatigue-related biological and behavioural sources. This modular structure was tested under different situations that involve losing one or more sources. In addition, the circadian rhythm, which is a main input to fatigue/alert regulators, was customised for each operator and modelled based on biological data collected from wearable devices. The constructed model captures individual differences of operators, which is a challenge in current systems. Such multi-source, modular and non-intrusive approach for fatigue/alertness assessment and prediction is expected to be of superior performance, low-cost and favourable by users compared to existing systems. Furthermore, it addresses other challenges of current fatigue systems by carrying out fatigue assessment in naturalistic environments and considering operator individual differences in response to fatigue. In addition, the modular structure of the proposed system helps improving robustness and accuracy against losing one or more input sources (accuracy for 4 sources: 91%, 3 sources: 87%, 2 sources: 77%). Following the proposed approach will definitely enhance the reliability of fatigue assessment systems, improve operator safety, productivity and reduce financial fatigue impacts. Moreover, the proposed system has proven to be non-intrusive in nature and of low implementation cost. The results obtained after testing the proposed system have been very promising to support the aforementioned benefits

Signal processing methods for mental fatigue measurement and monitoring using EEG

Ph.DDOCTOR OF PHILOSOPH

Event and state detection in time series by genetic programming

Event and state detection in time series has significant value in scientific areas and real-world applications. The aim of detecting time series event and state patterns is to identify particular variations of user-interest in one or more channels of time series streams. For example, dangerous driving behaviours such as sudden braking and harsh acceleration can be detected from continuous recordings from inertial sensors. However, the existing methods are highly dependent on domain knowledge such as the size of the time series pattern and a set of effective features. Furthermore, they are not directly suitable for multi-channel time series data. In this study, we establish a genetic programming based method which can perform classification on multi-channel time series data. It does not need the domain knowledge required by the existing methods. The investigation consists of four parts: the methodology, an evaluation on event detection tasks, an evaluation on state detection tasks and an analysis on the suitability for real-world applications. In the methodology, a GP based method is proposed for processing and analysing multi-channel time series streams. The function set includes basic mathematical operations. In addition, specific functions and terminals are introduced to reserve historical information, capture temporal dependency across time points and handle dependency between channels. These functions and terminals help the GP based method to automatically find the pattern size and extract features. This study also investigates two different fitness functions - accuracy and area under the curve. The proposed method is investigated on a range of event detection tasks. The investigation starts from synthetic tasks such as detecting complete sine waves. The performance of the GP based method is compared to traditional classification methods. On the raw data the GP based method achieves 100 percent accuracy, which outperforms all the non-GP methods.The performance of the non-GP methods is comparable to the GP based method only with suitable features. In addition, the GP based method is investigated on two complex real-world event detection tasks - dangerous driving behaviour detection and video shot detection. In the task of detecting three dangerous driving behaviours from 21-channel time series data, the GP based method performs consistently better than the non-GP classifiers even when features are provided. In the video shot detection task, the GP based method achieves comparable performance on 11200-channel time series to the non-GP classifiers on 28 features. The GP based method is more accurate than a commercial product. The GP based method has also been investigated on state detection tasks. This involves synthetic tasks such as detecting concurrent high values in four of five channels and a real-world activity recognition problem. The results also show that the GP based method consistently outperforms the non-GP methods even with the presence of manually constructed features. As part of the investigation, a mobile phone based activity recognition data set was collected as there was no existing publicly available data set. The suitability of the GP based method for solving real-world problems is further analysed. Our analysis shows that the GP based method can be successfully extended for multi-class classification. The analysis of the evolved programs demonstrates that they do capture time series patterns. On synthetic data sets, the injected regularities are revealed in understandable individuals. The best programs for three real-world problems are more difficult to explain but still provide some insight. The selection of relevant channels and data points by the programs are consistent with domain knowledge. In addition, the analysis shows that the proposed method still performs well for time series pattern of different sizes. The effective window sizes of the evolved GP programs are close to the pattern size. Finally, our study on execution performance of the evolved programs shows that these programs are fast in execution and are suitable for real-time applications. In summary, the GP based method is suitable for the kinds of real-world applications studied in this thesis. This thesis concludes that, with a suitable representation, genetic programming can be an effective method for event and state detection in multi-channel time series for a range of synthetic and real-world tasks. This method does not require much domain knowledge such as the pattern size and suitable features. It offers an effective classification method in similar tasks that are studied in this thesis

Investigation of smart work zone technologies using mixed simulator and field studies

Safety is the top concern in transportation, especially in work zones, as work zones deviate from regular driving environment and driver behavior is very different. In order to protect workers and create a safer work zone environment, new technologies are proposed by agencies and deployed to work zones, however, some are without scientific study before deployment. Therefore, quantitative studies need to be conducted to show the effectiveness of technologies. Driving simulator is a safe and cost-effective way to test effectiveness of new designs and compare different configurations. Field study is another scientific way of testing, as it provides absolute validity, while simulator study provides relative validity. The synergy of field and simulator studies construct a precise experiment as field study calibrates simulator design and validates simulator results. Two main projects, Evaluation of Automated Flagger Assistance Devices (AFADs), and Evaluation of Green Lights on Truck-Mounted Attenuator (TMA), are discussed in this dissertation to illustrate the investigation of smart work zone technologies using mixed simulator and field studies, along with one simulator project investigating interaction between human driven car and autonomous truck platoon in work zones. Both field and simulator studies indicated that AFADs improved stationary work zone safety by enhancing visibility, isolating workers from immediate traffic, and conveying clear guidance message to traffic. The results of green light on TMAs implied an inverse relationship between visibility/awareness of work zone and arrow board recognition/easy on eyes, but did not show if any of the light configurations is superior. Results anticipated for autonomous truck platoon in work zones are drivers behave more uniformly after being educated about the meaning of signage displayed on the back of truck, and performance measured with signage would be more preferable than those without signage. Applications of statistics are extension of studies, including experimental design, survey design, and data analysis. Data obtained from AFAD and Green Light projects were utilized to illustrate the methodologies of data analysis and model building, which incorporated simulator data, biofeedback and survey response to interpret the relationship among driver perspective and mental status, and driving behavior. From the studies conducted, it could be concluded that mixed simulator and field study is a good fit for smart work zone technologies investigation. Simulators provide a safe environment, flexibility and cost-effectiveness, while field studies calibrate and validate simulator setup and its results. The collaboration of two forms of study generates legitimate and convincing results for investigations. Applying statistical methodologies into transportation simulator and field studies is a good way to make experiment and survey design more rational, and the statistical methods are applicable for further data analysis.Includes bibliographical reference