Survey and synthesis of state of the art in driver monitoring

Road vehicle accidents are mostly due to human errors, and many such accidents could be avoided by continuously monitoring the driver. Driver monitoring (DM) is a topic of growing interest in the automotive industry, and it will remain relevant for all vehicles that are not fully autonomous, and thus for decades for the average vehicle owner. The present paper focuses on the first step of DM, which consists of characterizing the state of the driver. Since DM will be increasingly linked to driving automation (DA), this paper presents a clear view of the role of DM at each of the six SAE levels of DA. This paper surveys the state of the art of DM, and then synthesizes it, providing a unique, structured, polychotomous view of the many characterization techniques of DM. Informed by the survey, the paper characterizes the driver state along the five main dimensions—called here “(sub)states”—of drowsiness, mental workload, distraction, emotions, and under the influence. The polychotomous view of DM is presented through a pair of interlocked tables that relate these states to their indicators (e.g., the eye-blink rate) and the sensors that can access each of these indicators (e.g., a camera). The tables factor in not only the effects linked directly to the driver, but also those linked to the (driven) vehicle and the (driving) environment. They show, at a glance, to concerned researchers, equipment providers, and vehicle manufacturers (1) most of the options they have to implement various forms of advanced DM systems, and (2) fruitful areas for further research and innovation

Lapses in Responsiveness: Characteristics and Detection from the EEG

Performance lapses in occupations where public safety is paramount can have disastrous consequences, resulting in accidents with multiple fatalities. Drowsy individuals performing an active task, like driving, often cycle rapidly between periods of wake and sleep, as exhibited by cyclical variation in both EEG power spectra and task performance measures. The aim of this project was to identify reliable physiological cues indicative of lapses, related to behavioural microsleep episodes, from the EEG, which could in turn be used to develop a real-time lapse detection (or better still, prediction) system. Additionally, the project also sought to achieve an increased understanding of the characteristics of lapses in responsiveness in normal subjects. A study was conducted to determine EEG and/or EOG cues (if any) that expert raters use to detect lapses that occur during a psychomotor vigilance task (PVT), with the subsequent goal of using these cues to design an automated system. A previously-collected dataset comprising physiological and performance data of 10 air traffic controllers (ATCs) was used. Analysis showed that the experts were unable to detect the vast majority of lapses based on EEG and EOG cues. This suggested that, unlike automated sleep staging, an automated lapse detection system needed to identify features not generally visible in the EEG. Limitations in the ATC dataset led to a study where more comprehensive physiological and performance data were collected from normal subjects. Fifteen non-sleep-deprived male volunteers aged 18-36 years were recruited. All performed a 1-D continuous pursuit visuomotor tracking task for 1 hour during each of two sessions that occurred between 1 and 7 weeks apart. A video camera was used to record head and facial expressions of the subject. EEG was recorded from electrodes at 16 scalp locations according to the 10-20 system at 256 Hz. Vertical and horizontal EOG was also recorded. All experimental sessions were held between 12:30 and 17:00 hours. Subjects were asked to refrain from consuming stimulants or depressants, for 4 h prior to each session. Rate and duration were estimated for lapses identified by a tracking flat spot and/or video sleep. Fourteen of the 15 subjects had one or more lapses, with an overall rate of 39.3 ± 12.9 lapses per hour (mean ± SE) and a lapse duration of 3.4 ± 0.5 s. The study also showed that lapsing and tracking error increased during the first 30 or so min of a 1-h session, then decreased during the remaining time, despite the absence of external temporal cues. EEG spectral power was found to be higher during lapses in the delta, theta, and alpha bands, and lower in the beta, gamma, and higher bands, but correlations between changes in EEG power and lapses were low. Thus, complete lapses in responsiveness are a frequent phenomenon in normal subjects - even when not sleep-deprived - undertaking an extended, monotonous, continuous visuomotor task. This is the first study to investigate and report on the characteristics of complete lapses of responsiveness during a continuous tracking task in non-sleep-deprived subjects. The extent to which non-sleep-deprived subjects experience complete lapses in responsiveness during normal working hours was unexpected. Such findings will be of major concern to individuals and companies in various transport sectors. Models based on EEG power spectral features, such as power in the traditional bands and ratios between bands, were developed to detect the change of brain state during behavioural microsleeps. Several other techniques including spectral coherence and asymmetry, fractal dimension, approximate entropy, and Lempel-Ziv (LZ) complexity were also used to form detection models. Following the removal of eye blink artifacts from the EEG, the signal was transformed into z-scores relative to the baseline of the signal. An epoch length of 2 s and an overlap of 1 s (50%) between successive epochs were used for all signal processing algorithms. Principal component analysis was used to reduce redundancy in the features extracted from the 16 EEG derivations. Linear discriminant analysis was used to form individual classification models capable of detecting lapses using data from each subject. The overall detection model was formed by combining the outputs of the individual models using stacked generalization with constrained least-squares fitting used to determine the optimal meta-learner weights of the stacked system. The performance of the lapse detector was measured both in terms of its ability to detect lapse state (in 1-s epochs) and lapse events. Best performance in lapse state detection was achieved using the detector based on spectral power (SP) features (mean correlation of φ = 0.39 ± 0.06). Lapse event detection performance using SP features was moderate at best (sensitivity = 73.5%, selectivity = 25.5%). LZ complexity feature-based detector showed the highest performance (φ = 0.28 ± 0.06) out of the 3 non-linear feature-based detectors. The SP+LZ feature-based model had no improvement in performance over the detector based on SP alone, suggesting that LZ features contributed no additional information. Alpha power contributed the most to the overall SP-based detection model. Analysis showed that the lapse detection model was detecting phasic, rather than tonic, changes in the level of drowsiness. The performance of these EEG-based lapse detection systems is modest. Further research is needed to develop more sensitive methods to extract cues from the EEG leading to devices capable of detecting and/or predicting lapses

Measuring Behavior 2018 Conference Proceedings

These proceedings contain the papers presented at Measuring Behavior 2018, the 11th International Conference on Methods and Techniques in Behavioral Research. The conference was organised by Manchester Metropolitan University, in collaboration with Noldus Information Technology. The conference was held during June 5th – 8th, 2018 in Manchester, UK. Building on the format that has emerged from previous meetings, we hosted a fascinating program about a wide variety of methodological aspects of the behavioral sciences. We had scientific presentations scheduled into seven general oral sessions and fifteen symposia, which covered a topical spread from rodent to human behavior. We had fourteen demonstrations, in which academics and companies demonstrated their latest prototypes. The scientific program also contained three workshops, one tutorial and a number of scientific discussion sessions. We also had scientific tours of our facilities at Manchester Metropolitan Univeristy, and the nearby British Cycling Velodrome. We hope this proceedings caters for many of your interests and we look forward to seeing and hearing more of your contributions