Impact of Temperament Types and Anger Intensity on Drivers\u27 EEG Power Spectrum and Sample Entropy: An On-road Evaluation Toward Road Rage Warning

"Road rage", also called driving anger, is becoming an increasingly common phenomenon affecting road safety in auto era as most of previous driving anger detection approaches based on physiological indicators are often unreliable due to the less consideration of drivers\u27 individual differences. This study aims to explore the impact of temperament types and anger intensity on drivers\u27 EEG characteristics. Thirty-two drivers with valid license were enrolled to perform on-road experiments on a particularly busy route on which a variety of provoking events like cutting in line of surrounding vehicle, jaywalking, occupying road of non-motor vehicle and traffic congestion frequently happened. Then, muti-factor analysis of variance (ANOVA) and post hoc analysis were utilized to study the impact of temperament types and anger intensity on drivers\u27 power spectrum and sample entropy of θ and β waves extracted from EEG signals. The study results firstly indicated that right frontal region of the brain has close relationship with driving anger. Secondly, there existed significant main effects of temperament types on power spectrum and sample entropy of β wave while significant main effects of anger intensity on power spectrum and sample entropy of θ and β wave were all observed. Thirdly, significant interactions between temperament types and anger intensity for power spectrum and sample entropy of β wave were both noted. Fourthly, with the increase of anger intensity, the power spectrum and sample entropy both decreased sufficiently for θ wave while increased remarkably for β wave. The study results can provide a theoretical support for designing a personalized and hierarchical warning system for road rage

Emotion and Stress Recognition Related Sensors and Machine Learning Technologies

This book includes impactful chapters which present scientific concepts, frameworks, architectures and ideas on sensing technologies and machine learning techniques. These are relevant in tackling the following challenges: (i) the field readiness and use of intrusive sensor systems and devices for capturing biosignals, including EEG sensor systems, ECG sensor systems and electrodermal activity sensor systems; (ii) the quality assessment and management of sensor data; (iii) data preprocessing, noise filtering and calibration concepts for biosignals; (iv) the field readiness and use of nonintrusive sensor technologies, including visual sensors, acoustic sensors, vibration sensors and piezoelectric sensors; (v) emotion recognition using mobile phones and smartwatches; (vi) body area sensor networks for emotion and stress studies; (vii) the use of experimental datasets in emotion recognition, including dataset generation principles and concepts, quality insurance and emotion elicitation material and concepts; (viii) machine learning techniques for robust emotion recognition, including graphical models, neural network methods, deep learning methods, statistical learning and multivariate empirical mode decomposition; (ix) subject-independent emotion and stress recognition concepts and systems, including facial expression-based systems, speech-based systems, EEG-based systems, ECG-based systems, electrodermal activity-based systems, multimodal recognition systems and sensor fusion concepts and (x) emotion and stress estimation and forecasting from a nonlinear dynamical system perspective

Ubiquitous Technologies for Emotion Recognition

Emotions play a very important role in how we think and behave. As such, the emotions we feel every day can compel us to act and influence the decisions and plans we make about our lives. Being able to measure, analyze, and better comprehend how or why our emotions may change is thus of much relevance to understand human behavior and its consequences. Despite the great efforts made in the past in the study of human emotions, it is only now, with the advent of wearable, mobile, and ubiquitous technologies, that we can aim to sense and recognize emotions, continuously and in real time. This book brings together the latest experiences, findings, and developments regarding ubiquitous sensing, modeling, and the recognition of human emotions

Individual and Inter-related Action Unit Detection in Videos for Affect Recognition

The human face has evolved to become the most important source of non-verbal information that conveys our affective, cognitive and mental state to others. Apart from human to human communication facial expressions have also become an indispensable component of human-machine interaction (HMI). Systems capable of understanding how users feel allow for a wide variety of applications in medical, learning, entertainment and marketing technologies in addition to advancements in neuroscience and psychology research and many others. The Facial Action Coding System (FACS) has been built to objectively define and quantify every possible facial movement through what is called Action Units (AU), each representing an individual facial action. In this thesis we focus on the automatic detection and exploitation of these AUs using novel appearance representation techniques as well as incorporation of the prior co-occurrence information between them. Our contributions can be grouped in three parts. In the first part, we propose to improve the detection accuracy of appearance features based on local binary patterns (LBP) for AU detection in videos. For this purpose, we propose two novel methodologies. The first one uses three fundamental image processing tools as a pre-processing step prior to the application of the LBP transform on the facial texture. These tools each enhance the descriptive ability of LBP by emphasizing different transient appearance characteristics, and are proven to increase the AU detection accuracy significantly in our experiments. The second one uses multiple local curvature Gabor binary patterns (LCGBP) for the same problem and achieves state-of-the-art performance on a dataset of mostly posed facial expressions. The curvature information of the face, as well as the proposed multiple filter size scheme is very effective in recognizing these individual facial actions. In the second part, we propose to take advantage of the co-occurrence relation between the AUs, that we can learn through training examples. We use this information in a multi-label discriminant Laplacian embedding (DLE) scheme to train our system with SIFT features extracted around the salient and transient landmarks on the face. The system is first validated on a challenging (containing lots of occlusions and head pose variations) dataset without the DLE, then we show the performance of the full system on the FERA 2015 challenge on AU occurence detection. The challenge consists of two difficult datasets that contain spontaneous facial actions at different intensities. We demonstrate that our proposed system achieves the best results on these datasets for detecting AUs. The third and last part of the thesis contains an application on how this automatic AU detection system can be used in real-life situations, particularly for detecting cognitive distraction. Our contribution in this part is two-fold: First, we present a novel visual database of people driving a simulator while being induced visual and cognitive distraction via secondary tasks. The subjects have been recorded using three near-infrared camera-lighting systems, which makes it a very suitable configuration to use in real driving conditions, i.e. with large head pose and ambient light variations. Secondly, we propose an original framework to automatically discriminate cognitive distraction sequences from baseline sequences by extracting features from continuous AU signals and by exploiting the cross-correlations between them. We achieve a very high classification accuracy in our subject-based experiments and a lower yet acceptable performance for the subject-independent tests. Based on these results we discuss how facial expressions related to this complex mental state are individual, rather than universal, and also how the proposed system can be used in a vehicle to help decrease human error in traffic accidents

Pattern Recognition

Pattern recognition is a very wide research field. It involves factors as diverse as sensors, feature extraction, pattern classification, decision fusion, applications and others. The signals processed are commonly one, two or three dimensional, the processing is done in real- time or takes hours and days, some systems look for one narrow object class, others search huge databases for entries with at least a small amount of similarity. No single person can claim expertise across the whole field, which develops rapidly, updates its paradigms and comprehends several philosophical approaches. This book reflects this diversity by presenting a selection of recent developments within the area of pattern recognition and related fields. It covers theoretical advances in classification and feature extraction as well as application-oriented works. Authors of these 25 works present and advocate recent achievements of their research related to the field of pattern recognition

Intelligent Biosignal Analysis Methods

This book describes recent efforts in improving intelligent systems for automatic biosignal analysis. It focuses on machine learning and deep learning methods used for classification of different organism states and disorders based on biomedical signals such as EEG, ECG, HRV, and others

Connectivity Analysis of Brain States and Applications in Brain-Computer Interfaces

Human brain is organized by a large number of functionally correlated but spatially distributed cortical neurons. Cognitive processes are usually associated with dynamic interactions among multiple brain regions. Therefore, the understanding of brain functions requires the inves- tigation of the brain interaction patterns. This thesis contains two main aspects. The first aspect focuses on the neural basis for cognitive processes through the use of brain connectivity analysis. The second part targets on assessing brain connectivity patterns in realistic scenarios, e.g., in-car BCI and stroke patients. In the first part, we explored the neural correlates of error-related brain activity. We recorded scalp electroencephalogram (EEG) from 15 healthy subjects while monitoring the movement of a cursor on a computer screen, yielding particular brain connectivity patterns after monitoring external errors. This supports the presence of common role of medial frontal cortex in coordinating cross-regional activity during brain error processes, independent of their causes, either self-generated or external events. This part also included the investigation of the connectivity during left/right hand motor imagery, including 9 healthy subjects, which demonstrated particular intrahemispheric and interhemispheric information flows in two motor imagery tasks, i.e., the ÎŒ rhythm is highly modulated in intrahemispheric, whereas β and γ are modulated in interhemispheric interactions. This part also explored the neural correlates of reaction time during driving. An experiment with 15 healthy subjects in car simulator was designed, in which they needed to perform lane change to avoid collision with obstacles. Significant neural modulations were found in ERP (event-related potential), PSD (power spectral density), and frontoparietal network, which seems to reflect the underlying information transfer from sensory representation in the parietal cortex to behavioral adjusting in the frontal cortex. In the second part, we first explored the feasibility of using BCI as driving assistant system, in which visual stimuli were presented to evoke error/correct related potentials, and were classified to infer driverâs preferred turning direction. The system was validated in a car simulator with 22 subjects, and 7 joined online tests. The system was also tested in real car, yielding similar brain patterns and comparable classification accuracy. The second part also carried out the brain connectivity analysis in stroke patients.We performed exploratory study to correlate the recovery effects of BCI therapy, through the quantification of connectivity between healthy and lesioned hemispheres. The results indicate the benefits of BCI therapy for stroke patients, i.e., brain connectivity are more similar as healthy patterns, increased (decreased) flow from the damaged (undamaged) to the undamaged (damaged) cortex. Briefly, this thesis presents exploratory studies of brain connectivity analysis, investigating the neural basis of cognitive processes, and its contributions in the decoding phase. In particular, such analysis is not limited to laboratory researches, but also extended to clinical trials and driving scenarios, further supporting the findings observed in the ideal condition

Models and analysis of vocal emissions for biomedical applications: 5th International Workshop: December 13-15, 2007, Firenze, Italy

The MAVEBA Workshop proceedings, held on a biannual basis, collect the scientific papers presented both as oral and poster contributions, during the conference. The main subjects are: development of theoretical and mechanical models as an aid to the study of main phonatory dysfunctions, as well as the biomedical engineering methods for the analysis of voice signals and images, as a support to clinical diagnosis and classification of vocal pathologies. The Workshop has the sponsorship of: Ente Cassa Risparmio di Firenze, COST Action 2103, Biomedical Signal Processing and Control Journal (Elsevier Eds.), IEEE Biomedical Engineering Soc. Special Issues of International Journals have been, and will be, published, collecting selected papers from the conference

Signal Processing Using Non-invasive Physiological Sensors

Non-invasive biomedical sensors for monitoring physiological parameters from the human body for potential future therapies and healthcare solutions. Today, a critical factor in providing a cost-effective healthcare system is improving patients' quality of life and mobility, which can be achieved by developing non-invasive sensor systems, which can then be deployed in point of care, used at home or integrated into wearable devices for long-term data collection. Another factor that plays an integral part in a cost-effective healthcare system is the signal processing of the data recorded with non-invasive biomedical sensors. In this book, we aimed to attract researchers who are interested in the application of signal processing methods to different biomedical signals, such as an electroencephalogram (EEG), electromyogram (EMG), functional near-infrared spectroscopy (fNIRS), electrocardiogram (ECG), galvanic skin response, pulse oximetry, photoplethysmogram (PPG), etc. We encouraged new signal processing methods or the use of existing signal processing methods for its novel application in physiological signals to help healthcare providers make better decisions