Real-life stress level monitoring using smart bands in the light of contextual information

An automatic stress detection system that uses unobtrusive smart bands will contribute to human health and well-being by alleviating the effects of high stress levels. However, there are a number of challenges for detecting stress in unrestricted daily life which results in lower performances of such systems when compared to semi-restricted and laboratory environment studies. The addition of contextual information such as physical activity level, activity type and weather to the physiological signals can improve the classification accuracies of these systems. We developed an automatic stress detection system that employs smart bands for physiological data collection. In this study, we monitored the stress levels of 16 participants of an EU project training every day throughout the eight days long event by using our system. We collected 1440 hours of physiological data and 2780 self-report questions from the participants who are from diverse countries. The project midterm presentations (see Figure 3) in front of a jury at the end of the event were the source of significant real stress. Different types of contextual information, along with the physiological data, were recorded to determine the perceived stress levels of individuals. We further analyze the physiological signals in this event to infer long term perceived stress levels which we obtained from baseline PSS-14 questionnaires. Session-based, daily and long-term perceived stress levels could be identified by using the proposed system successfully

An Empirical Study Comparing Unobtrusive Physiological Sensors for Stress Detection in Computer Work.

Several unobtrusive sensors have been tested in studies to capture physiological reactions to stress in workplace settings. Lab studies tend to focus on assessing sensors during a specific computer task, while in situ studies tend to offer a generalized view of sensors' efficacy for workplace stress monitoring, without discriminating different tasks. Given the variation in workplace computer activities, this study investigates the efficacy of unobtrusive sensors for stress measurement across a variety of tasks. We present a comparison of five physiological measurements obtained in a lab experiment, where participants completed six different computer tasks, while we measured their stress levels using a chest-band (ECG, respiration), a wristband (PPG and EDA), and an emerging thermal imaging method (perinasal perspiration). We found that thermal imaging can detect increased stress for most participants across all tasks, while wrist and chest sensors were less generalizable across tasks and participants. We summarize the costs and benefits of each sensor stream, and show how some computer use scenarios present usability and reliability challenges for stress monitoring with certain physiological sensors. We provide recommendations for researchers and system builders for measuring stress with physiological sensors during workplace computer use

Brainatwork: Logging Cognitive Engagement and Tasks in the Workplace Using Electroencephalography

Today's workplaces are dynamic and complex. Digital data sources such as email and video conferencing aim to support workers but also add to their burden of multitasking. Psychophysiological sensors such as Electroencephalography (EEG) can provide users with cues about their cognitive state. We introduce BrainAtWork, a workplace engagement and task logger which shows users their cognitive state while working on different tasks. In a lab study with eleven participants working on their own real-world tasks, we gathered 16 hours of EEG and PC logs which were labeled into three classes: central, peripheral and meta work. We evaluated the usability of BrainAtWork via questionnaires and interviews. We investigated the correlations between measured cognitive engagement from EEG and subjective responses from experience sampling probes. Using random forests classification, we show the feasibility of automatically labeling work tasks into work classes. We discuss how BrainAtWork can support workers on the long term through encouraging reflection and helping in task scheduling

Neurophysiological Assessment of Affective Experience

In the field of Affective Computing the affective experience (AX) of the user during the interaction with computers is of great interest. The automatic recognition of the affective state, or emotion, of the user is one of the big challenges. In this proposal I focus on the affect recognition via physiological and neurophysiological signals. Long‐standing evidence from psychophysiological research and more recently from research in affective neuroscience suggests that both, body and brain physiology, are able to indicate the current affective state of a subject. However, regarding the classification of AX several questions are still unanswered. The principal possibility of AX classification was repeatedly shown, but its generalisation over different task contexts, elicitating stimuli modalities, subjects or time is seldom addressed. In this proposal I will discuss a possible agenda for the further exploration of physiological and neurophysiological correlates of AX over different elicitation modalities and task contexts

Automatic Measurement of Affect in Dimensional and Continuous Spaces: Why, What, and How?

This paper aims to give a brief overview of the current state-of-the-art in automatic measurement of affect signals in dimensional and continuous spaces (a continuous scale from -1 to +1) by seeking answers to the following questions: i) why has the field shifted towards dimensional and continuous interpretations of affective displays recorded in real-world settings? ii) what are the affect dimensions used, and the affect signals measured? and iii) how has the current automatic measurement technology been developed, and how can we advance the field

Emotions in context: examining pervasive affective sensing systems, applications, and analyses

Pervasive sensing has opened up new opportunities for measuring our feelings and understanding our behavior by monitoring our affective states while mobile. This review paper surveys pervasive affect sensing by examining and considering three major elements of affective pervasive systems, namely; “sensing”, “analysis”, and “application”. Sensing investigates the different sensing modalities that are used in existing real-time affective applications, Analysis explores different approaches to emotion recognition and visualization based on different types of collected data, and Application investigates different leading areas of affective applications. For each of the three aspects, the paper includes an extensive survey of the literature and finally outlines some of challenges and future research opportunities of affective sensing in the context of pervasive computing

Predict Daily Life Stress based on Heart Rate Variability

Department of Human Factors EngineeringThe purpose of this study is to investigate the feasibility of predicting a daily mental stress level from analyzing Heart Rate Variability (HRV) by using a Photoplethysmography (PPG) sensor which is integrated in the wristband-type wearable device. In this experiment, each participant was asked to measure their own PPG signals for 30 seconds, three times a day (at noon, 6 P.M, and 10 minutes before going to sleep) for a week. And 10 minutes before going to sleep, all participants were asked to self-evaluate their own daily mental stress level using Perceived Stress Scale (PSS). The recorded signals were transmitted and stored at each participant???s smartphone via Bluetooth Low Energy (BLE) communication by own-made mobile application. The preprocessing procedure was used to remove PPG signal artifacts in order to make better performance for detecting each pulse peak point at PPG signal. In this preprocessing, three- level-bandpass filtering which consisted three different pass band range bandpass filters was used. In this study, frequency domain HRV analysis feature that the ratio of low-frequency (0.04Hz ~ 0.15Hz) to high-frequency (0.15Hz ~ 0.4Hz) power value was used. In frequency domain analysis, autoregressive (AR) model was used, because this model has higher resolution than that of Fast Fourier Transform (FFT). The accuracy of this prediction was 86.35% on average of all participants. Prediction result was calculated from the leave-one-out validation. The IoT home appliances are arranged according to the result of this prediction algorithm. This arrangement is offering optimized user???s relaxation. Also, this algorithm can help acute stress disorder patients to concentrate on getting treatment.clos