Predict Daily Life Stress based on Heart Rate Variability

Department of Human Factors EngineeringThe purpose of this study is to investigate the feasibility of predicting a daily mental stress level from analyzing Heart Rate Variability (HRV) by using a Photoplethysmography (PPG) sensor which is integrated in the wristband-type wearable device. In this experiment, each participant was asked to measure their own PPG signals for 30 seconds, three times a day (at noon, 6 P.M, and 10 minutes before going to sleep) for a week. And 10 minutes before going to sleep, all participants were asked to self-evaluate their own daily mental stress level using Perceived Stress Scale (PSS). The recorded signals were transmitted and stored at each participant???s smartphone via Bluetooth Low Energy (BLE) communication by own-made mobile application. The preprocessing procedure was used to remove PPG signal artifacts in order to make better performance for detecting each pulse peak point at PPG signal. In this preprocessing, three- level-bandpass filtering which consisted three different pass band range bandpass filters was used. In this study, frequency domain HRV analysis feature that the ratio of low-frequency (0.04Hz ~ 0.15Hz) to high-frequency (0.15Hz ~ 0.4Hz) power value was used. In frequency domain analysis, autoregressive (AR) model was used, because this model has higher resolution than that of Fast Fourier Transform (FFT). The accuracy of this prediction was 86.35% on average of all participants. Prediction result was calculated from the leave-one-out validation. The IoT home appliances are arranged according to the result of this prediction algorithm. This arrangement is offering optimized user???s relaxation. Also, this algorithm can help acute stress disorder patients to concentrate on getting treatment.clos

Investigation of Lower-limb Tissue Perfusion during Loading

An extant tissue indentor used for amputee residual limb tissue indentation studies was modified to include laser Doppler flowmetry (LDF) to enable measurement of tissue perfusion during indentation. This device allows quantitative assessment of the mechanical and physiological response of soft tissues to load, as demonstrated by indentation studies of the lower-limb tissues of young healthy subjects. Potential measures of interest include the relative change in tissue perfusion with load and the time delays associated with the perfusion response during tissue loading and unloading. Such measures may prove useful in future studies of residual limb tissues, improving our understanding of tissue viability risk factors for individuals with lower-limb amputation

Assessing mental stress from the photoplethysmogram: a numerical study.

OBJECTIVE: Mental stress is detrimental to cardiovascular health, being a risk factor for coronary heart disease and a trigger for cardiac events. However, it is not currently routinely assessed. The aim of this study was to identify features of the photoplethysmogram (PPG) pulse wave which are indicative of mental stress. APPROACH: A numerical model of pulse wave propagation was used to simulate blood pressure signals, from which simulated PPG pulse waves were estimated using a transfer function. Pulse waves were simulated at six levels of stress by changing the model input parameters both simultaneously and individually, in accordance with haemodynamic changes associated with stress. Thirty-two feature measurements were extracted from pulse waves at three measurement sites: the brachial, radial and temporal arteries. Features which changed significantly with stress were identified using the Mann-Kendall monotonic trend test. MAIN RESULTS: Seventeen features exhibited significant trends with stress in measurements from at least one site. Three features showed significant trends at all three sites: the time from pulse onset to peak, the time from the dicrotic notch to pulse end, and the pulse rate. More features showed significant trends at the radial artery (15) than the brachial (8) or temporal (7) arteries. Most features were influenced by multiple input parameters. SIGNIFICANCE: The features identified in this study could be used to monitor stress in healthcare and consumer devices. Measurements at the radial artery may provide superior performance than the brachial or temporal arteries. In vivo studies are required to confirm these observations

Live Biofeedback as a User Interface Design Element: A Review of the Literature

With the advances in sensor technology and real-time processing of neurophysiological data, a growing body of academic literature has begun to explore how live biofeedback can be integrated into information systems for everyday use. While researchers have traditionally studied live biofeedback in the clinical domain, the proliferation of affordable mobile sensor technology enables researchers and practitioners to consider live biofeedback as a user interface element in contexts such as decision support, education, and gaming. In order to establish the current state of research on live biofeedback, we conducted a literature review on studies that examine self and foreign live biofeedback based on neurophysiological data for healthy subjects in an information systems context. By integrating a body of highly fragmented work from computer science, engineering and technology, information systems, medical science, and psychology, this paper synthesizes results from existing research, identifies knowledge gaps, and suggests directions for future research. In this vein, this review can serve as a reference guide for researchers and practitioners on how to integrate self and foreign live biofeedback into information systems for everyday use

Machine Learning Models for Mental Stress Classification based on Multimodal Biosignal Input

Mental stress is a largely prevalent condition directly or indirectly responsible for almost half of all work-related diseases. Work-Related Stress is the second most impactful occupational health problem in Europe, behind musculoskeletal diseases. When mental health is adequately handled, a worker’s well-being, performance, and productivity can be considerably improved. This thesis presents machine learning models to classify mental stress experienced by computer users using physiological signals including heart rate, acquired using a smart- watch; respiration, derived from a smartphone’s acc placed on the chest; and trapezius electromyography, using proprietary electromyography sensors. Two interactive proto- cols were implemented to collect data from 12 individuals. Time and frequency domain features were extracted from the heart rate and electromyography signals, and statistical and temporal features were extracted from the derived respiration signal. Three algorithms: Support Vector Machine, Random Forest, and K-Nearest-Neighbor were employed for mental stress classification. Different input modalities were tested for the machine learning models: one for each physiological signal and a multimodal one, combining all of them. Random Forest obtained the best mean accuracy (98.5%) for the respiration model whereas K-Nearest-Neighbor attained higher mean accuracies for the heart rate (89.0%) left, right and total electromyography (98.9%, 99.2%, and 99.3%) models. KNN algorithm was also able to achieve 100% mean accuracy for the multimodal model. A possible future approach would be to validate these models in real-time.O stress mental é uma condição amplamente prevalente direta ou indiretamente responsável por quase metade de todas doenças relacionadas com trabalho. O stress expe- rienciado no trabalho é o segundo problema de saúde ocupacional com maior impacto na Europa, depois das doenças músculo-esqueléticas. Quando a saúde mental é adequada- mente cuidada, o bem-estar, o desempenho e a produtividade de um trabalhador podem ser consideravelmente melhorados. Esta tese apresenta modelos de aprendizagem automática que classificam o stress mental experienciado por utilizadores de computadores recorrendo a sinais fisiológi- cos, incluindo a frequência cardíaca, adquirida pelo sensor de fotopletismografia de um smartwatch; a respiração, derivada de um acelerómetro incorporado no smartphone po- sicionado no peito; e electromiografia de cada um dos músculos trapézios, utilizando sensores electromiográficos proprietários. Foram implementados dois protocolos inte- ractivos para recolha de dados de 12 indivíduos. Características do domínio temporal e de frequência foram extraídas dos sinais de frequência cardíaca e electromiografia, e características estatísticas e temporais foram extraídas do sinal respiratório. Três algoritmos entitulados K-Nearest-Neighbor, Random Forest, e Support Vector Machine foram utilizados para a classificação do stress mental. Foram testadas diferentes modalidades de dados para os modelos de aprendizagem automática: uma para cada sinal fisiológico e uma multimodal, combinando os três. O Random Forest obteve a melhor precisão média (98,5%) para o modelo de respiração enquanto que o K-Nearest-Neighbor atingiu uma maior precisão média nos modelos de frequência cardíaca (89,0%) e electro- miografia esquerda, direita e total (98,9%, 99,2%, e 99,3%). O algoritmo KNN conseguiu ainda atingir uma precisão média de 100% para o modelo multimodal. Uma possível abordagem futura seria efetuar uma validação destes modelos em tempo real

Effectiveness of Music-Based Respiratory Biofeedback in Reducing Stress during Visually Demanding Tasks

Biofeedback techniques have shown to be effective to manage stress and improve task performance. Biofeedback generally can be divided into two steps (i) measuring physiological functions (e.g. respiration, heart rate) via sensors and (ii) conveying the physiological signals to the user to improve self-awareness. Current systems require costly and invasive sensors to measure physiology, which are not comfortable and are not readily accessible to the general population. Additionally, current feedback mechanisms may be physically unpleasant or may hinder multitasking, especially in visually-demanding environments. To overcome these problems, we developed two tools: a music-based biofeedback tool that uses music as the medium of feedback, and a tool to measure breathing rate using a smartphone camera. The music biofeedback tool encourages slow breathing by adjusting the quality of the music in response to the user’s breathing rate. This intervention combines the benefits of biofeedback and music to help users regulate their stress response while performing a visual task (driving a car simulator). We evaluate the intervention on a 2×2 design with music and auditory biofeedback as independent variables. Our results indicate that music-biofeedback leads to lower arousal (as measured by electrodermal activity and heart rate variability) than music alone, auditory biofeedback alone, and a control condition. Music biofeedback also reduces driving errors when compared to the other three conditions. While our results suggest that the music-based biofeedback tool is useful and enjoyable, it still requires expensive physiological sensors which are intrusive in nature. Hence, we present a second tool to measure breathing rate in real-time via smartphone camera, which makes it easily accessible given the pervasiveness of smartphones. Our algorithm measures breathing rate by obtaining the photoplethysmographic signal and performing spectral analysis using Goertzel algorithm. We validated the method under a range of controlled breathing rate conditions, and our results show a high degree of agreement between our estimates and ground truth measurements obtained via standard respiratory sensors. These results show that it is possible to accurately compute breathing rate in real-time using a smartphone

CardioCam: Leveraging Camera on Mobile Devices to Verify Users While Their Heart is Pumping

With the increasing prevalence of mobile and IoT devices (e.g., smartphones, tablets, smart-home appliances), massive private and sensitive information are stored on these devices. To prevent unauthorized access on these devices, existing user verification solutions either rely on the complexity of user-defined secrets (e.g., password) or resort to specialized biometric sensors (e.g., fingerprint reader), but the users may still suffer from various attacks, such as password theft, shoulder surfing, smudge, and forged biometrics attacks. In this paper, we propose, CardioCam, a low-cost, general, hard-to-forge user verification system leveraging the unique cardiac biometrics extracted from the readily available built-in cameras in mobile and IoT devices. We demonstrate that the unique cardiac features can be extracted from the cardiac motion patterns in fingertips, by pressing on the built-in camera. To mitigate the impacts of various ambient lighting conditions and human movements under practical scenarios, CardioCam develops a gradient-based technique to optimize the camera configuration, and dynamically selects the most sensitive pixels in a camera frame to extract reliable cardiac motion patterns. Furthermore, the morphological characteristic analysis is deployed to derive user-specific cardiac features, and a feature transformation scheme grounded on Principle Component Analysis (PCA) is developed to enhance the robustness of cardiac biometrics for effective user verification. With the prototyped system, extensive experiments involving 25 subjects are conducted to demonstrate that CardioCam can achieve effective and reliable user verification with over 99% average true positive rate (TPR) while maintaining the false positive rate (FPR) as low as 4%