Spatio-temporal analysis of blood perfusion by imaging photoplethysmography

Imaging photoplethysmography (iPPG) has attracted much attention over the last years. The vast majority of works focuses on methods to reliably extract the heart rate from videos. Only a few works addressed iPPGs ability to exploit spatio-temporal perfusion pattern to derive further diagnostic statements. This work directs at the spatio-temporal analysis of blood perfusion from videos. We present a novel algorithm that bases on the two-dimensional representation of the blood pulsation (perfusion map). The basic idea behind the proposed algorithm consists of a pairwise estimation of time delays between photoplethysmographic signals of spatially separated regions. The probabilistic approach yields a parameter denoted as perfusion speed. We compare the perfusion speed versus two parameters, which assess the strength of blood pulsation (perfusion strength and signal to noise ratio). Preliminary results using video data with different physiological stimuli (cold pressure test, cold face test) show that all measures are in fluenced by those stimuli (some of them with statistical certainty). The perfusion speed turned out to be more sensitive than the other measures in some cases. However, our results also show that the intraindividual stability and interindividual comparability of all used measures remain critical points. This work proves the general feasibility of employing the perfusion speed as novel iPPG quantity. Future studies will address open points like the handling of ballistocardiographic effects and will try to deepen the understanding of the predominant physiological mechanisms and their relation to the algorithmic performance

Automated Remote Pulse Oximetry System (ARPOS)

Funding: This research is funded by the School of Computer Science and by St Leonard’s Postgraduate College Doctoral Scholarship, both at the University of St Andrews for Pireh Pirzada’s PhD. Early work was funded by the Digital Health & Care Innovation Centre (DHI).Current methods of measuring heart rate (HR) and oxygen levels (SPO2) require physical contact, are individualised, and for accurate oxygen levels may also require a blood test. No-touch or non-invasive technologies are not currently commercially available for use in healthcare settings. To date, there has been no assessment of a system that measures HR and SPO2 using commercial off-the-shelf camera technology that utilises R, G, B and IR data. Moreover, no formal remote photoplethysmography studies have been done in real life scenarios with participants at home with different demographic characteristics. This novel study addresses all these objectives by developing, optimising, and evaluating a system that measures the HR and SPO2 of 40 participants. HR and SPO2 are determined by measuring the frequencies from different wavelength band regions using FFT and radiometric measurements after pre-processing face regions of interest (forehead, lips, and cheeks) from Colour, IR and Depth data. Detrending, interpolating, hamming, and normalising the signal with FastICA produced the lowest RMSE of 7.8 for HR with the r-correlation value of 0.85 and RMSE 2.3 for SPO2. This novel system could be used in several critical care settings, including in care homes and in hospitals and prompt clinical intervention as required.Publisher PDFPeer reviewe

VOLUNTARY CONTROL OF BREATHING ACCORDING TO THE BREATHING PATTERN DURING LISTENING TO MUSIC AND NON-CONTACT MEASUREMENT OF HEART RATE AND RESPIRATION

We investigated if listening to songs changes breathing pattern which changes autonomic responses such as heart rate (HR) and heart rate variability (HRV) or change in breathing pattern is a byproduct of listening to songs or change in breathing pattern as well as listening to songs causes changes in autonomic responses. Seven subjects (4 males and 3 females) participated in a pilot study where they listened to two types of songs and used a custom developed biofeedback program to control their breathing pattern to match the one recorded during listening to the songs. Coherencies between EEG, breathing pattern and RR intervals (RRI) were calculated to study the interaction with neural responses. Trends in HRV varied only during listening to songs, suggesting that autonomic response was affected by listening to songs irrespective of control of breathing. Effective coherence during songs while spontaneously breathing was more than during silence and during control of breathing. These results, although preliminary, suggest that listening to songs as well as change in breathing patterns changes the autonomic response but the effect of listening to songs may surpass the effect of changes in breathing. We explored feasibility of using non-contact measurements of HR and breathing rate (BR) by using recently developed Facemesh and other methods for tracking regions of interests from videos of faces of subjects. Performance was better for BR than HR, and over currently used methods. However, refinement of the approach would be needed to get the precision required for detecting subtle changes

Signal processing techniques for cardiovascular monitoring applications using conventional and video-based photoplethysmography

Photoplethysmography (PPG)-based monitoring devices will probably play a decisive role in healthcare environment of the future, which will be preventive, predictive, personalized and participatory. Indeed, this optical technology presents several practical advantages over gold standard methods based on electrocardiography, because PPG wearable devices can be comfortably used for long-term continuous monitoring during daily life activities. Contactless video-based PPG technique, also known as imaging photoplethysmography (iPPG), has also attracted much attention recently. In that case, the cardiac pulse is remotely measured from the subtle skin color changes resulting from the blood circulation, using a simple video camera. PPG/iPPG have a lot of potential for a wide range of cardiovascular applications. Hence, there is a substantial need for signal processing techniques to explore these applications and to improve the reliability of the PPG/iPPG-based parameters. \par A part of the thesis is dedicated to the development of robust processing schemes to estimate heart rate from the PPG/iPPG signals. The proposed approaches were built on adaptive frequency tracking algorithms that were previously developed in our group. These tools, based on adaptive band-pass filters, provide instantaneous frequency estimates of the input signal(s) with a very low time delay, making them suitable for real-time applications. In case of conventional PPG, a prior adaptive noise cancellation step involving the use of accelerometer signals was also necessary to reconstruct clean PPG signals during the regions corrupted by motion artifacts. Regarding iPPG, after comparing different regions of interest on the subject face, we hypothesized that the simultaneous use of different iPPG signal derivation methods (i.e. methods to derive the iPPG time series from the pixel values of the consecutive frames) could be advantageous. Methods to assess signal quality online and to incorporate it into instantaneous frequency estimation were also examined and successfully applied to improve system reliability. \par This thesis also explored different innovative applications involving PPG/iPPG signals. The detection of atrial fibrillation was studied. Novel features derived directly from the PPG waveforms, designed to reflect the morphological changes observed during arrhythmic episodes, were proposed and proven to be successful for atrial fibrillation detection. Arrhythmia detection and robust heart rate estimation approaches were combined in another study aimed at reducing the number of false arrhythmia alarms in the intensive care unit by exploiting signals from independent sources, including PPG. Evaluation on a hidden dataset demonstrated that the number of false alarms was drastically reduced while almost no true alarm was suppressed. Finally, other aspects of the iPPG technology were examined, such as the measurement of pulse rate variability indexes from the iPPG signals and the estimation of respiratory rate from the iPPG interbeat intervals