Unconstrained video monitoring of breathing behavior and application to diagnosis of sleep apnea

This paper presents a new real-time automated infrared video monitoring technique for detection of breathing anomalies, and its application in the diagnosis of obstructive sleep apnea. We introduce a novel motion model to detect subtle, cyclical breathing signals from video, a new 3-D unsupervised self-adaptive breathing template to learn individuals' normal breathing patterns online, and a robust action classification method to recognize abnormal breathing activities and limb movements. This technique avoids imposing positional constraints on the patient, allowing patients to sleep on their back or side, with or without facing the camera, fully or partially occluded by the bed clothes. Moreover, shallow and abdominal breathing patterns do not adversely affect the performance of the method, and it is insensitive to environmental settings such as infrared lighting levels and camera view angles. The experimental results show that the technique achieves high accuracy (94% for the clinical data) in recognizing apnea episodes and body movements and is robust to various occlusion levels, body poses, body movements (i.e., minor head movement, limb movement, body rotation, and slight torso movement), and breathing behavior (e.g., shallow versus heavy breathing, mouth breathing, chest breathing, and abdominal breathing). © 2013 IEEE

Jefferson Digital Commons quarterly report: January-March 2020

This quarterly report includes: New Look for the Jefferson Digital Commons Articles COVID-19 Working Papers Educational Materials From the Archives Grand Rounds and Lectures JeffMD Scholarly Inquiry Abstracts Journals and Newsletters Master of Public Health Capstones Oral Histories Posters and Conference Presentations What People are Saying About the Jefferson the Digital Common

Portable detection of apnea and hypopnea events using bio-impedance of the chest and deep learning

Sleep apnea is one of the most common sleep-related breathing disorders. It is diagnosed through an overnight sleep study in a specialized sleep clinic. This setup is expensive and the number of beds and staff are limited, leading to a long waiting time. To enable more patients to be tested, and repeated monitoring for diagnosed patients, portable sleep monitoring devices are being developed. These devices automatically detect sleep apnea events in one or more respiration-related signals. There are multiple methods to measure respiration, with varying levels of signal quality and comfort for the patient. In this study, the potential of using the bio-impedance (bioZ) of the chest as a respiratory surrogate is analyzed. A novel portable device is presented, combined with a two-phase Long Short-Term Memory (LSTM) deep learning algorithm for automated event detection. The setup is benchmarked using simultaneous recordings of the device and the traditional polysomnography in 25 patients. The results demonstrate that using only the bioZ, an area under the precision-recall curve of 46.9% can be achieved, which is on par with automatic scoring using a polysomnography respiration channel. The sensitivity, specificity and accuracy are 58.4%, 76.2% and 72.8% respectively. This confirms the potential of using the bioZ device and deep learning algorithm for automatically detecting sleep respiration events during the night, in a portable and comfortable setup

Convolutional Neural Networks for Apnea Detection from Smartphone Audio Signals: Effect of Window Size

Although sleep apnea is one of the most prevalent sleep disorders, most patients remain undiagnosed and untreated. The gold standard for sleep apnea diagnosis, polysomnography, has important limitations such as its high cost and complexity. This leads to a growing need for novel cost-effective systems. Mobile health tools and deep learning algorithms are nowadays being proposed as innovative solutions for automatic apnea detection. In this work, a convolutional neural network (CNN) is trained for the identification of apnea events from the spectrograms of audio signals recorded with a smartphone. A systematic comparison of the effect of different window sizes on the model performance is provided. According to the results, the best models are obtained with 60 s windows (sensitivity-0.72, specilicity-0.89, AUROC = 0.88), For smaller windows, the model performance can be negatively impacted, because the windows become shorter than most apnea events, by which sound reductions can no longer be appreciated. On the other hand, longer windows tend to include multiple or mixed events, that will confound the model. This careful trade-off demonstrates the importance of selecting a proper window size to obtain models with adequate predictive power. This paper shows that CNNs applied to smartphone audio signals can facilitate sleep apnea detection in a realistic setting and is a first step towards an automated method to assist sleep technicians. Clinical Relevance- The results show the effect of the window size on the predictive power of CNNs for apnea detection. Furthermore, the potential of smartphones, audio signals, and deep neural networks for automatic sleep apnea screening is demonstrated

A review of automated sleep disorder detection

Automated sleep disorder detection is challenging because physiological symptoms can vary widely. These variations make it difficult to create effective sleep disorder detection models which support hu-man experts during diagnosis and treatment monitoring. From 2010 to 2021, authors of 95 scientific papers have taken up the challenge of automating sleep disorder detection. This paper provides an expert review of this work. We investigated whether digital technology and Artificial Intelligence (AI) can provide automated diagnosis support for sleep disorders. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines during the content discovery phase. We compared the performance of proposed sleep disorder detection methods, involving differ-ent datasets or signals. During the review, we found eight sleep disorders, of which sleep apnea and insomnia were the most studied. These disorders can be diagnosed using several kinds of biomedical signals, such as Electrocardiogram (ECG), Polysomnography (PSG), Electroencephalogram (EEG), Electromyogram (EMG), and snore sound. Subsequently, we established areas of commonality and distinctiveness. Common to all reviewed papers was that AI models were trained and tested with labelled physiological signals. Looking deeper, we discovered that 24 distinct algorithms were used for the detection task. The nature of these algorithms evolved, before 2017 only traditional Machine Learning (ML) was used. From 2018 onward, both ML and Deep Learning (DL) methods were used for sleep disorder detection. The strong emergence of DL algorithms has considerable implications for future detection systems because these algorithms demand significantly more data for training and testing when compared with ML. Based on our review results, we suggest that both type and amount of labelled data is crucial for the design of future sleep disorder detection systems because this will steer the choice of AI algorithm which establishes the desired decision support. As a guiding principle, more labelled data will help to represent the variations in symptoms. DL algorithms can extract information from these larger data quantities more effectively, therefore; we predict that the role of these algorithms will continue to expand

An explainable deep-learning architecture for pediatric sleep apnea identification from overnight airflow and oximetry signals

Producción CientíficaDeep-learning algorithms have been proposed to analyze overnight airflow (AF) and oximetry (SpO2) signals to simplify the diagnosis of pediatric obstructive sleep apnea (OSA), but current algorithms are hardly interpretable. Explainable artificial intelligence (XAI) algorithms can clarify the models-derived predictions on these signals, enhancing their diagnostic trustworthiness. Here, we assess an explainable architecture that combines convolutional and recurrent neural networks (CNN + RNN) to detect pediatric OSA and its severity. AF and SpO2 were obtained from the Childhood Adenotonsillectomy Trial (CHAT) public database (n = 1,638) and a proprietary database (n = 974). These signals were arranged in 30-min segments and processed by the CNN + RNN architecture to derive the number of apneic events per segment. The apnea-hypopnea index (AHI) was computed from the CNN + RNN-derived estimates and grouped into four OSA severity levels. The Gradient-weighted Class Activation Mapping (Grad-CAM) XAI algorithm was used to identify and interpret novel OSA-related patterns of interest. The AHI regression reached very high agreement (intraclass correlation coefficient > 0.9), while OSA severity classification achieved 4-class accuracies 74.51% and 62.31%, and 4-class Cohen’s Kappa 0.6231 and 0.4495, in CHAT and the private datasets, respectively. All diagnostic accuracies on increasing AHI cutoffs (1, 5 and 10 events/h) surpassed 84%. The Grad-CAM heatmaps revealed that the model focuses on sudden AF cessations and SpO2 drops to detect apneas and hypopneas with desaturations, and often discards patterns of hypopneas linked to arousals. Therefore, an interpretable CNN + RNN model to analyze AF and SpO2 can be helpful as a diagnostic alternative in symptomatic children at risk of OSA.Ministerio de Ciencia e Innovación /AEI/10.13039/501100011033/ FEDER (grants PID2020-115468RB-I00 and PDC2021-120775-I00)CIBER -Consorcio Centro de Investigación Biomédica en Red- (CB19/01/00012), Instituto de Salud Carlos IIINational Institutes of Health (HL083075, HL083129, UL1-RR-024134, UL1 RR024989)National Heart, Lung, and Blood Institute (R24 HL114473, 75N92019R002)Ministerio de Ciencia e Innovación - Agencia Estatal de Investigación- “Ramón y Cajal” grant (RYC2019-028566-I

A 2D convolutional neural network to detect sleep apnea in children using airflow and oximetry

Producción CientíficaThe gold standard approach to diagnose obstructive sleep apnea (OSA) in children is overnight in-lab polysomnography (PSG), which is labor-intensive for clinicians and onerous to healthcare systems and families. Simplification of PSG should enhance availability and comfort, and reduce complexity and waitlists. Airflow (AF) and oximetry (SpO2) signals summarize most of the information needed to detect apneas and hypopneas, but automatic analysis of these signals using deep-learning algorithms has not been extensively investigated in the pediatric context. The aim of this study was to evaluate a convolutional neural network (CNN) architecture based on these two signals to estimate the severity of pediatric OSA. PSG-derived AF and SpO2 signals from the Childhood Adenotonsillectomy Trial (CHAT) database (1638 recordings), as well as from a clinical database (974 recordings), were analyzed. A 2D CNN fed with AF and SpO2 signals was implemented to estimate the number of apneic events, and the total apnea-hypopnea index (AHI) was estimated. A training-validation-test strategy was used to train the CNN, adjust the hyperparameters, and assess the diagnostic ability of the algorithm, respectively. Classification into four OSA severity levels (no OSA, mild, moderate, or severe) reached 4-class accuracy and Cohen's Kappa of 72.55% and 0.6011 in the CHAT test set, and 61.79% and 0.4469 in the clinical dataset, respectively. Binary classification accuracy using AHI cutoffs 1, 5 and 10 events/h ranged between 84.64% and 94.44% in CHAT, and 84.10%–90.26% in the clinical database. The proposed CNN-based architecture achieved high diagnostic ability in two independent databases, outperforming previous approaches that employed SpO2 signals alone, or other classical feature-engineering approaches. Therefore, analysis of AF and SpO2 signals using deep learning can be useful to deploy reliable computer-aided diagnostic tools for childhood OSA.Ministerio de Ciencia, Innovación y Universidades - Agencia Estatal de Investigación (project 10.13039/501100011033)Fondo Europeo de Desarrollo Regional - Unión Europea (projects PID2020-115468RB-I00 and PDC2021-120775-I00)Sociedad Española de Neumología y Cirugía Torácica (project 649/2018)Sociedad Española de Sueño (project Beca de Investigación SES 2019)Consorcio Centro de Investigación Biomédica en Red - Instituto de Salud Carlos III - Ministerio de Ciencia, Innovación y Universidades (project CB19/01/00012)National Institutes of Health (projects HL083075, HL083129, UL1-RR-024134 and UL1 RR024989)National Heart, Lung, and Blood Institute (projects R24 HL114473 and 75N92019R002)Ministerio de Educación, Cultura y Deporte (grant FPU16/02938)Ministerio de Ciencia, Innovación y Universidades - Agencia Estatal de Investigación - Fondo Social Europeo (grant RYC2019-028566-I)National Institutes of Health (grants HL130984, HL140548, and AG061824