Artificial intelligence in health care: enabling informed care

We read with interest the Lancet Editorial on artificial intelligence (AI) in health care (Dec 23, 2017, p 2739).1 Deep learning as a form of AI risks being overhyped. Deep neural networks contain multiple layers of nodes connected by adjustable weights. Learning occurs by adjusting these weights until the desired input-to-output function is achieved.2 With many millions of weights, huge amounts of data are required for learning, a process facilitated by recent increases in computational power. However, the learning algorithm, known as the error back-propagation algorithm, was invented in the 1980s and has been used to train neural networks ever since. Two decades ago, our neural network system scored sleep and diagnosed sleep disorders.3 Our machine learning algorithm,4, 5 which now provides early warning of deterioration in many hospitals, was commercialised a decade ago.6 A key change occurred in the early 2000s. Since then, error back-propagation learns features directly from the input data, rather than relying on expert-selected features (eg, microaneurysms for a neural network assessing diabetic retinopathy). The first layers become implicit feature detectors. The success of deep learning has been shown mainly in problems with inputs of image (or image-like) data, as shown in medical image analysis,7, 8 speech recognition, and board game playing. Deep learning also lacks explanatory power; deep neural networks cannot explain how a diagnosis is reached and the features enabling discrimination are not easily identifiable. Clinicians should be aware of the capabilities as well as current limitations of AI. Properly integrated AI will improve patient outcomes and health-care efficiency. Augmented intelligence at the point of care is likely to precede AI without human involvement. LT and PW are supported by the Biomedical Research Centre, Oxford. Both authors have received funding from the National Institute for Health Research. The authors have developed an electronic observations application for which Drayson Health has purchased a sole licence. Drayson Health has a research agreement with the University of Oxford and has paid LT personal fees for consultancy as a member of its Strategic Advisory Board. Drayson Health might pay PW consultancy fees in the future

Deep Learning-Enabled Sleep Staging From Vital Signs and Activity Measured Using a Near-Infrared Video Camera

Conventional sleep monitoring is time-consuming, expensive and uncomfortable, requiring a large number of contact sensors to be attached to the patient. Video data is commonly recorded as part of a sleep laboratory assessment. If accurate sleep staging could be achieved solely from video, this would overcome many of the problems of traditional methods. In this work we use heart rate, breathing rate and activity measures, all derived from a near-infrared video camera, to perform sleep stage classification. We use a deep transfer learning approach to overcome data scarcity, by using an existing contact-sensor dataset to learn effective representations from the heart and breathing rate time series. Using a dataset of 50 healthy volunteers, we achieve an accuracy of 73.4\% and a Cohen's kappa of 0.61 in four-class sleep stage classification, establishing a new state-of-the-art for video-based sleep staging.Comment: Accepted to the 6th International Workshop on Computer Vision for Physiological Measurement (CVPM) at CVPR 2023. 10 pages, 12 figures, 5 table

Continuous Physiological Monitoring of Ambulatory Patients

A poster originally presented at the "MEC Annual Meeting and Bioengineering14" conference (Imperial College London, 8th - 9th September 2014)

Modelling physiological deterioration in post-operative patient vital-sign data

Patients who undergo upper-gastrointestinal surgery have a high incidence of post-operative complications, often requiring admission to the intensive care unit several days after surgery. A dataset comprising observational vital-sign data from 171 post-operative patients taking part in a two-phase clinical trial at the Oxford Cancer Centre, was used to explore the trajectory of patients’ vital-sign changes during their stay in the post-operative ward using both univariate and multivariate analyses. A model of normality based vital-sign data from patients who had a “normal” recovery was constructed using a kernel density estimate, and tested with “abnormal” data from patients who deteriorated sufficiently to be re-admitted to the intensive care unit. The vital-sign distributions from “normal” patients were found to vary over time from admission to the post-operative ward to their discharge home, but no significant changes in their distributions were observed from halfway through their stay on the ward to the time of discharge. The model of normality identified patient deterioration when tested with unseen “abnormal” data, suggesting that such techniques may be used to provide early warning of adverse physiological events

The Influence of Recording Equipment on the Accuracy of Respiratory Rate Estimation from the Electrocardiogram and Photoplethysmogram

A poster originally presented at the "MEC Annual Meeting and Bioengineering14" conference (Imperial College London, 8th - 9th September 2014)

Estimation of respiratory rate from motion contaminated photoplethysmography signals incorporating accelerometry.

Estimation of respiratory rate (RR) from photoplethysmography (PPG) signals has important applications in the healthcare sector, from assisting doctors onwards to monitoring patients in their own homes. The problem is still very challenging, particularly during the motion for large segments of data, where results from different methods often do not agree. The authors aim to propose a new technique which performs motion reduction from PPG signals with the help of simultaneous acceleration signals where the PPG and accelerometer sensors need to be embedded in the same sensor unit. This method also reconstructs motion corrupted PPG signals in the Hilbert domain. An auto-regressive (AR) based technique has been used to estimate the RR from reconstructed PPGs. The proposed method has provided promising results for the estimation of RRs and their variations from PPG signals corrupted with motion artefact. The proposed platform is able to contribute to continuous in-hospital and home-based monitoring of patients using PPG signals under various conditions such as rest and motion states

Accelerometry-Based Estimation of Respiratory Rate for Post-Intensive Care Patient Monitoring

This paper evaluates the use of accelerometers for continuous monitoring of respiratory rate (RR), which is an important vital sign in post-intensive care patients or those inside the intensive care unit (ICU). The respiratory rate can be estimated from accelerometer and photoplethysmography (PPG) signals for patients following ICU discharge. Due to sensor faults, sensor detachment, and various artifacts arising from motion, RR estimates derived from accelerometry and PPG may not be sufficiently reliable for use with existing algorithms. This paper described a case study of 10 selected patients, for which fewer RR estimates have been obtained from PPG signals in comparison to those from accelerometry. We describe an algorithm for which we show a maximum mean absolute error between estimates derived from PPG and accelerometer of 2.56 breaths/min. Our results obtained using the 10 selected patients are highly promising for estimation of RR from accelerometers, where significant agreements have been observed with the PPG-based RR estimates in many segments and across various patients. We present this research as a step towards producing reliable RR monitoring systems using low-cost mobile accelerometers for monitoring patients inside the ICU or on the ward (post-ICU)

Extraction of respiratory signals from the electrocardiogram and photoplethysmogram: technical and physiological determinants.

OBJECTIVE: Breathing rate (BR) can be estimated by extracting respiratory signals from the electrocardiogram (ECG) or photoplethysmogram (PPG). The extracted respiratory signals may be influenced by several technical and physiological factors. In this study, our aim was to determine how technical and physiological factors influence the quality of respiratory signals. APPROACH: Using a variety of techniques 15 respiratory signals were extracted from the ECG, and 11 from PPG signals collected from 57 healthy subjects. The quality of each respiratory signal was assessed by calculating its correlation with a reference oral-nasal pressure respiratory signal using Pearson's correlation coefficient. MAIN RESULTS: Relevant results informing device design and clinical application were obtained. The results informing device design were: (i) seven out of 11 respiratory signals were of higher quality when extracted from finger PPG compared to ear PPG; (ii) laboratory equipment did not provide higher quality of respiratory signals than a clinical monitor; (iii) the ECG provided higher quality respiratory signals than the PPG; (iv) during downsampling of the ECG and PPG significant reductions in quality were first observed at sampling frequencies of  <250 Hz and  <16 Hz respectively. The results informing clinical application were: (i) frequency modulation-based respiratory signals were generally of lower quality in elderly subjects compared to young subjects; (ii) the qualities of 23 out of 26 respiratory signals were reduced at elevated BRs; (iii) there were no differences associated with gender. SIGNIFICANCE: Recommendations based on the results are provided regarding device designs for BR estimation, and clinical applications. The dataset and code used in this study are publicly available

An impedance pneumography signal quality index: Design, assessment and application to respiratory rate monitoring.

Impedance pneumography (ImP) is widely used for respiratory rate (RR) monitoring. However, ImP-derived RRs can be imprecise. The aim of this study was to develop a signal quality index (SQI) for the ImP signal, and couple it with a RR algorithm, to improve RR monitoring. An SQI was designed which identifies candidate breaths and assesses signal quality using: the variation in detected breath durations, how well peaks and troughs are defined, and the similarity of breath morphologies. The SQI categorises 32 s signal segments as either high or low quality. Its performance was evaluated using two critical care datasets. RRs were estimated from high-quality segments using a RR algorithm, and compared with reference RRs derived from manual annotations. The SQI had a sensitivity of 77.7 %, and specificity of 82.3 %. RRs estimated from segments classified as high quality were accurate and precise, with mean absolute errors of 0.21 and 0.40 breaths per minute (bpm) on the two datasets. Clinical monitor RRs were significantly less precise. The SQI classified 34.9 % of real-world data as high quality. In conclusion, the proposed SQI accurately identifies high-quality segments, and RRs estimated from those segments are precise enough for clinical decision making. This SQI may improve RR monitoring in critical care. Further work should assess it with wearable sensor data.This work was supported by a UK Engineering and Physical Sciences Research Council (EPSRC) Impact Acceleration Award awarded to PHC; the EPSRC [EP/H019944/1]; the Wellcome EPSRC Centre for Medical Engineering at King’s College London [WT 203148/Z/16/Z]; the Oxford and King’s College London Centres of Excellence in Medical Engineering funded by the Wellcome Trust and EPSRC under grants [WT88877/Z/09/Z] and [WT088641/Z/09/Z]; the National Institute for Health Research (NIHR) Biomedical Research Centre based at Guy’s & St Thomas’ NHS Foundation Trust and King’s College London; the NIHR Oxford Biomedical Research Centre Programme; a Royal Academy of Engineering Research Fellowship (RAEng) awarded to DAC; and EPSRC grants EP/P009824/1 and EP/N020774/1 to DAC