Missing data imputation techniques for wireless continuous vital signs monitoring

Wireless vital signs sensors are increasingly used for remote patient monitoring, but data analysis is often challenged by missing data periods. This study explored the performance of various imputation techniques for continuous vital signs measurements. Wireless vital signs measurements (heart rate, respiratory rate, blood oxygen saturation, axillary temperature) from surgical ward patients were used for repeated random simulation of missing data periods (gaps) of 5–60 min in two-hour windows. Gaps were imputed using linear interpolation, spline interpolation, last observation- and mean carried forwards technique, and cluster-based prognosis. Imputation performance was evaluated using the mean absolute error (MAE) between original and imputed gap samples. Besides, effects on signal features (window’s slope, mean) and early warning scores (EWS) were explored. Gaps were simulated in 1743 data windows, obtained from 52 patients. Although MAE ranges overlapped, median MAE was structurally lowest for linear interpolation (heart rate: 0.9–2.6 beats/min, respiratory rate: 0.8–1.8 breaths/min, temperature: 0.04–0.17 °C, oxygen saturation: 0.3–0.7% for 5–60 min gaps) but up to twice as high for other techniques. Three techniques resulted in larger ranges of signal feature bias compared to no imputation. Imputation led to EWS misclassification in 1–8% of all simulations. Imputation error ranges vary between imputation techniques and increase with gap length. Imputation may result in larger signal feature bias compared to performing no imputation, and can affect patient risk assessment as illustrated by the EWS. Accordingly, careful implementation and selection of imputation techniques is warranted. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10877-023-00975-w

Continuous Monitoring of Vital Signs With Wearable Sensors During Daily Life Activities:Validation Study

BACKGROUND: Continuous telemonitoring of vital signs in a clinical or home setting may lead to improved knowledge of patients’ baseline vital signs and earlier detection of patient deterioration, and it may also facilitate the migration of care toward home. Little is known about the performance of available wearable sensors, especially during daily life activities, although accurate technology is critical for clinical decision-making. OBJECTIVE: The aim of this study is to assess the data availability, accuracy, and concurrent validity of vital sign data measured with wearable sensors in volunteers during various daily life activities in a simulated free-living environment. METHODS: Volunteers were equipped with 4 wearable sensors (Everion placed on the left and right arms, VitalPatch, and Fitbit Charge 3) and 2 reference devices (Oxycon Mobile and iButton) to obtain continuous measurements of heart rate (HR), respiratory rate (RR), oxygen saturation (SpO(2)), and temperature. Participants performed standardized activities, including resting, walking, metronome breathing, chores, stationary cycling, and recovery afterward. Data availability was measured as the percentage of missing data. Accuracy was evaluated by the median absolute percentage error (MAPE) and concurrent validity using the Bland-Altman plot with mean difference and 95% limits of agreement (LoA). RESULTS: A total of 20 volunteers (median age 64 years, range 20-74 years) were included. Data availability was high for all vital signs measured by VitalPatch and for HR and temperature measured by Everion. Data availability for HR was the lowest for Fitbit (4807/13,680, 35.14% missing data points). For SpO(2) measured by Everion, median percentages of missing data of up to 100% were noted. The overall accuracy of HR was high for all wearable sensors, except during walking. For RR, an overall MAPE of 8.6% was noted for VitalPatch and that of 18.9% for Everion, with a higher MAPE noted during physical activity (up to 27.1%) for both sensors. The accuracy of temperature was high for VitalPatch (MAPE up to 1.7%), and it decreased for Everion (MAPE from 6.3% to 9%). Bland-Altman analyses showed small mean differences of VitalPatch for HR (0.1 beats/min [bpm]), RR (−0.1 breaths/min), and temperature (0.5 °C). Everion and Fitbit underestimated HR up to 5.3 (LoA of −39.0 to 28.3) bpm and 11.4 (LoA of −53.8 to 30.9) bpm, respectively. Everion had a small mean difference with large LoA (−10.8 to 10.4 breaths/min) for RR, underestimated SpO(2) (>1%), and overestimated temperature up to 2.9 °C. CONCLUSIONS: Data availability, accuracy, and concurrent validity of the studied wearable sensors varied and differed according to activity. In this study, the accuracy of all sensors decreased with physical activity. Of the tested sensors, VitalPatch was found to be the most accurate and valid for vital signs monitoring

Early Warning Scores to Support Continuous Wireless Vital Sign Monitoring for Complication Prediction in Patients on Surgical Wards:Retrospective Observational Study

Background: Wireless vital sign sensors are increasingly being used to monitor patients on surgical wards. Although early warning scores (EWSs) are the current standard for the identification of patient deterioration in a ward setting, their usefulness for continuous monitoring is unknown.Objective: This study aimed to explore the usability and predictive value of high-rate EWSs obtained from continuous vital sign recordings for early identification of postoperative complications and compares the performance of a sensor-based EWS alarm system with manual intermittent EWS measurements and threshold alarms applied to individual vital sign recordings (single-parameter alarms).Methods: Continuous vital sign measurements (heart rate, respiratory rate, blood oxygen saturation, and axillary temperature) collected with wireless sensors in patients on surgical wards were used for retrospective simulation of EWSs (sensor EWSs) for different time windows (1-240 min), adopting criteria similar to EWSs based on manual vital signs measurements (nurse EWSs). Hourly sensor EWS measurements were compared between patients with (event group: 14/46, 30%) and without (control group: 32/46, 70%) postoperative complications. In addition, alarms were simulated for the sensor EWSs using a range of alarm thresholds (1-9) and compared with alarms based on nurse EWSs and single-parameter alarms. Alarm performance was evaluated using the sensitivity to predict complications within 24 hours, daily alarm rate, and false discovery rate (FDR). Results: The hourly sensor EWSs of the event group (median 3.4, IQR 3.1-4.1) was significantly higher (P&lt;.004) compared with the control group (median 2.8, IQR 2.4-3.2). The alarm sensitivity of the hourly sensor EWSs was the highest (80%-67%) for thresholds of 3 to 5, which was associated with alarm rates of 2 (FDR=85%) to 1.2 (FDR=83%) alarms per patient per day respectively. The sensitivity of sensor EWS–based alarms was higher than that of nurse EWS–based alarms (maximum=40%) but lower than that of single-parameter alarms (87%) for all thresholds. In contrast, the (false) alarm rates of sensor EWS–based alarms were higher than that of nurse EWS–based alarms (maximum=0.6 alarm/patient/d; FDR=80%) but lower than that of single-parameter alarms (2 alarms/patient/d; FDR=84%) for most thresholds. Alarm rates for sensor EWSs increased for shorter time windows, reaching 70 alarms per patient per day when calculated every minute.Conclusions: EWSs obtained using wireless vital sign sensors may contribute to the early recognition of postoperative complications in a ward setting, with higher alarm sensitivity compared with manual EWS measurements. Although hourly sensor EWSs provide fewer alarms compared with single-parameter alarms, high false alarm rates can be expected when calculated over shorter time spans. Further studies are recommended to optimize care escalation criteria for continuous monitoring of vital signs in a ward setting and to evaluate the effects on patient outcomes.</p

Surveillance of high-risk early postsurgical patients for real-time detection of complications using wireless monitoring (SHEPHERD study):results of a randomized multicenter stepped wedge cluster trial

Background: Vital signs measurements on the ward are performed intermittently. This could lead to failure to rapidly detect patients with deteriorating vital signs and worsens long-term outcome. The aim of this study was to test the hypothesis that continuous wireless monitoring of vital signs on the postsurgical ward improves patient outcome. Methods: In this prospective, multicenter, stepped-wedge cluster randomized study, patients in the control group received standard monitoring. The intervention group received continuous wireless monitoring of heart rate, respiratory rate and temperature on top of standard care. Automated alerts indicating vital signs deviation from baseline were sent to ward nurses, triggering the calculation of a full early warning score followed. The primary outcome was the occurrence of new disability three months after surgery. Results: The study was terminated early (at 57% inclusion) due to COVID-19 restrictions. Therefore, only descriptive statistics are presented. A total of 747 patients were enrolled in this study and eligible for statistical analyses, 517 patients in the control group and 230 patients in the intervention group, the latter only from one hospital. New disability at three months after surgery occurred in 43.7% in the control group and in 39.1% in the intervention group (absolute difference 4.6%). Conclusion: This is the largest randomized controlled trial investigating continuous wireless monitoring in postoperative patients. While patients in the intervention group seemed to experience less (new) disability than patients in the control group, results remain inconclusive with regard to postoperative patient outcome due to premature study termination. Clinical trial registration: ClinicalTrials.gov, ID: NCT02957825.</p

Remote vital signs monitoring for early detection of deterioration after surgery

With the growing availability of wireless vital signs monitoring systems, opportunities for remote and continuous monitoring of patients within and outside the hospital arise. In surgical patients, remote vital sign monitoring may support improved recognition of postoperative complications and contribute to better patient outcomes and care efficiency. This thesis aimed to explore the desired design and expected clinical impact of remote vital signs monitoring strategies in surgical patients and to evaluate the performance of currently available remote sensing and decision-support techniques. Based on the results of our studies, we concluded that care professionals see opportunities to implement remote monitoring as an alternative or supplement to current in-hospital monitoring. Remote vital signs monitoring is expected to contribute to early detection of clinical deterioration in high-risk surgical patients in a ward or out-of-hospital setting and can allow early hospital dismissal, but only under certain circumstances and with suitable technology. Currently available wearable systems can monitor a selection of vital signs, but the measurement accuracy and reliability vary between systems and between vital parameters. Although imputation techniques may support further data analysis in case of missing data periods, we found that imputation errors vary strongly within and between imputation techniques and can affect clinical decision-making. Last, we showed that alarm systems that use adaptive thresholds or Early Warning Scores for the detection of abnormalities in continuous vital signs data may support early identification of complications in postoperative ward patients and perform better than classical single-parameter alarm systems, but also bring a serious risk of excessive false alarm rates. Careful selection and further improvement of sensing and data preprocessing techniques, decision-support methodology, and alarm settings are therefore warranted to ensure effective, reliable, and efficient patient monitoring

Predicting deterioration of patients with early sepsis at the emergency department using continuous heart rate variability analysis: a model-based approach

BACKGROUND: Sepsis is a life-threatening disease with an in-hospital mortality rate of approximately 20%. Physicians at the emergency department (ED) have to estimate the risk of deterioration in the coming hours or days and decide whether the patient should be admitted to the general ward, ICU or can be discharged. Current risk stratification tools are based on measurements of vital parameters at a single timepoint. Here, we performed a time, frequency, and trend analysis on continuous electrocardiograms (ECG) at the ED to try and predict deterioration of septic patients. METHODS: Patients were connected to a mobile bedside monitor that continuously recorded ECG waveforms from triage at the ED up to 48 h. Patients were post-hoc stratified into three groups depending on the development of organ dysfunction: no organ dysfunction, stable organ dysfunction or progressive organ dysfunction (i.e., deterioration). Patients with de novo organ dysfunction and those admitted to the ICU or died were also stratified to the group of progressive organ dysfunction. Heart rate variability (HRV) features over time were compared between the three groups. RESULTS: In total 171 unique ED visits with suspected sepsis were included between January 2017 and December 2018. HRV features were calculated over 5-min time windows and summarized into 3-h intervals for analysis. For each interval, the mean and slope of each feature was calculated. Of all analyzed features, the average of the NN-interval, ultra-low frequency, very low frequency, low frequency and total power were different between the groups at multiple points in time. CONCLUSIONS: We showed that continuous ECG recordings can be automatically analyzed and used to extract HRV features associated with clinical deterioration in sepsis. The predictive accuracy of our current model based on HRV features derived from the ECG only shows the potential of HRV measurements at the ED. Unlike other risk stratification tools employing multiple vital parameters this does not require manual calculation of the score and can be used on continuous data over time. Trial registration The protocol of this study is published by Quinten et al., 2017

Adaptive threshold-based alarm strategies for continuous vital signs monitoring

Continuous vital signs monitoring in post-surgical ward patients may support early detection of clinical deterioration, but novel alarm approaches are required to ensure timely notification of abnormalities and prevent alarm-fatigue. The current study explored the performance of classical and various adaptive threshold-based alarm strategies to warn for vital sign abnormalities observed during development of an adverse event. A classical threshold-based alarm strategy used for continuous vital signs monitoring in surgical ward patients was evaluated retrospectively. Next, (combinations of) six methods to adapt alarm thresholds to personal or situational factors were simulated in the same dataset. Alarm performance was assessed using the overall alarm rate and sensitivity to detect adverse events. Using a wireless patch-based monitoring system, 3999 h of vital signs data was obtained in 39 patients. The clinically used classical alarm system produced 0.49 alarms/patient/day, and alarms were generated for 11 out of 18 observed adverse events. Each of the tested adaptive strategies either increased sensitivity to detect adverse events or reduced overall alarm rate. Combining specific strategies improved overall performance most and resulted in earlier presentation of alarms in case of adverse events. Strategies that adapt vital sign alarm thresholds to personal or situational factors may improve early detection of adverse events or reduce alarm rates as compared to classical alarm strategies. Accordingly, further investigation of the potential of adaptive alarms for continuous vital signs monitoring in ward patients is warranted