Smile: a system to support machine learning on EEG data at scale

© 2019 VLDB Endowment. In order to reduce the possibility of neural injury from seizures and sidestep the need for a neurologist to spend hours on manually reviewing the EEG recording, it is critical to automatically detect and classify "interictal-ictal continuum" (IIC) patterns from EEG data. However, the existing IIC classification techniques are shown to be not accurate and robust enough for clinical use because of the lack of high quality labels of EEG segments as training data. Obtaining high-quality labeled data is traditionally a manual process by trained clinicians that can be tedious, time-consuming, and errorprone. In this work, we propose Smile, an industrial scale system that provides an end-to-end solution to the IIC pattern classification problem. The core components of Smile include a visualizationbased time series labeling module and a deep-learning based active learning module. The labeling module enables the users to explore and label 350 million EEG segments (30TB) at interactive speed. The multiple coordinated views allow the users to examine the EEG signals from both time domain and frequency domain simultaneously. The active learning module first trains a deep neural network that automatically extracts both the local features with respect to each segment itself and the long term dynamics of the EEG signals to classify IIC patterns. Then leveraging the output of the deep learning model, the EEG segments that can best improve the model are selected and prompted to clinicians to label. This process is iterated until the clinicians and the models show high degree of agreement. Our initial experimental results show that our Smile system allows the clinicians to label the EEG segments at will with a response time below 500 ms. The accuracy of the model is progressively improved as more and more high quality labels are acquired over time

Wearable Seismocardiography‐Based Assessment of Stroke Volume in Congenital Heart Disease

Background Patients with congenital heart disease (CHD) are at risk for the development of low cardiac output and other physiologic derangements, which could be detected early through continuous stroke volume (SV) measurement. Unfortunately, existing SV measurement methods are limited in the clinic because of their invasiveness (eg, thermodilution), location (eg, cardiac magnetic resonance imaging), or unreliability (eg, bioimpedance). Multimodal wearable sensing, leveraging the seismocardiogram, a sternal vibration signal associated with cardiomechanical activity, offers a means to monitoring SV conveniently, affordably, and continuously. However, it has not been evaluated in a population with significant anatomical and physiological differences (ie, children with CHD) or compared against a true gold standard (ie, cardiac magnetic resonance). Here, we present the feasibility of wearable estimation of SV in a diverse CHD population (N=45 patients). Methods and Results We used our chest‐worn wearable biosensor to measure baseline ECG and seismocardiogram signals from patients with CHD before and after their routine cardiovascular magnetic resonance imaging, and derived features from the measured signals, predominantly systolic time intervals, to estimate SV using ridge regression. Wearable signal features achieved acceptable SV estimation (28% error with respect to cardiovascular magnetic resonance imaging) in a held‐out test set, per cardiac output measurement guidelines, with a root‐mean‐square error of 11.48 mL and R2 of 0.76. Additionally, we observed that using a combination of electrical and cardiomechanical features surpassed the performance of either modality alone. Conclusions A convenient wearable biosensor that estimates SV enables remote monitoring of cardiac function and may potentially help identify decompensation in patients with CHD

Automated Annotation of Epileptiform Burden and Its Association with Outcomes

OBJECTIVE: This study was undertaken to determine the dose-response relation between epileptiform activity burden and outcomes in acutely ill patients. METHODS: A single center retrospective analysis was made of 1,967 neurologic, medical, and surgical patients who underwent \u3e16 hours of continuous electroencephalography (EEG) between 2011 and 2017. We developed an artificial intelligence algorithm to annotate 11.02 terabytes of EEG and quantify epileptiform activity burden within 72 hours of recording. We evaluated burden (1) in the first 24 hours of recording, (2) in the 12-hours epoch with highest burden (peak burden), and (3) cumulatively through the first 72 hours of monitoring. Machine learning was applied to estimate the effect of epileptiform burden on outcome. Outcome measure was discharge modified Rankin Scale, dichotomized as good (0-4) versus poor (5-6). RESULTS: Peak epileptiform burden was independently associated with poor outcomes (p \u3c 0.0001). Other independent associations included age, Acute Physiology and Chronic Health Evaluation II score, seizure on presentation, and diagnosis of hypoxic-ischemic encephalopathy. Model calibration error was calculated across 3 strata based on the time interval between last EEG measurement (up to 72 hours of monitoring) and discharge: (1) 10 days between last measurement and discharge, 0.0998 (95% CI = 0.0698-0.1335). After adjusting for covariates, increase in peak epileptiform activity burden from 0 to 100% increased the probability of poor outcome by 35%. INTERPRETATION: Automated measurement of peak epileptiform activity burden affords a convenient, consistent, and quantifiable target for future multicenter randomized trials investigating whether suppressing epileptiform activity improves outcomes

Deep active learning for Interictal Ictal Injury Continuum EEG patterns

Objectives: Seizures and seizure-like electroencephalography (EEG) patterns, collectively referred to as “ictal interictal injury continuum” (IIIC) patterns, are commonly encountered in critically ill patients. Automated detection is important for patient care and to enable research. However, training accurate detectors requires a large labeled dataset. Active Learning (AL) may help select informative examples to label, but the optimal AL approach remains unclear. Methods: We assembled >200,000 h of EEG from 1,454 hospitalized patients. From these, we collected 9,808 labeled and 120,000 unlabeled 10-second EEG segments. Labels included 6 IIIC patterns. In each AL iteration, a Dense-Net Convolutional Neural Network (CNN) learned vector representations for EEG segments using available labels, which were used to create a 2D embedding map. Nearest-neighbor label spreading within the embedding map was used to create additional pseudo-labeled data. A second Dense-Net was trained using real- and pseudo-labels. We evaluated several strategies for selecting candidate points for experts to label next. Finally, we compared two methods for class balancing within queries: standard balanced-based querying (SBBQ), and high confidence spread-based balanced querying (HCSBBQ). Results: Our results show: 1) Label spreading increased convergence speed for AL. 2) All query criteria produced similar results to random sampling. 3) HCSBBQ query balancing performed best. Using label spreading and HCSBBQ query balancing, we were able to train models approaching expert-level performance across all pattern categories after obtaining ∼7000 expert labels. Conclusion: Our results provide guidance regarding the use of AL to efficiently label large EEG datasets in critically ill patients.SCOPUS: ar.jinfo:eu-repo/semantics/publishe

Deep active learning for Interictal Ictal Injury Continuum EEG patterns

OBJECTIVES: Seizures and seizure-like electroencephalography (EEG) patterns, collectively referred to as ictal interictal injury continuum (IIIC) patterns, are commonly encountered in critically ill patients. Automated detection is important for patient care and to enable research. However, training accurate detectors requires a large labeled dataset. Active Learning (AL) may help select informative examples to label, but the optimal AL approach remains unclear. METHODS: We assembled \u3e200,000 h of EEG from 1,454 hospitalized patients. From these, we collected 9,808 labeled and 120,000 unlabeled 10-second EEG segments. Labels included 6 IIIC patterns. In each AL iteration, a Dense-Net Convolutional Neural Network (CNN) learned vector representations for EEG segments using available labels, which were used to create a 2D embedding map. Nearest-neighbor label spreading within the embedding map was used to create additional pseudo-labeled data. A second Dense-Net was trained using real- and pseudo-labels. We evaluated several strategies for selecting candidate points for experts to label next. Finally, we compared two methods for class balancing within queries: standard balanced-based querying (SBBQ), and high confidence spread-based balanced querying (HCSBBQ). RESULTS: Our results show: 1) Label spreading increased convergence speed for AL. 2) All query criteria produced similar results to random sampling. 3) HCSBBQ query balancing performed best. Using label spreading and HCSBBQ query balancing, we were able to train models approaching expert-level performance across all pattern categories after obtaining ∼7000 expert labels. CONCLUSION: Our results provide guidance regarding the use of AL to efficiently label large EEG datasets in critically ill patients

Interrater Reliability of Expert Electroencephalographers Identifying Seizures and Rhythmic and Periodic Patterns in EEGs.

The validity of brain monitoring using electroencephalography (EEG), particularly to guide care in patients with acute or critical illness, requires that experts can reliably identify seizures and other potentially harmful rhythmic and periodic brain activity, collectively referred to as "ictal-interictal-injury continuum" (IIIC). Previous interrater reliability (IRR) studies are limited by small samples and selection bias. This study was conducted to assess the reliability of experts in identifying IIIC.info:eu-repo/semantics/publishe