Evaluating true BCI communication rate through mutual information and language models.

Brain-computer interface (BCI) systems are a promising means for restoring communication to patients suffering from "locked-in" syndrome. Research to improve system performance primarily focuses on means to overcome the low signal to noise ratio of electroencephalogric (EEG) recordings. However, the literature and methods are difficult to compare due to the array of evaluation metrics and assumptions underlying them, including that: 1) all characters are equally probable, 2) character selection is memoryless, and 3) errors occur completely at random. The standardization of evaluation metrics that more accurately reflect the amount of information contained in BCI language output is critical to make progress. We present a mutual information-based metric that incorporates prior information and a model of systematic errors. The parameters of a system used in one study were re-optimized, showing that the metric used in optimization significantly affects the parameter values chosen and the resulting system performance. The results of 11 BCI communication studies were then evaluated using different metrics, including those previously used in BCI literature and the newly advocated metric. Six studies' results varied based on the metric used for evaluation and the proposed metric produced results that differed from those originally published in two of the studies. Standardizing metrics to accurately reflect the rate of information transmission is critical to properly evaluate and compare BCI communication systems and advance the field in an unbiased manner

Assessment of Heart Failure Patients' Interest in Mobile Health Apps for Self-Care: Survey Study.

BackgroundHeart failure is a serious public health concern that afflicts millions of individuals in the United States. Development of behaviors that promote heart failure self-care may be imperative to reduce complications and avoid hospital re-admissions. Mobile health solutions, such as activity trackers and smartphone apps, could potentially help to promote self-care through remote tracking and issuing reminders.ObjectiveThe objective of this study was to ascertain heart failure patients' interest in a smartphone app to assist them in managing their treatment and symptoms and to determine factors that influence their interest in such an app.MethodsIn the clinic waiting room on the day of their outpatient clinic appointments, 50 heart failure patients participated in a self-administered survey. The survey comprised 139 questions from previously published, institutional review board-approved questionnaires. The survey measured patients' interest in and experience using technology as well as their function, heart failure symptoms, and heart failure self-care behaviors. The Minnesota Living with Heart Failure Questionnaire (MLHFQ) was among the 11 questionnaires and was used to measure the heart failure patients' health-related quality of life through patient-reported outcomes.ResultsParticipants were aged 64.5 years on average, 32% (16/50) of the participants were women, and 91% (41/45) of the participants were determined to be New York Heart Association Class II or higher. More than 60% (30/50) of the survey participants expressed interest in several potential features of a smartphone app designed for heart failure patients. Participant age correlated negatively with interest in tracking, tips, and reminders in multivariate regression analysis (P<.05). In contrast, MLHFQ scores (worse health status) produced positive correlations with these interests (P<.05).ConclusionsThe majority of heart failure patients showed interest in activity tracking, heart failure symptom management tips, and reminder features of a smartphone app. Desirable features and an understanding of factors that influence patient interest in a smartphone app for heart failure self-care may allow researchers to address common concerns and to develop apps that demonstrate the potential benefits of mobile technology

Design considerations for a hierarchical semantic compositional framework for medical natural language understanding

Medical natural language processing (NLP) systems are a key enabling technology for transforming Big Data from clinical report repositories to information used to support disease models and validate intervention methods. However, current medical NLP systems fall considerably short when faced with the task of logically interpreting clinical text. In this paper, we describe a framework inspired by mechanisms of human cognition in an attempt to jump the NLP performance curve. The design centers about a hierarchical semantic compositional model (HSCM) which provides an internal substrate for guiding the interpretation process. The paper describes insights from four key cognitive aspects including semantic memory, semantic composition, semantic activation, and hierarchical predictive coding. We discuss the design of a generative semantic model and an associated semantic parser used to transform a free-text sentence into a logical representation of its meaning. The paper discusses supportive and antagonistic arguments for the key features of the architecture as a long-term foundational framework

Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression

Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR) data. Effort has been put both on increasing models' overall performance as well as improving their interpretability, particularly regarding the decision-making process. In this study, we present a temporal deep learning model to perform bidirectional representation learning on EHR sequences with a transformer architecture to predict future diagnosis of depression. This model is able to aggregate five heterogenous and high-dimensional data sources from the EHR and process them in a temporal manner for chronic disease prediction at various prediction windows. We applied the current trend of pretraining and fine-tuning on EHR data to outperform the current state-of-the-art in chronic disease prediction, and to demonstrate the underlying relation between EHR codes in the sequence. The model generated the highest increases of precision-recall area under the curve (PRAUC) from 0.70 to 0.76 in depression prediction compared to the best baseline model. Furthermore, the self-attention weights in each sequence quantitatively demonstrated the inner relationship between various codes, which improved the model's interpretability. These results demonstrate the model's ability to utilize heterogeneous EHR data to predict depression while achieving high accuracy and interpretability, which may facilitate constructing clinical decision support systems in the future for chronic disease screening and early detection.Comment: in IEEE Journal of Biomedical and Health Informatics (2021

Developing a real-time translator from neural signals to text: An articulatory phonetics approach

New developments in brain-computer interfaces (BCI) harness machine learning to decode spoken language from electrocorticographic (ECoG) and local field potential (LFP) signals. Orienting to signals associated with motor movements that produce articulatory features improves phoneme detection quality: individual phonemes share features, but possess a unique feature set; classification by feature set allows for a finer distinction between neural signals. Data indicates vowels are more detectable, consonants have greater detection accuracy, place of articulation informs precision, and manner of articulation affects recall. Findings have implications for the multisensory integration of speech and the role of motor imagery in phonemic neural representations

Ultrasound Image Enhancement using CycleGAN and Perceptual Loss

Purpose: The objective of this work is to introduce an advanced framework designed to enhance ultrasound images, especially those captured by portable hand-held devices, which often produce lower quality images due to hardware constraints. Additionally, this framework is uniquely capable of effectively handling non-registered input ultrasound image pairs, addressing a common challenge in medical imaging. Materials and Methods: In this retrospective study, we utilized an enhanced generative adversarial network (CycleGAN) model for ultrasound image enhancement across five organ systems. Perceptual loss, derived from deep features of pretrained neural networks, is applied to ensure the human-perceptual quality of the enhanced images. These images are compared with paired images acquired from high resolution devices to demonstrate the model's ability to generate realistic high-quality images across organ systems. Results: Preliminary validation of the framework reveals promising performance metrics. The model generates images that result in a Structural Similarity Index (SSI) score of 0.722, Locally Normalized Cross-Correlation (LNCC) score of 0.902 and 28.802 for the Peak Signal-to-Noise Ratio (PSNR) metric. Conclusion: This work presents a significant advancement in medical imaging through the development of a CycleGAN model enhanced with Perceptual Loss (PL), effectively bridging the quality gap between ultrasound images from varied devices. By training on paired images, the model not only improves image quality but also ensures the preservation of vital anatomic structural content. This approach may improve equity in access to healthcare by enhancing portable device capabilities, although further validation and optimizations are necessary for broader clinical application.Comment: 7 pages, 3 figure

High Performance P300 Spellers Using GPT2 Word Prediction With Cross-Subject Training

Amyotrophic lateral sclerosis (ALS) severely impairs patients' ability to communicate, often leading to a decline in their quality of life within a few years of diagnosis. The P300 speller brain-computer interface (BCI) offers an alternative communication method by interpreting a subject's EEG response to characters presented on a grid interface. This paper addresses the common speed limitations encountered in training efficient P300-based multi-subject classifiers by introducing innovative "across-subject" classifiers. We leverage a combination of the second-generation Generative Pre-Trained Transformer (GPT2) and Dijkstra's algorithm to optimize stimuli and suggest word completion choices based on typing history. Additionally, we employ a multi-layered smoothing technique to accommodate out-of-vocabulary (OOV) words. Through extensive simulations involving random sampling of EEG data from subjects, we demonstrate significant speed enhancements in typing passages containing rare and OOV words. These optimizations result in approximately 10% improvement in character-level typing speed and up to 40% improvement in multi-word prediction. We demonstrate that augmenting standard row/column highlighting techniques with layered word prediction yields close-to-optimal performance. Furthermore, we explore both "within-subject" and "across-subject" training techniques, showing that speed improvements are consistent across both approaches