Nonlinear Adaptive Signal Processing Improves the Diagnostic Quality of Transabdominal Fetal Electrocardiography

The abdominal fetal electrocardiogram (fECG) conveys valuable information that can aid clinicians with the diagnosis and monitoring of a potentially at risk fetus during pregnancy and in childbirth. This chapter primarily focuses on noninvasive (external and indirect) transabdominal fECG monitoring. Even though it is the preferred monitoring method, unlike its classical invasive (internal and direct) counterpart (transvaginal monitoring), it may be contaminated by a variety of undesirable signals that deteriorate its quality and reduce its value in reliable detection of hypoxic conditions in the fetus. A stronger maternal electrocardiogram (the mECG signal) along with technical and biological artifacts constitutes the main interfering signal components that diminish the diagnostic quality of the transabdominal fECG recordings. Currently, transabdominal fECG monitoring relies solely on the determination of the fetus’ pulse or heart rate (FHR) by detecting RR intervals and does not take into account the morphology and duration of the fECG waves (P, QRS, T), intervals, and segments, which collectively convey very useful diagnostic information in adult cardiology. The main reason for the exclusion of these valuable pieces of information in the determination of the fetus’ status from clinical practice is the fact that there are no sufficiently reliable and well-proven techniques for accurate extraction of fECG signals and robust derivation of these informative features. To address this shortcoming in fetal cardiology, we focus on adaptive signal processing methods and pay particular attention to nonlinear approaches that carry great promise in improving the quality of transabdominal fECG monitoring and consequently impacting fetal cardiology in clinical practice. Our investigation and experimental results by using clinical-quality synthetic data generated by our novel fECG signal generator suggest that adaptive neuro-fuzzy inference systems could produce a significant advancement in fetal monitoring during pregnancy and childbirth. The possibility of using a single device to leverage two advanced methods of fetal monitoring, namely noninvasive cardiotocography (CTG) and ST segment analysis (STAN) simultaneously, to detect fetal hypoxic conditions is very promising

Deep learning for surface electromyography artifact contamination type detection

The quality of surface Electromyography (sEMG) signals could be an issue if highly contaminated by Power Line Interference (PLI), Electrocardiogram signal (ECG), Movement Artifact (MOA) or White Gaussian Noise (WGN), that could lead to unsafe operation of devices that is controlled by sEMG data, such as electro-mechanical prothesis. There are some mitigation methods proposed for some specifics sEMG contaminants and to use these methods in an efficient way is important to identify the contaminant in the sEMG signal. In this work we propose the use of a Recurrent Neural Network (RNN) using Long Short-Term Memory (LSTM) units in the hidden layer with no need of features extraction with the objective to classify the signal directly from sequences of the band-pass filtered data. The method proposed use the NinaPro database with amputee and non-amputee subjects. Only non-amputee subjects are used for parameters selection and then tested on both databases. The results show that 98% of the non-contaminated sEMG data was corrected classified and more than 95% of the contaminants were identified inside the training SNR range. Also, in this work is presented a SNR sensibility control and the contamination analysis in the range from −40 dB to 40 dB in 10 dB steps. The conclusion is that is possible to classify the contamination type in sEMG signals with a RNN-LSTM with a 112.5 ms time window and to predicted with a small error the classification hit rate for each SNR level in some cases

Roadmap on signal processing for next generation measurement systems

Signal processing is a fundamental component of almost any sensor-enabled system, with a wide range of applications across different scientific disciplines. Time series data, images, and video sequences comprise representative forms of signals that can be enhanced and analysed for information extraction and quantification. The recent advances in artificial intelligence and machine learning are shifting the research attention towards intelligent, data-driven, signal processing. This roadmap presents a critical overview of the state-of-the-art methods and applications aiming to highlight future challenges and research opportunities towards next generation measurement systems. It covers a broad spectrum of topics ranging from basic to industrial research, organized in concise thematic sections that reflect the trends and the impacts of current and future developments per research field. Furthermore, it offers guidance to researchers and funding agencies in identifying new prospects.AerodynamicsMicrowave Sensing, Signals & System

Unsupervised Heart-rate Estimation in Wearables With Liquid States and A Probabilistic Readout

Heart-rate estimation is a fundamental feature of modern wearable devices. In this paper we propose a machine intelligent approach for heart-rate estimation from electrocardiogram (ECG) data collected using wearable devices. The novelty of our approach lies in (1) encoding spatio-temporal properties of ECG signals directly into spike train and using this to excite recurrently connected spiking neurons in a Liquid State Machine computation model; (2) a novel learning algorithm; and (3) an intelligently designed unsupervised readout based on Fuzzy c-Means clustering of spike responses from a subset of neurons (Liquid states), selected using particle swarm optimization. Our approach differs from existing works by learning directly from ECG signals (allowing personalization), without requiring costly data annotations. Additionally, our approach can be easily implemented on state-of-the-art spiking-based neuromorphic systems, offering high accuracy, yet significantly low energy footprint, leading to an extended battery life of wearable devices. We validated our approach with CARLsim, a GPU accelerated spiking neural network simulator modeling Izhikevich spiking neurons with Spike Timing Dependent Plasticity (STDP) and homeostatic scaling. A range of subjects are considered from in-house clinical trials and public ECG databases. Results show high accuracy and low energy footprint in heart-rate estimation across subjects with and without cardiac irregularities, signifying the strong potential of this approach to be integrated in future wearable devices.Comment: 51 pages, 12 figures, 6 tables, 95 references. Under submission at Elsevier Neural Network

Data-driven multivariate and multiscale methods for brain computer interface

This thesis focuses on the development of data-driven multivariate and multiscale methods for brain computer interface (BCI) systems. The electroencephalogram (EEG), the most convenient means to measure neurophysiological activity due to its noninvasive nature, is mainly considered. The nonlinearity and nonstationarity inherent in EEG and its multichannel recording nature require a new set of data-driven multivariate techniques to estimate more accurately features for enhanced BCI operation. Also, a long term goal is to enable an alternative EEG recording strategy for achieving long-term and portable monitoring. Empirical mode decomposition (EMD) and local mean decomposition (LMD), fully data-driven adaptive tools, are considered to decompose the nonlinear and nonstationary EEG signal into a set of components which are highly localised in time and frequency. It is shown that the complex and multivariate extensions of EMD, which can exploit common oscillatory modes within multivariate (multichannel) data, can be used to accurately estimate and compare the amplitude and phase information among multiple sources, a key for the feature extraction of BCI system. A complex extension of local mean decomposition is also introduced and its operation is illustrated on two channel neuronal spike streams. Common spatial pattern (CSP), a standard feature extraction technique for BCI application, is also extended to complex domain using the augmented complex statistics. Depending on the circularity/noncircularity of a complex signal, one of the complex CSP algorithms can be chosen to produce the best classification performance between two different EEG classes. Using these complex and multivariate algorithms, two cognitive brain studies are investigated for more natural and intuitive design of advanced BCI systems. Firstly, a Yarbus-style auditory selective attention experiment is introduced to measure the user attention to a sound source among a mixture of sound stimuli, which is aimed at improving the usefulness of hearing instruments such as hearing aid. Secondly, emotion experiments elicited by taste and taste recall are examined to determine the pleasure and displeasure of a food for the implementation of affective computing. The separation between two emotional responses is examined using real and complex-valued common spatial pattern methods. Finally, we introduce a novel approach to brain monitoring based on EEG recordings from within the ear canal, embedded on a custom made hearing aid earplug. The new platform promises the possibility of both short- and long-term continuous use for standard brain monitoring and interfacing applications

Learning Biosignals with Deep Learning

The healthcare system, which is ubiquitously recognized as one of the most influential system in society, is facing new challenges since the start of the decade.The myriad of physiological data generated by individuals, namely in the healthcare system, is generating a burden on physicians, losing effectiveness on the collection of patient data. Information systems and, in particular, novel deep learning (DL) algorithms have been prompting a way to take this problem. This thesis has the aim to have an impact in biosignal research and industry by presenting DL solutions that could empower this field. For this purpose an extensive study of how to incorporate and implement Convolutional Neural Networks (CNN), Recursive Neural Networks (RNN) and Fully Connected Networks in biosignal studies is discussed. Different architecture configurations were explored for signal processing and decision making and were implemented in three different scenarios: (1) Biosignal learning and synthesis; (2) Electrocardiogram (ECG) biometric systems, and; (3) Electrocardiogram (ECG) anomaly detection systems. In (1) a RNN-based architecture was able to replicate autonomously three types of biosignals with a high degree of confidence. As for (2) three CNN-based architectures, and a RNN-based architecture (same used in (1)) were used for both biometric identification, reaching values above 90% for electrode-base datasets (Fantasia, ECG-ID and MIT-BIH) and 75% for off-person dataset (CYBHi), and biometric authentication, achieving Equal Error Rates (EER) of near 0% for Fantasia and MIT-BIH and bellow 4% for CYBHi. As for (3) the abstraction of healthy clean the ECG signal and detection of its deviation was made and tested in two different scenarios: presence of noise using autoencoder and fully-connected network (reaching 99% accuracy for binary classification and 71% for multi-class), and; arrhythmia events by including a RNN to the previous architecture (57% accuracy and 61% sensitivity). In sum, these systems are shown to be capable of producing novel results. The incorporation of several AI systems into one could provide to be the next generation of preventive medicine, as the machines have access to different physiological and anatomical states, it could produce more informed solutions for the issues that one may face in the future increasing the performance of autonomous preventing systems that could be used in every-day life in remote places where the access to medicine is limited. These systems will also help the study of the signal behaviour and how they are made in real life context as explainable AI could trigger this perception and link the inner states of a network with the biological traits.O sistema de saúde, que é ubiquamente reconhecido como um dos sistemas mais influentes da sociedade, enfrenta novos desafios desde o ínicio da década. A miríade de dados fisiológicos gerados por indíviduos, nomeadamente no sistema de saúde, está a gerar um fardo para os médicos, perdendo a eficiência no conjunto dos dados do paciente. Os sistemas de informação e, mais espcificamente, da inovação de algoritmos de aprendizagem profunda (DL) têm sido usados na procura de uma solução para este problema. Esta tese tem o objetivo de ter um impacto na pesquisa e na indústria de biosinais, apresentando soluções de DL que poderiam melhorar esta área de investigação. Para esse fim, é discutido um extenso estudo de como incorporar e implementar redes neurais convolucionais (CNN), redes neurais recursivas (RNN) e redes totalmente conectadas para o estudo de biosinais. Diferentes arquiteturas foram exploradas para processamento e tomada de decisão de sinais e foram implementadas em três cenários diferentes: (1) Aprendizagem e síntese de biosinais; (2) sistemas biométricos com o uso de eletrocardiograma (ECG), e; (3) Sistema de detecção de anomalias no ECG. Em (1) uma arquitetura baseada na RNN foi capaz de replicar autonomamente três tipos de sinais biológicos com um alto grau de confiança. Quanto a (2) três arquiteturas baseadas em CNN e uma arquitetura baseada em RNN (a mesma usada em (1)) foram usadas para ambas as identificações, atingindo valores acima de 90 % para conjuntos de dados à base de eletrodos (Fantasia, ECG-ID e MIT -BIH) e 75 % para o conjunto de dados fora da pessoa (CYBHi) e autenticação, atingindo taxas de erro iguais (EER) de quase 0 % para Fantasia e MIT-BIH e abaixo de 4 % para CYBHi. Quanto a (3) a abstração de sinais limpos e assimptomáticos de ECG e a detecção do seu desvio foram feitas e testadas em dois cenários diferentes: na presença de ruído usando um autocodificador e uma rede totalmente conectada (atingindo 99 % de precisão na classificação binária e 71 % na multi-classe), e; eventos de arritmia incluindo um RNN na arquitetura anterior (57 % de precisão e 61 % de sensibilidade). Em suma, esses sistemas são mais uma vez demonstrados como capazes de produzir resultados inovadores. A incorporação de vários sistemas de inteligência artificial em um unico sistema pederá desencadear a próxima geração de medicina preventiva. Os algoritmos ao terem acesso a diferentes estados fisiológicos e anatómicos, podem produzir soluções mais informadas para os problemas que se possam enfrentar no futuro, aumentando o desempenho de sistemas autónomos de prevenção que poderiam ser usados na vida quotidiana, nomeadamente em locais remotos onde o acesso à medicinas é limitado. Estes sistemas também ajudarão o estudo do comportamento do sinal e como eles são feitos no contexto da vida real, pois a IA explicável pode desencadear essa percepção e vincular os estados internos de uma rede às características biológicas

Methods for enhanced learning using wearable technologies. A study of the maritime sector

Maritime safety is a critical concern due to the potential for serious consequences or accidents for the crew, passengers, environment, and assets resulting from navigation errors or unsafe acts. Traditional training methods face challenges in the rapidly evolving maritime industry, and innovative training methods are being explored. This study explores the use of wearable sensors with biosignal data collection to improve training performance in the maritime sector. Three experiments were conducted progressively to investigate the relationship between navigators' experience levels and biosignal data results, the effects of different training methods on cognitive workload, trainees' stress levels, and their decision-making skills, and the classification of scenario complexity and the biosignal data obtained by the trainees. questionnaire data on stress levels, workload, and user satisfaction of auxiliary training equipment; performance evaluation data on navigational abilities, decision-making skills, and ship-handling abilities; and biosignal data, including electrodermal activity (EDA), body temperature, blood volume pulse (BVP), inter-beat interval (IBI), and heart rate (HR). Several statistical methods and machine-learning algorithms were used in the data analysis. The present dissertation contributes to the advancement of the field of maritime education and training by exploring methods for enhancing learning in complex situations. The use of biosignal data provides insights into the interplay between stress levels and training outcomes in the maritime industry. The proposed conceptual training model underscores the relationship between trainees' stress and safety factors and offers a framework for the development and evaluation of advanced biosignal data-based training systems

Wired, wireless and wearable bioinstrumentation for high-precision recording of bioelectrical signals in bidirectional neural interfaces

It is widely accepted by the scientific community that bioelectrical signals, which can be used for the identification of neurophysiological biomarkers indicative of a diseased or pathological state, could direct patient treatment towards more effective therapeutic strategies. However, the design and realisation of an instrument that can precisely record weak bioelectrical signals in the presence of strong interference stemming from a noisy clinical environment is one of the most difficult challenges associated with the strategy of monitoring bioelectrical signals for diagnostic purposes. Moreover, since patients often have to cope with the problem of limited mobility being connected to bulky and mains-powered instruments, there is a growing demand for small-sized, high-performance and ambulatory biopotential acquisition systems in the Intensive Care Unit (ICU) and in High-dependency wards. Furthermore, electrical stimulation of specific target brain regions has been shown to alleviate symptoms of neurological disorders, such as Parkinson’s disease, essential tremor, dystonia, epilepsy etc. In recent years, the traditional practice of continuously stimulating the brain using static stimulation parameters has shifted to the use of disease biomarkers to determine the intensity and timing of stimulation. The main motivation behind closed-loop stimulation is minimization of treatment side effects by providing only the necessary stimulation required within a certain period of time, as determined from a guiding biomarker. Hence, it is clear that high-quality recording of local field potentials (LFPs) or electrocorticographic (ECoG) signals during deep brain stimulation (DBS) is necessary to investigate the instantaneous brain response to stimulation, minimize time delays for closed-loop neurostimulation and maximise the available neural data. To our knowledge, there are no commercial, small, battery-powered, wearable and wireless recording-only instruments that claim the capability of recording ECoG signals, which are of particular importance in closed-loop DBS and epilepsy DBS. In addition, existing recording systems lack the ability to provide artefact-free high-frequency (> 100 Hz) LFP recordings during DBS in real time primarily because of the contamination of the neural signals of interest by the stimulation artefacts. To address the problem of limited mobility often encountered by patients in the clinic and to provide a wide variety of high-precision sensor data to a closed-loop neurostimulation platform, a low-noise (8 nV/√Hz), eight-channel, battery-powered, wearable and wireless multi-instrument (55 × 80 mm2) was designed and developed. The performance of the realised instrument was assessed by conducting both ex vivo and in vivo experiments. The combination of desirable features and capabilities of this instrument, namely its small size (~one business card), its enhanced recording capabilities, its increased processing capabilities, its manufacturability (since it was designed using discrete off-the-shelf components), the wide bandwidth it offers (0.5 – 500 Hz) and the plurality of bioelectrical signals it can precisely record, render it a versatile tool to be utilized in a wide range of applications and environments. Moreover, in order to offer the capability of sensing and stimulating via the same electrode, novel real-time artefact suppression methods that could be used in bidirectional (recording and stimulation) system architectures are proposed and validated. More specifically, a novel, low-noise and versatile analog front-end (AFE), which uses a high-order (8th) analog Chebyshev notch filter to suppress the artefacts originating from the stimulation frequency, is presented. After defining the system requirements for concurrent LFP recording and DBS artefact suppression, the performance of the realised AFE is assessed by conducting both in vitro and in vivo experiments using unipolar and bipolar DBS (monophasic pulses, amplitude ranging from 3 to 6 V peak-to-peak, frequency 140 Hz and pulse width 100 µs). Under both in vitro and in vivo experimental conditions, the proposed AFE provided real-time, low-noise and artefact-free LFP recordings (in the frequency range 0.5 – 250 Hz) during stimulation. Finally, a family of tunable hardware filter designs and a novel method for real-time artefact suppression that enables wide-bandwidth biosignal recordings during stimulation are also presented. This work paves the way for the development of miniaturized research tools for closed-loop neuromodulation that use a wide variety of bioelectrical signals as control signals.Open Acces

A real-time noise cancelling EEG electrode employing Deep Learning

Two major problems of head worn electroencephalogram (EEG) are muscle and eye-blink artefacts, in particular in non-clinical environments while performing everyday tasks. Current artefact removal techniques such as principle component analysis (PCA) or independent component analysis (ICA) take signals from a high number of electrodes and separate the noise from the signal by processing them offline in a computationally expensive and slow way. In contrast, we present a smart compound electrode which is able to learn in real-time to remove artefacts. The smart 3D printed electrode consists of a central electrode and a ring electrode where poly-lactate acid (PLA) was used for the the base and Ag/AgCl for the conductive parts allowing standard manufacturing processes. A new deep learning algorithm then learns continuously to remove both eye-blink and muscle artefacts which combines the real-time capabilities of adaptive filters with the power of deep neural networks. The electrode setup together with the deep learning algorithm increases the signal to noise ratio of the EEG in average by 20 dB. Our approach offers a simple 3D printed design in combination with a real-time algorithm which can be integrated into the electrode itself. This electrode has the potential to provide high quality EEG in non-clinical and consumer applications, such as sleep monitoring and brain-computer interface (BCI).Comment: 12 pages, 4 figures, code available under http://doi.org/10.5281/zenodo.413110