Scalable Digital Architecture of a Liquid State Machine

Liquid State Machine (LSM) is an adaptive neural computational model with rich dynamics to process spatio-temporal inputs. These machines are extremely fast in learning because the goal-oriented training is moved to the output layer, unlike conventional recurrent neural networks. The capability to multiplex at the output layer for multiple tasks makes LSM a powerful intelligent engine. These properties are desirable in several machine learning applications such as speech recognition, anomaly detection, user identification etc. Scalable hardware architectures for spatio-temporal signal processing algorithms like LSMs are energy efficient compared to the software implementations. These designs can also naturally adapt to dierent temporal streams of inputs. Early literature shows few behavioral models of LSM. However, they cannot process real time data either due to their hardware complexity or xed design approach. In this thesis, a scalable digital architecture of an LSM is proposed. A key feature of the architecture is a digital liquid that exploits spatial locality and is capable of processing real time data. The quality of the proposed LSM is analyzed using kernel quality, separation property of the liquid and Lyapunov exponent. When realized using TSMC 65nm technology node, the total power dissipation of the liquid layer, with 60 neurons, is 55.7 mW with an area requirement of 2 mm^2. The proposed model is validated for two benchmark. In the case of an epileptic seizure detection an average accuracy of 84% is observed. For user identification/authentication using gait an average accuracy of 98.65% is achieved

Automated Classification for Electrophysiological Data: Machine Learning Approaches for Disease Detection and Emotion Recognition

Smart healthcare is a health service system that utilizes technologies, e.g., artificial intelligence and big data, to alleviate the pressures on healthcare systems. Much recent research has focused on the automatic disease diagnosis and recognition and, typically, our research pays attention on automatic classifications for electrophysiological signals, which are measurements of the electrical activity. Specifically, for electrocardiogram (ECG) and electroencephalogram (EEG) data, we develop a series of algorithms for automatic cardiovascular disease (CVD) classification, emotion recognition and seizure detection. With the ECG signals obtained from wearable devices, the candidate developed novel signal processing and machine learning method for continuous monitoring of heart conditions. Compared to the traditional methods based on the devices at clinical settings, the developed method in this thesis is much more convenient to use. To identify arrhythmia patterns from the noisy ECG signals obtained through the wearable devices, CNN and LSTM are used, and a wavelet-based CNN is proposed to enhance the performance. An emotion recognition method with a single channel ECG is developed, where a novel exploitative and explorative GWO-SVM algorithm is proposed to achieve high performance emotion classification. The attractive part is that the proposed algorithm has the capability to learn the SVM hyperparameters automatically, and it can prevent the algorithm from falling into local solutions, thereby achieving better performance than existing algorithms. A novel EEG-signal based seizure detector is developed, where the EEG signals are transformed to the spectral-temporal domain, so that the dimension of the input features to the CNN can be significantly reduced, while the detector can still achieve superior detection performance

Algorithm-circuit co-design for detecting symptomatic patterns in biological signals

The advancement in scaled Silicon technology has accelerated the development of a wide range of applications in various fields including medical technology. It has immensely contributed to finding solutions for monitoring general health as well as alleviating intractable disorders in the form of implantable and wearable systems. This necessitates the development of energy efficient and functionally efficacious systems. This thesis has explored the algorithm-circuit co-design approach for developing an energy efficient epileptic seizure detection processor which could be used for implantable epilepsy prosthesis. Novel wavelet transform based algorithms are proposed for accurate detection of epileptic seizures. Energy efficient techniques at circuit level such as power and clock gating are utilized along with error resiliency at algorithm level to implement these algorithms in TSMC $65$nm bulk-Si technology. Furthermore, the methodology is extended to develop a generic pattern detection system, which could be used for health monitoring. The wavelet transform along with mathematical metrics and Mel cepstrum are used to develop an algorithm which can detect generic patterns in biological audio signals. The application of algorithm-circuit co-design methodology helps in practically implementing this system into a low power design. Using approximation of coefficients and multiplier-less implementation, the Mel cepstrum algorithm is modified to optimize the hardware cost without losing its functional efficacy. The system is user-specific and scalable for detecting various patterns in biological signals. The methodologies mentioned in this thesis are intended towards development of user-scalable, energy efficient and highly efficacious systems for detection of patterns in variety of biological signals

Seizure Detection Using Deep Learning, Information Theoretic Measures and Factor Graphs

Epilepsy is a common neurological disorder that disrupts normal electrical activity in the brain causing severe impact on patients’ daily lives. Accurate seizure detection based on long-term time-series electroencephalogram (EEG) signals has gained vital importance for epileptic seizure diagnosis. However, visual analysis of these recordings is a time-consuming task for neurologists. Therefore, the purpose of this thesis is to propose an automatic hybrid model-based /data-driven algorithm that exploits inter-channel and temporal correlations. Hence, we use mutual information (MI) estimator to compute correlation between EEG channels as spatial features and employ a carefully designed 1D convolutional neural network (CNN) to extract additional information from raw EEGs. Then, seizure probabilities from combined features of MI estimator and CNN are applied to factor graphs to learn factor nodes. The performance of the algorithm is evaluated through measuring different parameters as well as comparing with previous studies. On CHB-MIT dataset, our generalized algorithm achieves state-of-the-art performance

Inferring complex networks from time series of dynamical systems: Pitfalls, misinterpretations, and possible solutions

Understanding the dynamics of spatially extended systems represents a challenge in diverse scientific disciplines, ranging from physics and mathematics to the earth and climate sciences or the neurosciences. This challenge has stimulated the development of sophisticated data analysis approaches adopting concepts from network theory: systems are considered to be composed of subsystems (nodes) which interact with each other (represented by edges). In many studies, such complex networks of interactions have been derived from empirical time series for various spatially extended systems and have been repeatedly reported to possess the same, possibly desirable, properties (e.g. small-world characteristics and assortativity). In this thesis we study whether and how interaction networks are influenced by the analysis methodology, i.e. by the way how empirical data is acquired (the spatial and temporal sampling of the dynamics) and how nodes and edges are derived from multivariate time series. Our modeling and numerical studies are complemented by field data analyses of brain activities that unfold on various spatial and temporal scales. We demonstrate that indications of small-world characteristics and assortativity can already be expected due solely to the analysis methodology, irrespective of the actual interaction structure of the system. We develop and discuss strategies to distinguish the properties of interaction networks related to the dynamics from those spuriously induced by the analysis methodology. We show how these strategies can help to avoid misinterpretations when investigating the dynamics of spatially extended systems.Comment: PhD thesis, University of Bonn (Germany), published in 2012, 141 page

Performance Exploration of Multiple Classifiers with Grid Search Hyperparameter Tuning for Detecting Epileptic Seizures from EEG Signals

This study evaluates the performance of two-level classifications using dimensionality reduction methods to determine the risk level of epilepsy from EEG dataset. To diminish the complexity of EEG data, dimensionality reduction techniques such as Singular Value Decomposition (SVD), Independent Component Analysis (ICA), and Principal Component Analysis (PCA) are utilized. The risk level of epilepsy classification from EEG dataset would then be carried out using three classifiers: Hidden Markov Model (HMM), Naïve Bayesian Classifier (NBC) and Gaussian Mixture Model (GMM). The Grid Search (GS) process is employed to tune the hyperparameters of GMM and NBC classifiers. This study analyzed twenty patients’ datasets. Performance evaluation of classifiers with and without GS hyperparameter tuning is examined, including performance index, sensitivity, specificity, and accuracy. The GMM classifier with the GS hyper-tuning approach for SVD dimensionality reduction technique achieved a higher accuracy of 98.18% than its counterpart classifiers