Application of P300 Event-Related Potential in Brain-Computer Interface

The primary purpose of this chapter is to demonstrate one of the applications of P300 event-related potential (ERP), i.e., brain-computer interface (BCI). Researchers and students will find the chapter appealing with a preliminary description of P300 ERP. This chapter also appreciates the importance and advantages of noninvasive ERP technique. In noninvasive BCI, the P300 ERPs are extracted from brain electrical activities [electroencephalogram (EEG)] as a signature of the underlying electrophysiological mechanism of brain responses to the external or internal changes and events. As the chapter proceeds, topics are covered on more relevant scholarly works about challenges and new directions in P300 BCI. Along with these, articles with the references on the advancement of this technique will be presented to ensure that the scholarly reviews are accessible to people who are new to this field. To enhance fundamental understanding, stimulation as well as signal processing methods will be discussed from some novel works with a comparison of the associated results. This chapter will meet the need for a concise and practical description of basic, as well as advanced P300 ERP techniques, which is suitable for a broad range of researchers extending from today’s novice to an experienced cognitive researcher

Theoretical and experimental study of P300 ERP in the context of Brain-computer interfaces. Part I: Study and analysis of functional connectivity methods.

Trabajo Fin de Máster en Ingeniería InformáticaThe analysis of connectivity in brain networks has been widely researched and it has been shown that certain cognitive processes require the integration of distributed brain areas. Functional connectivity attempts to statistically quantify the interdependencies between these brain areas. For this study, an analysis of functional connectivity in an ERP context, more specifically on the P300 component using the Granger Causality metric was proposed. To this end, an analysis method is proposed which consists in quantifying the causality in the P300 signal and the non-P300 signal using the MVCG toolbox to determine if there are differences between the two results obtained. In this respect, a dataset from a Brain-Computer Interface (BCI) based on P300 is analyzed. Causality is determined in overlapping windows calculated from the signals under three aspects: i) Using standard electrodes, ii) Using electrodes selected by Bayesian Linear Discriminant Analysis and exhaustive search by forward selection (BLDA-FS), and iii) Using electrodes selected by the coefficient of determination (r2). Based on this analysis, it is shown that the Granger Causality metric is valid to show the existence of a significant connectivity difference between the P300 signal and the non-P300 signal. This measure shows higher connectivity values for the P300 signal and lower connectivity values for the non-P300 signal. Among the three approaches considered, the standard electrodes and the electrodes selected with BLDA-FS were found to be more discriminative in showing differences between P300 and nonP300 connectivity. Furthermore, through this study, it was possible to differentiate the level of functional connectivity between subjects with cognitive disabilities and nondisabled subjects, observing that the measured functional connectivity was higher in subjects without an underlying cognitive pathology. Studying functional connectivity with Granger Causality may help to incorporate this information as new features that allow better detection of the P300 signal and consequently improve the performance of P300-based BCIs

A Survey on the Project in title

In this paper we present a survey of work that has been done in the project ldquo;Unsupervised Adaptive P300 BCI in the framework of chaotic theory and stochastic theoryrdquo;we summarised the following papers, (Mohammed J Alhaddad amp; 2011), (Mohammed J. Alhaddad amp; Kamel M, 2012), (Mohammed J Alhaddad, Kamel, amp; Al-Otaibi, 2013), (Mohammed J Alhaddad, Kamel, amp; Bakheet, 2013), (Mohammed J Alhaddad, Kamel, amp; Al-Otaibi, 2014), (Mohammed J Alhaddad, Kamel, amp; Bakheet, 2014), (Mohammed J Alhaddad, Kamel, amp; Kadah, 2014), (Mohammed J Alhaddad, Kamel, Makary, Hargas, amp; Kadah, 2014), (Mohammed J Alhaddad, Mohammed, Kamel, amp; Hagras, 2015).We developed a new pre-processing method for denoising P300-based brain-computer interface data that allows better performance with lower number of channels and blocks. The new denoising technique is based on a modified version of the spectral subtraction denoising and works on each temporal signal channel independently thus offering seamless integration with existing pre-processing and allowing low channel counts to be used. We also developed a novel approach for brain-computer interface data that requires no prior training. The proposed approach is based on interval type-2 fuzzy logic based classifier which is able to handle the usersrsquo; uncertainties to produce better prediction accuracies than other competing classifiers such as BLDA or RFLDA. In addition, the generated type-2 fuzzy classifier is learnt from data via genetic algorithms to produce a small number of rules with a rule length of only one antecedent to maximize the transparency and interpretability for the normal clinician. We also employ a feature selection system based on an ensemble neural networks recursive feature selection which is able to find the effective time instances within the effective sensors in relation to given P300 event. The basic principle of this new class of techniques is that the trial with true activation signal within each block has to be different from the rest of the trials within that block. Hence, a measure that is sensitive to this dissimilarity can be used to make a decision based on a single block without any prior training. The new methods were verified using various experiments which were performed on standard data sets and using real-data sets obtained from real subjects experiments performed in the BCI lab in King Abdulaziz University. The results were compared to the classification results of the same data using previous methods. Enhanced performance in different experiments as quantitatively assessed using classification block accuracy as well as bit rate estimates was confirmed. It will be shown that the produced type-2 fuzzy logic based classifier will learn simple rules which are easy to understand explaining the events in question. In addition, the produced type-2 fuzzy logic classifier will be able to give better accuracies when compared to BLDA or RFLDA on various human subjects on the standard and real-world data sets

Signal Processing Combined with Machine Learning for Biomedical Applications

The Master’s thesis is comprised of four projects in the realm of machine learning and signal processing. The abstract of the thesis is divided into four parts and presented as follows, Abstract 1: A Kullback-Leibler Divergence-Based Predictor for Inter-Subject Associative BCI. Inherent inter-subject variability in sensorimotor brain dynamics hinders the transferability of brain-computer interface (BCI) model parameters across subjects. An individual training session is essential for effective BCI control to compensate for variability. We report a Kullback-Leibler Divergence (KLD)-based predictor for inter-subject associative BCI. An online dataset comprising left/right hand, both feet, and tongue motor imagery tasks was used to show correlation between the proposed inter-subject predictor and BCI performance. Linear regression between the KLD predictor and BCI performance showed a strong inverse correlation (r = -0.62). The KLD predictor can act as an indicator for generalized inter-subject associative BCI designs. Abstract 2: Multiclass Sensorimotor BCI Based on Simultaneous EEG and fNIRS. Hybrid BCI (hBCI) utilizes multiple data modalities to acquire brain signals during motor execution (ME) tasks. Studies have shown significant enhancements in the classification of binary class ME-hBCIs; however, four-class ME-hBCI classification is yet to be done using multiclass algorithms. We present a quad-class classification of ME-hBCI tasks from simultaneous EEG-fNIRS recordings. Appropriate features were extracted from EEG-fNIRS signals and combined for hybrid features and classified with support vector machine. Results showed a significant increase in hybrid accuracy over single modalities and show hybrid method’s performance enhancement capability. Abstract 3: Deep Learning for Improved Inter-Subject EEG-fNIRS Hybrid BCI Performance. Multimodality based hybrid BCI has become famous for performance improvement; however, the inherent inter-subject and inter-session variation between participants brain dynamics poses obstacles in achieving high performance. This work presents an inter-subject hBCI to classify right/left-hand MI tasks from simultaneous EEG-fNIRS recordings of 29 healthy subjects. State-of-art features were extracted from EEG-fNIRS signals and combined for hybrid features, and finally, classified using deep Long short-term memory classifier. Results showed an increase in the inter-subject performance for the hybrid system while making the system more robust to brain dynamics change and hints to the feasibility of EEG-fNIRS based inter-subject hBCI. Abstract 4: Microwave Based Glucose Concentration Classification by Machine Learning. Non-invasive blood sugar measurement attracts increased attention in recent years, given the increase in diabetes-related complications and inconvenience in the traditional ways using blood. This work utilized machine learning (ML) algorithms to classify glucose concentration (GC) from the measured broadband microwave scattering signals (S11). An N-type microwave adapter pair was utilized to measure the sweeping frequency scattering-parameter (S-parameter) of the glucose solutions with GC varying from 50-10,000 dg/dL. Dielectric parameters were retrieved from the measured wideband complex S-parameters based on the modified Debye dielectric dispersion model. Results indicate that the best algorithm can achieve a perfect classification accuracy and suggests an alternate way to develop a GC detection method using ML algorithms

Electroencephalography (EEG) as a Research Tool in the Information Systems Discipline: Foundations, Measurement, and Applications

The concept of neuro-information systems (neuroIS) has emerged in the IS discipline recently. Since the neuroIS field’s genesis, several neuroIS papers have been published. Investigating empirical papers published in scientific journals and conference proceedings reveals that electroencephalography (EEG) is a widely used tool. Thus, considering its relevance in contemporary research and the fact that it will also play a major role in future neuroIS research, we describe EEG from a layman’s perspective. Because previous EEG descriptions in the neuroIS literature have only scantily outlined theoretical and methodological aspects related to this tool, we urgently need a more thorough one. As such, we inform IS scholars about the fundamentals of EEG in a compact way and discuss EEG’s potential for IS research. Based on the knowledge base provided in this paper, IS researchers can make an informed decision about whether EEG could, or should, become part of their toolbox

Development and applications of a smartphone-based mobile electroencephalography (EEG) system

Electroencephalography (EEG) is a clinical and research technique used to non-invasively acquire brain activity. EEG is performed using static systems in specialist laboratories where participant mobility is constrained. It is desirable to have EEG systems which enable acquisition of brain activity outside such settings. Mobile systems seek to reduce the constraining factors of EEG device and participant mobility to enable recordings in various environments but have had limited success due to various factors including low system specification. The main aim of this thesis was to design, build, test and validate a novel smartphone-based mobile EEG system.A literature review found that the term ‘mobile EEG’ has an ambiguous meaning as researchers have used it to describe many differing degrees of participant and device mobility. A novel categorisation of mobile EEG (CoME) scheme was derived from thirty published EEG studies which defined scores for participant and device mobilities, and system specifications. The CoME scheme was subsequently applied to generate a specification for the proposed mobile EEG system which had 24 channels, sampled at 24 bit at a rate of 250 Hz. Unique aspects of the EEG system were the introduction of a smartphone into the specification, along with the use of Wi-Fi for communications. The smartphone’s processing power was used to remotely control the EEG device so as to enable EEG data capture and storage as well as electrode impedance checking via the app. This was achieved by using the Unity game engine to code an app which provided the flexibility for future development possibilities with its multi-platform support.The prototype smartphone-based waist-mounted mobile EEG system (termed ‘io:bio’) was validated against a commercial FDA clinically approved mobile system (Micromed). The power spectral frequency, amplitude and area of alpha frequency waves were determined in participants with their eyes closed in various postures: lying, sitting, standing and standing with arms raised. Since a correlation analysis to compare two systems has interpretability problems, Bland and Altman plots were utilised with a priori justified limits of agreement to statistically assess the agreement between the two EEG systems. Overall, the results found similar agreements between the io:bio and Micromed systems indicating that the systems could be used interchangeably. Utilising the io:bio and Micromed systems in a walking configuration, led to contamination of EEG channels with artifacts thought to arise from movement and muscle-related sources, and electrode displacement.To enable an event related potential (ERP) capability of the EEG system, additional coding of the smartphone app was undertaken to provide stimulus delivery and associated data marking. Using the waist-mounted io:bio system, an auditory oddball paradigm was also coded into the app, and delivery of auditory tones (standard and deviant) to the participant (sitting posture) achieved via headphones connected to the smartphone. N100, N200 and P300 ERP components were recorded in participants sitting, and larger amplitudes were found for the deviant tones compared to the standard ones. In addition, when the paradigm was tested in individual participants during walking, movement-related artifacts impacted negatively upon the quality of the ERP components, although components were discernible in the grand mean ERP.The io:bio system was redesigned into a head-mounted configuration in an attempt to reduce EEG artifacts during participant walking. The initial approach taken to redesign the system involved using electronic components populated onto a flexible PCB proved to be non-robust. Instead, the rigid PCB form of the circuitry was taken from the io:bio waist-mounted system and placed onto the rear head section of the electrode cap via a bespoke cradle. Using this head-mounted system, in a preliminary auditory oddball paradigm study, ERP responses were obtained in participants whilst walking. Initial results indicate that artifacts are reduced in this head-mounted configuration, and N100, N200 and P300 components are clearly identifiable in some channels

P300 Detection for Brain Computer Interface

P300 based brain computer interface (BCI) sometimes called brain machine interface (BMI) is a way of direct communication between human brain and external device which provides an alternative communication link with outside world to the people who are unable to communicate via conventional means because of sever motor disability. P300 wave is an event related potential which evoked in the process of decision making of human brain which can be generated using oddball paradigm. This thesis aims to detect the P300 wave as accurate as possible. To do that this study proposed discrete wavelet transforms (DWT) based feature extraction method from each P300 and No-P300 of EEG signal from the entire 64 channel. Principal component analysis (PCA) technique is further applied for the reduction of the dimension of the feature. Detection of P300 is achieved using support vector machine (SVM) and artificial neural network (ANN) classifier. Experimental result shows that the proposed method with SVM classifier yields better performance compared to the method with ANN

Deep Learning in EEG: Advance of the Last Ten-Year Critical Period

Deep learning has achieved excellent performance in a wide range of domains, especially in speech recognition and computer vision. Relatively less work has been done for EEG, but there is still significant progress attained in the last decade. Due to the lack of a comprehensive and topic widely covered survey for deep learning in EEG, we attempt to summarize recent progress to provide an overview, as well as perspectives for future developments. We first briefly mention the artifacts removal for EEG signal and then introduce deep learning models that have been utilized in EEG processing and classification. Subsequently, the applications of deep learning in EEG are reviewed by categorizing them into groups such as brain-computer interface, disease detection, and emotion recognition. They are followed by the discussion, in which the pros and cons of deep learning are presented and future directions and challenges for deep learning in EEG are proposed. We hope that this paper could serve as a summary of past work for deep learning in EEG and the beginning of further developments and achievements of EEG studies based on deep learning