Electroencephalogram Signal Processing For Hybrid Brain Computer Interface Systems

The goal of this research was to evaluate and compare three types of brain computer interface (BCI) systems, P300, steady state visually evoked potentials (SSVEP) and Hybrid as virtual spelling paradigms. Hybrid BCI is an innovative approach to combine the P300 and SSVEP. However, it is challenging to process the resulting hybrid signals to extract both information simultaneously and effectively. The major step executed toward the advancement to modern BCI system was to move the BCI techniques from traditional LED system to electronic LCD monitor. Such a transition allows not only to develop the graphics of interest but also to generate objects flickering at different frequencies. There were pilot experiments performed for designing and tuning the parameters of the spelling paradigms including peak detection for different range of frequencies of SSVEP BCI, placement of objects on LCD monitor, design of the spelling keyboard, and window time for the SSVEP peak detection processing. All the experiments were devised to evaluate the performance in terms of the spelling accuracy, region error, and adjacency error among all of the paradigms: P300, SSVEP and Hybrid. Due to the different nature of P300 and SSVEP, designing a hybrid P300-SSVEP signal processing scheme demands significant amount of research work in this area. Eventually, two critical questions in hybrid BCl are: (1) which signal processing strategy can best measure the user\u27s intent and (2) what a suitable paradigm is to fuse these two techniques in a simple but effective way. In order to answer these questions, this project focused mainly on developing signal processing and classification technique for hybrid BCI. Hybrid BCI was implemented by extracting the specific information from brain signals, selecting optimum features which contain maximum discrimination information about the speller characters of our interest and by efficiently classifying the hybrid signals. The designed spellers were developed with the aim to improve quality of life of patients with disability by utilizing visually controlled BCI paradigms. The paradigms consist of electrodes to record electroencephalogram signal (EEG) during stimulation, a software to analyze the collected data, and a computing device where the subject’s EEG is the input to estimate the spelled character. Signal processing phase included preliminary tasks as preprocessing, feature extraction, and feature selection. Captured EEG data are usually a superposition of the signals of interest with other unwanted signals from muscles, and from non-biological artifacts. The accuracy of each trial and average accuracy for subjects were computed. Overall, the average accuracy of the P300 and SSVEP spelling paradigm was 84% and 68.5 %. P300 spelling paradigms have better accuracy than both the SSVEP and hybrid paradigm. Hybrid paradigm has the average accuracy of 79 %. However, hybrid system is faster in time and more soothing to look than other paradigms. This work is significant because it has great potential for improving the BCI research in design and application of clinically suitable speller paradigm

A supervised machine-learning method for detecting steady-state visually evoked potentials for use in brain computer interfaces: A comparative assessment

It is hypothesised that supervised machine learning on the estimated parameters output by a model for visually evoked potentials (VEPs), created by Kremlácek et al. (2002), could be used to classify steady-state visually evoked potentials (SSVEP) by frequency of stimulation. Classification of SSVEPs by stimulus frequency has application in SSVEP-based brain computer interfaces (BCI), where users are presented with flashing stimuli and user intent is decoded by identifying which stimulus the subject is attending to. We investigate the ability of the model of VEPs to fit the initial portions of SSVEPs, which are not yet in a steady state and contain characteristic features of VEPs superimposed with those of a steady state response. In this process the estimated parameters, as a function of the model for a given SSVEP response, were found. These estimated parameters were used to train several support vector machines (SVM) to classify the SSVEPs. Three initialisation conditions for the model are examined for their contribution to the goodness of fit and the subsequent classification accuracy, of the SVMs. It was found that the model was able to fit SSVEPs with a normalised root mean square error (NRMSE) of 27%, this performance did not match the expected NRMSE values of 13% reported by Kremlácek et al. (2002) for fits on VEPs. The fit data was assessed by the machine learning scheme and generated parameters which were classifiable by SVM above a random chance of 14% (Reang 9% to 28%). It was also shown that the selection of initial parameters had no distinct effect on the classification accuracy. Traditional classification approaches using spectral techniques such as Power Spectral Density Analysis (PSDA) and canonical correlation analysis (CCA) require a window period of data above 1 s to perform accurately enough for use in BCIs. The larger the window period of SSVEP data used the more the Information transfer rate (ITR) decreases. Undertaking a successful classification on only the initial 250 ms portions of SSVEP data would lead to an improved ITR and a BCI which is faster to use. Classification of each method was assessed at three SSVEP window periods (0.25, 0.5 and 1 s). Comparison of the three methods revealed that, on a whole CCA outperformed both the PSDA and SVM methods. While PSDA performance was in-line with that of the SVM method. All methods performed poorly at the window period of 0.25 s with an average accuracy converging on random chance - 14%. At the window period of 0.5 s the CCA only marginally outperformed the SVM method and at a time of 1 s the CCA method significantly (p<0.05) outperformed the SVM method. While the SVMs tended to improve with window period the results were not generally significant. It was found that certain SVMs (Representing a unique combination of subject, initial conditions and window period) achieved an accuracy as high as 30%. For a few instances the accuracy was comparable to the CCA method with a significance of 5%. While we were unable to predict which SVM would perform well for a given subject, it was demonstrated that with further refinement this novel method may produce results similar to or better than that of CCA

Examining sensory ability, feature matching, and assessment-based adaptation for a brain-computer interface using the steady-state visually evoked potential

This is an Accepted Manuscript of an article published by Taylor & Francis in Disability and Rehabilitation: Assistive Technology on 01/31/2018, available online: http://www.tandfonline.com/10.1080/17483107.2018.1428369.PURPOSE:We investigated how overt visual attention and oculomotor control influence successful use of a visual feedback brain-computer interface (BCI) for accessing augmentative and alternative communication (AAC) devices in a heterogeneous population of individuals with profound neuromotor impairments. BCIs are often tested within a single patient population limiting generalization of results. This study focuses on examining individual sensory abilities with an eye toward possible interface adaptations to improve device performance. METHODS: Five individuals with a range of neuromotor disorders participated in four-choice BCI control task involving the steady state visually evoked potential. The BCI graphical interface was designed to simulate a commercial AAC device to examine whether an integrated device could be used successfully by individuals with neuromotor impairment. RESULTS: All participants were able to interact with the BCI and highest performance was found for participants able to employ an overt visual attention strategy. For participants with visual deficits to due to impaired oculomotor control, effective performance increased after accounting for mismatches between the graphical layout and participant visual capabilities. CONCLUSION: As BCIs are translated from research environments to clinical applications, the assessment of BCI-related skills will help facilitate proper device selection and provide individuals who use BCI the greatest likelihood of immediate and long term communicative success. Overall, our results indicate that adaptations can be an effective strategy to reduce barriers and increase access to BCI technology. These efforts should be directed by comprehensive assessments for matching individuals to the most appropriate device to support their complex communication needs. Implications for Rehabilitation Brain computer interfaces using the steady state visually evoked potential can be integrated with an augmentative and alternative communication device to provide access to language and literacy for individuals with neuromotor impairment. Comprehensive assessments are needed to fully understand the sensory, motor, and cognitive abilities of individuals who may use brain-computer interfaces for proper feature matching as selection of the most appropriate device including optimization device layouts and control paradigms. Oculomotor impairments negatively impact brain-computer interfaces that use the steady state visually evoked potential, but modifications to place interface stimuli and communication items in the intact visual field can improve successful outcomes

SSVEP-based brain-computer interface for computer control application using SVM classifier

n this research, a Brain Computer Interface (BCI) based on Steady State Visually Evoked Potential (SSVEP) for computer control appli-cations using Support Vector Machine (SVM) is presented. For many years, people have speculated that electroencephalographic activi-ties or other electrophysiological measures of brain function might provide a new non-muscular channel that can be used for sending messages or commands to the external world. BCI is a fast-growing emergent technology in which researchers aim to build a direct channel between the human brain and the computer. BCI systems provide a new communication channel for disabled people. Among many different types of the BCI systems, the SSVEP based has attracted more attention due to its ease of use and signal processing. SSVEPs are usually detected from the occipital lobe of the brain when the subject is looking at a twinkling light source. In this paper, SVM is used to classify SSVEP based on electroencephalogram data with proper features. Based on the experiment utilizing a 14-channel Electroencephalography (EEG) device, 80 percent of accuracy can be reached by our SSVEP-based BCI system using Linear SVM Kernel as classification engine

SSVEP-Based BCIs

This chapter describes the method of flickering targets, eliciting fundamental frequency changes in the EEG signal of the subject, used to drive machine commands after interpretation of user’s intentions. The steady-state response of the changes in the EEG caused by events such as visual stimulus applied to the subject via a computer screen is called steady-state visually evoked potential (SSVEP). This feature of the EEG signal can be used to form a basis of input to assistive devices for locked in patients to improve their quality of life, as well as for performance enhancing devices for healthy subjects. The contents of this chapter describe the SSVEP stimuli; feature extraction techniques, feature classification techniques and a few applications based on SSVEP based BCI

Development of a practical and mobile brain-computer communication device for profoundly paralyzed individuals

Thesis (Ph.D.)--Boston UniversityBrain-computer interface (BCI) technology has seen tremendous growth over the past several decades, with numerous groundbreaking research studies demonstrating technical viability (Sellers et al., 2010; Silvoni et al., 2011). Despite this progress, BCIs have remained primarily in controlled laboratory settings. This dissertation proffers a blueprint for translating research-grade BCI systems into real-world applications that are noninvasive and fully portable, and that employ intelligent user interfaces for communication. The proposed architecture is designed to be used by severely motor-impaired individuals, such as those with locked-in syndrome, while reducing the effort and cognitive load needed to communicate. Such a system requires the merging of two primary research fields: 1) electroencephalography (EEG)-based BCIs and 2) intelligent user interface design. The EEG-based BCI portion of this dissertation provides a history of the field, details of our software and hardware implementation, and results from an experimental study aimed at verifying the utility of a BCI based on the steady-state visual evoked potential (SSVEP), a robust brain response to visual stimulation at controlled frequencies. The visual stimulation, feature extraction, and classification algorithms for the BCI were specially designed to achieve successful real-time performance on a laptop computer. Also, the BCI was developed in Python, an open-source programming language that combines programming ease with effective handling of hardware and software requirements. The result of this work was The Unlock Project app software for BCI development. Using it, a four-choice SSVEP BCI setup was implemented and tested with five severely motor-impaired and fourteen control participants. The system showed a wide range of usability across participants, with classification rates ranging from 25-95%. The second portion of the dissertation discusses the viability of intelligent user interface design as a method for obtaining a more user-focused vocal output communication aid tailored to motor-impaired individuals. A proposed blueprint of this communication "app" was developed in this dissertation. It would make use of readily available laptop sensors to perform facial recognition, speech-to-text decoding, and geo-location. The ultimate goal is to couple sensor information with natural language processing to construct an intelligent user interface that shapes communication in a practical SSVEP-based BCI