Assessing the quality of steady-state visual-evoked potentials for moving humans using a mobile electroencephalogram headset.

Recent advances in mobile electroencephalogram (EEG) systems, featuring non-prep dry electrodes and wireless telemetry, have enabled and promoted the applications of mobile brain-computer interfaces (BCIs) in our daily life. Since the brain may behave differently while people are actively situated in ecologically-valid environments versus highly-controlled laboratory environments, it remains unclear how well the current laboratory-oriented BCI demonstrations can be translated into operational BCIs for users with naturalistic movements. Understanding inherent links between natural human behaviors and brain activities is the key to ensuring the applicability and stability of mobile BCIs. This study aims to assess the quality of steady-state visual-evoked potentials (SSVEPs), which is one of promising channels for functioning BCI systems, recorded using a mobile EEG system under challenging recording conditions, e.g., walking. To systematically explore the effects of walking locomotion on the SSVEPs, this study instructed subjects to stand or walk on a treadmill running at speeds of 1, 2, and 3 mile (s) per hour (MPH) while concurrently perceiving visual flickers (11 and 12 Hz). Empirical results of this study showed that the SSVEP amplitude tended to deteriorate when subjects switched from standing to walking. Such SSVEP suppression could be attributed to the walking locomotion, leading to distinctly deteriorated SSVEP detectability from standing (84.87 ± 13.55%) to walking (1 MPH: 83.03 ± 13.24%, 2 MPH: 79.47 ± 13.53%, and 3 MPH: 75.26 ± 17.89%). These findings not only demonstrated the applicability and limitations of SSVEPs recorded from freely behaving humans in realistic environments, but also provide useful methods and techniques for boosting the translation of the BCI technology from laboratory demonstrations to practical applications

Frequency Recognition in SSVEP-based BCI using Multiset Canonical Correlation Analysis

Canonical correlation analysis (CCA) has been one of the most popular methods for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs). Despite its efficiency, a potential problem is that using pre-constructed sine-cosine waves as the required reference signals in the CCA method often does not result in the optimal recognition accuracy due to their lack of features from the real EEG data. To address this problem, this study proposes a novel method based on multiset canonical correlation analysis (MsetCCA) to optimize the reference signals used in the CCA method for SSVEP frequency recognition. The MsetCCA method learns multiple linear transforms that implement joint spatial filtering to maximize the overall correlation among canonical variates, and hence extracts SSVEP common features from multiple sets of EEG data recorded at the same stimulus frequency. The optimized reference signals are formed by combination of the common features and completely based on training data. Experimental study with EEG data from ten healthy subjects demonstrates that the MsetCCA method improves the recognition accuracy of SSVEP frequency in comparison with the CCA method and other two competing methods (multiway CCA (MwayCCA) and phase constrained CCA (PCCA)), especially for a small number of channels and a short time window length. The superiority indicates that the proposed MsetCCA method is a new promising candidate for frequency recognition in SSVEP-based BCIs

Assessing the feasibility of online SSVEP decoding in human walking using a consumer EEG headset.

BackgroundBridging the gap between laboratory brain-computer interface (BCI) demonstrations and real-life applications has gained increasing attention nowadays in translational neuroscience. An urgent need is to explore the feasibility of using a low-cost, ease-of-use electroencephalogram (EEG) headset for monitoring individuals' EEG signals in their natural head/body positions and movements. This study aimed to assess the feasibility of using a consumer-level EEG headset to realize an online steady-state visual-evoked potential (SSVEP)-based BCI during human walking.MethodsThis study adopted a 14-channel Emotiv EEG headset to implement a four-target online SSVEP decoding system, and included treadmill walking at the speeds of 0.45, 0.89, and 1.34 meters per second (m/s) to initiate the walking locomotion. Seventeen participants were instructed to perform the online BCI tasks while standing or walking on the treadmill. To maintain a constant viewing distance to the visual targets, participants held the hand-grip of the treadmill during the experiment. Along with online BCI performance, the concurrent SSVEP signals were recorded for offline assessment.ResultsDespite walking-related attenuation of SSVEPs, the online BCI obtained an information transfer rate (ITR) over 12 bits/min during slow walking (below 0.89 m/s).ConclusionsSSVEP-based BCI systems are deployable to users in treadmill walking that mimics natural walking rather than in highly-controlled laboratory settings. This study considerably promotes the use of a consumer-level EEG headset towards the real-life BCI applications

Driving steady-state visual evoked potentials at arbitrary frequencies using temporal interpolation of stimulus presentation

Date of Acceptance: 29/10/2015 We thank Renate Zahn for help with data collection. This work was supported by Deutsche Forschungsgemeinschaft (AN 841/1-1, MU 972/20-1). We would like to thank A. Trujillo-Ortiz, R. Hernandez-Walls, A. Castro-Perez and K. BarbaRojo (Universidad Autonoma de Baja California) for making Matlab code for non-sphericity corrections freely available.Peer reviewedPublisher PD

Electrophysiological Studies of Visual Attention and of Emotion Regulation

Electrophysiological methods, such as electroencephalography (EEG) and electrocardiography (ECG), measure biological activity that allow us to infer underlying cognitive processes. In the first study, we use EEG to track feature-based attention (FBA), a form of visual attention that helps one detect objects with a particular color, motion, or orientation. We explore the use of SSVEPs, generated by flicker presented peripherally, to track attention in a visual search task presented centrally. Classification results show that one can track an observer’s attended color, which suggests that these methods may provide a viable means for tracking FBA in a real-time task. In the second study, we use cardiovascular measures to examine influences of the emotion regulation strategy of reappraisal. We examine cooperation and cardiovascular responses in individuals that were defected on by their opponent in the first round of an iterated Prisoner’s Dilemma. We find significant differences between the emotion regulation conditions using the biopsychosocial (BPS) model of challenge and threat, where participants primed with the reappraisal strategy were weakly comparable with a threat state of the BPS model and participants without an emotion regulation were weakly comparable with a challenge state of the BPS model. In the third study, we use EEG to study the chromatic sensitivity of FBA for color during a visual search task. We use SSVEP responses evoked through peripheral flicker to measure the spectral tuning of color detection mechanisms and how attentional selection is affected by distractor color. Our results find smaller responses for the distractor colors and suggest that feature-based attention to a particular color involves chromatic mechanisms that both enhance the response to a target and minimize responses to distractors

A novel visual stimulation paradigm: exploiting individual primary visual cortex geometry to boost steady state visual evoked potentials (SSVEP)

The steady-state visual evoked potential (SSVEP) is an electroencephalographic response to flickering stimuli generated in significant part by activity in primary visual cortex (V1). SSVEP signal-to-noise ratio is generally low for stimuli that are located in the visual periphery, at frequencies higher than 20 Hz, or at low contrast. Because of the typical cruciform geometry of V1, large stimuli tend to excite neighboring cortical regions of opposite orientation, likely resulting in electric field cancellation. In Study 1, we explored ways to exploit V1 geometry in order to boost scalp SSVEP amplitude via oscillatory summation, by manipulating flicker-phase offsets among angular segments of a large annular stimulus. We found that by dividing the annulus into standard octants, flickering upper horizontal octants with opposite temporal phase to the lower horizontal ones, and left vertical octants opposite to the right vertical ones, the normalized SSVEP power was enhanced by 202% relative to the conventional condition with no temporal phase offsets. In two further conditions we individually customized the phase-segment boundaries based on early-latency topographical shifts in pattern-pulse multifocal visual-evoked potentials (PPMVEP) derived for each of 32 equal-sized segments. Adjusting the boundaries between 8 phase-segments by visual inspection resulted in significant enhancement of normalized SSVEP power of 383%, a further significant improvement over the standard octants condition. An automatic segment-phase assignment algorithm based on the relative strength of vertically- and horizontally-oriented multifocal VEP scalp potential amplitudes produced an enhancement of 300%. In Study 2, we applied the same principle to obtain more reliable measures of visual evoked activity to obtain surround suppression measures. Here we report for the first time, a novel vii paradigm that exploits simple signal processing, sensory physiology and psychophysical evidences in order to extract a direct index of surround suppression using EEG. Surround suppression effects were tested for low and high flickering frequencies in two different configurations of a flickering stimulus (foreground, FG) on a static surrounding pattern (background, BG): foveal, where the stimulus was a unique central disc, and peripheral, where four discs were presented at symmetrical locations around the horizontal meridian. We varied FG and BG contrast combinations and also evaluated the influence of differences in spatial phase and orientation between the surrounding pattern and the foreground. Across a population of sixteen healthy subjects, we found that the foreground contrast response function was significantly suppressed in proportion with the contrast of the background, and that, like psychophysical measures, this suppression effect was greater when the background was oriented in parallel with the foreground than when it was orthogonal. Suppression effects were also greater for the peripheral stimulus condition. This is the first demonstration of a clear surround suppression effect in the visual evoked potentials of humans, and paves the way for the first definitive measurement of the relative contributions of under-inhibition and over-excitation to hyperexcitability in epilepsy

Data Analytics in Steady-State Visual Evoked Potential-based Brain-Computer Interface: A Review

Electroencephalograph (EEG) has been widely applied for brain-computer interface (BCI) which enables paralyzed people to directly communicate with and control of external devices, due to its portability, high temporal resolution, ease of use and low cost. Of various EEG paradigms, steady-state visual evoked potential (SSVEP)-based BCI system which uses multiple visual stimuli (such as LEDs or boxes on a computer screen) flickering at different frequencies has been widely explored in the past decades due to its fast communication rate and high signal-to-noise ratio. In this paper, we review the current research in SSVEP-based BCI, focusing on the data analytics that enables continuous, accurate detection of SSVEPs and thus high information transfer rate. The main technical challenges, including signal pre-processing, spectrum analysis, signal decomposition, spatial filtering in particular canonical correlation analysis and its variations, and classification techniques are described in this paper. Research challenges and opportunities in spontaneous brain activities, mental fatigue, transfer learning as well as hybrid BCI are also discussed