Preparing Laboratory and Real-World EEG Data for Large-Scale Analysis: A Containerized Approach.

Large-scale analysis of EEG and other physiological measures promises new insights into brain processes and more accurate and robust brain-computer interface models. However, the absence of standardized vocabularies for annotating events in a machine understandable manner, the welter of collection-specific data organizations, the difficulty in moving data across processing platforms, and the unavailability of agreed-upon standards for preprocessing have prevented large-scale analyses of EEG. Here we describe a "containerized" approach and freely available tools we have developed to facilitate the process of annotating, packaging, and preprocessing EEG data collections to enable data sharing, archiving, large-scale machine learning/data mining and (meta-)analysis. The EEG Study Schema (ESS) comprises three data "Levels," each with its own XML-document schema and file/folder convention, plus a standardized (PREP) pipeline to move raw (Data Level 1) data to a basic preprocessed state (Data Level 2) suitable for application of a large class of EEG analysis methods. Researchers can ship a study as a single unit and operate on its data using a standardized interface. ESS does not require a central database and provides all the metadata data necessary to execute a wide variety of EEG processing pipelines. The primary focus of ESS is automated in-depth analysis and meta-analysis EEG studies. However, ESS can also encapsulate meta-information for the other modalities such as eye tracking, that are increasingly used in both laboratory and real-world neuroimaging. ESS schema and tools are freely available at www.eegstudy.org and a central catalog of over 850 GB of existing data in ESS format is available at studycatalog.org. These tools and resources are part of a larger effort to enable data sharing at sufficient scale for researchers to engage in truly large-scale EEG analysis and data mining (BigEEG.org)

EEG Source Imaging Indices of Cognitive Control Show Associations with Dopamine System Genes.

Cognitive or executive control is a critical mental ability, an important marker of mental illness, and among the most heritable of neurocognitive traits. Two candidate genes, catechol-O-methyltransferase (COMT) and DRD4, which both have a roles in the regulation of cortical dopamine, have been consistently associated with cognitive control. Here, we predicted that individuals with the COMT Met/Met allele would show improved response execution and inhibition as indexed by event-related potentials in a Go/NoGo task, while individuals with the DRD4 7-repeat allele would show impaired brain activity. We used independent component analysis (ICA) to separate brain source processes contributing to high-density EEG scalp signals recorded during the task. As expected, individuals with the DRD4 7-repeat polymorphism had reduced parietal P3 source and scalp responses to response (Go) compared to those without the 7-repeat. Contrary to our expectation, the COMT homozygous Met allele was associated with a smaller frontal P3 source and scalp response to response-inhibition (NoGo) stimuli, suggesting that while more dopamine in frontal cortical areas has advantages in some tasks, it may also compromise response inhibition function. An interaction effect emerged for P3 source responses to Go stimuli. These were reduced in those with both the 7-repeat DRD4 allele and either the COMT Val/Val or the Met/Met homozygous polymorphisms but not in those with the heterozygous Val/Met polymorphism. This epistatic interaction between DRD4 and COMT replicates findings that too little or too much dopamine impairs cognitive control. The anatomic and functional separated maximally independent cortical EEG sources proved more informative than scalp channel measures for genetic studies of brain function and thus better elucidate the complex mechanisms in psychiatric illness

Hierarchical Event Descriptors (HED): Semi-Structured Tagging for Real-World Events in Large-Scale EEG.

Real-world brain imaging by EEG requires accurate annotation of complex subject-environment interactions in event-rich tasks and paradigms. This paper describes the evolution of the Hierarchical Event Descriptor (HED) system for systematically describing both laboratory and real-world events. HED version 2, first described here, provides the semantic capability of describing a variety of subject and environmental states. HED descriptions can include stimulus presentation events on screen or in virtual worlds, experimental or spontaneous events occurring in the real world environment, and events experienced via one or multiple sensory modalities. Furthermore, HED 2 can distinguish between the mere presence of an object and its actual (or putative) perception by a subject. Although the HED framework has implicit ontological and linked data representations, the user-interface for HED annotation is more intuitive than traditional ontological annotation. We believe that hiding the formal representations allows for a more user-friendly interface, making consistent, detailed tagging of experimental, and real-world events possible for research users. HED is extensible while retaining the advantages of having an enforced common core vocabulary. We have developed a collection of tools to support HED tag assignment and validation; these are available at hedtags.org. A plug-in for EEGLAB (sccn.ucsd.edu/eeglab), CTAGGER, is also available to speed the process of tagging existing studies

Visual Evoked Responses During Standing and Walking

Human cognition has been shaped both by our body structure and by its complex interactions with its environment. Our cognition is thus inextricably linked to our own and others’ motor behavior. To model brain activity associated with natural cognition, we propose recording the concurrent brain dynamics and body movements of human subjects performing normal actions. Here we tested the feasibility of such a mobile brain/body (MoBI) imaging approach by recording high-density electroencephalographic (EEG) activity and body movements of subjects standing or walking on a treadmill while performing a visual oddball response task. Independent component analysis of the EEG data revealed visual event-related potentials that during standing, slow walking, and fast walking did not differ across movement conditions, demonstrating the viability of recording brain activity accompanying cognitive processes during whole body movement. Non-invasive and relatively low-cost MoBI studies of normal, motivated actions might improve understanding of interactions between brain and body dynamics leading to more complete biological models of cognition

EEG Source Imaging Indices of Cognitive Control Show Associations with Dopamine System Genes

Cognitive or executive control is a critical mental ability, an important marker of mental illness, and among the most heritable of neurocognitive traits. Two candidate genes, catechol-O-methyltransferase (COMT) and DRD4, which both have a roles in the regulation of cortical dopamine, have been consistently associated with cognitive control. Here, we predicted that individuals with the COMT Met/Met allele would show improved response execution and inhibition as indexed by event-related potentials in a Go/NoGo task, while individuals with the DRD4 7-repeat allele would show impaired brain activity. We used independent component analysis (ICA) to separate brain source processes contributing to high-density EEG scalp signals recorded during the task. As expected, individuals with the DRD4 7-repeat polymorphism had reduced parietal P3 source and scalp responses to response (Go) compared to those without the 7-repeat. Contrary to our expectation, the COMT homozygous Met allele was associated with a smaller frontal P3 source and scalp response to response-inhibition (NoGo) stimuli, suggesting that while more dopamine in frontal cortical areas has advantages in some tasks, it may also compromise response inhibition function. An interaction effect emerged for P3 source responses to Go stimuli. These were reduced in those with both the 7-repeat DRD4 allele and either the COMT Val/Val or the Met/Met homozygous polymorphisms but not in those with the heterozygous Val/Met polymorphism. This epistatic interaction between DRD4 and COMT replicates findings that too little or too much dopamine impairs cognitive control. The anatomic and functional separated maximally independent cortical EEG sources proved more informative than scalp channel measures for genetic studies of brain function and thus better elucidate the complex mechanisms in psychiatric illness

EEGLAB, SIFT, NFT, BCILAB, and ERICA: New Tools for Advanced EEG Processing

We describe a set of complementary EEG data collection and processing tools recently developed at the Swartz Center for Computational Neuroscience (SCCN) that connect to and extend the EEGLAB software environment, a freely available and readily extensible processing environment running under Matlab. The new tools include (1) a new and flexible EEGLAB STUDY design facility for framing and performing statistical analyses on data from multiple subjects; (2) a neuroelectromagnetic forward head modeling toolbox (NFT) for building realistic electrical head models from available data; (3) a source information flow toolbox (SIFT) for modeling ongoing or event-related effective connectivity between cortical areas; (4) a BCILAB toolbox for building online brain-computer interface (BCI) models from available data, and (5) an experimental real-time interactive control and analysis (ERICA) environment for real-time production and coordination of interactive, multimodal experiments

Characterization and Robust Classification of EEG Signal from Image RSVP Events with Independent Time-Frequency Features

This paper considers the problem of automatic characterization and detection of target images in a rapid serial visual presentation (RSVP) task based on EEG data. A novel method that aims to identify single-trial event-related potentials (ERPs) in time-frequency is proposed, and a robust classifier with feature clustering is developed to better utilize the correlated ERP features. The method is applied to EEG recordings of a RSVP experiment with multiple sessions and subjects. The results show that the target image events are mainly characterized by 3 distinct patterns in the time-frequency domain, i.e., a theta band (4.3 Hz) power boosting 300–700 ms after the target image onset, an alpha band (12 Hz) power boosting 500–1000 ms after the stimulus onset, and a delta band (2 Hz) power boosting after 500 ms. The most discriminant time-frequency features are power boosting and are relatively consistent among multiple sessions and subjects. Since the original discriminant time-frequency features are highly correlated, we constructed the uncorrelated features using hierarchical clustering for better classification of target and non-target images. With feature clustering, performance (area under ROC) improved from 0.85 to 0.89 on within-session tests, and from 0.76 to 0.84 on cross-subject tests. The constructed uncorrelated features were more robust than the original discriminant features and corresponded to a number of local regions on the time-frequency plane

The quest for the genuine visual mismatch negativity (vMMN): Event-related potential indications of deviance detection for low-level visual features

Research shows that the visual system monitors the environment for changes. For example, a left‐tilted bar, a deviant, that appears after several presentations of a right‐tilted bar, standards, elicits a classic visual mismatch negativity (vMMN): greater negativity for deviants than standards in event‐related potentials (ERPs) between 100 and 300 ms after onset of the deviant. The classic vMMN is contributed to by adaptation; it can be distinguished from the genuine vMMN that, through use of control conditions, compares standards and deviants that are equally adapted and physically identical. To determine whether the vMMN follows similar principles to the auditory mismatch negativity (MMN), in two experiments we searched for a genuine vMMN from simple, physiologically plausible stimuli that change in fundamental dimensions: orientation, contrast, phase, and spatial frequency. We carefully controlled for attention and eye movements. We found no evidence for the genuine vMMN, despite adequate statistical power. We conclude that either the genuine vMMN is a rather unstable phenomenon that depends on still‐to‐be‐identified experimental parameters, or it is confined to visual stimuli for which monitoring across time is more natural than monitoring over space, such as for high‐level features. We also observed an early deviant‐related positivity that we propose might reflect earlier predictive processing

Improving object segmentation by using EEG signals and rapid serial visual presentation

This paper extends our previous work on the potential of EEG-based brain computer interfaces to segment salient objects in images. The proposed system analyzes the Event Related Potentials (ERP) generated by the rapid serial visual presentation of windows on the image. The detection of the P300 signal allows estimating a saliency map of the image, which is used to seed a semi-supervised object segmentation algorithm. Thanks to the new contributions presented in this work, the average Jaccard index was improved from $0.47$ to $0.66$ when processed in our publicly available dataset of images, object masks and captured EEG signals. This work also studies alternative architectures to the original one, the impact of object occupation in each image window, and a more robust evaluation based on statistical analysis and a weighted F-score