Contralateral delay activity as a marker of visual working memory capacity: a multi-site registered replication

Visual working memory (VWM) is a temporary storage system capable of retaining information that can be accessed and manipulated by higher cognitive processes, thereby facilitating a wide range of cognitive functions. Electroencephalography (EEG) is used to understand the neural correlates of VWM with high temporal precision, and one commonly used EEG measure is an event-related potential called the contralateral delay activity (CDA). In a landmark study by Vogel and Machizawa (2004), the authors found that the CDA amplitude increases with the number of items stored in VWM and plateaus around three to four items, which is thought to represent the typical adult working memory capacity. Critically, this study also showed that the increase in CDA amplitude between two-item and four-item arrays correlated with individual subjects’ VWM performance. Although these results have been supported by subsequent studies, a recent study suggested that the number of subjects used in experiments investigating the CDA may not be sufficient to detect differences in set size and to provide a reliable account of the relationship between behaviorally measured VWM capacity and the CDA amplitude. To address this, the current study, as part of the #EEGManyLabs project, aims to conduct a multi-site replication of Vogel and Machizawa's (2004) seminal study on a large sample of participants, with a pre-registered analysis plan. Through this, our goal is to contribute to deepening our understanding of the neural correlates of visual working memory

One hundred years of EEG for brain and behaviour research

On the centenary of the first human EEG recording, more than 500 experts reflect on the impact that this discovery has had on our understanding of the brain and behaviour. We document their priorities and call for collective action focusing on validity, democratization and responsibility to realize the potential of EEG in science and society over the next 100 years

Reevaluating Psychophysiology: The Imperative of Psychometric Rigor

This OSF project supports the talk Reevaluating Psychophysiology: The Imperative of Psychometric Rigor given at the 2023 Annual Meeting of the Society for Psychophysiological Research

Moderators of the Internal Consistency of Error-related Negativity Scores: A Meta-analysis of Internal Consistency Estimates

To ensure adequate reliability (i.e., internal consistency), it is common in studies using event-related brain potentials (ERPs) to exclude participants for having too few trials. This practice is particularly relevant for error-related ERPs, such as error-related negativity (ERN), where the number of recorded ERN trials is not entirely under the researcher\u27s control. Furthermore, there is a widespread practice of inferring reliability based on published psychometric research, which assumes that internal consistency is a universal property of ERN. The present, preregistered reliability generalization study examined whether there is heterogeneity in internal consistency estimates of ERN scores and whether contextual factors moderate reliability. A total of 189 internal consistency estimates from 68 samples nested within 43 studies (n = 4,499 total participants) were analyzed. There was substantial heterogeneity in ERN score internal consistency, which was partially moderated by the type of paradigm (e.g., Stroop, flanker), the clinical status of the sample, the ocular artifact correction procedure, measurement sensors (single versus cluster), and the approach to scoring and estimating reliability, suggesting that contextual factors impact internal consistency at the individual study level. Age, sex, year of publication, artifact rejection procedure, acquisition system, sample type (undergraduate versus community), and length of mean amplitude window did not significantly moderate reliability. Notably, the overall estimated reliability of ERN scores was below established standards. Recommendations for improving ERN score reliability are provided, but the routine failure of most ERN studies to report internal consistency represents a substantial barrier to understanding the factors that impact reliability

Moderators of the Internal Consistency of Error-Related Negativity Scores: A Meta-Analysis of Internal Consistency Estimates

To ensure adequate reliability (i.e., internal consistency), it is common in studies using event-related brain potentials (ERPs) to exclude participants for having too few trials. This practice is particularly relevant for error-related ERPs, such as error-related negativity (ERN), where the number of recorded ERN trials is not entirely under the researcher’s control. Furthermore, there is a widespread practice of inferring reliability based on published psychometric research, which assumes that internal consistency is a universal property of ERN. The present, preregistered reliability generalization study examined whether there is heterogeneity in internal consistency estimates of ERN scores and whether contextual factors moderate reliability. A total of 189 internal consistency estimates from 68 samples nested within 43 studies (n = 4,499 total participants) were analyzed. There was substantial heterogeneity in ERN score internal consistency, which was partially moderated by the type of paradigm (e.g., Stroop, flanker), the clinical status of the sample, the ocular artifact correction procedure, measurement sensors (single vs. cluster), and the approach to scoring and estimating reliability, suggesting that contextual factors impact internal consistency at the individual study level. Age, sex, year of publication, artifact rejection procedure, acquisition system, sample type (undergraduate vs. community), and length of mean amplitude window did not significantly moderate reliability. Notably, the overall estimated reliability of ERN scores was below established standards. Recommendations for improving ERN score reliability are provided, but the routine failure of most ERN studies to report internal consistency represents a substantial barrier to understanding the factors that impact reliability

Multiverse Analysis of Psychophysiological Data

Psychophysiological research is an inherently complex undertaking due to the nature of the data, and its analysis is characterized by many decision points that shape the final dataset and a study’s findings. These decisions create a “multiverse” of potential outcomes, and each decision from study conceptualization to statistical analysis can lead to different results and interpretations. This review describes the concept of multiverse analyses, a methodological approach designed to understand the impact of different decisions on the robustness of the study findings and interpretation. The emphasis is on transparently showcasing different reasonable approaches for constructing a final dataset and on highlighting the influence of various decision points, from experimental design to data processing and outcome selection. For example, the choice of an experimental task can significantly impact event-related potential (ERP) scores or skin conductance responses (SCRs), and different tasks might elicit unique variances in each measure. The review underscores the importance of transparently embracing the flexibility inherent in psychophysiological research and the potential consequences of not understanding the fragility or robustness of experimental findings. By navigating the intricate terrain of the psychophysiological multiverse, this review serves as a guide, helping researchers make informed decisions, improve the collective understanding of psychophysiological findings, and push the boundaries of the field

ERN Score Internal Consistency: A Reliability Generalization Meta-Analysis

The purpose of the present study was to identify moderators of ERN score internal consistency

Adaptation to emotional conflict: evidence from a novel face emotion paradigm.

The preponderance of research on trial-by-trial recruitment of affective control (e.g., conflict adaptation) relies on stimuli wherein lexical word information conflicts with facial affective stimulus properties (e.g., the face-Stroop paradigm where an emotional word is overlaid on a facial expression). Several studies, however, indicate different neural time course and properties for processing of affective lexical stimuli versus affective facial stimuli. The current investigation used a novel task to examine control processes implemented following conflicting emotional stimuli with conflict-inducing affective face stimuli in the absence of affective words. Forty-one individuals completed a task wherein the affective-valence of the eyes and mouth were either congruent (happy eyes, happy mouth) or incongruent (happy eyes, angry mouth) while high-density event-related potentials (ERPs) were recorded. There was a significant congruency effect and significant conflict adaptation effects for error rates. Although response times (RTs) showed a significant congruency effect, the effect of previous-trial congruency on current-trial RTs was only present for current congruent trials. Temporospatial principal components analysis showed a P3-like ERP source localized using FieldTrip software to the medial cingulate gyrus that was smaller on incongruent than congruent trials and was significantly influenced by the recruitment of control processes following previous-trial emotional conflict (i.e., there was significant conflict adaptation in the ERPs). Results show that a face-only paradigm may be sufficient to elicit emotional conflict and suggest a system for rapidly detecting conflicting emotional stimuli and subsequently adjusting control resources, similar to cognitive conflict detection processes, when using conflicting facial expressions without words