The role of psychometrics in individual differences research in cognition: A case study of the AX-CPT

Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particularly when comparing correlations in different populations. Second, we demonstrate the importance of variability and reliability for evaluating potential failures to replicate predicted correlations, even within the same population. Third, we demonstrate how researchers can turn to evaluating psychometric properties as a way of evaluating the feasibility of utilizing the task in new settings (e.g., online administration). Lastly, we show how the examination of psychometric properties can help researchers make informed decisions when designing a study, such as determining the appropriate number of trials for a task

REsearching COVID to Enhance Recovery (RECOVER) pediatric study protocol: Rationale, objectives and design

IMPORTANCE: The prevalence, pathophysiology, and long-term outcomes of COVID-19 (post-acute sequelae of SARS-CoV-2 [PASC] or Long COVID ) in children and young adults remain unknown. Studies must address the urgent need to define PASC, its mechanisms, and potential treatment targets in children and young adults. OBSERVATIONS: We describe the protocol for the Pediatric Observational Cohort Study of the NIH\u27s REsearching COVID to Enhance Recovery (RECOVER) Initiative. RECOVER-Pediatrics is an observational meta-cohort study of caregiver-child pairs (birth through 17 years) and young adults (18 through 25 years), recruited from more than 100 sites across the US. This report focuses on two of four cohorts that comprise RECOVER-Pediatrics: 1) a de novo RECOVER prospective cohort of children and young adults with and without previous or current infection; and 2) an extant cohort derived from the Adolescent Brain Cognitive Development (ABCD) study (n = 10,000). The de novo cohort incorporates three tiers of data collection: 1) remote baseline assessments (Tier 1, n = 6000); 2) longitudinal follow-up for up to 4 years (Tier 2, n = 6000); and 3) a subset of participants, primarily the most severely affected by PASC, who will undergo deep phenotyping to explore PASC pathophysiology (Tier 3, n = 600). Youth enrolled in the ABCD study participate in Tier 1. The pediatric protocol was developed as a collaborative partnership of investigators, patients, researchers, clinicians, community partners, and federal partners, intentionally promoting inclusivity and diversity. The protocol is adaptive to facilitate responses to emerging science. CONCLUSIONS AND RELEVANCE: RECOVER-Pediatrics seeks to characterize the clinical course, underlying mechanisms, and long-term effects of PASC from birth through 25 years old. RECOVER-Pediatrics is designed to elucidate the epidemiology, four-year clinical course, and sociodemographic correlates of pediatric PASC. The data and biosamples will allow examination of mechanistic hypotheses and biomarkers, thus providing insights into potential therapeutic interventions. CLINICAL TRIALS.GOV IDENTIFIER: Clinical Trial Registration: http://www.clinicaltrials.gov. Unique identifier: NCT05172011

Peer Victimization and Dysfunctional Reward Processing: ERP and Behavioral Responses to Social and Monetary Rewards

Peer victimization (or bullying) is a known risk factor for depression, especially among youth. However, the mechanisms connecting victimization experience to depression symptoms remains unknown. As depression is known to be associated with neural blunting to monetary rewards, aberrant responsiveness to social rewards may be a key deficit connecting socially stressful experiences with later depression. We, therefore, sought to determine whether adolescents’ experiences with social stress would be related to their current response to social rewards over less socially relevant monetary rewards. Neural responses to monetary and social rewards were measured using event-related potentials (ERPs) to peer acceptance and rejection feedback (Island Getaway task) and to monetary reward and loss feedback (Doors task) in a sample of 56 late adolescents/emerging young adults followed longitudinally since preschool. In the Island Getaway task, participants voted whether to “keep” or “kick out” each co-player, providing an index of prosocial behavior, and then received feedback about how each player voted for the participant. Analyses tested whether early and recent peer victimization was related to response to rewards (peer acceptance or monetary gains), residualized for response to losses (peer rejection or monetary losses) using the reward positivity (RewP) component. Findings indicated that both experiencing greater early and greater recent peer victimization were significantly associated with participants casting fewer votes to keep other adolescents (“Keep” votes) and that greater early peer victimization was associated with reduced neural response to peer acceptance. Early and recent peer victimization were significantly more associated with neural response to social than monetary rewards. Together, these findings suggest that socially injurious experiences such as peer victimization, especially those occurring early in childhood, relate to two distinct but important findings: that early victimization is associated with later reduced response to peer acceptance, and is associated with later tendency to reject peers. Findings also suggest that there is evidence of specificity to reward processing of different types; thus, future research should expand studies of reward processing beyond monetary rewards to account for the possibility that individual differences may be related to other, more relevant, reward types

Prevalence and family-related factors associated with suicidal ideation, suicide attempts, and self-injury in children aged 9 to 10 years

Importance: Although suicide is a leading cause of death for children in the United States, and the rate of suicide in childhood has steadily increased, little is known about suicidal ideation and behaviors in children. Objective: To assess the overall prevalence of suicidal ideation, suicide attempts, and nonsuicidal self-injury, as well as family-related factors associated with suicidality and self-injury among preadolescent children. Design, Setting, and Participants: Cross-sectional study using retrospective analysis of the baseline sample from the Adolescent Brain Cognitive Development (ABCD) study. This multicenter investigation used an epidemiologically informed school-based recruitment strategy, with consideration of the demographic composition of the 21 ABCD sites and the United States as a whole. The sample included children aged 9 to 10 years and their caregivers. Main Outcomes and Measures: Lifetime suicidal ideation, suicide attempts, and nonsuicidal self-injury as reported by children and their caregivers in a computerized version of the Kiddie Schedule for Affective Disorders and Schizophrenia. Results: A total of 11 814 children aged 9 to 10 years (47.8% girls; 52.0% white) and their caregivers were included. After poststratification sociodemographic weighting, the approximate prevalence rates were 6.4% (95% CI, 5.7%-7.3%) for lifetime history of passive suicidal ideation; 4.4% (95% CI, 3.9%-5.0%) for nonspecific active suicidal ideation; 2.4% (95% CI, 2.1%-2.7%) for active ideation with method, intent, or plan; 1.3% (95% CI, 1.0%-1.6%) for suicide attempts; and 9.1% (95% CI, 8.1-10.3) for nonsuicidal self-injury. After covarying by sex, family history, internalizing and externalizing problems, and relevant psychosocial variables, high family conflict was significantly associated with suicidal ideation (odds ratio [OR], 1.12; 95% CI, 1.07-1.16) and nonsuicidal self-injury (OR, 1.09; 95% CI, 1.05-1.14), and low parental monitoring was significantly associated with ideation (OR, 0.97; 95% CI, 0.95-0.98), attempts (OR, 0.91; 95% CI, 0.86-0.97), and nonsuicidal self-injury (OR, 0.95; 95% CI, 0.93-0.98); these findings were consistent after internal replication. Most of children\u27s reports of suicidality and self-injury were either unknown or not reported by their caregivers. Conclusions and Relevance: This study demonstrates the association of family factors, including high family conflict and low parental monitoring, with suicidality and self-injury in children. Future research and ongoing prevention and intervention efforts may benefit from the examination of family factors

Both unmedicated and medicated individuals with schizophrenia show impairments across a wide array of cognitive and reinforcement learning tasks

BACKGROUND: Schizophrenia is a disorder characterized by pervasive deficits in cognitive functioning. However, few well-powered studies have examined the degree to which cognitive performance is impaired even among individuals with schizophrenia not currently on antipsychotic medications using a wide range of cognitive and reinforcement learning measures derived from cognitive neuroscience. Such research is particularly needed in the domain of reinforcement learning, given the central role of dopamine in reinforcement learning, and the potential impact of antipsychotic medications on dopamine function. METHODS: The present study sought to fill this gap by examining healthy controls (N = 75), unmedicated (N = 48) and medicated (N = 148) individuals with schizophrenia. Participants were recruited across five sites as part of the CNTRaCS Consortium to complete tasks assessing processing speed, cognitive control, working memory, verbal learning, relational encoding and retrieval, visual integration and reinforcement learning. RESULTS: Individuals with schizophrenia who were not taking antipsychotic medications, as well as those taking antipsychotic medications, showed pervasive deficits across cognitive domains including reinforcement learning, processing speed, cognitive control, working memory, verbal learning and relational encoding and retrieval. Further, we found that chlorpromazine equivalency rates were significantly related to processing speed and working memory, while there were no significant relationships between anticholinergic load and performance on other tasks. CONCLUSIONS: These findings add to a body of literature suggesting that cognitive deficits are an enduring aspect of schizophrenia, present in those off antipsychotic medications as well as those taking antipsychotic medications

Covariance and correlation analysis of resting state functional magnetic resonance imaging data acquired in a clinical trial of mindfulness-based stress reduction and exercise in older individuals

We describe and apply novel methodology for whole-brain analysis of resting state fMRI functional connectivity data, combining conventional multi-channel Pearson correlation with covariance analysis. Unlike correlation, covariance analysis preserves signal amplitude information, which feature of fMRI time series may carry physiological significance. Additionally, we demonstrate that dimensionality reduction of the fMRI data offers several computational advantages including projection onto a space of manageable dimension, enabling linear operations on functional connectivity measures and exclusion of variance unrelated to resting state network structure. We show that group-averaged, dimensionality reduced, covariance and correlation matrices are related, to reasonable approximation, by a single scalar factor. We apply this methodology to the analysis of a large, resting state fMRI data set acquired in a prospective, controlled study of mindfulness training and exercise in older, sedentary participants at risk for developing cognitive decline. Results show marginally significant effects of both mindfulness training and exercise in both covariance and correlation measures of functional connectivity

The characteristics of cognitive neuroscience tests in a schizophrenia cognition clinical trial: Psychometric properties and correlations with standard measures.

In comparison to batteries of standard neuropsychological tests, cognitive neuroscience tests may offer a more specific assessment of discrete neurobiological processes that may be aberrant in schizophrenia. However, more information regarding psychometric properties and correlations with standard neuropsychological tests and functional measures is warranted to establish their validity as treatment outcome measures. The N-back and AX-Continuous Performance Task (AX-CPT) are two promising cognitive neuroscience tests designed to measure specific components of working memory and contextual processing respectively. In the current study, we report the psychometric properties of multiple outcome measures from these two tests as well as their correlations with standard neuropsychological measures and functional capacity measures. The results suggest that while the AX-CPT and N-back display favorable psychometric properties, they do not exhibit greater sensitivity or specificity with functional measures than standard neurocognitive tests

Prenatal exposure to maternal social disadvantage and psychosocial stress and neonatal white matter connectivity at birth

Early life adversity (social disadvantage and psychosocial stressors) is associated with altered microstructure in fronto-limbic pathways important for socioemotional development. Understanding when these associations begin to emerge may inform the timing and design of preventative interventions. In this longitudinal study, 399 mothers were oversampled for low income and completed social background measures during pregnancy. Measures were analyzed with structural equation analysis resulting in two latent factors: social disadvantage (education, insurance status, income-to-needs ratio [INR], neighborhood deprivation, and nutrition) and psychosocial stress (depression, stress, life events, and racial discrimination). At birth, 289 healthy term-born neonates underwent a diffusion MRI (dMRI) scan. Mean diffusivity (MD) and fractional anisotropy (FA) were measured for the dorsal and inferior cingulum bundle (CB), uncinate, and fornix using probabilistic tractography in FSL. Social disadvantage and psychosocial stress were fitted to dMRI parameters using regression models adjusted for infant postmenstrual age at scan and sex. Social disadvantage, but not psychosocial stress, was independently associated with lower MD in the bilateral inferior CB and left uncinate, right fornix, and lower MD and higher FA in the right dorsal CB. Results persisted after accounting for maternal medical morbidities and prenatal drug exposure. In moderation analysis, psychosocial stress was associated with lower MD in the left inferior CB among the lower-to-higher socioeconomic status (SES) (INR ≥ 200%) group, but not the extremely low SES (INR \u3c 200%) group. Increasing access to social welfare programs that reduce the burden of social disadvantage and related psychosocial stressors may be an important target to protect fetal brain development in fronto-limbic pathways