CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generation

We propose a method to control the attributes of Language Models (LMs) for the text generation task using Causal Average Treatment Effect (ATE) scores and counterfactual augmentation. We explore this method, in the context of LM detoxification, and propose the Causally Fair Language (CFL) architecture for detoxifying pre-trained LMs in a plug-and-play manner. Our architecture is based on a Structural Causal Model (SCM) that is mathematically transparent and computationally efficient as compared with many existing detoxification techniques. We also propose several new metrics that aim to better understand the behaviour of LMs in the context of toxic text generation. Further, we achieve state of the art performance for toxic degeneration, which are computed using \RTP (RTP) benchmark. Our experiments show that CFL achieves such a detoxification without much impact on the model perplexity. We also show that CFL mitigates the unintended bias problem through experiments on the BOLD dataset.Comment: 19 pages, 10 figures. Findings of ACL 202

Reproducible Brain Charts: An Open Data Resource for Mapping the Developing Brain and Mental Health

Reproducible Brain Charts (RBC) is an open data resource that harmonizes several of the largest studies of brain development in youth

Cognitive-Behavioral Interventions Targeting Alcohol or Other Drug Use and Co-Occurring Mental Health Disorders: A Meta-Analysis.

AimsThis meta-analysis reviewed 15 clinical trials (18 study sites/arms), examining the efficacy of an integrated cognitive-behavioral intervention (CBI) delivered to individuals with an alcohol or other drug use disorder and a co-occurring mental health disorder (AOD/MHD). Outcomes were alcohol or other drug use and mental health symptoms at post-treatment through follow-up.MethodsThe inverse-variance weighted effect size was calculated for each study and pooled under random effects assumptions.ResultsIntegrated CBI showed a small effect size for AOD (g = 0.188, P = 0.061; I2 = 86%, τ2 = 0.126, k = 18) and MHD (g = 0.169, P = 0.024; I2 = 58%, τ2 = 0.052, k = 18) outcomes, although only MHD outcomes were statistically significant. Analysis by subgroup suggested that effect magnitude varied by type of contrast condition (integrated CBI + usual care vs. usual care only; integrated CBI vs. a single-disorder intervention), follow-up time point (post-treatment vs. 3-6 months) and primary AOD/MHD diagnosis, although these sub-groups often contained significant residual heterogeneity. In a series of mixed effects, meta-regression models, demographic factors were non-significant predictors of between-study heterogeneity. For AOD outcomes, greater effects were observed in higher quality studies, but study quality was not related to effect size variability for MHD outcomes.ConclusionsThe current meta-analysis shows a small and variable effect for integrated CBI with the most promising effect sizes observed for integrated CBI compared with a single disorder intervention (typically an AOD-only intervention) for follow-up outcomes, and for interventions targeting alcohol use and/or post-traumatic stress disorder. Given the clinical and methodological variability within the sample, results should be considered a preliminary, but important step forward in our understanding of treatment for co-occurring AOD/MHD

Individual differences in delay discounting are associated with dorsal prefrontal cortex connectivity in children, adolescents, and adults

Delay discounting is a measure of impulsive choice relevant in adolescence as it predicts many real-life outcomes, including obesity and academic achievement. However, resting-state functional networks underlying individual differences in delay discounting during youth remain incompletely described. Here we investigate the association between multivariate patterns of functional connectivity and individual differences in impulsive choice in a large sample of children, adolescents, and adults. A total of 293 participants (9–23 years) completed a delay discounting task and underwent 3T resting-state fMRI. A connectome-wide analysis using multivariate distance-based matrix regression was used to examine whole-brain relationships between delay discounting and functional connectivity. These analyses revealed that individual differences in delay discounting were associated with patterns of connectivity emanating from the left dorsal prefrontal cortex, a default mode network hub. Greater delay discounting was associated with greater functional connectivity between the dorsal prefrontal cortex and other default mode network regions, but reduced connectivity with regions in the dorsal and ventral attention networks. These results suggest delay discounting in children, adolescents, and adults is associated with individual differences in relationships both within the default mode network and between the default mode and networks involved in attentional and cognitive control

ModelArray: An R package for statistical analysis of fixel-wise data

ABSTRACT: Diffusion MRI is the dominant non-invasive imaging method used to characterize white matter organization in health and disease. Increasingly, fiber-specific properties within a voxel are analyzed using fixels. While tools for conducting statistical analyses of fixel-wise data exist, currently available tools support only a limited number of statistical models. Here we introduce ModelArray, an R package for mass-univariate statistical analysis of fixel-wise data. At present, ModelArray supports linear models as well as generalized additive models (GAMs), which are particularly useful for studying nonlinear effects in lifespan data. In addition, ModelArray also aims for scalable analysis. With only several lines of code, even large fixel-wise datasets can be analyzed using a standard personal computer. Detailed memory profiling revealed that ModelArray required only limited memory even for large datasets. As an example, we applied ModelArray to fixel-wise data derived from diffusion images acquired as part of the Philadelphia Neurodevelopmental Cohort (n = 938). ModelArray revealed anticipated nonlinear developmental effects in white matter. Moving forward, ModelArray is supported by an open-source software development model that can incorporate additional statistical models and other imaging data types. Taken together, ModelArray provides a flexible and efficient platform for statistical analysis of fixel-wise data