AI Risk Profiles: A Standards Proposal for Pre-Deployment AI Risk Disclosures

As AI systems' sophistication and proliferation have increased, awareness of the risks has grown proportionally (Sorkin et al. 2023). In response, calls have grown for stronger emphasis on disclosure and transparency in the AI industry (NTIA 2023; OpenAI 2023b), with proposals ranging from standardizing use of technical disclosures, like model cards (Mitchell et al. 2019), to yet-unspecified licensing regimes (Sindhu 2023). Since the AI value chain is complicated, with actors representing various expertise, perspectives, and values, it is crucial that consumers of a transparency disclosure be able to understand the risks of the AI system the disclosure concerns. In this paper we propose a risk profiling standard which can guide downstream decision-making, including triaging further risk assessment, informing procurement and deployment, and directing regulatory frameworks. The standard is built on our proposed taxonomy of AI risks, which reflects a high-level categorization of the wide variety of risks proposed in the literature. We outline the myriad data sources needed to construct informative Risk Profiles and propose a template-based methodology for collating risk information into a standard, yet flexible, structure. We apply this methodology to a number of prominent AI systems using publicly available information. To conclude, we discuss design decisions for the profiles and future work

Insistence on sameness relates to increased covariance of gray matter structure in autism spectrum disorder.

BACKGROUND: Autism spectrum disorder (ASD) is characterized by atypical development of cortical and subcortical gray matter volume. Subcortical structural changes have been associated with restricted and repetitive behavior (RRB), a core component of ASD. Behavioral studies have identified insistence on sameness (IS) as a separable RRB dimension prominent in high-functioning ASD, though no simple brain-behavior relationship has emerged. Structural covariance, a measure of morphological coupling among brain regions using magnetic resonance imaging (MRI), has proven an informative measure of anatomical relationships in typical development and neurodevelopmental disorders. In this study, we use this measure to characterize the relationship between brain structure and IS. METHODS: We quantified the structural covariance of cortical and subcortical gray matter volume in 55 individuals with high-functioning ASD using 3T MRI. We then related these structural metrics to individual IS scores, as assessed by the Repetitive Behavior Scale-Revised (RBS-R). RESULTS: We found that increased coupling among subcortical regions and between subcortical and cortical regions related to greater IS symptom severity. Most pronounced, the striatum and amygdala participated in a plurality of identified relationships, indicating a central role for these structures in IS symptomatology. These structural associations were specific to IS and did not relate to any of the other RRB subcomponents measured by the RBS-R. CONCLUSIONS: This study indicates that behavioral dimensions in ASD can relate to the coordination of development across multiple brain regions, which might be otherwise obscured using typical brain-behavior correlations. It also expands the structures traditionally related to RRB in ASD and provides neuroanatomical evidence supportive of IS as a separate RRB dimension. TRIAL REGISTRATION: ClinicalTrials.gov NCT01031407

The Experiment Factory: Standardizing Behavioral Experiments

The administration of behavioral and experimental paradigms for psychology research is hindered by lack of a coordinated effort to develop and deploy standardized paradigms. While several frameworks (de Leeuw (2015); McDonnell et al. (2012); Mason and Suri (2011); Lange et al. (2015)) have provided infrastructure and methods for individual research groups to develop paradigms, missing is a coordinated effort to develop paradigms linked with a system to easily deploy them. This disorganization leads to redundancy in development, divergent implementations of conceptually identical tasks, disorganized and error-prone code lacking documentation, and difficulty in replication. The ongoing reproducibility crisis in psychology and neuroscience research (Baker (2015); Open Science Collaboration (2015)) highlights the urgency of this challenge: reproducible research in behavioral psychology is conditional on deployment of equivalent experiments. A large, accessible repository of experiments for researchers to develop collaboratively is most efficiently accomplished through an open source framework. Here we present the Experiment Factory, an open source framework for the development and deployment of web-based experiments. The modular infrastructure includes experiments, virtual machines for local or cloud deployment, and an application to drive these components and provide developers with functions and tools for further extension. We release this infrastructure with a deployment (http://www.expfactory.org) that researchers are currently using to run a set of over 80 standardized web-based experiments on Amazon Mechanical Turk. By providing open source tools for both deployment and development, this novel infrastructure holds promise to bring reproducibility to the administration of experiments, and accelerate scientific progress by providing a shared community resource of psychological paradigms

Cycling and Female Sexual and Urinary Function: Results From a Large, Multinational, Cross-Sectional Study.

BACKGROUND:Bicycle riding has become an increasingly popular mode of transportation and exercise, especially among women, and previous studies have demonstrated a relationship between cycling and sexual dysfunction, albeit using non-validated questionnaires. AIM:We aimed to explore the relationship between cycling and sexual and urinary dysfunction. METHODS:Cyclists were recruited to complete a survey through Facebook advertisements and outreach to sporting clubs across 5 English-speaking countries. Swimmers and runners were recruited as a comparison group. OUTCOMES:Participants were queried using validated questionnaires, including the Female Sexual Function Index, the American Urological Association Symptom Index, and non-validated questions about history of urinary tract infections (UTIs), genital numbness, and genital saddle sores (all self-reported). RESULTS:3,118 (53.3%) Women completed the survey, comprising 1,053 (34%) non-cyclists, 1,656 (53%) low-intensity cyclists, and 409 (13%) high-intensity cyclists. After adjusting for age, body mass index, hypertension, diabetes, ischemic heart disease, tobacco use, race, marital status, urinary symptoms, and sexual activity, high-intensity cyclists had lower odds of self-reported sexual dysfunction compared to non-cyclists (adjusted odds ratio [aOR] 0.7, P = .02). There were no statistically significant differences in urinary symptoms across groups. Compared to non-cyclists, both low- and high-intensity cyclists had higher odds of reporting a previous UTI (aOR 1.4, P < .001, and aOR 1.4, P = .009, respectively), genital numbness (odds ratio [OR] 6.5, P < .001, and OR 9.1, P < .001, respectively), and saddle sores (OR 6.3, P < .001, and OR 22.7, P < .001, respectively). CLINICAL TRANSLATION:Women cyclists were more likely to report other genitourinary conditions, including UTIs, genital numbness, and saddle sores. CONCLUSIONS:This is the largest study comparing cyclists to other athletes with respect to sexual and urinary function. The study is limited by its cross-sectional design and sampling methods. We found that women cyclists were no more likely to report sexual dysfunction or urinary symptoms than swimmers or runners. Gaither TW, Awad MA, Murphy GP, et al. Cycling and Female Sexual and Urinary Function: Results From a Large, Multinational, Cross-Sectional Study. J Sex Med 2018;15:510-518

Cognitive tasks, anatomical MRI, and functional MRI data evaluating the construct of self-regulation

We describe the following shared data from N = 103 healthy adults who completed a broad set of cognitive tasks, surveys, and neuroimaging measurements to examine the construct of self-regulation. The neuroimaging acquisition involved task-based fMRI, resting state fMRI, and structural MRI. Each subject completed the following ten tasks in the scanner across two 90-minute scanning sessions: attention network test (ANT), cued task switching, Columbia card task, dot pattern expectancy (DPX), delay discounting, simple and motor selective stop signal, Stroop, a towers task, and a set of survey questions. The dataset is shared openly through the OpenNeuro project, and the dataset is formatted according to the Brain Imaging Data Structure (BIDS) standard

The interpretation of systematic reviews with meta-analyses: an objective or subjective process?

<p>Abstract</p> <p>Background</p> <p>Discrepancies between the conclusions of different meta-analyses (quantitative syntheses of systematic reviews) are often ascribed to methodological differences. The objective of this study was to determine the discordance in interpretations when meta-analysts are presented with identical data.</p> <p>Methods</p> <p>We searched the literature for all randomized clinical trials (RCT) and review articles on the efficacy of intravenous magnesium in the early post-myocardial infarction period. We organized the articles chronologically and grouped them in packages. The first package included the first RCT, and a summary of the review articles published prior to first RCT. The second package contained the second and third RCT, a meta-analysis based on the data, and a summary of all review articles published prior to the third RCT. Similar packages were created for the 5^thRCT, 10^thRCT, 20^thRCT and 23^rdRCT (all articles). We presented the packages one at a time to eight different reviewers and asked them to answer three clinical questions after each package based solely on the information provided. The clinical questions included whether 1) they believed magnesium is now proven beneficial, 2) they believed magnesium will eventually be proven to be beneficial, and 3) they would recommend its use at this time.</p> <p>Results</p> <p>There was considerable disagreement among the reviewers for each package, and for each question. The discrepancies increased when the heterogeneity of the data increased. In addition, some reviewers became more sceptical of the effectiveness of magnesium over time, and some reviewers became less sceptical.</p> <p>Conclusion</p> <p>The interpretation of the results of systematic reviews with meta-analyses includes a subjective component that can lead to discordant conclusions that are independent of the methodology used to obtain or analyse the data.</p

Identification of Reference Genes across Physiological States for qRT-PCR through Microarray Meta-Analysis

The accuracy of quantitative real-time PCR (qRT-PCR) is highly dependent on reliable reference gene(s). Some housekeeping genes which are commonly used for normalization are widely recognized as inappropriate in many experimental conditions. This study aimed to identify reference genes for clinical studies through microarray meta-analysis of human clinical samples.After uniform data preprocessing and data quality control, 4,804 Affymetrix HU-133A arrays performed by clinical samples were classified into four physiological states with 13 organ/tissue types. We identified a list of reference genes for each organ/tissue types which exhibited stable expression across physiological states. Furthermore, 102 genes identified as reference gene candidates in multiple organ/tissue types were selected for further analysis. These genes have been frequently identified as housekeeping genes in previous studies, and approximately 71% of them fall into Gene Expression (GO:0010467) category in Gene Ontology.Based on microarray meta-analysis of human clinical sample arrays, we identified sets of reference gene candidates for various organ/tissue types and then examined the functions of these genes. Additionally, we found that many of the reference genes are functionally related to transcription, RNA processing and translation. According to our results, researchers could select single or multiple reference gene(s) for normalization of qRT-PCR in clinical studies

Guidelines and Recommendations on Yeast Cell Death Nomenclature

Elucidating the biology of yeast in its full complexity has major implications for science, medicine and industry. One of the most critical processes determining yeast life and physiology is cellular demise. However, the investigation of yeast cell death is a relatively young field, and a widely accepted set of concepts and terms is still missing. Here, we propose unified criteria for the definition of accidental, regulated, and programmed forms of cell death in yeast based on a series of morphological and biochemical criteria. Specifically, we provide consensus guidelines on the differential definition of terms including apoptosis, regulated necrosis, and autophagic cell death, as we refer to additional cell death routines that are relevant for the biology of (at least some species of) yeast. As this area of investigation advances rapidly, changes and extensions to this set of recommendations will be implemented in the years to come. Nonetheless, we strongly encourage the authors, reviewers and editors of scientific articles to adopt these collective standards in order to establish an accurate framework for yeast cell death research and, ultimately, to accelerate the progress of this vibrant field of research