On Masked Pre-training and the Marginal Likelihood

Masked pre-training removes random input dimensions and learns a model that can predict the missing values. Empirical results indicate that this intuitive form of self-supervised learning yields models that generalize very well to new domains. A theoretical understanding is, however, lacking. This paper shows that masked pre-training with a suitable cumulative scoring function corresponds to maximizing the model's marginal likelihood, which is de facto the Bayesian model selection measure of generalization. Beyond shedding light on the success of masked pre-training, this insight also suggests that Bayesian models can be trained with appropriately designed self-supervision. Empirically, we confirm the developed theory and explore the main learning principles of masked pre-training in large language models

Neratinib protects pancreatic beta cells in diabetes

The loss of functional insulin-producing β-cells is a hallmark of diabetes. Mammalian sterile 20-like kinase 1 (MST1) is a key regulator of pancreatic β-cell death and dysfunction; its deficiency restores functional β-cells and normoglycemia. The identification of MST1 inhibitors represents a promising approach for a β-cell-protective diabetes therapy. Here, we identify neratinib, an FDA-approved drug targeting HER2/EGFR dual kinases, as a potent MST1 inhibitor, which improves β-cell survival under multiple diabetogenic conditions in human islets and INS-1E cells. In a pre-clinical study, neratinib attenuates hyperglycemia and improves β-cell function, survival and β-cell mass in type 1 (streptozotocin) and type 2 (obese Leprdb/db) diabetic mouse models. In summary, neratinib is a previously unrecognized inhibitor of MST1 and represents a potential β-cell-protective drug with proof-of-concept in vitro in human islets and in vivo in rodent models of both type 1 and type 2 diabetes

The lancet weight determines wheal diameter in response to skin prick testing with histamine

BACKGROUND:Skin prick test (SPT) is a common test for diagnosing immunoglobulin E-mediated allergies. In clinical routine, technicalities, human errors or patient-related biases, occasionally results in suboptimal diagnosis of sensitization. OBJECTIVE:Although not previously assessed qualitatively, lancet weight is hypothesized to be important when performing SPT to minimize the frequency of false positives, false negatives, and unwanted discomfort. METHODS:Accurate weight-controlled SPT was performed on the volar forearms and backs of 20 healthy subjects. Four predetermined lancet weights were applied (25 g, 85 g, 135 g and 265 g) using two positive control histamine solutions (1 mg/mL and 10 mg/mL) and one negative control (saline). A total of 400 SPTs were conducted. The outcome parameters were: wheal size, neurogenic inflammation (measured by superficial blood perfusion), frequency of bleeding, and the lancet provoked pain response. RESULTS:The mean wheal diameter increased significantly as higher weights were applied to the SPT lancet, e.g. from 3.2 ± 0.28 mm at 25 g to 5.4 ± 1.7 mm at 265 g (p<0.01). Similarly, the frequency of bleeding, the provoked pain, and the neurogenic inflammatory response increased significantly. At 265 g saline evoked two wheal responses (/160 pricks) below 3 mm. CONCLUSION AND CLINICAL RELEVANCE:The applied weight of the lancet during the SPT-procedure is an important factor. Higher lancet weights precipitate significantly larger wheal reactions with potential diagnostic implications. This warrants additional research of the optimal lancet weight in relation to SPT-guidelines to improve the specificity and sensitivity of the procedure

Pitfalls in machine learning-based assessment of tumor-infiltrating lymphocytes in breast cancer: a report of the international immuno-oncology biomarker working group

The clinical significance of the tumor-immune interaction in breast cancer is now established, and tumor-infiltrating lymphocytes (TILs) have emerged as predictive and prognostic biomarkers for patients with triple-negative (estrogen receptor, progesterone receptor, and HER2-negative) breast cancer and HER2-positive breast cancer. How computational assessments of TILs might complement manual TIL assessment in trial and daily practices is currently debated. Recent efforts to use machine learning (ML) to automatically evaluate TILs have shown promising results. We review state-of-the-art approaches and identify pitfalls and challenges of automated TIL evaluation by studying the root cause of ML discordances in comparison to manual TIL quantification. We categorize our findings into four main topics: (1) technical slide issues, (2) ML and image analysis aspects, (3) data challenges, and (4) validation issues. The main reason for discordant assessments is the inclusion of false-positive areas or cells identified by performance on certain tissue patterns or design choices in the computational implementation. To aid the adoption of ML for TIL assessment, we provide an in-depth discussion of ML and image analysis, including validation issues that need to be considered before reliable computational reporting of TILs can be incorporated into the trial and routine clinical management of patients with triple-negative breast cancer. © 2023 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland

CommonMind Consortium provides transcriptomic and epigenomic data for Schizophrenia and Bipolar Disorder

Schizophrenia and bipolar disorder are serious mental illnesses that affect more than 2% of adults. While large-scale genetics studies have identified genomic regions associated with disease risk, less is known about the molecular mechanisms by which risk alleles with small effects lead to schizophrenia and bipolar disorder. In order to fill this gap between genetics and disease phenotype, we have undertaken a multi-cohort genomics study of postmortem brains from controls, individuals with schizophrenia and bipolar disorder. Here we present a public resource of functional genomic data from the dorsolateral prefrontal cortex (DLPFC; Brodmann areas 9 and 46) of 986 individuals from 4 separate brain banks, including 353 diagnosed with schizophrenia and 120 with bipolar disorder. The genomic data include RNA-seq and SNP genotypes on 980 individuals, and ATAC-seq on 269 individuals, of which 264 are a subset of individuals with RNA-seq. We have performed extensive preprocessing and quality control on these data so that the research community can take advantage of this public resource available on the Synapse platform at http://CommonMind.org

Identification of common genetic risk variants for autism spectrum disorder

Autism spectrum disorder (ASD) is a highly heritable and heterogeneous group of neurodevelopmental phenotypes diagnosed in more than 1% of children. Common genetic variants contribute substantially to ASD susceptibility, but to date no individual variants have been robustly associated with ASD. With a marked sample-size increase from a unique Danish population resource, we report a genome-wide association meta-analysis of 18,381 individuals with ASD and 27,969 controls that identified five genome-wide-significant loci. Leveraging GWAS results from three phenotypes with significantly overlapping genetic architectures (schizophrenia, major depression, and educational attainment), we identified seven additional loci shared with other traits at equally strict significance levels. Dissecting the polygenic architecture, we found both quantitative and qualitative polygenic heterogeneity across ASD subtypes. These results highlight biological insights, particularly relating to neuronal function and corticogenesis, and establish that GWAS performed at scale will be much more productive in the near term in ASD.Peer reviewe

Pitfalls in machine learning‐based assessment of tumor‐infiltrating lymphocytes in breast cancer: a report of the international immuno‐oncology biomarker working group

The clinical significance of the tumor-immune interaction in breast cancer (BC) has been well established, and tumor-infiltrating lymphocytes (TILs) have emerged as a predictive and prognostic biomarker for patients with triple-negative (estrogen receptor, progesterone receptor, and HER2 negative) breast cancer (TNBC) and HER2-positive breast cancer. How computational assessment of TILs can complement manual TIL-assessment in trial- and daily practices is currently debated and still unclear. Recent efforts to use machine learning (ML) for the automated evaluation of TILs show promising results. We review state-of-the-art approaches and identify pitfalls and challenges by studying the root cause of ML discordances in comparison to manual TILs quantification. We categorize our findings into four main topics; (i) technical slide issues, (ii) ML and image analysis aspects, (iii) data challenges, and (iv) validation issues. The main reason for discordant assessments is the inclusion of false-positive areas or cells identified by performance on certain tissue patterns, or design choices in the computational implementation. To aid the adoption of ML in TILs assessment, we provide an in-depth discussion of ML and image analysis including validation issues that need to be considered before reliable computational reporting of TILs can be incorporated into the trial- and routine clinical management of patients with TNBC

A genetic investigation of sex bias in the prevalence of attention-deficit/hyperactivity disorder

Background Attention-deficit/hyperactivity disorder (ADHD) shows substantial heritability and is 2-7 times more common in males than females. We examined two putative genetic mechanisms underlying this sex bias: sex-specific heterogeneity and higher burden of risk in female cases. Methods We analyzed genome-wide autosomal common variants from the Psychiatric Genomics Consortium and iPSYCH Project (20,183 cases, 35,191 controls) and Swedish populationregister data (N=77,905 cases, N=1,874,637 population controls). Results Genetic correlation analyses using two methods suggested near complete sharing of common variant effects across sexes, with rg estimates close to 1. Analyses of population data, however, indicated that females with ADHD may be at especially high risk of certain comorbid developmental conditions (i.e. autism spectrum disorder and congenital malformations), potentially indicating some clinical and etiological heterogeneity. Polygenic risk score (PRS) analysis did not support a higher burden of ADHD common risk variants in female cases (OR=1.02 [0.98-1.06], p=0.28). In contrast, epidemiological sibling analyses revealed that the siblings of females with ADHD are at higher familial risk of ADHD than siblings of affected males (OR=1.14, [95% CI: 1.11-1.18], p=1.5E-15). Conclusions Overall, this study supports a greater familial burden of risk in females with ADHD and some clinical and etiological heterogeneity, based on epidemiological analyses. However, molecular genetic analyses suggest that autosomal common variants largely do not explain the sex bias in ADHD prevalence