From Human Days to Machine Seconds: Automatically Answering and Generating Machine Learning Final Exams

A final exam in machine learning at a top institution such as MIT, Harvard, or Cornell typically takes faculty days to write, and students hours to solve. We demonstrate that large language models pass machine learning finals at a human level, on finals available online after the models were trained, and automatically generate new human-quality final exam questions in seconds. Previous work has developed program synthesis and few-shot learning methods to solve university-level problem set questions in mathematics and STEM courses. In this work, we develop and compare methods that solve final exams, which differ from problem sets in several ways: the questions are longer, have multiple parts, are more complicated, and span a broader set of topics. We curate a dataset and benchmark of questions from machine learning final exams available online and code for answering these questions and generating new questions. We show how to generate new questions from other questions and course notes. For reproducibility and future research on this final exam benchmark, we use automatic checkers for multiple-choice, numeric, and questions with expression answers. We perform ablation studies comparing zero-shot learning with few-shot learning and chain-of-thought prompting using GPT-3, OPT, Codex, and ChatGPT across machine learning topics and find that few-shot learning methods perform best. We highlight the transformative potential of language models to streamline the writing and solution of large-scale assessments, significantly reducing the workload from human days to mere machine seconds. Our results suggest that rather than banning large language models such as ChatGPT in class, instructors should teach students to harness them by asking students meta-questions about correctness, completeness, and originality of the responses generated, encouraging critical thinking in academic studies.Comment: 9 page

Defining the causes of sporadic Parkinson's disease in the global Parkinson's genetics program (GP2)

The Global Parkinson's Genetics Program (GP2) will genotype over 150,000 participants from around the world, and integrate genetic and clinical data for use in large-scale analyses to dramatically expand our understanding of the genetic architecture of PD. This report details the workflow for cohort integration into the complex arm of GP2, and together with our outline of the monogenic hub in a companion paper, provides a generalizable blueprint for establishing large scale collaborative research consortia

Whole genome landscapes of uveal melanoma show an ultraviolet radiation signature in iris tumours

Uveal melanoma (UM) is the most common intraocular tumour in adults and despite surgical or radiation treatment of primary tumours, ~50% of patients progress to metastatic disease. Therapeutic options for metastatic UM are limited, with clinical trials having little impact. Here we perform whole-genome sequencing (WGS) of 103 UM from all sites of the uveal tract (choroid, ciliary body, iris). While most UM have low tumour mutation burden (TMB), two subsets with high TMB are seen; one driven by germline MBD4 mutation, and another by ultraviolet radiation (UVR) exposure, which is restricted to iris UM. All but one tumour have a known UM driver gene mutation (GNAQ, GNA11, BAP1, PLCB4, CYSLTR2, SF3B1, EIF1AX). We identify three other significantly mutated genes (TP53, RPL5 and CENPE)

Sirt1 Regulates Insulin Secretion by Repressing UCP2 in Pancreatic β Cells

Sir2 and insulin/IGF-1 are the major pathways that impinge upon aging in lower organisms. In Caenorhabditis elegans a possible genetic link between Sir2 and the insulin/IGF-1 pathway has been reported. Here we investigate such a link in mammals. We show that Sirt1 positively regulates insulin secretion in pancreatic β cells. Sirt1 represses the uncoupling protein (UCP) gene UCP2 by binding directly to the UCP2 promoter. In β cell lines in which Sirt1 is reduced by SiRNA, UCP2 levels are elevated and insulin secretion is blunted. The up-regulation of UCP2 is associated with a failure of cells to increase ATP levels after glucose stimulation. Knockdown of UCP2 restores the ability to secrete insulin in cells with reduced Sirt1, showing that UCP2 causes the defect in glucose-stimulated insulin secretion. Food deprivation induces UCP2 in mouse pancreas, which may occur via a reduction in NAD (a derivative of niacin) levels in the pancreas and down-regulation of Sirt1. Sirt1 knockout mice display constitutively high UCP2 expression. Our findings show that Sirt1 regulates UCP2 in β cells to affect insulin secretion

Defining the causes of sporadic Parkinson’s disease in the global Parkinson’s genetics program (GP2)

© The Author(s) 2023. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.The Global Parkinson’s Genetics Program (GP2) will genotype over 150,000 participants from around the world, and integrate genetic and clinical data for use in large-scale analyses to dramatically expand our understanding of the genetic architecture of PD. This report details the workflow for cohort integration into the complex arm of GP2, and together with our outline of the monogenic hub in a companion paper, provides a generalizable blueprint for establishing large scale collaborative research consortia.This research is supported by the Aligning Science Across Parkinson’s Initiative, the Intramural Research Program, National Institute on Aging, National Institutes of Health, Department of Health and Human Services, project ZO1 AG000949, and the Michael J. Fox Foundation for Parkinson’s Research. Data used in the preparation of this article were obtained from Global Parkinson’s Genetics Program (GP2). GP2 is funded by the Aligning Science Across Parkinson’s (ASAP) initiative and implemented by The Michael J. Fox Foundation for Parkinson’s Research (https://gp2.org). For a complete list of GP2 members see https://gp2.org.Peer reviewe

Sertraline for anxiety in adults with a diagnosis of autism (STRATA) : study protocol for a pragmatic, multicentre, double-blind, placebo-controlled randomised controlled trial

Background: Selective serotonin reuptake inhibitors (SSRIs) are commonly prescribed to manage anxiety in adults with an autism diagnosis. However, their effectiveness and adverse effect profile in the autistic population are not well known. This trial aims to determine the effectiveness and cost-effectiveness of the SSRI sertraline in reducing symptoms of anxiety and improving quality of life in adults with a diagnosis of autism compared with placebo and to quantify any adverse effects. Methods: STRATA is a two-parallel group, multi-centre, pragmatic, double-blind, randomised placebo-controlled trial with allocation at the level of the individual. It will be delivered through recruiting sites with autism services in 4 regional centres in the United Kingdom (UK) and 1 in Australia. Adults with an autism diagnosis and a Generalised Anxiety Disorder Assessment (GAD-7) score ≥ 10 at screening will be randomised 1:1 to either 25 mg sertraline or placebo, with subsequent flexible dose titration up to 200 mg. The primary outcome is GAD-7 scores at 16 weeks post-randomisation. Secondary outcomes include adverse effects, proportionate change in GAD-7 scores including 50% reduction, social anxiety, obsessive-compulsive symptoms, panic attacks, repetitive behaviours, meltdowns, depressive symptoms, composite depression and anxiety, functioning and disability and quality of life. Carer burden will be assessed in a linked carer sub-study. Outcome data will be collected using online/paper methods via video call, face-to-face or telephone according to participant preference at 16, 24 and 52 weeks post-randomisation, with brief safety checks and data collection at 1–2, 4, 8, 12 and 36 weeks. An economic evaluation to study the cost-effectiveness of sertraline vs placebo and a QuinteT Recruitment Intervention (QRI) to optimise recruitment and informed consent are embedded within the trial. Qualitative interviews at various times during the study will explore experiences of participating and taking the trial medication. Discussion: Results from this study should help autistic adults and their clinicians make evidence-based decisions on the use of sertraline for managing anxiety in this population. Trial registration: ISRCTN, ISRCTN15984604. Registered on 08 February 2021. EudraCT 2019-004312-66. ANZCTR ACTRN12621000801819. Registered on 07 April 2021

Mortality Among Adults With Cancer Undergoing Chemotherapy or Immunotherapy and Infected With COVID-19

Importance: Large cohorts of patients with active cancers and COVID-19 infection are needed to provide evidence of the association of recent cancer treatment and cancer type with COVID-19 mortality. // Objective: To evaluate whether systemic anticancer treatments (SACTs), tumor subtypes, patient demographic characteristics (age and sex), and comorbidities are associated with COVID-19 mortality. // Design, Setting, and Participants: The UK Coronavirus Cancer Monitoring Project (UKCCMP) is a prospective cohort study conducted at 69 UK cancer hospitals among adult patients (≥18 years) with an active cancer and a clinical diagnosis of COVID-19. Patients registered from March 18 to August 1, 2020, were included in this analysis. // Exposures: SACT, tumor subtype, patient demographic characteristics (eg, age, sex, body mass index, race and ethnicity, smoking history), and comorbidities were investigated. // Main Outcomes and Measures: The primary end point was all-cause mortality within the primary hospitalization. // Results: Overall, 2515 of 2786 patients registered during the study period were included; 1464 (58%) were men; and the median (IQR) age was 72 (62-80) years. The mortality rate was 38% (966 patients). The data suggest an association between higher mortality in patients with hematological malignant neoplasms irrespective of recent SACT, particularly in those with acute leukemias or myelodysplastic syndrome (OR, 2.16; 95% CI, 1.30-3.60) and myeloma or plasmacytoma (OR, 1.53; 95% CI, 1.04-2.26). Lung cancer was also significantly associated with higher COVID-19–related mortality (OR, 1.58; 95% CI, 1.11-2.25). No association between higher mortality and receiving chemotherapy in the 4 weeks before COVID-19 diagnosis was observed after correcting for the crucial confounders of age, sex, and comorbidities. An association between lower mortality and receiving immunotherapy in the 4 weeks before COVID-19 diagnosis was observed (immunotherapy vs no cancer therapy: OR, 0.52; 95% CI, 0.31-0.86). // Conclusions and Relevance: The findings of this study of patients with active cancer suggest that recent SACT is not associated with inferior outcomes from COVID-19 infection. This has relevance for the care of patients with cancer requiring treatment, particularly in countries experiencing an increase in COVID-19 case numbers. Important differences in outcomes among patients with hematological and lung cancers were observed