Large Language Models Encode Clinical Knowledge

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge typically rely on automated evaluations on limited benchmarks. There is no standard to evaluate model predictions and reasoning across a breadth of tasks. To address this, we present MultiMedQA, a benchmark combining six existing open question answering datasets spanning professional medical exams, research, and consumer queries; and HealthSearchQA, a new free-response dataset of medical questions searched online. We propose a framework for human evaluation of model answers along multiple axes including factuality, precision, possible harm, and bias. In addition, we evaluate PaLM (a 540-billion parameter LLM) and its instruction-tuned variant, Flan-PaLM, on MultiMedQA. Using a combination of prompting strategies, Flan-PaLM achieves state-of-the-art accuracy on every MultiMedQA multiple-choice dataset (MedQA, MedMCQA, PubMedQA, MMLU clinical topics), including 67.6% accuracy on MedQA (US Medical License Exam questions), surpassing prior state-of-the-art by over 17%. However, human evaluation reveals key gaps in Flan-PaLM responses. To resolve this we introduce instruction prompt tuning, a parameter-efficient approach for aligning LLMs to new domains using a few exemplars. The resulting model, Med-PaLM, performs encouragingly, but remains inferior to clinicians. We show that comprehension, recall of knowledge, and medical reasoning improve with model scale and instruction prompt tuning, suggesting the potential utility of LLMs in medicine. Our human evaluations reveal important limitations of today's models, reinforcing the importance of both evaluation frameworks and method development in creating safe, helpful LLM models for clinical applications

Production Scheduling Requirements to Smart Manufacturing

The production scheduling has attracted a lot of researchers for many years, however most of the approaches are not targeted to deal with real manufacturing environments, and those that are, are very particular for the case study. It is crucial to consider important features related with the factories, such as products and machines characteristics and unexpected disturbances, but also information such as when the parts arrive to the factory and when should be delivered. So, the purpose of this paper is to identify some important characteristics that have been considered independently in a lot of studies and that should be considered together to develop a generic scheduling framework to be used in a real manufacturing environment.authorsversionpublishe

The histone H3K36 demethylase Rph1/KDM4 regulates the expression of the photoreactivation gene PHR1

The dynamics of histone methylation have emerged as an important issue since the identification of histone demethylases. We studied the regulatory function of Rph1/KDM4 (lysine demethylase), a histone H3K36 demethylase, on transcription in Saccharomyces cerevisiae. Overexpression of Rph1 reduced the expression of PHR1 and increased UV sensitivity. The catalytically deficient mutant (H235A) of Rph1 diminished the repressive transcriptional effect on PHR1 expression, which indicates that histone demethylase activity contributes to transcriptional repression. Chromatin immunoprecipitation analysis demonstrated that Rph1 was associated at the upstream repression sequence of PHR1 through zinc-finger domains and was dissociated after UV irradiation. Notably, overexpression of Rph1 and H3K36A mutant reduced histone acetylation at the URS, which implies a crosstalk between histone demethylation and acetylation at the PHR1 promoter. In addition, the crucial checkpoint protein Rad53 acted as an upstream regulator of Rph1 and dominated the phosphorylation of Rph1 that was required for efficient PHR1 expression and the dissociation of Rph1. The release of Rph1 from chromatin also required the phosphorylation at S652. Our study demonstrates that the histone demethylase Rph1 is associated with a specific chromatin locus and modulates histone modifications to repress a DNA damage responsive gene under control of damage checkpoint signaling

Decreased Circulating Endothelial Progenitor Cell Levels and Function in Patients with Nonalcoholic Fatty Liver Disease

OBJECTIVES: Nonalcoholic fatty liver disease (NAFLD) is associated with advanced atherosclerosis and a higher risk of cardiovascular disease. Increasing evidence suggests that injured endothelial monolayer is regenerated by circulating bone marrow derived-endothelial progenitor cells (EPCs), and levels of circulating EPCs reflect vascular repair capacity. However, the relation between NAFLD and EPC remains unclear. Here, we tested the hypothesis that patients with nonalcoholic fatty liver disease (NAFLD) might have decreased endothelial progenitor cell (EPC) levels and attenuated EPC function. METHODS AND RESULTS: A total of 312 consecutive patients undergoing elective coronary angiography because of suspected coronary artery disease were screened and received examinations of abdominal ultrasonography between July 2009 and November 2010. Finally, 34 patients with an ultrasonographic diagnosis of NAFLD, and 68 age- and sex-matched controls without NAFLD were enrolled. Flow cytometry with quantification of EPC markers (defined as CD34(+), CD34(+)KDR(+), and CD34(+)KDR(+)CD133(+)) in peripheral blood samples was used to assess circulating EPC numbers. The adhesive function, and migration, and tube formation capacities of EPCs were also determined in NAFLD patients and controls. Patients with NAFLD had a significantly higher incidence of metabolic syndrome, previous myocardial infarction, hyperuricemia, and higher waist circumference, body mass index, fasting glucose and triglyceride levels. In addition, patients with NAFLD had significantly decreased circulating EPC levels (all P<0.05), attenuated EPC functions, and enhanced systemic inflammation compared to controls. Multivariate logistic regression analysis showed that circulating EPC level (CD34(+)KDR(+) [cells/10(5) events]) was an independent reverse predictor of NAFLD (Odds ratio: 0.78; 95% confidence interval: 0.69-0.89, P<0.001). CONCLUSIONS: NAFLD patients have decreased circulating EPC numbers and functions than those without NAFLD, which may be one of the mechanisms to explain atherosclerotic disease progression and enhanced cardiovascular risk in patients with NAFLD

Performance of CMS muon reconstruction in pp collision events at sqrt(s) = 7 TeV

The performance of muon reconstruction, identification, and triggering in CMS has been studied using 40 inverse picobarns of data collected in pp collisions at sqrt(s) = 7 TeV at the LHC in 2010. A few benchmark sets of selection criteria covering a wide range of physics analysis needs have been examined. For all considered selections, the efficiency to reconstruct and identify a muon with a transverse momentum pT larger than a few GeV is above 95% over the whole region of pseudorapidity covered by the CMS muon system, abs(eta) < 2.4, while the probability to misidentify a hadron as a muon is well below 1%. The efficiency to trigger on single muons with pT above a few GeV is higher than 90% over the full eta range, and typically substantially better. The overall momentum scale is measured to a precision of 0.2% with muons from Z decays. The transverse momentum resolution varies from 1% to 6% depending on pseudorapidity for muons with pT below 100 GeV and, using cosmic rays, it is shown to be better than 10% in the central region up to pT = 1 TeV. Observed distributions of all quantities are well reproduced by the Monte Carlo simulation.Comment: Replaced with published version. Added journal reference and DO

Azimuthal anisotropy of charged particles at high transverse momenta in PbPb collisions at sqrt(s[NN]) = 2.76 TeV

The azimuthal anisotropy of charged particles in PbPb collisions at nucleon-nucleon center-of-mass energy of 2.76 TeV is measured with the CMS detector at the LHC over an extended transverse momentum (pt) range up to approximately 60 GeV. The data cover both the low-pt region associated with hydrodynamic flow phenomena and the high-pt region where the anisotropies may reflect the path-length dependence of parton energy loss in the created medium. The anisotropy parameter (v2) of the particles is extracted by correlating charged tracks with respect to the event-plane reconstructed by using the energy deposited in forward-angle calorimeters. For the six bins of collision centrality studied, spanning the range of 0-60% most-central events, the observed v2 values are found to first increase with pt, reaching a maximum around pt = 3 GeV, and then to gradually decrease to almost zero, with the decline persisting up to at least pt = 40 GeV over the full centrality range measured.Comment: Replaced with published version. Added journal reference and DO

Performance of CMS muon reconstruction in pp collision events at sqrt(s) = 7 TeV

The performance of muon reconstruction, identification, and triggering in CMS has been studied using 40 inverse picobarns of data collected in pp collisions at sqrt(s) = 7 TeV at the LHC in 2010. A few benchmark sets of selection criteria covering a wide range of physics analysis needs have been examined. For all considered selections, the efficiency to reconstruct and identify a muon with a transverse momentum pT larger than a few GeV is above 95% over the whole region of pseudorapidity covered by the CMS muon system, abs(eta) < 2.4, while the probability to misidentify a hadron as a muon is well below 1%. The efficiency to trigger on single muons with pT above a few GeV is higher than 90% over the full eta range, and typically substantially better. The overall momentum scale is measured to a precision of 0.2% with muons from Z decays. The transverse momentum resolution varies from 1% to 6% depending on pseudorapidity for muons with pT below 100 GeV and, using cosmic rays, it is shown to be better than 10% in the central region up to pT = 1 TeV. Observed distributions of all quantities are well reproduced by the Monte Carlo simulation.Comment: Replaced with published version. Added journal reference and DO

Search for anomalous t t-bar production in the highly-boosted all-hadronic final state

A search is presented for a massive particle, generically referred to as a Z', decaying into a t t-bar pair. The search focuses on Z' resonances that are sufficiently massive to produce highly Lorentz-boosted top quarks, which yield collimated decay products that are partially or fully merged into single jets. The analysis uses new methods to analyze jet substructure, providing suppression of the non-top multijet backgrounds. The analysis is based on a data sample of proton-proton collisions at a center-of-mass energy of 7 TeV, corresponding to an integrated luminosity of 5 inverse femtobarns. Upper limits in the range of 1 pb are set on the product of the production cross section and branching fraction for a topcolor Z' modeled for several widths, as well as for a Randall--Sundrum Kaluza--Klein gluon. In addition, the results constrain any enhancement in t t-bar production beyond expectations of the standard model for t t-bar invariant masses larger than 1 TeV.Comment: Submitted to the Journal of High Energy Physics; this version includes a minor typo correction that will be submitted as an erratu