The politicisation of evaluation: constructing and contesting EU policy performance

Although systematic policy evaluation has been conducted for decades and has been growing strongly within the European Union (EU) institutions and in the member states, it remains largely underexplored in political science literatures. Extant work in political science and public policy typically focuses on elements such as agenda setting, policy shaping, decision making, or implementation rather than evaluation. Although individual pieces of research on evaluation in the EU have started to emerge, most often regarding policy “effectiveness” (one criterion among many in evaluation), a more structured approach is currently missing. This special issue aims to address this gap in political science by focusing on four key focal points: evaluation institutions (including rules and cultures), evaluation actors and interests (including competencies, power, roles and tasks), evaluation design (including research methods and theories, and their impact on policy design and legislation), and finally, evaluation purpose and use (including the relationships between discourse and scientific evidence, political attitudes and strategic use). The special issue considers how each of these elements contributes to an evolving governance system in the EU, where evaluation is playing an increasingly important role in decision making

PaLM: Scaling Language Modeling with Pathways

Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning, which drastically reduces the number of task-specific training examples needed to adapt the model to a particular application. To further our understanding of the impact of scale on few-shot learning, we trained a 540-billion parameter, densely activated, Transformer language model, which we call Pathways Language Model PaLM. We trained PaLM on 6144 TPU v4 chips using Pathways, a new ML system which enables highly efficient training across multiple TPU Pods. We demonstrate continued benefits of scaling by achieving state-of-the-art few-shot learning results on hundreds of language understanding and generation benchmarks. On a number of these tasks, PaLM 540B achieves breakthrough performance, outperforming the finetuned state-of-the-art on a suite of multi-step reasoning tasks, and outperforming average human performance on the recently released BIG-bench benchmark. A significant number of BIG-bench tasks showed discontinuous improvements from model scale, meaning that performance steeply increased as we scaled to our largest model. PaLM also has strong capabilities in multilingual tasks and source code generation, which we demonstrate on a wide array of benchmarks. We additionally provide a comprehensive analysis on bias and toxicity, and study the extent of training data memorization with respect to model scale. Finally, we discuss the ethical considerations related to large language models and discuss potential mitigation strategies

PaLM 2 Technical Report

We introduce PaLM 2, a new state-of-the-art language model that has better multilingual and reasoning capabilities and is more compute-efficient than its predecessor PaLM. PaLM 2 is a Transformer-based model trained using a mixture of objectives. Through extensive evaluations on English and multilingual language, and reasoning tasks, we demonstrate that PaLM 2 has significantly improved quality on downstream tasks across different model sizes, while simultaneously exhibiting faster and more efficient inference compared to PaLM. This improved efficiency enables broader deployment while also allowing the model to respond faster, for a more natural pace of interaction. PaLM 2 demonstrates robust reasoning capabilities exemplified by large improvements over PaLM on BIG-Bench and other reasoning tasks. PaLM 2 exhibits stable performance on a suite of responsible AI evaluations, and enables inference-time control over toxicity without additional overhead or impact on other capabilities. Overall, PaLM 2 achieves state-of-the-art performance across a diverse set of tasks and capabilities. When discussing the PaLM 2 family, it is important to distinguish between pre-trained models (of various sizes), fine-tuned variants of these models, and the user-facing products that use these models. In particular, user-facing products typically include additional pre- and post-processing steps. Additionally, the underlying models may evolve over time. Therefore, one should not expect the performance of user-facing products to exactly match the results reported in this report

Obeticholic acid for the treatment of non-alcoholic steatohepatitis: interim analysis from a multicentre, randomised, placebo-controlled phase 3 trial

Background Non-alcoholic steatohepatitis (NASH) is a common type of chronic liver disease that can lead to cirrhosis. Obeticholic acid, a farnesoid X receptor agonist, has been shown to improve the histological features of NASH. Here we report results from a planned interim analysis of an ongoing, phase 3 study of obeticholic acid for NASH. Methods In this multicentre, randomised, double-blind, placebo-controlled study, adult patients with definite NASH,non-alcoholic fatty liver disease (NAFLD) activity score of at least 4, and fibrosis stages F2–F3, or F1 with at least oneaccompanying comorbidity, were randomly assigned using an interactive web response system in a 1:1:1 ratio to receive oral placebo, obeticholic acid 10 mg, or obeticholic acid 25 mg daily. Patients were excluded if cirrhosis, other chronic liver disease, elevated alcohol consumption, or confounding conditions were present. The primary endpointsfor the month-18 interim analysis were fibrosis improvement (≥1 stage) with no worsening of NASH, or NASH resolution with no worsening of fibrosis, with the study considered successful if either primary endpoint was met. Primary analyses were done by intention to treat, in patients with fibrosis stage F2–F3 who received at least one dose of treatment and reached, or would have reached, the month 18 visit by the prespecified interim analysis cutoff date. The study also evaluated other histological and biochemical markers of NASH and fibrosis, and safety. This study is ongoing, and registered with ClinicalTrials.gov, NCT02548351, and EudraCT, 20150-025601-6. Findings Between Dec 9, 2015, and Oct 26, 2018, 1968 patients with stage F1–F3 fibrosis were enrolled and received at least one dose of study treatment; 931 patients with stage F2–F3 fibrosis were included in the primary analysis (311 in the placebo group, 312 in the obeticholic acid 10 mg group, and 308 in the obeticholic acid 25 mg group). The fibrosis improvement endpoint was achieved by 37 (12%) patients in the placebo group, 55 (18%) in the obeticholic acid 10 mg group (p=0·045), and 71 (23%) in the obeticholic acid 25 mg group (p=0·0002). The NASH resolution endpoint was not met (25 [8%] patients in the placebo group, 35 [11%] in the obeticholic acid 10 mg group [p=0·18], and 36 [12%] in the obeticholic acid 25 mg group [p=0·13]). In the safety population (1968 patients with fibrosis stages F1–F3), the most common adverse event was pruritus (123 [19%] in the placebo group, 183 [28%] in the obeticholic acid 10 mg group, and 336 [51%] in the obeticholic acid 25 mg group); incidence was generally mild to moderate in severity. The overall safety profile was similar to that in previous studies, and incidence of serious adverse events was similar across treatment groups (75 [11%] patients in the placebo group, 72 [11%] in the obeticholic acid 10 mg group, and 93 [14%] in the obeticholic acid 25 mg group). Interpretation Obeticholic acid 25 mg significantly improved fibrosis and key components of NASH disease activity among patients with NASH. The results from this planned interim analysis show clinically significant histological improvement that is reasonably likely to predict clinical benefit. This study is ongoing to assess clinical outcomes

[Photograph 2012.201.B0977.0732]

Photograph used for a story in the Daily Oklahoman newspaper

[Photograph 2012.201.B0145.0040]

Photograph used for a newspaper owned by the Oklahoma Publishing Company. Caption: "Norman police Sgt. Gerald Moody, left, and Master Sgt. Lonny Loftin arrest burglary suspect Charles Couchman 29, at NW 10th and Meridian in Oklahoma City after an hour-long chase that stretched through several communities.

[Photograph 2012.201.B0960B.0730]

Photograph used for a story in the Daily Oklahoman newspaper. Caption: "OKC police officers and firefighters converge on a rural northeast-side residence Monday. In background, tactical team members unload gear from a van. An armed mental patient barricaded himself in a house at 5525 N Jericho after firing a shotgun blast at his common-law wife earlier Monday.

[Photograph 2012.201.B0960B.0106]

Photograph used for a story in the Daily Oklahoman newspaper. Caption: "A police photographer takes pictures at NE 36 and Interstate 35 where a city police officer was fatally shot Tuesday night.

Veterans Confer

Photograph used for a story in the Daily Oklahoman newspaper. Caption: "Bob Newell, left, of Oklahoma City and Jim Makos of Lawton were among the Veterans of Foreign Wars attending the Oklahoma group's annual Mid-Winter Conference Saturday at the Lincoln Plaza in Oklahoma City.

[Photograph 2012.201.B1363.0491]

Photograph used for a newspaper owned by the Oklahoma Publishing Company