The metric tide: report of the independent review of the role of metrics in research assessment and management

This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration. This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. The report starts by tracing the history of metrics in research management and assessment, in the UK and internationally. It looks at the applicability of metrics within different research cultures, compares the peer review system with metric-based alternatives, and considers what balance might be struck between the two. It charts the development of research management systems within institutions, and examines the effects of the growing use of quantitative indicators on different aspects of research culture, including performance management, equality, diversity, interdisciplinarity, and the ‘gaming’ of assessment systems. The review looks at how different funders are using quantitative indicators, and considers their potential role in research and innovation policy. Finally, it examines the role that metrics played in REF2014, and outlines scenarios for their contribution to future exercises

Predicting Driver Fatigue in Automated Driving with Explainability

Research indicates that monotonous automated driving increases the incidence of fatigued driving. Although many prediction models based on advanced machine learning techniques were proposed to monitor driver fatigue, especially in manual driving, little is known about how these black-box machine learning models work. In this paper, we proposed a combination of eXtreme Gradient Boosting (XGBoost) and SHAP (SHapley Additive exPlanations) to predict driver fatigue with explanations due to their efficiency and accuracy. First, in order to obtain the ground truth of driver fatigue, PERCLOS (percentage of eyelid closure over the pupil over time) between 0 and 100 was used as the response variable. Second, we built a driver fatigue regression model using both physiological and behavioral measures with XGBoost and it outperformed other selected machine learning models with 3.847 root-mean-squared error (RMSE), 1.768 mean absolute error (MAE) and 0.996 adjusted $R^2$. Third, we employed SHAP to identify the most important predictor variables and uncovered the black-box XGBoost model by showing the main effects of most important predictor variables globally and explaining individual predictions locally. Such an explainable driver fatigue prediction model offered insights into how to intervene in automated driving when necessary, such as during the takeover transition period from automated driving to manual driving

Coagulation status of critically ill patients with and without liver disease assessed using a novel thrombin generation analyzer

Funding Information: NHS Blood and TransplantPeer reviewedPublisher PD

Cryoprecipitate transfusion in trauma patients attenuates hyperfibrinolysis and restores normal clot structure and stability : Results from a laboratory sub-study of the FEISTY trial

Acknowledgements We acknowledge the Aberdeen Microscopy and Histology Core Facility and thank Judith de Vries for her guidance in analysing the confocal images. We thank Megan Simpson for measuring PAI-1 and uPA antigen levels in the fibrinogen preparations. We thank all of the FEISTY research staff who collected and processed the patient samples. Funding This work was supported by research grants from CSL Behring and Tenovus Scotland.Peer reviewedPublisher PD

A novel method to quantify fibrin-fibrin and fibrin-α2AP cross-links in thrombi formed from human trauma patient plasma.

The widespread use of the anti-fibrinolytic agent, tranexamic acid (TXA), interferes with the quantification of fibrinolysis by dynamic laboratory assays such as clot lysis, making it difficult to measure fibrinolysis in many trauma patients. At the final stage of coagulation, Factor XIIIa (FXIIIa) catalyses the formation of fibrin-fibrin and fibrin-α2-antiplasmin (α2AP) cross-links which increases clot mechanical strength and resistance to fibrinolysis. Here, we develop a method to quantify fibrin-fibrin and fibrin-α2AP cross-links that avoids the challenges posed by TXA in determining fibrinolytic resistance in conventional assays. Fibrinogen alpha chain (FGA-FGA), fibrinogen gamma chain (FGG-FGG) and FGA-α2AP cross-links were quantified using liquid-chromatography-mass spectrometry (LC-MS) and parallel reaction monitoring (PRM) in paired plasma samples from trauma patients pre- and post-fibrinogen replacement. Differences in the abundance of cross-links in trauma patients receiving cryoprecipitate (cryo) or fibrinogen concentrate (Fg-C) were analysed. The study found that the abundance of cross-links was significantly increased in trauma patients post-cryo, but not Fg-C, transfusion (p < 0.0001). The abundance of cross-links was positively correlated with the toughness of individual fibrin fibres, the peak thrombin concentration and FXIII antigen (p < 0.05). We have developed a novel method that allows us to quantify fibrin cross-links in trauma patients who have received TXA, providing an indirect measure of fibrinolytic resistance. Using this novel approach we have avoided the effect of TXA and shown that cryo increases fibrin-fibrin and fibrin-α2AP cross-linking when compared to Fg-C, highlighting the importance of FXIII in clot formation and stability in trauma patients

Chimera: A Low Cost Solution to Small Satellite Space Access

In the Proceedings of the 17th Annual AIAA/USU Conference on Small Satellites, UT State University Logan, UT, August 11 -14, 2003.The Chimera rocket was designed to enter the small satellite market by offering an affordable and flexible alternative to the Pegasus launch vehicle. A number of design concepts were evaluated, and one was selected to undergo detailed analysis. This included disciplinary analyses in aerodynamics, propulsion, trajectory, aeroheating, structures, weights, operations, and cost. The baseline vehicle, consisting of a Minuteman 2-2 first stage, a PAM-S second stage, and a new third stage carries a 100 and 50 kg payload to a 700 km altitude, at inclinations of 60° and 110° respectively. At this point a Monte Carlo Simulation was performed to determine how well the system met its price goals. The baseline vehicle fails to meet the desired launch price of $5 million to a reasonable confidence level. However, either the implementation of a cost reduction in the cost of the first stage, or the infusion of appropriate structural and propellant technologies in the design of the third stage, help to make the desired launch price viable

Adam Smith’s Green Thumb and Malthus’ Three Horsemen: Cautionary tales from classical political economy

This essay identifies a contradiction between the flourishing interest in the environmental economics of the classical period and a lack of critical parsing of the works of its leading representatives. Its focus is the work of Adam Smith and Thomas Malthus. It offers a critical analysis of their contribution to environmental thought and surveys the work of their contemporary devotees. It scrutinizes Smith's contribution to what Karl Polanyi termed the "economistic fallacy," as well as his defenses of class hierarchy, the "growth imperative" and consumerism. It subjects to critical appraisal Malthus's enthusiasm for private property and the market system, and his opposition to market regulation. While Malthus's principal attraction to ecological economists lies in his having allegedly broadened the scope of economics, and in his narrative of scarcity, this article shows that he, in fact, narrowed the scope of the discipline and conceptualized scarcity in a reified and pseudo-scientific way

Mosaic: A Satellite Constellation to Enable Groundbreaking Mars Climate System Science and Prepare for Human Exploration

The Martian climate system has been revealed to rival the complexity of Earth\u27s. Over the last 20 yr, a fragmented and incomplete picture has emerged of its structure and variability; we remain largely ignorant of many of the physical processes driving matter and energy flow between and within Mars\u27 diverse climate domains. Mars Orbiters for Surface, Atmosphere, and Ionosphere Connections (MOSAIC) is a constellation of ten platforms focused on understanding these climate connections, with orbits and instruments tailored to observe the Martian climate system from three complementary perspectives. First, low-circular near-polar Sun-synchronous orbits (a large mothership and three smallsats spaced in local time) enable vertical profiling of wind, aerosols, water, and temperature, as well as mapping of surface and subsurface ice. Second, elliptical orbits sampling all of Mars\u27 plasma regions enable multipoint measurements necessary to understand mass/energy transport and ion-driven escape, also enabling, with the polar orbiters, dense radio occultation coverage. Last, longitudinally spaced areostationary orbits enable synoptic views of the lower atmosphere necessary to understand global and mesoscale dynamics, global views of the hydrogen and oxygen exospheres, and upstream measurements of space weather conditions. MOSAIC will characterize climate system variability diurnally and seasonally, on meso-, regional, and global scales, targeting the shallow subsurface all the way out to the solar wind, making many first-of-their-kind measurements. Importantly, these measurements will also prepare for human exploration and habitation of Mars by providing water resource prospecting, operational forecasting of dust and radiation hazards, and ionospheric communication/positioning disruptions

UK General Population Utility Values for the SIDECAR-D Instrument Measuring the Impact of Caring for People With Dementia

Objectives: Dementia affects many people, with numbers expected to grow as populations age. Many people with dementia receive informal/family/unpaid care, for example, from a spouse or child, which may affect carer quality of life. Measuring the effectiveness of health/social care interventions for carers requires a value measure of the quality-of-life impact of caring. This motivated development of the Scales Measuring the Impact of Dementia on Carers-D (SIDECAR-D) instrument. This study aimed to obtain general population values for SIDECAR-D to aid incorporating the impact of caring in economic evaluation. Methods: Members of the UK general public completed a best–worst scaling object case survey, which included the 18 SIDECAR-D items and EQ-5D-3L descriptions. Responses were analyzed using scale-adjusted finite mixture models. Relative importance scores (RISs) for the 18 SIDECAR-D items formed the SIDECAR-D relative scale measuring the relative impact of caring. The SIDECAR-D tariff, on the full health = 1, dead = 0 scale, was derived by rescaling EQ-5D-3L and SIDECAR-D RISs so the EQ-5D-3L RISs equaled anchored valuations of the EQ-5D-3L pits state from a visual analog scale task. Results: Five hundred ten respondents completed the survey. The model had 2 parameter and 3 scale classes. Additive utility decrements of SIDECAR-D items ranged from –0.05 to –0.162. Utility scores range from 0.95 for someone affirming 1 item to –0.297 for someone affirming all 18. Conclusion: SIDECAR-D is a needs-based scale of the impact on quality of life of caring for someone with dementia, with a valuation tariff to support its use in economic evaluation