Metric-based vs peer-reviewed evaluation of a research output: Lesson learnt from UK’s national research assessment exercise

Purpose There is a general inquisition regarding the monetary value of a research output, as a substantial amount of funding in modern academia is essentially awarded to good research presented in the form of journal articles, conferences papers, performances, compositions, exhibitions, books and book chapters etc., which, eventually leads to another question if the value varies across different disciplines. Answers to these questions will not only assist academics and researchers, but will also help higher education institutions (HEIs) make informed decisions in their administrative and research policies. Design and methodology To examine both the questions, we applied the United Kingdom’s recently concluded national research assessment exercise known as the Research Excellence Framework (REF) 2014 as a case study. All the data for this study is sourced from the openly available publications which arose from the digital repositories of REF’s results and HEFCE’s funding allocations. Findings A world leading output earns between £7504 and £14,639 per year within the REF cycle, whereas an internationally excellent output earns between £1876 and £3659, varying according to their area of research. Secondly, an investigation into the impact rating of 25315 journal articles submitted in five areas of research by UK HEIs and their awarded funding revealed a linear relationship between the percentage of quartile-one journal publications and percentage of 4* outputs in Clinical Medicine, Physics and Psychology/Psychiatry/Neuroscience UoAs, and no relationship was found in the Classics and Anthropology/Development Studies UoAs, due to the fact that most publications in the latter two disciplines are not journal articles. Practical implications The findings provide an indication of the monetary value of a research output, from the perspectives of government funding for research, and also what makes a good output, i.e. whether a relationship exists between good quality output and the source of its publication. The findings may also influence future REF submission strategies in HEIs and ascertain that the impact rating of the journals is not necessarily a reflection of the quality of research in every discipline, and this may have a significant influence on the future of scholarly communications in general. Originality According to the author’s knowledge, this is the first time an investigation has estimated the monetary value of a good research output

Impact of antenna correlation on the performance of partial relay selection

Antenna correlation is generally viewed as an obstacle to realize the desired performance of a wireless system. In this article, we investigate the performance of partial relay selection in the presence of antenna correlation. We consider both channel state information (csi)-assisted and fixed gain amplify-and-forward (AF) relay schemes. The source and the destination are equipped with multiple antennas communicating via the best first hop signal-to-noise ratio (SNR) relay. We derived the closed form expression for outage probability, average symbol error rate (SER) for both schemes. Further, an exact expression is derived for the ergodic capacity in the csi-assisted relay case and an approximated expression is considered for the fixed gain case. Moreover, we provide simple asymptotic results and show that the diversity order of the system remains unchanged with the effect of antenna correlation for both types of relay schemes

The impact of a brief lifestyle intervention delivered by generalist community nurses (CN SNAP trial)

BackgroundThe risk factors for chronic disease, smoking, poor nutrition, hazardous alcohol consumption, physical inactivity and weight (SNAPW) are common in primary health care (PHC) affording opportunity for preventive interventions. Community nurses are an important component of PHC in Australia. However there has been little research evaluating the effectiveness of lifestyle interventions in routine community nursing practice. This study aimed to address this gap in our knowledge.MethodsThe study was a quasi-experimental trial involving four generalist community nursing (CN) services in New South Wales, Australia. Two services were randomly allocated to an ‘early intervention’ and two to a ‘late intervention’ group. Nurses in the early intervention group received training and support in identifying risk factors and offering brief lifestyle intervention for clients. Those in the late intervention group provided usual care for the first 6 months and then received training. Clients aged 30–80 years who were referred to the services between September 2009 and September 2010 were recruited prior to being seen by the nurse and baseline self-reported data collected. Data on their SNAPW risk factors, readiness to change these behaviours and advice and referral received about their risk factors in the previous 3 months were collected at baseline, 3 and 6 months. Analysis compared changes using univariate and multilevel regression techniques.Results804 participants were recruited from 2361 (34.1%) eligible clients. The proportion of clients who recalled receiving dietary or physical activity advice increased between baseline and 3 months in the early intervention group (from 12.9 to 23.3% and 12.3 to 19.1% respectively) as did the proportion who recalled being referred for dietary or physical activity interventions (from 9.5 to 15.6% and 5.8 to 21.0% respectively). There was no change in the late intervention group. There a shift towards greater readiness to change in those who were physically inactive in the early but not the comparison group. Clients in both groups reported being more physically active and eating more fruit and vegetables but there were no significant differences between groups at 6 months.ConclusionThe study demonstrated that although the intervention was associated with increases in advice and referral for diet or physical activity and readiness for change in physical activity, this did not translate into significant changes in lifestyle behaviours or weight. This suggests a need to facilitate referral to more intensive long-term interventions for clients with risk factors identified by primary health care nurses

Changes in Invasive Pneumococcal Disease Caused by Streptococcus pneumoniae Serotype 1 Following Introduction of PCV10 and PCV13: Findings from the PSERENADE Project.

Streptococcus pneumoniae serotype 1 (ST1) was an important cause of invasive pneumococcal disease (IPD) globally before the introduction of pneumococcal conjugate vaccines (PCVs) containing ST1 antigen. The Pneumococcal Serotype Replacement and Distribution Estimation (PSERENADE) project gathered ST1 IPD surveillance data from sites globally and aimed to estimate PCV10/13 impact on ST1 IPD incidence. We estimated ST1 IPD incidence rate ratios (IRRs) comparing the pre-PCV10/13 period to each post-PCV10/13 year by site using a Bayesian multi-level, mixed-effects Poisson regression and all-site IRRs using a linear mixed-effects regression (N = 45 sites). Following PCV10/13 introduction, the incidence rate (IR) of ST1 IPD declined among all ages. After six years of PCV10/13 use, the all-site IRR was 0.05 (95% credibility interval 0.04–0.06) for all ages, 0.05 (0.04–0.05) for <5 years of age, 0.08 (0.06–0.09) for 5–17 years, 0.06 (0.05–0.08) for 18–49 years, 0.06 (0.05–0.07) for 50–64 years, and 0.05 (0.04–0.06) for ≥65 years. PCV10/13 use in infant immunization programs was followed by a 95% reduction in ST1 IPD in all ages after approximately 6 years. Limited data availability from the highest ST1 disease burden countries using a 3+0 schedule constrains generalizability and data from these settings are needed

Global landscape review of serotype-specific invasive pneumococcal disease surveillance among countries using PCV10/13: The pneumococcal serotype replacement and distribution estimation (PSERENADE) project

Serotype-specific surveillance for invasive pneumococcal disease (IPD) is essential for assessing the impact of 10- and 13-valent pneumococcal conjugate vaccines (PCV10/13). The Pneumococcal Serotype Replacement and Distribution Estimation (PSERENADE) project aimed to evaluate the global evidence to estimate the impact of PCV10/13 by age, product, schedule, and syndrome. Here we systematically characterize and summarize the global landscape of routine serotype-specific IPD surveillance in PCV10/13-using countries and describe the subset that are included in PSERENADE. Of 138 countries using PCV10/13 as of 2018, we identified 109 with IPD surveillance systems, 76 of which met PSERENADE data collection eligibility criteria. PSERENADE received data from most (n = 63, 82.9%), yielding 240,639 post-PCV10/13 introduction IPD cases. Pediatric and adult surveillance was represented from all geographic regions but was limited from lower income and high-burden countries. In PSERENADE, 18 sites evaluated PCV10, 42 PCV13, and 17 both; 17 sites used a 3 + 0 schedule, 38 used 2 + 1, 13 used 3 + 1, and 9 used mixed schedules. With such a sizeable and generally representative dataset, PSERENADE will be able to conduct robust analyses to estimate PCV impact and inform policy at national and global levels regarding adult immunization, schedule, and product choice, including for higher valency PCVs on the horizon

A Reliability-Generalization Study of Journal Peer Reviews: A Multilevel Meta-Analysis of Inter-Rater Reliability and Its Determinants

Background: This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined as the extent to which two or more independent reviews of the same scientific document agree. Methodology/Principal Findings: Altogether, 70 reliability coefficients (Cohen’s Kappa, intra-class correlation [ICC], and Pearson product-moment correlation [r]) from 48 studies were taken into account in the meta-analysis. The studies were based on a total of 19,443 manuscripts; on average, each study had a sample size of 311 manuscripts (minimum: 28, maximum: 1983). The results of the meta-analysis confirmed the findings of the narrative literature reviews published to date: The level of IRR (mean ICC/r 2 =.34, mean Cohen’s Kappa =.17) was low. To explain the study-to-study variation of the IRR coefficients, meta-regression analyses were calculated using seven covariates. Two covariates that emerged in the metaregression analyses as statistically significant to gain an approximate homogeneity of the intra-class correlations indicated that, firstly, the more manuscripts that a study is based on, the smaller the reported IRR coefficients are. Secondly, if the information of the rating system for reviewers was reported in a study, then this was associated with a smaller IRR coefficient than if the information was not conveyed. Conclusions/Significance: Studies that report a high level of IRR are to be considered less credible than those with a low level o

A922 Sequential measurement of 1 hour creatinine clearance (1-CRCL) in critically ill patients at risk of acute kidney injury (AKI)

Meeting abstrac