Survey of the quality of experimental design, statistical analysis and reporting of research using animals

For scientific, ethical and economic reasons, experiments involving animals should be appropriately designed, correctly analysed and transparently reported. This increases the scientific validity of the results, and maximises the knowledge gained from each experiment. A minimum amount of relevant information must be included in scientific publications to ensure that the methods and results of a study can be reviewed, analysed and repeated. Omitting essential information can raise scientific and ethical concerns. We report the findings of a systematic survey of reporting, experimental design and statistical analysis in published biomedical research using laboratory animals. Medline and EMBASE were searched for studies reporting research on live rats, mice and non-human primates carried out in UK and US publicly funded research establishments. Detailed information was collected from 271 publications, about the objective or hypothesis of the study, the number, sex, age and/or weight of animals used, and experimental and statistical methods. Only 59% of the studies stated the hypothesis or objective of the study and the number and characteristics of the animals used. Appropriate and efficient experimental design is a critical component of high-quality science. Most of the papers surveyed did not use randomisation (87%) or blinding (86%), to reduce bias in animal selection and outcome assessment. Only 70% of the publications that used statistical methods described their methods and presented the results with a measure of error or variability. This survey has identified a number of issues that need to be addressed in order to improve experimental design and reporting in publications describing research using animals. Scientific publication is a powerful and important source of information; the authors of scientific publications therefore have a responsibility to describe their methods and results comprehensively, accurately and transparently, and peer reviewers and journal editors share the responsibility to ensure that published studies fulfil these criteria

Serum Biomarkers of Disease Activity in Longitudinal Assessment of Patients with ANCA-Associated Vasculitis

OBJECTIVE: Improved biomarkers of current disease activity and prediction of relapse are needed in antineutrophil cytoplasmic antibody–associated vasculitis (AAV). For clinical relevance, biomarkers must perform well longitudinally in patients on treatment and in patients with nonsevere flares. METHODS: Twenty‐two proteins were measured in 347 serum samples from 74 patients with AAV enrolled in a clinical trial. Samples were collected at Month 6 after remission induction, then every 3 months until Month 18, or at the time of flare. Associations of protein concentrations with concurrent disease activity and with future flare were analyzed using mixed‐effects models, Cox proportional hazards models, and conditional logistic regression. RESULTS: Forty‐two patients had flares during the 12‐month follow‐up period, and 32 remained in remission. Twenty‐two patients had severe flares. Six experimental markers (CXCL13, IL‐6, IL‐8, IL‐15, IL‐18BP, and matrix metalloproteinase‐3 [MMP‐3]) and ESR were associated with disease activity using all three methods (P < 0.05, with P < 0.01 in at least one method). A rise in IL‐8, IL‐15, or IL‐18BP was associated temporally with flare. Combining C‐reactive protein (CRP), IL‐18BP, neutrophil gelatinase‐associated lipocalin (NGAL), and sIL‐2Rα improved association with active AAV. CXCL13 and MMP‐3 were increased during treatment with prednisone, independent of disease activity. Marker concentrations during remission were not predictive of future flare. CONCLUSION: Serum biomarkers of inflammation and tissue damage and repair have been previously shown to be strongly associated with severe active AAV were less strongly associated with active AAV in a longitudinal study that included mild flares and varying treatment. Markers rising contemporaneously with flare or with an improved association in combination merit further study

Cerebellar Integrity in the Amyotrophic Lateral Sclerosis - Frontotemporal Dementia Continuum

Amyotrophic lateral sclerosis (ALS) and behavioural variant frontotemporal dementia (bvFTD) are multisystem neurodegenerative disorders that manifest overlapping cognitive, neuropsychiatric and motor features. The cerebellum has long been known to be crucial for intact motor function although emerging evidence over the past decade has attributed cognitive and neuropsychiatric processes to this structure. The current study set out i) to establish the integrity of cerebellar subregions in the amyotrophic lateral sclerosis-behavioural variant frontotemporal dementia spectrum (ALS-bvFTD) and ii) determine whether specific cerebellar atrophy regions are associated with cognitive, neuropsychiatric and motor symptoms in the patients. Seventy-eight patients diagnosed with ALS, ALS-bvFTD, behavioural variant frontotemporal dementia (bvFTD), most without C9ORF72 gene abnormalities, and healthy controls were investigated. Participants underwent cognitive, neuropsychiatric and functional evaluation as well as structural imaging using voxel-based morphometry (VBM) to examine the grey matter subregions of the cerebellar lobules, vermis and crus. VBM analyses revealed: i) significant grey matter atrophy in the cerebellum across the whole ALS-bvFTD continuum; ii) atrophy predominantly of the superior cerebellum and crus in bvFTD patients, atrophy of the inferior cerebellum and vermis in ALS patients, while ALS-bvFTD patients had both patterns of atrophy. Post-hoc covariance analyses revealed that cognitive and neuropsychiatric symptoms were particularly associated with atrophy of the crus and superior lobule, while motor symptoms were more associated with atrophy of the inferior lobules. Taken together, these findings indicate an important role of the cerebellum in the ALS-bvFTD disease spectrum, with all three clinical phenotypes demonstrating specific patterns of subregional atrophy that associated with different symptomology

Evaluation Research and Institutional Pressures: Challenges in Public-Nonprofit Contracting

This article examines the connection between program evaluation research and decision-making by public managers. Drawing on neo-institutional theory, a framework is presented for diagnosing the pressures and conditions that lead alternatively toward or away the rational use of evaluation research. Three cases of public-nonprofit contracting for the delivery of major programs are presented to clarify the way coercive, mimetic, and normative pressures interfere with a sound connection being made between research and implementation. The article concludes by considering how public managers can respond to the isomorphic pressures in their environment that make it hard to act on data relating to program performance.This publication is Hauser Center Working Paper No. 23. The Hauser Center Working Paper Series was launched during the summer of 2000. The Series enables the Hauser Center to share with a broad audience important works-in-progress written by Hauser Center scholars and researchers

A study to assess changes in myocardial perfusion after treatment with spinal cord stimulation and percutaneous myocardial laser revascularisation; data from a randomised trial

<p>Abstract</p> <p>Background</p> <p>Spinal cord stimulation (SCS) and percutaneous myocardial laser revascularisation (PMR) are treatment modalities used to treat refractory angina pectoris, with the major aim of such treatment being the relief of disabling symptoms. This study compared the change in myocardial perfusion following SCS and PMR treatment.</p> <p>Methods</p> <p>Subjects with Canadian Cardiovascular Society class 3/4 angina and reversible perfusion defects as assessed by single-photon emission computed tomographic myocardial perfusion scintigraphy were randomised to SCS (34) or PMR (34). 28 subjects in each group underwent repeat myocardial perfusion imaging 12 months post intervention. Visual scoring of perfusion images was performed using a 20-segment model and a scale of 0 to 4.</p> <p>Results</p> <p>The mean (standard deviation) baseline summed rest score (SRS) and stress scores (SSS) were 4.6 (5.7) and 13.6 (9.0) in the PMR group and 6.1 (7.4) and 16.8 (11.6) in the SCS group. At 12 months, SRS was 5.5 (6.0) and SSS 15.3 (11.3) in the PMR group and 6.9 (8.2) and 15.1 (10.9) in the SCS group. There was no significant difference between the two treatment groups adjusted for baseline (p = 1.0 for SRS, p = 0.29 for SSS).</p> <p>Conclusion</p> <p>There was no significant difference in myocardial perfusion one year post treatment with SCS or PMR.</p

Cataract research using electronic health records

<p>Abstract</p> <p>Background</p> <p>The eMERGE (electronic MEdical Records and Genomics) network, funded by the National Human Genome Research Institute, is a national consortium formed to develop, disseminate, and apply approaches to research that combine DNA biorepositories with electronic health record (EHR) systems for large-scale, high-throughput genetic research. Marshfield Clinic is one of five sites in the eMERGE network and primarily studied: 1) age-related cataract and 2) HDL-cholesterol levels. The purpose of this paper is to describe the approach to electronic evaluation of the epidemiology of cataract using the EHR for a large biobank and to assess previously identified epidemiologic risk factors in cases identified by electronic algorithms.</p> <p>Methods</p> <p>Electronic algorithms were used to select individuals with cataracts in the Personalized Medicine Research Project database. These were analyzed for cataract prevalence, age at cataract, and previously identified risk factors.</p> <p>Results</p> <p>Cataract diagnoses and surgeries, though not type of cataract, were successfully identified using electronic algorithms. Age specific prevalence of both cataract (22% compared to 17.2%) and cataract surgery (11% compared to 5.1%) were higher when compared to the Eye Diseases Prevalence Research Group. The risk factors of age, gender, diabetes, and steroid use were confirmed.</p> <p>Conclusions</p> <p>Using electronic health records can be a viable and efficient tool to identify cataracts for research. However, using retrospective data from this source can be confounded by historical limits on data availability, differences in the utilization of healthcare, and changes in exposures over time.</p

Improving eye care for veterans with diabetes: An example of using the QUERI steps to move from evidence to implementation: QUERI Series

<p>Abstract</p> <p>Background</p> <p>Despite being a critical part of improving healthcare quality, little is known about how best to move important research findings into clinical practice. To address this issue, the Department of Veterans Affairs (VA) developed the Quality Enhancement Research Initiative (QUERI), which provides a framework, a supportive structure, and resources to promote the more rapid implementation of evidence into practice.</p> <p>Methods</p> <p>This paper uses a practical example to demonstrate the use of the six-step QUERI process, which was developed as part of QUERI and provides a systematic approach for moving along the research to practice pipeline. Specifically, we describe a series of projects using the six-step framework to illustrate how this process guided work by the Diabetes Mellitus QUERI (DM-QUERI) Center to assess and improve eye care for veterans with diabetes.</p> <p>Results</p> <p>Within a relatively short time, DM-QUERI identified a high-priority issue, developed evidence to support a change in the diabetes eye screening performance measure, and identified a gap in quality of care. A prototype scheduling system to address gaps in screening and follow-up also was tested as part of an implementation project. We did not succeed in developing a fully functional pro-active scheduling system. This work did, however, provide important information to help us further understand patients' risk status, gaps in follow-up at participating eye clinics, specific considerations for additional implementation work in the area of proactive scheduling, and contributed to a change in the prevailing diabetes eye care performance measure.</p> <p>Conclusion</p> <p>Work by DM-QUERI to promote changes in the delivery of eye care services for veterans with diabetes demonstrates the value of the QUERI process in facilitating the more rapid implementation of evidence into practice. However, our experience with using the QUERI process also highlights certain challenges, including those related to the hybrid nature of the research-operations partnership as a mechanism for promoting rapid, system-wide implementation of important research findings. In addition, this paper suggests a number of important considerations for future implementation work, both in the area of pro-active scheduling interventions, as well as for implementation science in general.</p

Examining the presence and nature of delusions in Alzheimer's disease and frontotemporal dementia syndromes

Objectives Abnormal beliefs and delusions have been reported in some people with dementia, however, the prevalence of delusions, and their neurocognitive basis has been underexplored. This study aimed to examine the presence, severity, content and neural correlates of delusions in a large, well-characterised cohort of dementia patients using a transdiagnostic, cross-sectional approach. Methods Four-hundred and eighty-seven people with dementia were recruited: 102 Alzheimer's disease, 136 behavioural-variant frontotemporal dementia, 154 primary progressive aphasia, 29 motor neurone disease, 46 corticobasal syndrome, 20 progressive supranuclear palsy. All patients underwent neuropsychological assessment and brain magnetic resonance imaging, and the Neuropsychiatric Inventory was conducted with an informant, by an experienced clinician. Results In our cohort, 48/487 patients (10.8%) had delusions. A diagnosis of behavioural-variant frontotemporal dementia (18.4%) and Alzheimer's disease (11.8%) were associated with increased risk of delusions. A positive gene mutation was observed in 11/27 people with delusions. Individuals with frequent delusions performed worse on the Addenbrooke's Cognitive Examination (p = 0.035), particularly on the orientation/attention (p = 0.022) and memory (p = 0.013) subtests. Voxel-based morphometry analyses found that increased delusional psychopathology was associated with reduced integrity of the right middle frontal gyrus, right planum temporale and left anterior temporal pole. Conclusion Our results demonstrate that delusions are relatively common in dementia and uncover a unique cognitive and neural profile associated with the manifestation of delusions. Clinically, delusions may lead to delayed or misdiagnosis. Our results shed light on how to identify individuals at risk of neuropsychiatric features of dementia, a crucial first step to enable targeted symptom management