436 research outputs found

    Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers

    Get PDF
    <p>Abstract</p> <p>Background</p> <p>Decision curve analysis is a novel method for evaluating diagnostic tests, prediction models and molecular markers. It combines the mathematical simplicity of accuracy measures, such as sensitivity and specificity, with the clinical applicability of decision analytic approaches. Most critically, decision curve analysis can be applied directly to a data set, and does not require the sort of external data on costs, benefits and preferences typically required by traditional decision analytic techniques.</p> <p>Methods</p> <p>In this paper we present several extensions to decision curve analysis including correction for overfit, confidence intervals, application to censored data (including competing risk) and calculation of decision curves directly from predicted probabilities. All of these extensions are based on straightforward methods that have previously been described in the literature for application to analogous statistical techniques.</p> <p>Results</p> <p>Simulation studies showed that repeated 10-fold crossvalidation provided the best method for correcting a decision curve for overfit. The method for applying decision curves to censored data had little bias and coverage was excellent; for competing risk, decision curves were appropriately affected by the incidence of the competing risk and the association between the competing risk and the predictor of interest. Calculation of decision curves directly from predicted probabilities led to a smoothing of the decision curve.</p> <p>Conclusion</p> <p>Decision curve analysis can be easily extended to many of the applications common to performance measures for prediction models. Software to implement decision curve analysis is provided.</p

    Empirical estimates of prostate cancer overdiagnosis by age and prostate-specific antigen

    Get PDF
    Background: Prostate cancer screening depends on a careful balance of benefits, in terms of reduced prostate cancer mortality, and harms, in terms of overdiagnosis and overtreatment. We aimed to estimate the effect on overdiagnosis of restricting prostate specific antigen (PSA) testing by age and baseline PSA.Methods: Estimates of the effects of age on overdiagnosis were based on population based incidence data from the US Surveillance, Epidemiology and End Results database. To investigate the relationship between PSA and overdiagnosis, we used two separate cohorts subject to PSA testing in clinical trials (n = 1,577 and n = 1,197) and a population-based cohort of Swedish men not subject to PSA-screening followed for 25 years (n = 1,162).Results: If PSA testing had been restricted to younger men, the number of excess cases associated with the introduction of PSA in the US would have been reduced by 85%, 68% and 42% for age cut-offs of 60, 65 and 70, respectively. The risk that a man with screen-detected cancer at age 60 would not subsequently lead to prostate cancer morbidity or mortality decreased exponentially as PSA approached conventional biopsy thresholds. For PSAs below 1 ng/ml, the risk of a positive biopsy is 65 (95% CI 18.2, 72.9) times greater than subsequent prostate cancer mortality.Conclusions: Prostate cancer overdiagnosis has a strong relationship to age and PSA level. Restricting screening in men over 60 to those with PSA above median (>1 ng/ml) and screening men over 70 only in selected circumstances would importantly reduce overdiagnosis and change the ratio of benefits to harms of PSA-screening

    Activation of Ventral Tegmental Area 5-HT2C Receptors Reduces Incentive Motivation

    Get PDF
    FUNDING AND DISCLOSURE The research was funded by Wellcome Trust (WT098012) to LKH; and National Institute of Health (DK056731) and the Marilyn H. Vincent Foundation to MGM. The University of Michigan Transgenic Core facility is partially supported by the NIH-funded University of Michigan Center for Gastrointestinal Research (DK034933). The remaining authors declare no conflict of interest. ACKNOWLEDGMENTS We thank Dr Celine Cansell, Ms Raffaella Chianese and the staff of the Medical Research Facility for technical assistance. We thank Dr Vladimir Orduña for the scientific advice and technical assistance.Peer reviewedPublisher PD

    Evaluation of the impact of a school gardening intervention on children's fruit and vegetable intake: a randomised controlled trial.

    Get PDF
    Background: Current academic literature suggests that school gardening programmes can provide an interactive environment with the potential to change children’s fruit and vegetable intake. This is the first cluster randomised controlled trial (RCT) designed to evaluate whether a school gardening programme can have an effect on children’s fruit and vegetable intake. Methods: The trial included children from 23 schools; these schools were randomised into two groups, one to receive the Royal Horticultural Society (RHS)-led intervention and the other to receive the less involved Teacher-led intervention. A 24-hour food diary (CADET) was used to collect baseline and follow-up dietary intake 18 months apart. Questionnaires were also administered to evaluate the intervention implementation. Results: A total of 641 children completed the trial with a mean age of 8.1 years (95% CI: 8.0, 8.4). The unadjusted results from multilevel regression analysis revealed that for combined daily fruit and vegetable intake the Teacher-led group had a higher daily mean change of 8 g (95% CI: −19, 36) compared to the RHS-led group -32 g (95% CI: −60, −3). However, after adjusting for possible confounders this difference was not significant (intervention effect: −40 g, 95% CI: −88, 1; p = 0.06). The adjusted analysis of process measures identified that if schools improved their gardening score by 3 levels (a measure of school gardening involvement - the scale has 6 levels from 0 ‘no garden’ to 5 ‘community involvement’), irrespective of group allocation, children had, on average, a daily increase of 81 g of fruit and vegetable intake (95% CI: 0, 163; p = 0.05) compared to schools that had no change in gardening score. Conclusions: This study is the first cluster randomised controlled trial designed to evaluate a school gardening intervention. The results have found very little evidence to support the claims that school gardening alone can improve children’s daily fruit and vegetable intake. However, when a gardening intervention is implemented at a high level within the school it may improve children’s daily fruit and vegetable intake by a portion. Improving children’s fruit and vegetable intake remains a challenging task

    The challenges faced in the design, conduct and analysis of surgical randomised controlled trials

    Get PDF
    Randomised evaluations of surgical interventions are rare; some interventions have been widely adopted without rigorous evaluation. Unlike other medical areas, the randomised controlled trial (RCT) design has not become the default study design for the evaluation of surgical interventions. Surgical trials are difficult to successfully undertake and pose particular practical and methodological challenges. However, RCTs have played a role in the assessment of surgical innovations and there is scope and need for greater use. This article will consider the design, conduct and analysis of an RCT of a surgical intervention. The issues will be reviewed under three headings: the timing of the evaluation, defining the research question and trial design issues. Recommendations on the conduct of future surgical RCTs are made. Collaboration between research and surgical communities is needed to address the distinct issues raised by the assessmentof surgical interventions and enable the conduct of appropriate and well-designed trials.The Health Services Research Unit is funded by the Scottish Government Health DirectoratesPeer reviewedPublisher PD

    Does publication bias inflate the apparent efficacy of psychological treatment for major depressive disorder? A systematic review and meta-analysis of US national institutes of health-funded trials

    Get PDF
    Background The efficacy of antidepressant medication has been shown empirically to be overestimated due to publication bias, but this has only been inferred statistically with regard to psychological treatment for depression. We assessed directly the extent of study publication bias in trials examining the efficacy of psychological treatment for depression. Methods and Findings We identified US National Institutes of Health grants awarded to fund randomized clinical trials comparing psychological treatment to control conditions or other treatments in patients diagnosed with major depressive disorder for the period 1972–2008, and we determined whether those grants led to publications. For studies that were not published, data were requested from investigators and included in the meta-analyses. Thirteen (23.6%) of the 55 funded grants that began trials did not result in publications, and two others never started. Among comparisons to control conditions, adding unpublished studies (Hedges’ g = 0.20; CI95% -0.11~0.51; k = 6) to published studies (g = 0.52; 0.37~0.68; k = 20) reduced the psychotherapy effect size point estimate (g = 0.39; 0.08~0.70) by 25%. Moreover, these findings may overestimate the "true" effect of psychological treatment for depression as outcome reporting bias could not be examined quantitatively. Conclusion The efficacy of psychological interventions for depression has been overestimated in the published literature, just as it has been for pharmacotherapy. Both are efficacious but not to the extent that the published literature would suggest. Funding agencies and journals should archive both original protocols and raw data from treatment trials to allow the detection and correction of outcome reporting bias. Clinicians, guidelines developers, and decision makers should be aware that the published literature overestimates the effects of the predominant treatments for depression

    A Systematic Evaluation of the Impact of STRICTA and CONSORT Recommendations on Quality of Reporting for Acupuncture Trials

    Get PDF
    Background: We investigated whether there had been an improvement in quality of reporting for randomised controlled trials of acupuncture since the publication of the STRICTA and CONSORT statements. We conducted a before-and-after study, comparing ratings for quality of reporting following the publication of both STRICTA and CONSORT recommendations. Methodology and Principal Findings: Ninety peer reviewed journal articles reporting the results of acupuncture trials were selected at random from a wider sample frame of 266 papers. Papers published in three distinct time periods (1994–1995, 1999–2000 and 2004–2005) were compared. Assessment criteria were developed directly from CONSORT and STRICTA checklists. Papers were independently assessed for quality of reporting by two assessors, one of whom was blind to information which could have introduced systematic bias (e.g. date of publication). We detected a statistically significant increase in the reporting of CONSORT items for papers published in each time period measured. We did not, however, find a difference between the number of STRICTA items reported in journal articles published before and 3 to 4 years following the introduction of STRICTA recommendations. Conclusions and Significance: The results of this study suggest that general standards of reporting for acupuncture trials have significantly improved since the introduction of the CONSORT statement in 1996, but that quality in reporting detail
    corecore