359 research outputs found

    Reporting performance of prognostic models in cancer: a review

    Get PDF
    <p>Abstract</p> <p>Background</p> <p>Appropriate choice and use of prognostic models in clinical practice require the use of good methods for both model development, and for developing prognostic indices and risk groups from the models. In order to assess reliability and generalizability for use, models need to have been validated and measures of model performance reported. We reviewed published articles to assess the methods and reporting used to develop and evaluate performance of prognostic indices and risk groups from prognostic models.</p> <p>Methods</p> <p>We developed a systematic search string and identified articles from PubMed. Forty-seven articles were included that satisfied the following inclusion criteria: published in 2005; aiming to predict patient outcome; presenting new prognostic models in cancer with outcome time to an event and including a combination of at least two separate variables; and analysing data using multivariable analysis suitable for time to event data.</p> <p>Results</p> <p>In 47 studies, Cox models were used in 94% (44), but the coefficients or hazard ratios for the variables in the final model were reported in only 72% (34). The reproducibility of the derived model was assessed in only 11% (5) of the articles. A prognostic index was developed from the model in 81% (38) of the articles, but researchers derived the prognostic index from the final prognostic model in only 34% (13) of the studies; different coefficients or variables from those in the final model were used in 50% (19) of models and the methods used were unclear in 16% (6) of the articles. Methods used to derive prognostic groups were also poor, with researchers not reporting the methods used in 39% (14 of 36) of the studies and data derived methods likely to bias estimates of differences between risk groups being used in 28% (10) of the studies. Validation of their models was reported in only 34% (16) of the studies. In 15 studies validation used data from the same population and in five studies from a different population. Including reports of validation with external data from publications up to four years following model development, external validation was attempted for only 21% (10) of models. Insufficient information was provided on the performance of models in terms of discrimination and calibration.</p> <p>Conclusions</p> <p>Many published prognostic models have been developed using poor methods and many with poor reporting, both of which compromise the reliability and clinical relevance of models, prognostic indices and risk groups derived from them.</p

    Reporting methods in studies developing prognostic models in cancer: a review

    Get PDF
    Development of prognostic models enables identification of variables that are influential in predicting patient outcome and the use of these multiple risk factors in a systematic, reproducible way according to evidence based methods. The reliability of models depends on informed use of statistical methods, in combination with prior knowledge of disease. We reviewed published articles to assess reporting and methods used to develop new prognostic models in cancer.We developed a systematic search string and identified articles from PubMed. Forty-seven articles were included that satisfied the following inclusion criteria: published in 2005; aiming to predict patient outcome; presenting new prognostic models in cancer with outcome time to an event and including a combination of at least two separate variables; and analysing data using multivariable analysis suitable for time to event data.In 47 studies, prospective cohort or randomised controlled trial data were used for model development in only 33% (15) of studies. In 30% (14) of the studies insufficient data were available, having fewer than 10 events per variable (EPV) used in model development. EPV could not be calculated in a further 40% (19) of the studies. The coding of candidate variables was only reported in 68% (32) of the studies. Although use of continuous variables was reported in all studies, only one article reported using recommended methods of retaining all these variables as continuous without categorisation. Statistical methods for selection of variables in the multivariate modelling were often flawed. A method that is not recommended, namely, using statistical significance in univariate analysis as a pre-screening test to select variables for inclusion in the multivariate model, was applied in 48% (21) of the studies.We found that published prognostic models are often characterised by both use of inappropriate methods for development of multivariable models and poor reporting. In addition, models are limited by the lack of studies based on prospective data of sufficient sample size to avoid overfitting. The use of poor methods compromises the reliability of prognostic models developed to provide objective probability estimates to complement clinical intuition of the physician and guidelines

    Toward a Resilient Global Society: Air, Sea Level, Earthquakes, and Weather

    Full text link
    Society’s progress along the four corners of prepare, absorb, respond and adapt resilience square is uneven, in spite of our understanding of the foundational science and a growing sense that urgent action is needed. The resilience vignettes describe the meaning and impact of current and near‐term change in four major domains: human health impacts from air pollution, coastal inundation from sea‐level rise, damaging earthquakes in populated areas, and impacts from extreme precipitation. Given our understanding of the scientific principles, societal action, from preparation to adaption, will be critical in minimizing the negative impacts of change. The unprecedented rates of change in today’s Earth system argue for urgent action in support of a resilient global society.Key PointsUnprecedented rates of change in the Earth system argue for more urgent action in support of a resilient global societyExperts describe the meaning and impact of current and near‐term change in four major domainsWe take an ensemble approach to highlight the similarities for actionable decision‐makingPeer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/151889/1/eft2547_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/151889/2/eft2547.pd

    The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed

    Get PDF
    Objectives To examine the reporting characteristics and methodological details of randomised trials indexed in PubMed in 2000 and 2006 and assess whether the quality of reporting has improved after publication of the Consolidated Standards of Reporting Trials (CONSORT) Statement in 2001

    Association between trial registration and positive study findings: cross sectional study (Epidemiological Study of Randomized Trials—ESORT)

    Get PDF
    Objective To assess whether randomised controlled trials (RCTs) that were registered were less likely to report positive study findings compared with RCTs that were not registered and whether the association varied by funding source. Design Cross sectional study. Study sample All primary RCTs published in December 2012 and indexed in PubMed by November 2013. Trial registration was determined based on the report of a trial registration number in published RCTs or the identification of the trial in a search of trial registries. Trials were separated into prospectively and retrospectively registered studies. Main outcome measure Association between trial registration and positive study findings. Results 1122 eligible RCTs were identified, of which 593 (52.9%) were registered and 529 (47.1%) were not registered. Overall, registration was marginally associated with positive study findings (adjusted risk ratio 0.87, 95% confidence interval 0.78 to 0.98), even with stratification as prospectively and retrospectively registered trials (0.87, 0.74 to 1.03 and 0.88, 0.78 to 1.00, respectively). The interaction term between overall registration and funding source was marginally statistically significant and relative risk estimates were imprecise (0.75, 0.63 to 0.89 for non-industry funded and 1.03, 0.79 to 1.36 for industry funded, P interaction=0.046). Furthermore, a statistically significant interaction was not maintained in sensitivity analyses. Within each stratum of funding source, relative risk estimates were also imprecise for the association between positive study findings and prospective and retrospective registration. Conclusion Among published RCTs, there was little evidence of a difference in positive study findings between registered and non-registered clinical trials, even with stratification by timing of registration. Relative risk estimates were imprecise in subgroups of non-industry and industry funded trials

    Platelet rich plasma injection for acute Achilles tendon rupture: PATH-2 randomised, placebo controlled, superiority trial

    Get PDF
    Objective To determine whether an injection of platelet rich plasma improves outcomes after acute Achilles tendon rupture. Design Randomised, placebo controlled, two arm, parallel group, participant and assessor masked, superiority trial. Setting Secondary care trauma units across 19 hospitals in the United Kingdom’s health service. Participants Recruitment commenced in July 2015 and follow-up was completed in March 2018. 230 adults aged 18 years and over were included, with acute Achilles tendon rupture presenting within 12 days of injury and managed with non-surgical treatment. Exclusions were injury at the insertion or musculotendinous junction, major leg injury or deformity, diabetes mellitus, platelet or haematological disorder, systemic corticosteroids, anticoagulation treatment, and other contraindicating conditions. Interventions Participants were randomised 1:1 to platelet rich plasma (n=114) or placebo (dry needle; n=116) injection. All participants received standard rehabilitation care (ankle immobilisation followed by physiotherapy). Main outcomes and measures Primary outcome was muscle tendon function at 24 weeks, measured objectively with the limb symmetry index (injured/uninjured×100) in maximal work done during the heel rise endurance test (an instrumented measure of repeated single leg heel rises until fatigue). Secondary outcomes included patient reported function (Achilles tendon rupture score), quality of life (short form 12 version 2¼), pain (visual analogue scale), goal attainment (patient specific functional scale), and adverse events. A central laboratory analysed the quality and content of platelet rich plasma. Analyses were by modified intention to treat. Results Participants were 46 years old on average, and 57 (25%) of 230 were female. At 24 weeks, 202 (88%) participants completed the heel rise endurance test and 216 (94%) the patient reported outcomes. The platelet rich plasma was of good quality, with expected growth factor content. No difference was detected in muscle tendon function between participants receiving platelet rich plasma injections and those receiving placebo injections (limb symmetry index, mean 34.7% (standard deviation 17.7%) v 38.5% (22.8%); adjusted mean difference −3.9% (95% confidence interval −10.5% to 2.7%)) or in any secondary outcomes or adverse event rates. Complier average causal effect analyses gave similar findings. Conclusions There is no evidence to indicate that injections of platelet rich plasma can improve objective muscle tendon function, patient reported function, or quality of life after acute Achilles tendon rupture compared with placebo, or that they offer any patient benefit. Trial registration isrctn.com identifier: ISRCTN54992179</p
    • 

    corecore