Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines

Background: Multiple imputation (MI) provides an effective approach to handle missing covariate data within prognostic modelling studies, as it can properly account for the missing data uncertainty. The multiply imputed datasets are each analysed using standard prognostic modelling techniques to obtain the estimates of interest. The estimates from each imputed dataset are then combined into one overall estimate and variance, incorporating both the within and between imputation variability. Rubin's rules for combining these multiply imputed estimates are based on asymptotic theory. The resulting combined estimates may be more accurate if the posterior distribution of the population parameter of interest is better approximated by the normal distribution. However, the normality assumption may not be appropriate for all the parameters of interest when analysing prognostic modelling studies, such as predicted survival probabilities and model performance measures. Methods: Guidelines for combining the estimates of interest when analysing prognostic modelling studies are provided. A literature review is performed to identify current practice for combining such estimates in prognostic modelling studies. Results: Methods for combining all reported estimates after MI were not well reported in the current literature. Rubin's rules without applying any transformations were the standard approach used, when any method was stated. Conclusion: The proposed simple guidelines for combining estimates after MI may lead to a wider and more appropriate use of MI in future prognostic modelling studies

Power grip, pinch grip, manual muscle testing or thenar atrophy - which should be assessed as a motor outcome after carpal tunnel decompression? A systematic review

<p>Abstract</p> <p>Background</p> <p>Objective assessment of motor function is frequently used to evaluate outcome after surgical treatment of carpal tunnel syndrome (CTS). However a range of outcome measures are used and there appears to be no consensus on which measure of motor function effectively captures change. The purpose of this systematic review was to identify the methods used to assess motor function in randomized controlled trials of surgical interventions for CTS. A secondary aim was to evaluate which instruments reflect clinical change and are psychometrically robust.</p> <p>Methods</p> <p>The bibliographic databases Medline, AMED and CINAHL were searched for randomized controlled trials of surgical interventions for CTS. Data on instruments used, methods of assessment and results of tests of motor function was extracted by two independent reviewers.</p> <p>Results</p> <p>Twenty-two studies were retrieved which included performance based assessments of motor function. Nineteen studies assessed power grip dynamometry, fourteen studies used both power and pinch grip dynamometry, eight used manual muscle testing and five assessed the presence or absence of thenar atrophy. Several studies used multiple tests of motor function. Two studies included both power and pinch strength and reported descriptive statistics enabling calculation of effect sizes to compare the relative responsiveness of grip and pinch strength within study samples. The study findings suggest that tip pinch is more responsive than lateral pinch or power grip up to 12 weeks following surgery for CTS.</p> <p>Conclusion</p> <p>Although used most frequently and known to be reliable, power and key pinch dynamometry are not the most valid or responsive tools for assessing motor outcome up to 12 weeks following surgery for CTS. Tip pinch dynamometry more specifically targets the thenar musculature and appears to be more responsive. Manual muscle testing, which in theory is most specific to the thenar musculature, may be more sensitive if assessed using a hand held dynamometer – the Rotterdam Intrinsic Handheld Myometer. However further research is needed to evaluate its reliability and responsiveness and establish the most efficient and psychometrically robust method of evaluating motor function following surgery for CTS.</p

Effectiveness of physiotherapy exercise following hip arthroplasty for osteoarthritis: a systematic review of clinical trials

Background: Physiotherapy has long been a routine component of patient rehabilitation following hip joint replacement. The purpose of this systematic review was to evaluate the effectiveness of physiotherapy exercise after discharge from hospital on function, walking, range of motion, quality of life and muscle strength, for osteoarthritic patients following elective primary total hip arthroplasty. Methods: Design: Systematic review, using the Cochrane Collaboration Handbook for Systematic Reviews of Interventions and the Quorom Statement. Database searches: AMED, CINAHL, EMBASE, KingsFund, MEDLINE, Cochrane library (Cochrane reviews, Cochrane Central Register of Controlled Trials, DARE), PEDro, The Department of Health National Research Register. Handsearches: Physiotherapy, Physical Therapy, Journal of Bone and Joint Surgery (Britain) Conference Proceedings. No language restrictions were applied. Selection: Trials comparing physiotherapy exercise versus usual/standard care, or comparing two types of relevant exercise physiotherapy, following discharge from hospital after elective primary total hip replacement for osteoarthritis were reviewed. Outcomes: Functional activities of daily living, walking, quality of life, muscle strength and range of hip joint motion. Trial quality was extensively evaluated. Narrative synthesis plus meta-analytic summaries were performed to summarise the data. Results: 8 trials were identified. Trial quality was mixed. Generally poor trial quality, quantity and diversity prevented explanatory meta-analyses. The results were synthesised and meta-analytic summaries were used where possible to provide a formal summary of results. Results indicate that physiotherapy exercise after discharge following total hip replacement has the potential to benefit patients. Conclusion: Insufficient evidence exists to establish the effectiveness of physiotherapy exercise following primary hip replacement for osteoarthritis. Further well designed trials are required to determine the value of post discharge exercise following this increasingly common surgical procedure

A systematic review of biomarkers for disease progression in Parkinson's disease

Peer reviewedPublisher PD

Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited

Decision tools in health care: focus on the problem, not the solution

BACKGROUND: Systematic reviews or randomised-controlled trials usually help to establish the effectiveness of drugs and other health technologies, but are rarely sufficient by themselves to ensure actual clinical use of the technology. The process from innovation to routine clinical use is complex. Numerous computerised decision support systems (DSS) have been developed, but many fail to be taken up into actual use. Some developers construct technologically advanced systems with little relevance to the real world. Others did not determine whether a clinical need exists. With NHS investing £5 billion in computer systems, also occurring in other countries, there is an urgent need to shift from a technology-driven approach to one that identifies and employs the most cost-effective method to manage knowledge, regardless of the technology. The generic term, 'decision tool' (DT), is therefore suggested to demonstrate that these aids, which seem different technically, are conceptually the same from a clinical viewpoint. DISCUSSION: Many computerised DSSs failed for various reasons, for example, they were not based on best available knowledge; there was insufficient emphasis on their need for high quality clinical data; their development was technology-led; or evaluation methods were misapplied. We argue that DSSs and other computer-based, paper-based and even mechanical decision aids are members of a wider family of decision tools. A DT is an active knowledge resource that uses patient data to generate case specific advice, which supports decision making about individual patients by health professionals, the patients themselves or others concerned about them. The identification of DTs as a consistent and important category of health technology should encourage the sharing of lessons between DT developers and users and reduce the frequency of decision tool projects focusing only on technology. The focus of evaluation should become more clinical, with the impact of computer-based DTs being evaluated against other computer, paper- or mechanical tools, to identify the most cost effective tool for each clinical problem. SUMMARY: We suggested the generic term 'decision tool' to demonstrate that decision-making aids, such as computerised DSSs, paper algorithms, and reminders are conceptually the same, so the methods to evaluate them should be the same

Femoroacetabular impingement and classification of the cam deformity: the reference interval in normal hips

BACKGROUND AND PURPOSE: Most patients with femoroacetabular impingement (FAI) have a cam deformity, which may be quantified by measuring the alpha angle and anterior offset ratio (AOR). Knowledge of what constitutes a "normal" alpha angle and AOR is limited. We defined the reference intervals of these measurements from normal hips in the general population. PATIENTS AND METHODS: 157 individuals from the general population were reviewed clinically and radiographically. 74 individuals with clinical evidence of hip disease or radiographic evidence of osteoarthritis (OA) were excluded, leaving a study group of 83 individuals (mean age 46 (22-69) years, 44 females) with normal hips. The alpha angles and AORs were measured from cross-table lateral radiographs taken in 15 degrees internal rotation. A validation study consisting of a cadaver study and a measurement reliability study was also performed. RESULTS: The mean alpha angle was 48 degrees in men and 47 degrees in women. The mean AOR was 0.19, the same in men and women. Thus, sexes were combined to derive 95% confidence intervals for the population mean alpha angle (46-49 degrees ) and AOR (0.18-0.20). The 95% reference interval for the alpha angle was 32-62 degrees degrees, and for the AOR it was 0.14-0.24. The validation study confirmed that these measurements were resistant to a reasonable degree of variation in positioning and that the repeatability and reproducibility of the measurements was good. INTERPRETATION: These reference intervals indicate that clinically and radiographically normal hips may have alpha angles and AORs that have previously been considered "abnormal". The thresholds provided by this study will aid classification of individuals involved in longitudinal studies of FAI and OA, and may be of use to the practicing clinician in evaluating the young adult with hip pain

Effect of changes over time in the performance of a customized SAPS-II model on the quality of care assessment

Purpose: The aim of our study was to explore, using an innovative method, the effect of temporal changes in the mortality prediction performance of an existing model on the quality of care assessment. The prognostic model (rSAPS-II) was a recalibrated Simplified Acute Physiology Score-II model developed for very elderly Intensive Care Unit (ICU) patients. Methods: The study population comprised all 12,143 consecutive patients aged 80 years and older admitted between January 2004 and July 2009 to one of the ICUs of 21 Dutch hospitals. The prospective dataset was split into 30 equally sized consecutive subsets. Per subset, we measured the model's discrimination [area under the curve (AUC)], accuracy (Brier score), and standardized mortality ratio (SMR), both without and after repeated recalibration. All performance measures were considered to be stable if 1 without and after repeated recalibration for the year 2009. Results: For all subsets, the AUCs were stable, but the Brier scores and SMRs were not. The SMR was downtrending, achieving levels significantly below 1. Repeated recalibration rendered it stable again. The proportions of hospitals with SMR>1 and SMR <1 changed from 15 versus 85% to 35 versus 65%. Conclusions: Variability over time may markedly vary among different performance measures, and infrequent model recalibration can result in improper assessment of the quality of care in many hospitals. We stress the importance of the timely recalibration and repeated validation of prognostic models over tim

Intra- and inter-observer analysis in the morphological assessment of early-stage embryos

<p>Abstract</p> <p>Background</p> <p>The aim of this study was to determine the intra- and inter-observer variability in the evaluation of embryo quality. Multilevel images of embryos on day 1, day 2 and day 3, were analysed using different morphological parameters.</p> <p>Methods</p> <p>Multilevel images of embryos on day 1, day 2 and day 3, were analysed using a standard scoring system. The kappa coefficient was calculated to measure intra- and inter-observer variability before and after training sessions.</p> <p>Results</p> <p>Good to excellent intra-observer agreement was present for most parameters exceptions being scoring the position of pronuclei and the presence of a cytoplasmic halo on day 1, multinucleation on day 2 and the size of fragments on day 3. Inter-observer agreement was only good to excellent for the number of blastomeres on day 2 and day 3 and the orientation of the cleavage axes on day 2. Training sessions had a positive impact on inter-observer agreement.</p> <p>Conclusion</p> <p>In conclusion, assessment of morphological characteristics of early stage embryos using multilevel images was marked by a high intra-observer and a moderate inter-observer agreement. Training sessions were useful to increase inter-observer agreement.</p