A cluster randomized trial evaluating electronic prescribing in an ambulatory care setting

<p>Abstract</p> <p>Background</p> <p>Medication errors, adverse drug events and potential adverse drug events are common and serious in terms of the harms and costs that they impose on the health system and those who use it. Errors resulting in preventable adverse drug events have been shown to occur most often at the stages of ordering and administration. This paper describes the protocol for a pragmatic trial of electronic prescribing to reduce prescription error. The trial was designed to overcome the limitations associated with traditional study design.</p> <p>Design</p> <p>This study was designed as a 65-week, cluster randomized, parallel study.</p> <p>Methods</p> <p>The trial was conducted within ambulatory outpatient clinics in an academic tertiary care centre in Ontario, Canada. The electronic prescribing software for the study is a Canadian electronic prescribing software package which provides physician prescription entry with decision support at the point of care. Using a handheld computer (PDA) the physician selects medications using an error minimising menu-based pick list from a comprehensive drug database, create specific prescription instructions and then transmit the prescription directly and electronically to a participating pharmacy via facsimile or to the physician's printer using local area wireless technology. The unit of allocation and randomization is by 'week', i.e. the system is "on" or "off" according to the randomization scheme and the unit of analysis is the prescription, with adjustment for clustering of patients within practitioners.</p> <p>Discussion</p> <p>This paper describes the protocol for a pragmatic cluster randomized trial of point-of-care electronic prescribing, which was specifically designed to overcome the limitations associated with traditional study design.</p> <p>Trial Registration</p> <p>This trial has been registered with clinicaltrials.gov (ID: NCT00252395)</p

Looking inside the black box : a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada

Background: Randomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths). This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. Methods/design: We will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results.The OPEM trial and OPEM process evaluation are funded by the Canadian Institute of Health Research (CIHR). The OPEM process evaluation study was developed as part of the CIHR funded interdisciplinary capacity enhancement team KT-ICEBeRG. Gaston Godin, Jeremy Grimshaw and France Légaré hold Canada Research Chairs. Louise Lemyre holds an R.S. McLaughlin Research Chair

Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651]

Background: Theory-based process evaluations conducted alongside randomized controlled trials provide the opportunity to investigate hypothesized mechanisms of action of interventions, helping to build a cumulative knowledge base and to inform the interpretation of individual trial outcomes. Our objective was to identify the underlying causal mechanisms in a cluster randomized trial of the effectiveness of printed educational materials (PEMs) to increase referral for diabetic retinopathy screening. We hypothesized that the PEMs would increase physicians’ intention to refer patients for retinal screening by strengthening their attitude and subjective norm, but not their perceived behavioral control. Methods: Design: A theory based process evaluation alongside the Ontario Printed Educational Material (OPEM) cluster randomized trial. Postal surveys based on the Theory of Planned Behavior were sent to a random sample of trial participants two months before and six months after they received the intervention. Setting: Family physicians in Ontario, Canada. Participants: 1,512 family physicians (252 per intervention group) from the OPEM trial were invited to participate, and 31.3% (473/1512) responded at time one and time two. The final sample comprised 437 family physicians fully completing questionnaires at both time points. Main outcome measures: Primary: behavioral intention related to referring patient for retinopathy screening; secondary: attitude, subjective norm, perceived behavioral control. Results: At baseline, family physicians reported positive intention, attitude, subjective norm, and perceived behavioral control to advise patients about retinopathy screening suggesting limited opportunities for improvement in these constructs. There were no significant differences on intention, attitude, subjective norm, and perceived behavioral control following the intervention. Respondents also reported additional physician- and patient-related factors perceived to influence whether patients received retinopathy screening. Conclusions: Lack of change in the primary and secondary theory-based outcomes provides an explanation for the lack of observed effect of the main OPEM trial. High baseline levels of intention to advise patients to attend retinopathy screening suggest that post-intentional and other factors may explain gaps in care. Process evaluations based on behavioral theory can provide replicable and generalizable insights to aid interpretation of randomized controlled trials of complex interventions to change health professional behavior

Real-Life Anti-Tumour Necrosis Factor Experience in > 500 Paediatric United Kingdom Inflammatory Bowel Disease Patients.

OBJECTIVES: To measure the effectiveness, safety and use of anti-Tumour necrosis Factor (TNF) therapy in paediatric inflammatory bowel disease (PIBD) in the United Kingdom (UK). METHODS: Prospective UK audit of patients newly starting anti-TNF therapy. Disease severity was assessed using Physician Global Assessment (PGA) +/or the Paediatric Crohn's Disease Activity Index (PCDAI). RESULTS: 37 centres participated (23 of 25 specialist PIBD sites). 524 patients were included; 429 Crohn's disease (CD), 76 ulcerative colitis (UC), 19 IBD unclassified (IBDU). 87% (488/562) anti-TNF was infliximab; commonest indication was active luminal CD 77% (330/429) or chronic refractory UC/IBDU 56% (53/95); 79% (445/562) had concomitant co-immunosuppression. In CD (267/429 male), median time from diagnosis to treatment was 1.42 years (IQR 0.63-2.97). Disease (at initiation) was moderate or severe in 91% (156/171) by PGA compared to 41% (88/217) by PCDAI; Kappa (Κ) 0.28 = only 'fair agreement' (p < 0.001).Where documented, 77% (53/69) of CD patients responded to induction; and 65% (46/71) entered remission. 2287 infusions and 301.96 years of patient follow-up (n = 385) are represented; adverse events affected 3% (49/1587) infliximab and 2% (2/98) adalimumab infusions (no deaths or malignancies). Perianal abscess drainage was less common after anti-TNF initiation (CD): 26% (27/102) before, 7% (3/42) after (p = 0.01); however pre and post anti-TNF data collection was not over equal time periods. CONCLUSION: Anti-TNFs are effective treatments, usually given with thiopurine co-immunosuppression. This study highlights deficiencies in formal documentation of effect and disparity between disease severity scoring tools which need to be addressed to improve ongoing patient care

An innovative telemedicine knowledge translation program to improve quality of care in intensive care units: protocol for a cluster randomized pragmatic trial

Abstract Background There are challenges to timely adoption of, and ongoing adherence to, evidence-based practices known to improve patient care in the intensive care unit (ICU). Quality improvement initiatives using a collaborative network approach may increase the use of such practices. Our objective is to evaluate the effectiveness of a novel knowledge translation program for increasing the proportion of patients who appropriately receive the following six evidence-based care practices: venous thromboembolism prophylaxis; ventilator-associated pneumonia prevention; spontaneous breathing trials; catheter-related bloodstream infection prevention; decubitus ulcer prevention; and early enteral nutrition. Methods and design We will conduct a pragmatic cluster randomized active control trial in 15 community ICUs and one academic ICU in Ontario, Canada. The intervention is a multifaceted videoconferenced educational and problem-solving forum to organize knowledge translation strategies, including comparative audit and feedback, educational sessions from content experts, and dissemination of algorithms. Fifteen individual ICUs (clusters) will be randomized to receive quality improvement interventions targeting one of the best practices during each of six study phases. Each phase lasts four months during the first study year and three months during the second. At the end of each study phase, ICUs are assigned to an intervention for a best practice not yet received according to a random schedule. The primary analysis will use patient-level process-of-care data to measure the intervention's effect on rates of adoption and adherence of each best practice in the targeted ICU clusters versus controls. Discussion This study design evaluates a new system for knowledge translation and quality improvement across six common ICU problems. All participating ICUs receive quality improvement initiatives during every study phase, improving buy-in. This study design could be considered for other quality improvement interventions and in other care settings. Trial Registration This trial is registered with http://www.clinicaltrials.gov (ID #: NCT00332982

Personalized versus standardized dosing strategies for the treatment of childhood amblyopia: study protocol for a randomized controlled trial

Background: Amblyopia is the commonest visual disorder of childhood in Western societies, affecting, predominantly, spatial visual function. Treatment typically requires a period of refractive correction (‘optical treatment’) followed by occlusion: covering the nonamblyopic eye with a fabric patch for varying daily durations. Recent studies have provided insight into the optimal amount of patching (‘dose’), leading to the adoption of standardized dosing strategies, which, though an advance on previous ad-hoc regimens, take little account of individual patient characteristics. This trial compares the effectiveness of a standardized dosing strategy (that is, a fixed daily occlusion dose based on disease severity) with a personalized dosing strategy (derived from known treatment dose-response functions), in which an initially prescribed occlusion dose is modulated, in a systematic manner, dependent on treatment compliance. Methods/design: A total of 120 children aged between 3 and 8 years of age diagnosed with amblyopia in association with either anisometropia or strabismus, or both, will be randomized to receive either a standardized or a personalized occlusion dose regimen. To avoid confounding by the known benefits of refractive correction, participants will not be randomized until they have completed an optical treatment phase. The primary study objective is to determine whether, at trial endpoint, participants receiving a personalized dosing strategy require fewer hours of occlusion than those in receipt of a standardized dosing strategy. Secondary objectives are to quantify the relationship between observed changes in visual acuity (logMAR, logarithm of the Minimum Angle of Resolution) with age, amblyopia type, and severity of amblyopic visual acuity deficit. Discussion: This is the first randomized controlled trial of occlusion therapy for amblyopia to compare a treatment arm representative of current best practice with an arm representative of an entirely novel treatment regimen based on statistical modelling of previous trial outcome data. Should the personalized dosing strategy demonstrate superiority over the standardized dosing strategy, then its adoption into routine practice could bring practical benefits in reducing the duration of treatment needed to achieve an optimal outcome

cExternal beam radiation results in minimal changes in post void residual urine volumes during the treatment of clinically localized prostate cancer

<p>Abstract</p> <p>Background</p> <p>To evaluate the impact of external beam radiation therapy (XRT) on weekly ultrasound determined post-void residual (PVR) urine volumes in patients with prostate cancer.</p> <p>Methods</p> <p>125 patients received XRT for clinically localized prostate cancer. XRT was delivered to the prostate only (n = 66) or if the risk of lymph node involvement was greater than 10% to the whole pelvis followed by a prostate boost (n = 59). All patients were irradiated in the prone position in a custom hip-fix mobilization device with an empty bladder and rectum. PVR was obtained at baseline and weekly. Multiple clinical and treatment parameters were evaluated as predictors for weekly PVR changes.</p> <p>Results</p> <p>The mean patient age was 73.9 years with a mean pre-treatment prostate volume of 53.3 cc, a mean IPSS of 11.3 and a mean baseline PVR of 57.6 cc. During treatment, PVR decreased from baseline in both cohorts with the absolute difference within the limits of accuracy of the bladder scanner. Alpha-blockers did not predict for a lower PVR during treatment. There was no significant difference in mean PVR urine volumes or differences from baseline in either the prostate only or pelvic radiation groups (p = 0.664 and p = 0.458, respectively). Patients with a larger baseline PVR (>40 cc) had a greater reduction in PVR, although the greatest reduction was seen between weeks one and three. Patients with a small PVR (<40 cc) had no demonstrable change throughout treatment.</p> <p>Conclusion</p> <p>Prostate XRT results in clinically insignificant changes in weekly PVR volumes, suggesting that radiation induced bladder irritation does not substantially influence bladder residual urine volumes.</p

A theory-based process evaluation alongside a randomised controlled trial of printed educational messages to increase primary care physicians' prescription of thiazide diuretics for hypertension [ISRCTN72772651]

Background Pragmatic trials of implementation interventions focus on evaluating whether an intervention changes professional behaviour under real-world conditions rather than investigating the mechanism through which change occurs. Theory-based process evaluations conducted alongside pragmatic randomised trials address this by assessing whether the intervention changes theoretical constructs proposed to mediate change. The Ontario Printed Educational Materials (PEM) cluster trial was designed to increase family physicians’ guideline-recommended prescription of thiazide diuretics. The trial found no intervention effect. Using the theory of planned behaviour (TPB), we hypothesised that changes in thiazide prescribing would be reflected in changes in intention, consistent with changes in attitude and subjective norm, with no change to their perceived behavioural control (PBC), and tested this alongside the RCT. Methods We developed and sent TPB postal questionnaires to a random sub-sample of family physicians in each trial arm 2 months before and 6 months after dissemination of the PEMs. We used analysis of covariance to test for group differences using a 2 × 3 factorial design. We content-analysed an open-ended question about perceived barriers to thiazide prescription. Using control group data, we tested whether baseline measures of TPB constructs predicted self-reported thiazide prescribing at follow-up. Results Four hundred twenty-six physicians completed pre- and post-intervention questionnaires. Baseline scores on measures of TPB constructs were high: intention mean = 5.9 out of 7 (SD = 1.4), attitude mean = 5.8 (SD = 1.1), subjective norm mean = 5.8 (SD = 1.1) and PBC mean = 6.2 (SD = 1.0). The arms did not significantly differ post-intervention on any of the theory-based constructs, suggesting a possible ceiling effect. Content analysis of perceived barriers suggested post-intentional barriers to prescribing thiazides most often focused on specific patient clinical characteristics and potential side effects. Baseline intention (β = 0.63, p < 0.01) but not PBC (β = 0.04, p = 0.78) predicted 42.6 % of the variance in self-reported behaviour at follow-up in the control group. Conclusions Congruent with the Ontario Printed Educational Messages trial results and aligned with the TPB, we saw no impact of the intervention on any TPB constructs. The theoretical basis of this evaluation suggests possible explanations for the failure of the PEM intervention to change professional behaviour, which can directly inform the design and content of future theory-based PEM interventions to change professional behaviour

How does study quality affect the results of a diagnostic meta-analysis?

Background: The use of systematic literature review to inform evidence based practice in diagnostics is rapidly expanding. Although the primary diagnostic literature is extensive, studies are often of low methodological quality or poorly reported. There has been no rigorously evaluated, evidence based tool to assess the methodological quality of diagnostic studies. The primary objective of this study was to determine the extent to which variations in the quality of primary studies impact the results of a diagnostic meta-analysis and whether this differs with diagnostic test type. A secondary objective was to contribute to the evaluation of QUADAS, an evidence-based tool for the assessment of quality in diagnostic accuracy studies. Methods: This study was conducted as part of large systematic review of tests used in the diagnosis and further investigation of urinary tract infection (UTI) in children. All studies included in this review were assessed using QUADAS, an evidence-based tool for the assessment of quality in systematic reviews of diagnostic accuracy studies. The impact of individual components of QUADAS on a summary measure of diagnostic accuracy was investigated using regression analysis. The review divided the diagnosis and further investigation of UTI into the following three clinical stages: diagnosis of UTI, localisation of infection, and further investigation of the UTI. Each stage used different types of diagnostic test, which were considered to involve different quality concerns. Results: Many of the studies included in our review were poorly reported. The proportion of QUADAS items fulfilled was similar for studies in different sections of the review. However, as might be expected, the individual items fulfilled differed between the three clinical stages. Regression analysis found that different items showed a strong association with test performance for the different tests evaluated. These differences were observed both within and between the three clinical stages assessed by the review. The results of regression analyses were also affected by whether or not a weighting (by sample size) was applied. Our analysis was severely limited by the completeness of reporting and the differences between the index tests evaluated and the reference standards used to confirm diagnoses in the primary studies. Few tests were evaluated by sufficient studies to allow meaningful use of meta-analytic pooling and investigation of heterogeneity. This meant that further analysis to investigate heterogeneity could only be undertaken using a subset of studies, and that the findings are open to various interpretations. Conclusion: Further work is needed to investigate the influence of methodological quality on the results of diagnostic meta-analyses. Large data sets of well-reported primary studies are needed to address this question. Without significant improvements in the completeness of reporting of primary studies, progress in this area will be limited