Impact of CONSORT extension for cluster randomised trials on quality of reporting and study methodology : review of random sample of 300 trials, 2000-8

Peer reviewedPublisher PD

Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651]

Background: Theory-based process evaluations conducted alongside randomized controlled trials provide the opportunity to investigate hypothesized mechanisms of action of interventions, helping to build a cumulative knowledge base and to inform the interpretation of individual trial outcomes. Our objective was to identify the underlying causal mechanisms in a cluster randomized trial of the effectiveness of printed educational materials (PEMs) to increase referral for diabetic retinopathy screening. We hypothesized that the PEMs would increase physicians’ intention to refer patients for retinal screening by strengthening their attitude and subjective norm, but not their perceived behavioral control. Methods: Design: A theory based process evaluation alongside the Ontario Printed Educational Material (OPEM) cluster randomized trial. Postal surveys based on the Theory of Planned Behavior were sent to a random sample of trial participants two months before and six months after they received the intervention. Setting: Family physicians in Ontario, Canada. Participants: 1,512 family physicians (252 per intervention group) from the OPEM trial were invited to participate, and 31.3% (473/1512) responded at time one and time two. The final sample comprised 437 family physicians fully completing questionnaires at both time points. Main outcome measures: Primary: behavioral intention related to referring patient for retinopathy screening; secondary: attitude, subjective norm, perceived behavioral control. Results: At baseline, family physicians reported positive intention, attitude, subjective norm, and perceived behavioral control to advise patients about retinopathy screening suggesting limited opportunities for improvement in these constructs. There were no significant differences on intention, attitude, subjective norm, and perceived behavioral control following the intervention. Respondents also reported additional physician- and patient-related factors perceived to influence whether patients received retinopathy screening. Conclusions: Lack of change in the primary and secondary theory-based outcomes provides an explanation for the lack of observed effect of the main OPEM trial. High baseline levels of intention to advise patients to attend retinopathy screening suggest that post-intentional and other factors may explain gaps in care. Process evaluations based on behavioral theory can provide replicable and generalizable insights to aid interpretation of randomized controlled trials of complex interventions to change health professional behavior

Educating the future workforce: building the evidence about interprofessional learning

This paper addresses the theme of interprofessional education for health and social care professionals as it effects on the development of the work force. The drivers for change in the UK, typified by the Bristol Royal Infirmary and Victoria Climbié inquiries and the response to this in the form of Department of Health policy, are discussed. The need for rapid development of the evidence base around this subject is evident form literature reviews of the impact of interprofessional education. Directions for future research and investment in this area are proposed including the need for a stronger theoretical base and for longitudinal studies over extended periods of time in order to examine short, medium and long term outcomes in relation to health care practice

Looking inside the black box : a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada

Background: Randomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths). This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. Methods/design: We will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results.The OPEM trial and OPEM process evaluation are funded by the Canadian Institute of Health Research (CIHR). The OPEM process evaluation study was developed as part of the CIHR funded interdisciplinary capacity enhancement team KT-ICEBeRG. Gaston Godin, Jeremy Grimshaw and France Légaré hold Canada Research Chairs. Louise Lemyre holds an R.S. McLaughlin Research Chair

Feedback GAP: pragmatic, cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care

Background Audit and feedback to physicians is a commonly used quality improvement strategy, but its optimal design is unknown. This trial tested the effects of a theory-informed worksheet to facilitate goal setting and action planning, appended to feedback reports on chronic disease management, compared to feedback reports provided without these worksheets. Methods A two-arm pragmatic cluster randomized trial was conducted, with allocation at the level of primary care clinics. Participants were family physicians who contributed data from their electronic medical records. The ‘usual feedback’ arm received feedback every six months for two years regarding the proportion of their patients meeting quality targets for diabetes and/or ischemic heart disease. The intervention arm received these same reports plus a worksheet designed to facilitate goal setting and action plan development in response to the feedback reports. Blood pressure (BP) and low-density lipoprotein cholesterol (LDL) values were compared after two years as the primary outcomes. Process outcomes measured the proportion of guideline-recommended actions (e.g., testing and prescribing) conducted within the appropriate timeframe. Intention-to-treat analysis was performed. Results Outcomes were similar across groups at baseline. Final analysis included 20 physicians from seven clinics and 1,832 patients in the intervention arm (15% loss to follow up) and 29 physicians from seven clinics and 2,223 patients in the usual feedback arm (10% loss to follow up). Ten of 20 physicians completed the worksheet at least once during the study. Mean BP was 128/72 in the feedback plus worksheet arm and 128/73 in the feedback alone arm, while LDL was 2.1 and 2.0, respectively. Thus, no significant differences were observed across groups in the primary outcomes, but mean haemoglobin A1c was lower in the feedback plus worksheet arm (7.2% versus 7.4%, p<0.001). Improvements in both arms were noted over time for one-half of the process outcomes. Discussion Appending a theory-informed goal setting and action planning worksheet to an externally produced audit and feedback intervention did not lead to improvements in patient outcomes. The results may be explained in part by passive dissemination of the worksheet leading to inadequate engagement with the intervention

The benefits of interprofessional education 10 years on.

Interprofessional education (IPE) was first conceived in 1973 by a World Health Organization (WHO) expert group in Geneva. WHO member states were then charged with implementing medical education IPE pilot projects and from then to today there has a been a rapid proliferation in the number of publications on the subject. IPE has generated research into its use, conferences specific to IPE, organisations dedicated to it and policy championing it. The authors question whether there has been any major shift in the silos in which different professions might be working. The authors published an article on the benefits of IPE ( Illingworth and Chelvanayagam, 2007 ). Ten years have now passed and many changes have been implemented and experienced in health and social care and therefore a review of the literature is required. Also, it is 7 years since the publication of WHO's report outlining the role of IPE in the preparation of health professionals ( WHO, 2010 ) and, increasingly, UK Government policy champions collaborative and integrated working. The conclusions from the 2007 article acknowledged the development of IPE; however, it highlighted the need for empirical evidence to demonstrate the effectiveness of IPE in service user and carer outcomes. This article will explore whether IPE has achieved the benefits discussed in the previous article and what developments have occurred since it was published

Interprofessional communication with hospitalist and consultant physicians in general internal medicine : a qualitative study

This study helps to improve our understanding of the collaborative environment in GIM, comparing the communication styles and strategies of hospitalist and consultant physicians, as well as the experiences of providers working with them. The implications of this research are globally important for understanding how to create opportunities for physicians and their colleagues to meaningfully and consistently participate in interprofessional communication which has been shown to improve patient, provider, and organizational outcomes

Task shifting and integration of HIV care into primary care in South Africa: The development and content of the streamlining tasks and roles to expand treatment and care for HIV (STRETCH) intervention

Background: Task shifting and the integration of human immunodeficiency virus (HIV) care into primary care services have been identified as possible strategies for improving access to antiretroviral treatment (ART). This paper describes the development and content of an intervention involving these two strategies, as part of the Streamlining Tasks and Roles to Expand Treatment and Care for HIV (STRETCH) pragmatic randomised controlled trial. Methods: Developing the intervention: The intervention was developed following discussions with senior management, clinicians, and clinic staff. These discussions revealed that the establishment of separate antiretroviral treatment services for HIV had resulted in problems in accessing care due to the large number of patients at ART clinics. The intervention developed therefore combined the shifting from doctors to nurses of prescriptions of antiretrovirals (ARVs) for uncomplicated patients and the stepwise integration of HIV care into primary care services. Results: Components of the intervention: The intervention consisted of regulatory changes, training, and guidelines to support nurse ART prescription, local management teams, an implementation toolkit, and a flexible, phased introduction. Nurse supervisors were equipped to train intervention clinic nurses in ART prescription using outreach education and an integrated primary care guideline. Management teams were set up and a STRETCH coordinator was appointed to oversee the implementation process. Discussion: Three important processes were used in developing and implementing this intervention: active participation of clinic staff and local and provincial management, educational outreach to train nurses in intervention sites, and an external facilitator to support all stages of the intervention rollout