Methodological bias in cluster randomised trials

Background: Cluster randomised trials can be susceptible to a range of methodological problems. These problems are not commonly recognised by many researchers. In this paper we discuss the issues that can lead to bias in cluster trials. Methods: We used a sample of cluster randomised trials from a recent review and from a systematic review of hip protectors. We compared the mean age of participants between intervention groups in a sample of 'good' cluster trials with a sample of potentially biased trials. We also compared the effect sizes, in a funnel plot, between hip protector trials that used individual randomisation compared with those that used cluster randomisation. Results: There is a tendency for cluster trials, with evidence methodological biases, to also show an age imbalance between treatment groups. In a funnel plot we show that all cluster trials show a large positive effect of hip protectors whilst individually randomised trials show a range of positive and negative effects, suggesting that cluster trials may be producing a biased estimate of effect. Conclusion: Methodological biases in the design and execution of cluster randomised trials is frequent. Some of these biases associated with the use of cluster designs can be avoided through careful attention to the design of cluster trials. Firstly, if possible, individual allocation should be used. Secondly, if cluster allocation is required, then ideally participants should be identified before random allocation of the clusters. Third, if prior identification is not possible, then an independent recruiter should be used to recruit participants

Supportive Self-Management Program for People With Chronic Headaches and Migraine: A Randomized Controlled Trial and Economic Evaluation.

BACKGROUND AND OBJECTIVES: Chronic headache disorders are a major cause of pain and disability. Education and supportive self-management approaches could reduce the burden of headache disability. We tested the effectiveness of a group educational and supportive self-management program for people living with chronic headaches. METHODS: This was a pragmatic randomized controlled trial. Participants were aged 18 years or older with chronic migraine or chronic tension-type headache, with or without medication overuse headache. We primarily recruited from general practices. Participants were assigned to either a 2-day group education and self-management program, a one-to-one nurse interview, and telephone support or to usual care plus relaxation material. The primary outcome was headache related-quality of life using the Headache Impact Test (HIT)-6 at 12 months. The primary analysis used intention-to-treat principles for participants with migraine and both baseline and 12-month HIT-6 data. RESULTS: Between April 2017 and March 2019, we randomized 736 participants. Because only 9 participants just had tension-type headache, our main analyses were on the 727 participants with migraine. Of them, 376 were allocated to the self-management intervention and 351 to usual care. Data from 586 (81%) participants were analyzed for primary outcome. There was no between-group difference in HIT-6 (adjusted mean difference = -0.3, 95% CI -1.23 to 0.67) or headache days (0.9, 95% CI -0.29 to 2.05) at 12 months. The Chronic Headache Education and Self-management Study intervention generated incremental adjusted costs of £268 (95% CI, £176-£377) (USD383 [95% CI USD252-USD539]) and incremental adjusted quality-adjusted life years (QALYs) of 0.031 (95% CI -0.005 to 0.063). The incremental cost-effectiveness ratio was £8,617 (USD12,322) per QALY gained. DISCUSSION: These findings conclusively show a lack of benefit for quality of life or monthly headache days from a brief group education and supportive self-management program for people living with chronic migraine or chronic tension-type headache with episodic migraine. TRIAL REGISTRATION INFORMATION: Registered on the International Standard Randomized Controlled Trial Number registry, ISRCTN79708100 16th December 2015 doi.org/10.1186/ISRCTN79708100. The first enrollment was April 24, 2017. CLASSIFICATION OF EVIDENCE: This study provides Class III evidence that a brief group education and self-management program does not increase the probability of improvement in headache-related quality of life in people with chronic migraine

Supportive Self-Management Program for People With Chronic Headaches and Migraine: A Randomized Controlled Trial and Economic Evaluation

Background and Objectives: Chronic headache disorders are a major cause of pain and disability. Education and supportive self-management approaches could reduce the burden of headache disability. We tested the effectiveness of a group educational and supportive self-management program for people living with chronic headaches. / Methods: This was a pragmatic randomized controlled trial. Participants were aged 18 years or older with chronic migraine or chronic tension-type headache, with or without medication overuse headache. We primarily recruited from general practices. Participants were assigned to either a 2-day group education and self-management program, a one-to-one nurse interview, and telephone support or to usual care plus relaxation material. The primary outcome was headache related-quality of life using the Headache Impact Test (HIT)-6 at 12 months. The primary analysis used intention-to-treat principles for participants with migraine and both baseline and 12-month HIT-6 data. / Results: Between April 2017 and March 2019, we randomized 736 participants. Because only 9 participants just had tension-type headache, our main analyses were on the 727 participants with migraine. Of them, 376 were allocated to the self-management intervention and 351 to usual care. Data from 586 (81%) participants were analyzed for primary outcome. There was no between-group difference in HIT-6 (adjusted mean difference = -0.3, 95% CI -1.23 to 0.67) or headache days (0.9, 95% CI -0.29 to 2.05) at 12 months. The Chronic Headache Education and Self-management Study intervention generated incremental adjusted costs of £268 (95% CI, £176-£377) (USD383 [95% CI USD252-USD539]) and incremental adjusted quality-adjusted life years (QALYs) of 0.031 (95% CI -0.005 to 0.063). The incremental cost-effectiveness ratio was £8,617 (USD12,322) per QALY gained. / Discussion: These findings conclusively show a lack of benefit for quality of life or monthly headache days from a brief group education and supportive self-management program for people living with chronic migraine or chronic tension-type headache with episodic migraine

Evaluation of a standard provision versus an autonomy promotive exercise referral programme: rationale and study design

Background The National Institute of Clinical Excellence in the UK has recommended that the effectiveness of ongoing exercise referral schemes to promote physical activity should be examined in research trials. Recent empirical evidence in health care and physical activity promotion contexts provides a foundation for testing the utility of a Self Determination Theory (SDT) -based exercise referral consultation. Methods/Design Design: An exploratory cluster randomised controlled trial comparing standard provision exercise on prescription with a Self Determination Theory-based (SDT) exercise on prescription intervention. Participants: 347 people referred to the Birmingham Exercise on Prescription scheme between November 2007 and July 2008. The 13 exercise on prescription sites in Birmingham were randomised to current practice (n=7) or to the SDT-based intervention (n=6). Outcomes measured at 3 and 6-months: Minutes of moderate or vigorous physical activity per week assessed using the 7-day Physical Activity Recall; physical health: blood pressure and weight; health status measured using the Dartmouth CO-OP charts; anxiety and depression measured by the Hospital Anxiety and Depression Scale and vitality measured by the subjective vitality score; motivation and processes of change: perceptions of autonomy support from the advisor, satisfaction of the needs for competence, autonomy, and relatedness via physical activity, and motivational regulations for exercise. Discussion This trial will determine whether an exercise referral programme based on Self Determination Theory increases physical activity and other health outcomes compared to a standard programme and will test the underlying SDT-based process model (perceived autonomy support, need satisfaction, motivation regulations, outcomes) via structural equation modelling. Trial registration The trial is registered as Current Controlled trials ISRCTN07682833

Enhanced relapse prevention for bipolar disorder – ERP trial. A cluster randomised controlled trial to assess the feasibility of training care coordinators to offer enhanced relapse prevention for bipolar disorder

BACKGROUND: Bipolar Disorder (BD) is a common and severe form of mental illness characterised by repeated relapses of mania or depression. Pharmacotherapy is the main treatment currently offered, but this has only limited effectiveness. A recent Cochrane review has reported that adding psycho-social interventions that train people to recognise and manage the early warning signs of their relapses is effective in increasing time to recurrence, improving social functioning and in reducing hospitalisations. However, the review also highlights the difficulties in offering these interventions within standard mental health services due to the need for highly trained therapists and extensive input of time. There is a need to explore the potential for developing Early Warning Sign (EWS) interventions in ways that will enhance dissemination. METHODS AND DESIGN: This article describes a cluster-randomised trial to assess the feasibility of training care coordinators (CCs) in community mental health teams (CMHTs) to offer Enhanced Relapse Prevention (ERP) to people with Bipolar Disorder. CMHTs in the North West of England are randomised to either receive training in ERP and to offer this to their clients, or to continue to offer treatment as usual (TAU). The main aims of the study are (1) to determine the acceptability of the intervention, training and outcome measures (2) to assess the feasibility of the design as measured by rates of recruitment, retention, attendance and direct feedback from participants (3) to estimate the design effect of clustering for key outcome variables (4) to estimate the effect size of the impact of the intervention on outcome. In this paper we provide a rationale for the study design, briefly outline the ERP intervention, and describe in detail the study protocol. DISCUSSION: This information will be useful to researchers attempting to carry out similar feasibility assessments of clinical effectiveness trials and in particular cluster randomised controlled trials

RoB 2: a revised tool for assessing risk of bias in randomised trials

Assessment of risk of bias is regarded as an essential component of a systematic review on the effects of an intervention. The most commonly used tool for randomised trials is the Cochrane risk-of-bias tool. We updated the tool to respond to developments in understanding how bias arises in randomised trials, and to address user feedback on and limitations of the original tool

Preventing Bias in Cluster Randomised Trials

Bruno Giraudeau and Philippe Ravaud discuss the difficulties in preventing selection bias and applying intention-to-treat analysis in cluster randomized trials, and propose some solutions

Specifying content and mechanisms of change in interventions to change professionals’ practice : an illustration from the Good Goals study in occupational therapy

PMID: 23078918 [PubMed - indexed for MEDLINE] PMCID: PMC3502268 Free PMC Article The study was funded by the Chief Scientist Office of the Scottish Government Health Directorates (ref: CZF/1/38). The views expressed in this paper are those of the authors. The funder was not involved in the conduct of the study or preparation of the manuscript.Peer reviewedPublisher PD

Hand sanitisers for reducing illness absences in primary school children in New Zealand: a cluster randomised controlled trial study protocol

<p>Abstract</p> <p>Background</p> <p>New Zealand has relatively high rates of morbidity and mortality from infectious disease compared with other OECD countries, with infectious disease being more prevalent in children compared with others in the population. Consequences of infectious disease in children may have significant economic and social impact beyond the direct effects of the disease on the health of the child; including absence from school, transmission of infectious disease to other pupils, staff, and family members, and time off work for parents/guardians. Reduction of the transmission of infectious disease between children at schools could be an effective way of reducing the community incidence of infectious disease. Alcohol based no-rinse hand sanitisers provide an alternative hand cleaning technology, for which there is some evidence that they may be effective in achieving this. However, very few studies have investigated the effectiveness of hand sanitisers, and importantly, the potential wider economic implications of this intervention have not been established.</p> <p>Aims</p> <p>The primary objective of this trial is to establish if the provision of hand sanitisers in primary schools in the South Island of New Zealand, in addition to an education session on hand hygiene, reduces the incidence rate of absence episodes due to illness in children. In addition, the trial will establish the cost-effectiveness and conduct a cost-benefit analysis of the intervention in this setting.</p> <p>Methods/Design</p> <p>A cluster randomised controlled trial will be undertaken to establish the effectiveness and cost-effectiveness of hand sanitisers. Sixty-eight primary schools will be recruited from three regions in the South Island of New Zealand. The schools will be randomised, within region, to receive hand sanitisers and an education session on hand hygiene, or an education session on hand hygiene alone. Fifty pupils from each school in years 1 to 6 (generally aged from 5 to 11 years) will be randomly selected for detailed follow-up about their illness absences, providing a total of 3400 pupils. In addition, absence information will be collected on all children from the school rolls. Investigators not involved in the running of the trial, outcome assessors, and the statistician will be blinded to the group allocation until the analysis is completed.</p> <p>Trial registration</p> <p>ACTRN12609000478213</p