Clustering in surgical trials : database of intracluster correlations

PMID: 22217216 [PubMed - indexed for MEDLINE] PMCID: PMC3311136 Free PMC ArticlePeer reviewedPublisher PD

Methodological bias in cluster randomised trials

Background: Cluster randomised trials can be susceptible to a range of methodological problems. These problems are not commonly recognised by many researchers. In this paper we discuss the issues that can lead to bias in cluster trials. Methods: We used a sample of cluster randomised trials from a recent review and from a systematic review of hip protectors. We compared the mean age of participants between intervention groups in a sample of 'good' cluster trials with a sample of potentially biased trials. We also compared the effect sizes, in a funnel plot, between hip protector trials that used individual randomisation compared with those that used cluster randomisation. Results: There is a tendency for cluster trials, with evidence methodological biases, to also show an age imbalance between treatment groups. In a funnel plot we show that all cluster trials show a large positive effect of hip protectors whilst individually randomised trials show a range of positive and negative effects, suggesting that cluster trials may be producing a biased estimate of effect. Conclusion: Methodological biases in the design and execution of cluster randomised trials is frequent. Some of these biases associated with the use of cluster designs can be avoided through careful attention to the design of cluster trials. Firstly, if possible, individual allocation should be used. Secondly, if cluster allocation is required, then ideally participants should be identified before random allocation of the clusters. Third, if prior identification is not possible, then an independent recruiter should be used to recruit participants

Soil foraging animals alter the composition and co-occurrence of microbial communities in a desert shrubland

Animals that modify their physical environment by foraging in the soil can have dramatic effects on ecosystem functions and processes. We compared bacterial and fungal communities in the foraging pits created by bilbies and burrowing bettongs with undisturbed surface soils dominated by biocrusts. Bacterial communities were characterized by Actinobacteria and Alphaproteobacteria, and fungal communities by Lecanoromycetes and Archaeosporomycetes. The composition of bacterial or fungal communities was not observed to vary between loamy or sandy soils. There were no differences in richness of either bacterial or fungal operational taxonomic units (OTUs) in the soil of young or old foraging pits, or undisturbed soils. Although the bacterial assemblage did not vary among the three microsites, the composition of fungi in undisturbed soils was significantly different from that in old or young foraging pits. Network analysis indicated that a greater number of correlations between bacterial OTUs occurred in undisturbed soils and old pits, whereas a greater number of correlations between fungal OTUs occurred in undisturbed soils. Our study suggests that digging by soil-disturbing animals is likely to create successional shifts in soil microbial and fungal communities, leading to functional shifts associated with the decomposition of organic matter and the fixation of nitrogen. Given the primacy of organic matter decomposition in arid and semi-arid environments, the loss of native soil-foraging animals is likely to impair the ability of these systems to maintain key ecosystem processes such as the mineralization of nitrogen and the breakdown of organic matter, and to recover from disturbance

Centre selection for clinical trials and the generalisability of results: a mixed methods study.

BACKGROUND: The rationale for centre selection in randomised controlled trials (RCTs) is often unclear but may have important implications for the generalisability of trial results. The aims of this study were to evaluate the factors which currently influence centre selection in RCTs and consider how generalisability considerations inform current and optimal practice. METHODS AND FINDINGS: Mixed methods approach consisting of a systematic review and meta-summary of centre selection criteria reported in RCT protocols funded by the UK National Institute of Health Research (NIHR) initiated between January 2005-January 2012; and an online survey on the topic of current and optimal centre selection, distributed to professionals in the 48 UK Clinical Trials Units and 10 NIHR Research Design Services. The survey design was informed by the systematic review and by two focus groups conducted with trialists at the Birmingham Centre for Clinical Trials. 129 trial protocols were included in the systematic review, with a total target sample size in excess of 317,000 participants. The meta-summary identified 53 unique centre selection criteria. 78 protocols (60%) provided at least one criterion for centre selection, but only 31 (24%) protocols explicitly acknowledged generalisability. This is consistent with the survey findings (n = 70), where less than a third of participants reported generalisability as a key driver of centre selection in current practice. This contrasts with trialists' views on optimal practice, where generalisability in terms of clinical practice, population characteristics and economic results were prime considerations for 60% (n = 42), 57% (n = 40) and 46% (n = 32) of respondents, respectively. CONCLUSIONS: Centres are rarely enrolled in RCTs with an explicit view to external validity, although trialists acknowledge that incorporating generalisability in centre selection should ideally be more prominent. There is a need to operationalize 'generalisability' and incorporate it at the design stage of RCTs so that results are readily transferable to 'real world' practice

The Diabetes Manual trial protocol – a cluster randomized controlled trial of a self-management intervention for type 2 diabetes [ISRCTN06315411]

Background The Diabetes Manual is a type 2 diabetes self-management programme based upon the clinically effective 'Heart Manual'. The 12 week programme is a complex intervention theoretically underpinned by self-efficacy theory. It is a one to one intervention meeting United Kingdom requirements for structured diabetes-education and is delivered within routine primary care. Methods/design In a two-group cluster randomized controlled trial, GP practices are allocated by computer minimisation to an intervention group or a six-month deferred intervention group. We aim to recruit 250 participants from 50 practices across central England. Eligibility criteria are adults able to undertake the programme with type 2 diabetes, not taking insulin, with HbA1c over 8% (first 12 months) and following an agreed protocol change over 7% (months 13 to 18). Following randomisation, intervention nurses receive two-day training and delivered the Diabetes Manual programme to participants. Deferred intervention nurses receive the training following six-month follow-up. Primary outcome is HbA1c with total and HDL cholesterol; blood pressure, body mass index; self-efficacy and quality of life as additional outcomes. Primary analysis is between-group HbA1c differences at 6 months powered to give 80% power to detect a difference in HbA1c of 0.6%. A 12 month cohort analysis will assess maintenance of effect and assess relationship between self-efficacy and outcomes, and a qualitative study is running alongside. Discussion This trial incorporates educational and psychological diabetes interventions into a single programme and assesses both clinical and psychosocial outcomes. The trial will increase our understanding of intervention transferability between conditions, those diabetes related health behaviours that are more or less susceptible to change through efficacy enhancing mechanisms and how this impacts on clinical outcomes

Effectiveness and cost-effectiveness of an educational intervention for practice teams to deliver problem focused therapy for insomnia: rationale and design of a pilot cluster randomised trial

Background: Sleep problems are common, affecting over a third of adults in the United Kingdom and leading to reduced productivity and impaired health-related quality of life. Many of those whose lives are affected seek medical help from primary care. Drug treatment is ineffective long term. Psychological methods for managing sleep problems, including cognitive behavioural therapy for insomnia (CBTi) have been shown to be effective and cost effective but have not been widely implemented or evaluated in a general practice setting where they are most likely to be needed and most appropriately delivered. This paper outlines the protocol for a pilot study designed to evaluate the effectiveness and cost-effectiveness of an educational intervention for general practitioners, primary care nurses and other members of the primary care team to deliver problem focused therapy to adult patients presenting with sleep problems due to lifestyle causes, pain or mild to moderate depression or anxiety. Methods and design: This will be a pilot cluster randomised controlled trial of a complex intervention. General practices will be randomised to an educational intervention for problem focused therapy which includes a consultation approach comprising careful assessment (using assessment of secondary causes, sleep diaries and severity) and use of modified CBTi for insomnia in the consultation compared with usual care (general advice on sleep hygiene and pharmacotherapy with hypnotic drugs). Clinicians randomised to the intervention will receive an educational intervention (2 × 2 hours) to implement a complex intervention of problem focused therapy. Clinicians randomised to the control group will receive reinforcement of usual care with sleep hygiene advice. Outcomes will be assessed via self-completion questionnaires and telephone interviews of patients and staff as well as clinical records for interventions and prescribing. Discussion: Previous studies in adults have shown that psychological treatments for insomnia administered by specialist nurses to groups of patients can be effective within a primary care setting. This will be a pilot study to determine whether an educational intervention aimed at primary care teams to deliver problem focused therapy for insomnia can improve sleep management and outcomes for individual adult patients presenting to general practice. The study will also test procedures and collect information in preparation for a larger definitive cluster-randomised trial. The study is funded by The Health Foundation

Effect of an Injury Awareness Education Program on Risk-Taking Behaviors and Injuries in Juvenile Justice Offenders: A Retrospective Cohort Study

Background Risk-taking behavior is a leading cause of injury and death amongst young people. Methodology and Principal Findings This was a retrospective cohort study on the effectiveness of a 1-day youth injury awareness education program (Prevent Alcohol and Risk-related Trauma in Youth, P.A.R.T.Y.) program in reducing risk taking behaviors and injuries of juvenille justice offenders in Western Australia. Of the 3659 juvenile justice offenders convicted by the court magistrates between 2006 and 2010, 225 were referred to the P.A.R.T.Y. education program. In a before and after survey of these 225 participants, a significant proportion of them stated that they were more receptive to modifying their risk-taking behavior (21% before vs. 57% after). Using data from the Western Australia Police and Department of Health, the incidence of subsequent offences and injuries of all juvenile justice offenders was assessed. The incidence of subsequent traffic or violence-related offences was significantly lower for those who had attended the program compared to those who did not (3.6% vs. 26.8%; absolute risk reduction [ARR] = 23.2%, 95% confidence interval [CI] 19.9%–25.8%; number needed to benefit = 4.3, 95%CI 3.9–5.1; p = 0.001), as were injuries leading to hospitalization (0% vs. 1.6% including 0.2% fatality; ARR = 1.6%, 95%CI 1.2%–2.1%) and alcohol or drug-related offences (0% vs. 2.4%; ARR 2.4%, 95%CI 1.9%–2.9%). In the multivariate analysis, only P.A.R.T.Y. education program attendance (odds ratio [OR] 0.10, 95%CI 0.05–0.21) and a higher socioeconomic background (OR 0.97 per decile increment in Index of Relative Socioeconomic Advantage and Disadvantage, 95%CI 0.93–0.99) were associated with a lower risk of subsequent traffic or violence-related offences. Significance Participation in an injury education program involving real-life trauma scenarios was associated with a reduced subsequent risk of committing violence- or traffic-related offences, injuries, and death for juvenille justice offenders

Preventing Bias in Cluster Randomised Trials

Bruno Giraudeau and Philippe Ravaud discuss the difficulties in preventing selection bias and applying intention-to-treat analysis in cluster randomized trials, and propose some solutions

Enhanced relapse prevention for bipolar disorder – ERP trial. A cluster randomised controlled trial to assess the feasibility of training care coordinators to offer enhanced relapse prevention for bipolar disorder

BACKGROUND: Bipolar Disorder (BD) is a common and severe form of mental illness characterised by repeated relapses of mania or depression. Pharmacotherapy is the main treatment currently offered, but this has only limited effectiveness. A recent Cochrane review has reported that adding psycho-social interventions that train people to recognise and manage the early warning signs of their relapses is effective in increasing time to recurrence, improving social functioning and in reducing hospitalisations. However, the review also highlights the difficulties in offering these interventions within standard mental health services due to the need for highly trained therapists and extensive input of time. There is a need to explore the potential for developing Early Warning Sign (EWS) interventions in ways that will enhance dissemination. METHODS AND DESIGN: This article describes a cluster-randomised trial to assess the feasibility of training care coordinators (CCs) in community mental health teams (CMHTs) to offer Enhanced Relapse Prevention (ERP) to people with Bipolar Disorder. CMHTs in the North West of England are randomised to either receive training in ERP and to offer this to their clients, or to continue to offer treatment as usual (TAU). The main aims of the study are (1) to determine the acceptability of the intervention, training and outcome measures (2) to assess the feasibility of the design as measured by rates of recruitment, retention, attendance and direct feedback from participants (3) to estimate the design effect of clustering for key outcome variables (4) to estimate the effect size of the impact of the intervention on outcome. In this paper we provide a rationale for the study design, briefly outline the ERP intervention, and describe in detail the study protocol. DISCUSSION: This information will be useful to researchers attempting to carry out similar feasibility assessments of clinical effectiveness trials and in particular cluster randomised controlled trials