Group sequential designs for pragmatic clinical trials with early outcomes : methods and guidance for planning and implementation

Background: Group sequential designs are one of the most widely used methodologies for adaptive design in randomized clinical trials. In settings where early outcomes are available, they offer large gains in efficiency compared to a fixed design. However, such designs are underused and used predominantly in therapeutic areas where there is expertise and experience in implementation. One barrier to their greater use is the requirement to undertake simulation studies at the planning stage that require considerable knowledge, coding experience and additional costs. Based on some modest assumptions about the likely patterns of recruitment and the covariance structure of the outcomes, some simple analytic expressions are presented that negate the need to undertake simulations. Methods: A model for longitudinal outcomes with an assumed approximate multivariate normal distribution and three contrasting simple recruitment models are described, based on fixed, increasing and decreasing rates. For assumed uniform and exponential correlation models, analytic expressions for the variance of the treatment effect and the effects of the early outcomes on reducing this variance at the primary outcome time-point are presented. Expressions for the minimum and maximum values show how the correlations and timing of the early outcomes affect design efficiency. Results: Simulations showed how patterns of information accrual varied between correlation and recruitment models, and consequentially to some general guidance for planning a trial. Using a previously reported group sequential trial as an exemplar, it is shown how the analytic expressions given here could have been used as a quick and flexible planning tool, avoiding the need for extensive simulation studies based on individual participant data. Conclusions: The analytic expressions described can be routinely used at the planning stage of a putative trial, based on some modest assumptions about the likely number of outcomes and when they might occur and the expected recruitment patterns. Numerical simulations showed that these models behaved sensibly and allowed a range of design options to be explored in a way that would have been difficult and time-consuming if the previously described method of simulating individual trial participant data had been used

Sterile versus non-sterile gloves for traumatic wounds in the ED

In their Emergency Medicine Journal paper, Zwaans et al present a randomised controlled trial that asked whether the use of non-sterile gloves and dressings affects risk of infection when suturing traumatic wounds in the ED.1 Most randomised trials compare two treatments so they can determine which is better. However, such a ‘superiority’ design would not make sense when comparing the effect of sterile and non-sterile gloves as there is no reason to think that non-sterile gloves should be superior in terms of reducing wound infections. There may nevertheless be other reasons to prefer non-sterile gloves if they are ‘not much worse’—perhaps because they are cheaper, more accessible or generate less packaging waste. Zwaans et al therefore chose a non-inferiority trial design. Instead of asking whether sterile or non-sterile gloves are ‘better’, their trial asked whether non-sterile gloves are ‘much worse’ than sterile equivalents

The comprehensive cohort model in a pilot trial in orthopaedic trauma

Background: The primary aim of this study was to provide an estimate of effect size for the functional outcome of operative versus non-operative treatment for patients with an acute rupture of the Achilles tendon using accelerated rehabilitation for both groups of patients. The secondary aim was to assess the use of a comprehensive cohort research design (i.e. a parallel patient-preference group alongside a randomised group) in improving the accuracy of this estimate within an orthopaedic trauma setting. Methods: Pragmatic randomised controlled trial and comprehensive cohort study within a level 1 trauma centre. Twenty randomised participants (10 operative and 10 non-operative) and 29 preference participants (3 operative and 26 non-operative). The ge range was 22-72 years and 37 of the 52 patients were men. All participants had an acute rupture of their Achilles tendon and no other injuries. All of the patients in the operative group had a simple end-to-end repair of the tendon with no augmentation. Both groups then followed the same eight-week immediate weight-bearing rehabilitation programme using an off-the-shelf orthotic. The disability rating index (DRI; primary outcome), EQ-5D, Achilles Total Rupture Score and complications were assessed ed at two weeks, six weeks, three months, six months and nine months after initial injury. Results: At nine months, there was no significant difference in DRI between patients randomised to operative or non-operative management. There was no difference in DRI between the randomised group and the parallel patient preference group. The use of a comprehensive cohort of patients did not provide useful additional information as to the treatment effect size because the majority of patients chose non-operative management. Conclusions: Recruitment to clinical trials that compare operative and non-operative interventions is notoriously difficult; especially within the trauma setting. Including a parallel patient preference group to create a comprehensive cohort of patients has been suggested as a way of increasing the power of such trials. In our study, the comprehensive cohort model doubled the number of patients involved in the study. However, a strong preference for non-operative treatment meant that the increased number of patients did not significantly increase the ability of the trial to detect a difference between the two interventions

Cast versus functional brace in the rehabilitation of patients treated non-operatively for a rupture of the Achilles tendon: protocol for the UK study of tendo achilles rehabilitation (UK STAR) multi-centre randomised trial

INTRODUCTION Achilles tendon rupture affects over 11 000 people yearly in the UK, and the incidence is increasing. Controversy remains with regard to the best rehabilitation strategy for these patients. In operatively treated patients, functional bracing provides better outcomes compared with plaster casts. However, the role of functional bracing in non-operatively managed patients is unclear. This is the protocol for a multicentre randomised trial of plaster cast immobilisation versus functional bracing for patients with a non-operatively managed Achilles tendon rupture. METHODS AND ANALYSIS All adults presenting with a primary rupture of the Achilles tendon will be screened. Non-operatively treated patients will be eligible to take part in the trial. Broad eligibility criteria will ensure that the results of the study can be generalised to the wider patient population. Randomisation will be on a 1:1 basis. Both rehabilitation strategies are widely used within the National Health Service. Standardised protocols will be followed, and details of plaster material and brace will be as per the site's usual practice.A minimum of 330 patients will be randomised to obtain 90% power to detect a difference of 8 points in Achilles Tendon Total Rupture Score at 9 months. Quality of life and resource use will be collected at 3, 6 and 9 months. The differences between treatment groups will be assessed on an intention-to-treat basis. The results of the trial-based economic evaluation will be expressed in terms of incremental cost per quality-adjusted life-year gained. ETHICS AND DISSEMINATION The National Research Ethic Committee approved this study on 18 March 2016 (16/SC/0109).The National Institute for Health Research Health Technology Assessment monograph and a manuscript to a peer-reviewed journal will be submitted on completion of the trial (summer 2019). The results of this trial will substantially inform clinical practice on the clinical and cost-effectiveness of the treatment of this injury. This study has been registered on the International Standard Randomised Controlled Trial Number registry with reference no ISRCTN62639639

The effect of high dose antibiotic impregnated cement on rate of surgical site infection after hip hemiarthroplasty for fractured neck of femur : a protocol for a double-blind quasi randomised controlled trial

Background: Mortality following hip hemiarthroplasty is in the range of 10-40% in the first year, with much attributed to post-operative complications. One such complication is surgical site infection (SSI), which at the start of this trial affected 4.68% of patients in the UK having this operation. Compared to SSI rates of elective hip surgery, at less than 1%, this figure is elevated. The aim of this quasi randomised controlled trial (RCT) is to determine if high dose antibiotic impregnated cement can reduce the SSI in patients at 12-months after hemiarthroplasty for intracapsular fractured neck of femur. Methods: 848 patients with an intracapsular fractured neck of femur requiring a hip hemiarthroplasty are been recruited into this two-centre double-blind quasi RCT. Participants were recruited before surgery and quasi randomised to standard care or intervention group. Participants, statistician and outcome assessors were blind to treatment allocation throughout the study. The intervention consisted of high dose antibiotic impregnated cement consisting of 1 gram Clindamycin and 1 gram of Gentamicin. The primary outcome is Health Protection Agency (HPA) defined deep surgical site infection at 12 months. Secondary outcomes include HPA defined superficial surgical site infection at 30 days, 30 and 90-day mortality, length of hospital stay, critical care stay, and complications. Discussion: Large randomised controlled trials assessing the effectiveness of a surgical intervention are uncommon, particularly in the speciality of orthopaedics. The results from this trial will inform evidence-based recommendations for antibiotic impregnated cement in the management of patients with a fractured neck of femur undergoing a hip hemiarthroplasty. If high dose antibiotic impregnated cement is found to be an effective intervention, implementation into clinical practice could improve long-term outcomes for patients undergoing hip hemiarthroplasty

Survey of the quality of experimental design, statistical analysis and reporting of research using animals

For scientific, ethical and economic reasons, experiments involving animals should be appropriately designed, correctly analysed and transparently reported. This increases the scientific validity of the results, and maximises the knowledge gained from each experiment. A minimum amount of relevant information must be included in scientific publications to ensure that the methods and results of a study can be reviewed, analysed and repeated. Omitting essential information can raise scientific and ethical concerns. We report the findings of a systematic survey of reporting, experimental design and statistical analysis in published biomedical research using laboratory animals. Medline and EMBASE were searched for studies reporting research on live rats, mice and non-human primates carried out in UK and US publicly funded research establishments. Detailed information was collected from 271 publications, about the objective or hypothesis of the study, the number, sex, age and/or weight of animals used, and experimental and statistical methods. Only 59% of the studies stated the hypothesis or objective of the study and the number and characteristics of the animals used. Appropriate and efficient experimental design is a critical component of high-quality science. Most of the papers surveyed did not use randomisation (87%) or blinding (86%), to reduce bias in animal selection and outcome assessment. Only 70% of the publications that used statistical methods described their methods and presented the results with a measure of error or variability. This survey has identified a number of issues that need to be addressed in order to improve experimental design and reporting in publications describing research using animals. Scientific publication is a powerful and important source of information; the authors of scientific publications therefore have a responsibility to describe their methods and results comprehensively, accurately and transparently, and peer reviewers and journal editors share the responsibility to ensure that published studies fulfil these criteria

Virtual patients design and its effect on clinical reasoning and student experience : a protocol for a randomised factorial multi-centre study

Background Virtual Patients (VPs) are web-based representations of realistic clinical cases. They are proposed as being an optimal method for teaching clinical reasoning skills. International standards exist which define precisely what constitutes a VP. There are multiple design possibilities for VPs, however there is little formal evidence to support individual design features. The purpose of this trial is to explore the effect of two different potentially important design features on clinical reasoning skills and the student experience. These are the branching case pathways (present or absent) and structured clinical reasoning feedback (present or absent). Methods/Design This is a multi-centre randomised 2x2 factorial design study evaluating two independent variables of VP design, branching (present or absent), and structured clinical reasoning feedback (present or absent).The study will be carried out in medical student volunteers in one year group from three university medical schools in the United Kingdom, Warwick, Keele and Birmingham. There are four core musculoskeletal topics. Each case can be designed in four different ways, equating to 16 VPs required for the research. Students will be randomised to four groups, completing the four VP topics in the same order, but with each group exposed to a different VP design sequentially. All students will be exposed to the four designs. Primary outcomes are performance for each case design in a standardized fifteen item clinical reasoning assessment, integrated into each VP, which is identical for each topic. Additionally a 15-item self-reported evaluation is completed for each VP, based on a widely used EViP tool. Student patterns of use of the VPs will be recorded. In one centre, formative clinical and examination performance will be recorded, along with a self reported pre and post-intervention reasoning score, the DTI. Our power calculations indicate a sample size of 112 is required for both primary outcomes

Group sequential designs in pragmatic trials : feasibility and assessment of utility using data from a number of recent surgical RCTs

Background Assessing the long term effects of many surgical interventions tested in pragmatic RCTs may require extended periods of participant follow-up to assess effectiveness and use patient-reported outcomes that require large sample sizes. Consequently the RCTs are often perceived as being expensive and time-consuming, particularly if the results show the test intervention is not effective. Adaptive, and particularly group sequential, designs have great potential to improve the efficiency and cost of testing new and existing surgical interventions. As a means to assess the potential utility of group sequential designs, we re-analyse data from a number of recent high-profile RCTs and assess whether using such a design would have caused the trial to stop early. Methods Many pragmatic RCTs monitor participants at a number of occasions (e.g. at 6, 12 and 24 months after surgery) during follow-up as a means to assess recovery and also to keep participants engaged with the trial process. Conventionally one of the outcomes is selected as the primary (final) outcome, for clinical reasons, with others designated as either early or late outcomes. In such settings, novel group sequential designs that use data from not only the final outcome but also from early outcomes at interim analyses can be used to inform stopping decisions. We describe data from seven recent surgical RCTs (WAT, DRAFFT, WOLLF, FASHION, CSAW, FIXDT, TOPKAT), and outline possible group sequential designs that could plausibly have been proposed at the design stage. We then simulate how these group sequential designs could have proceeded, by using the observed data and dates to replicate how information could have accumulated and decisions been made for each RCT. Results The results of the simulated group sequential designs showed that for two of the RCTs it was highly likely that they would have stopped for futility at interim analyses, potentially saving considerable time (15 and 23 months) and costs and avoiding patients being exposed to interventions that were either ineffective or no better than standard care. We discuss the characteristics of RCTs that are important in order to use the methodology we describe, particularly the value of early outcomes and the window of opportunity when early stopping decisions can be made and how it is related to the length of recruitment period and follow-up. Conclusions The results for five of the RCTs tested showed that group sequential designs using early outcome data would have been feasible and likely to provide designs that were at least as efficient, and possibly more efficient, than the original fixed sample size designs. In general, the amount of information provided by the early outcomes was surprisingly large, due to the strength of correlations with the primary outcome. This suggests that the methods described here are likely to provide benefits more generally across the range of surgical trials and more widely in other application areas where trial designs, outcomes and follow-up patterns are structured and behave similarly

Sources of new nitrogen in the Indian Ocean

Quantifying the different sources of nitrogen (N) within the N cycle is crucial to gain insights in oceanic phytoplankton production. To understand the controls of primary productivity and the associated capture of CO2 through photosynthesis in the southeastern Indian Ocean, we compiled the physical and biogeochemical data from four voyages conducted in 2010, 2011, 2012, and 2013. Overall, higher NH4 assimilation rates (~530 μmolm-2 h-1) relative to NO3 assimilation rates (~375 μmolm!2 h!1) suggest that the assimilation dynamics of C are primarily regulated by microbial regeneration in our region. N2 fixation rates did not decline when other source of dissolved inorganic nitrogen were available, although the assimilation of N2 is a highly energetic process. Our data showed that the diazotrophic community assimilated ~2 nmol N L!1 h!1 at relative elevated NH4 assimilation rates ~12 nmol L-1 h-1 and NO3 assimilation rates ~6 nmol L!1 h!1. The small diffusive deep water NO3 fluxes could not support the measured NO3 assimilation rates and consequently point toward another source of dissolved inorganic NO3. Highest NO2! values coincided consistently with shallow lower dissolved O2 layers (100–200 m; 100–180 μmol L-1). These results suggest that nitrification above the pycnocline could be a significant component of the N cycle in the eastern Indian Ocean. In our analysis we provide a conceptual understanding of how NO3 in the photic zone could be derived from new N through N2 fixation. We conclude with the hypothesis that N injected through N2 fixation can be recycled within the photic zone as NH4 and sequentially oxidized to NO2 and NO3 in shallow lower dissolved oxygen layers