Restricted mean survival time: an alternative to the hazard ratio for the design and analysis of randomized trials with a time-to-event outcome

BACKGROUND: Designs and analyses of clinical trials with a time-to-event outcome almost invariably rely on the hazard ratio to estimate the treatment effect and implicitly, therefore, on the proportional hazards assumption. However, the results of some recent trials indicate that there is no guarantee that the assumption will hold. Here, we describe the use of the restricted mean survival time as a possible alternative tool in the design and analysis of these trials. METHODS: The restricted mean is a measure of average survival from time 0 to a specified time point, and may be estimated as the area under the survival curve up to that point. We consider the design of such trials according to a wide range of possible survival distributions in the control and research arm(s). The distributions are conveniently defined as piecewise exponential distributions and can be specified through piecewise constant hazards and time-fixed or time-dependent hazard ratios. Such designs can embody proportional or non-proportional hazards of the treatment effect. RESULTS: We demonstrate the use of restricted mean survival time and a test of the difference in restricted means as an alternative measure of treatment effect. We support the approach through the results of simulation studies and in real examples from several cancer trials. We illustrate the required sample size under proportional and non-proportional hazards, also the significance level and power of the proposed test. Values are compared with those from the standard approach which utilizes the logrank test. CONCLUSIONS: We conclude that the hazard ratio cannot be recommended as a general measure of the treatment effect in a randomized controlled trial, nor is it always appropriate when designing a trial. Restricted mean survival time may provide a practical way forward and deserves greater attention

How do you design randomised trials for smaller populations? A framework.

How should we approach trial design when we can get some, but not all, of the way to the numbers required for a randomised phase III trial?We present an ordered framework for designing randomised trials to address the problem when the ideal sample size is considered larger than the number of participants that can be recruited in a reasonable time frame. Staying with the frequentist approach that is well accepted and understood in large trials, we propose a framework that includes small alterations to the design parameters. These aim to increase the numbers achievable and also potentially reduce the sample size target. The first step should always be to attempt to extend collaborations, consider broadening eligibility criteria and increase the accrual time or follow-up time. The second set of ordered considerations are the choice of research arm, outcome measures, power and target effect. If the revised design is still not feasible, in the third step we propose moving from two- to one-sided significance tests, changing the type I error rate, using covariate information at the design stage, re-randomising patients and borrowing external information.We discuss the benefits of some of these possible changes and warn against others. We illustrate, with a worked example based on the Euramos-1 trial, the application of this framework in designing a trial that is feasible, while still providing a good evidence base to evaluate a research treatment.This framework would allow appropriate evaluation of treatments when large-scale phase III trials are not possible, but where the need for high-quality randomised data is as pressing as it is for common diseases

How to design a MAMS-ROCI (aka DURATIONS) randomised trial: the REFINE-Lung case study

Background. The DURATIONS design has been recently proposed as a practical alternative to a standard two-arm non-inferiority design when the goal is to optimise some continuous aspect of treatment administration, e.g. duration or frequency, preserving efficacy but improving on secondary outcomes such as safety, costs or convenience. The main features of this design are that (i) it randomises patients to a moderate number of arms across the continuum and (ii) it uses a model to share information across arms. While papers published to date about the design have focused on analysis aspects, here we show how to design such a trial in practice. We use the REFINE-Lung trial as an example; this is a trial seeking the optimal frequency of immunotherapy treatment for non-small cell lung cancer patients. Because the aspect of treatment administration to optimise is frequency, rather than duration, we propose to rename the design as Multi-Arm Multi-Stage Response Over Continuous Intervention (MAMS-ROCI). Methods. We show how simulations can be used to design such a trial. We propose to use the ADEMP framework to plan such simulations, clearly specifying aims, data generating mechanisms, estimands, methods and performance measures before coding and analysing the simulations. We discuss the possible choices to be made using the REFINE-Lung trial as an example. Results. We describe all the choices made while designing the REFINE-Lung trial, and the results of the simulations performed. We justify our choice of total sample size based on these results. Conclusions. MAMS-ROCI trials can be designed using simulation studies that have to be carefully planned and conducted. REFINE-Lung has been designed using such an approach and we have shown how researchers could similarly design their own MAMS-ROCI trial.Comment: 25 pages, 1 table, 5 figure

Rethinking non-inferiority: a practical trial design for optimising treatment duration.

Background Trials to identify the minimal effective treatment duration are needed in different therapeutic areas, including bacterial infections, tuberculosis and hepatitis C. However, standard non-inferiority designs have several limitations, including arbitrariness of non-inferiority margins, choice of research arms and very large sample sizes. Methods We recast the problem of finding an appropriate non-inferior treatment duration in terms of modelling the entire duration-response curve within a pre-specified range. We propose a multi-arm randomised trial design, allocating patients to different treatment durations. We use fractional polynomials and spline-based methods to flexibly model the duration-response curve. We call this a 'Durations design'. We compare different methods in terms of a scaled version of the area between true and estimated prediction curves. We evaluate sensitivity to key design parameters, including sample size, number and position of arms. Results A total sample size of ~ 500 patients divided into a moderate number of equidistant arms (5-7) is sufficient to estimate the duration-response curve within a 5% error margin in 95% of the simulations. Fractional polynomials provide similar or better results than spline-based methods in most scenarios. Conclusion Our proposed practical randomised trial 'Durations design' shows promising performance in the estimation of the duration-response curve; subject to a pending careful investigation of its inferential properties, it provides a potential alternative to standard non-inferiority designs, avoiding many of their limitations, and yet being fairly robust to different possible duration-response curves. The trial outcome is the whole duration-response curve, which may be used by clinicians and policymakers to make informed decisions, facilitating a move away from a forced binary hypothesis testing paradigm

Treatment selection in multi-arm multi-stage designs: With application to a postpartum haemorrhage trial

Background: Multi-arm multi-stage trials are an efficient, adaptive approach for testing many treatments simultaneously within one protocol. In settings where numbers of patients available to be entered into trials and resources might be limited, such as primary postpartum haemorrhage, it may be necessary to select a pre-specified subset of arms at interim stages even if they are all showing some promise against the control arm. This will put a limit on the maximum number of patients required and reduce the associated costs. Motivated by the World Health Organization Refractory HaEmorrhage Devices trial in postpartum haemorrhage, we explored the properties of such a selection design in a randomised phase III setting and compared it with other alternatives. The objectives are: (1) to investigate how the timing of treatment selection affects the operating characteristics; (2) to explore the use of an information-rich (continuous) intermediate outcome to select the best-performing arm, out of four treatment arms, compared with using the primary (binary) outcome for selection at the interim stage; and (3) to identify factors that can affect the efficiency of the design. / Methods: We conducted simulations based on the refractory haemorrhage devices multi-arm multi-stage selection trial to investigate the impact of the timing of treatment selection and applying an adaptive allocation ratio on the probability of correct selection, overall power and familywise type I error rate. Simulations were also conducted to explore how other design parameters will affect both the maximum sample size and trial timelines. / Results: The results indicate that the overall power of the trial is bounded by the probability of ‘correct’ selection at the selection stage. The results showed that good operating characteristics are achieved if the treatment selection is conducted at around 17% of information time. Our results also showed that although randomising more patients to research arms before selection will increase the probability of selecting correctly, this will not increase the overall efficiency of the (selection) design compared with the fixed allocation ratio of 1:1 to all arms throughout. / Conclusions: Multi-arm multi-stage selection designs are efficient and flexible with desirable operating characteristics. We give guidance on many aspects of these designs including selecting the intermediate outcome measure, the timing of treatment selection, and choosing the operating characteristics

Uptake of the multi-arm multi-stage (MAMS) adaptive platform approach: a trial-registry review of late-phase randomised clinical trials

BACKGROUND: For medical conditions with numerous interventions worthy of investigation, there are many advantages of a multi-arm multi-stage (MAMS) platform trial approach. However, there is currently limited knowledge on uptake of the MAMS design, especially in the late-phase setting. We sought to examine uptake and characteristics of late-phase MAMS platform trials, to enable better planning for teams considering future use of this approach. DESIGN: We examined uptake of registered, late-phase MAMS platforms in the EU clinical trials register, Australian New Zealand Clinical Trials Registry, International Standard Randomised Controlled Trial Number registry, Pan African Clinical Trials Registry, WHO International Clinical Trial Registry Platform and databases: PubMed, Medline, Cochrane Library, Global Health Library and EMBASE. Searching was performed and review data frozen on 1 April 2021. MAMS platforms were defined as requiring two or more comparison arms, with two or more trial stages, with an interim analysis allowing for stopping of recruitment to arms and typically the ability to add new intervention arms. RESULTS: 62 late-phase clinical trials using an MAMS approach were included. Overall, the number of late-phase trials using the MAMS design has been increasing since 2001 and been accelerated by COVID-19. The majority of current MAMS platforms were either targeting infectious diseases (52%) or cancers (29%) and all identified trials were for treatment interventions. 89% (55/62) of MAMS platforms were evaluating medications, with 45% (28/62) of the MAMS platforms having at least one or more repurposed medication as a comparison arm. CONCLUSIONS: Historically, late-phase trials have adhered to long-established standard (two-arm) designs. However, the number of late-phase MAMS platform trials is increasing, across a range of different disease areas. This study highlights the potential scope of MAMS platform trials and may assist research teams considering use of this approach in the late-phase randomised clinical trial setting. PROSPERO REGISTRATION NUMBER: CRD42019153910

artcat: Sample-size calculation for an ordered categorical outcome

We describe a new command, artcat, that calculates sample size or power for a randomized controlled trial or similar experiment with an ordered categorical outcome, where analysis is by the proportional-odds model. artcat implements the method of Whitehead (1993, Statistics in Medicine 12: 2257–2271). We also propose and implement a new method that 1) allows the user to specify a treatment effect that does not obey the proportional-odds assumption, 2) offers greater accuracy for large treatment effects, and 3) allows for noninferiority trials. We illustrate the command and explore the value of an ordered categorical outcome over a binary outcome in various settings. We show by simulation that the methods perform well and that the new method is more accurate than Whitehead’s method