Can trial quality be reliably assessed from published reports of cancer trials: evaluation of risk of bias assessments in systematic reviews

To evaluate the reliability of risk of bias assessments based on published trial reports, for determining trial inclusion in meta-analyses

Identifying additional studies for a systematic review of retention strategies in randomised controlled trials: making contact with trials units and trial methodologists

BACKGROUND: Search strategies for systematic reviews aim to identify all evidence relevant to the research question posed. Reports of methodological research can be difficult to find leading to biased results in systematic reviews of research methodology. Evidence suggests that contact with investigators can help to identify unpublished research. To identify additional eligible randomised controlled trials (RCTs) for a Cochrane systematic review of strategies to improve retention in RCTs, we conducted a survey of UK clinical trials units (CTUs) and made contact with RCT methodologists. METHODS: Key contacts for all UK CTUs were sent a personalised email with a short questionnaire and summary protocol of the Cochrane methodology review. The questionnaire asked whether a RCT evaluating strategies to improve retention embedded in a RCT had ever been conducted by the CTU. Questions about the stage of completion and publication of such RCTs were included. The summary protocol outlined the aims, eligibility criteria, examples of types of retention strategies, and the primary outcome for the systematic review. Personal communication with RCT methodologists and presentations of preliminary results of the review at conferences were also used to identify additional eligible RCTs. We checked the results of our standard searches to see if eligible studies identified through these additional methods were also found using our standard searches. RESULTS: We identified 14 of the 38 RCTs included in the Cochrane methodology review by contacting trials units and methodologists. Eleven of the 14 RCTs identified by these methods were either published in grey literature, in press or unpublished. Three remaining RCTs were fully published at the time. Six of the RCTs identified were not found through any other searches. The RCTs identified represented data for 6 of 14 RCTs of incentive strategies (52% of randomised participants included in the review), and 6 of 14 RCTs of communication strategies (52% of randomised participants included in the Cochrane review). Data were unavailable for two of the RCTs identified. CONCLUSIONS: Methodological evaluations embedded in RCTs may be unpublished, published in the grey literature or where published, poorly indexed in bibliographic databases. To identify such studies and minimise selection bias in systematic reviews of methodological evaluations, reviewers should consider contacting CTUs and trial methodologists

Meta-analytical methods to identify who benefits most from treatments: daft, deluded, or deft approach?

Identifying which individuals benefit most from particular treatments or other interventions underpins so-called personalised or stratified medicine. However, single trials are typically underpowered for exploring whether participant characteristics, such as age or disease severity, determine an individual’s response to treatment. A meta-analysis of multiple trials, particularly one where individual participant data (IPD) are available, provides greater power to investigate interactions between participant characteristics (covariates) and treatment effects. We use a published IPD meta-analysis to illustrate three broad approaches used for testing such interactions. Based on another systematic review of recently published IPD meta-analyses, we also show that all three approaches can be applied to aggregate data as well as IPD. We also summarise which methods of analysing and presenting interactions are in current use, and describe their advantages and disadvantages. We recommend that testing for interactions using within-trials information alone (the deft approach) becomes standard practice, alongside graphical presentation that directly visualises this

Duplicated network meta-analysis in advanced prostate cancer: a case study and recommendations for change

Background: Research overlap and duplication is a recognised problem in the context of both pairwise and network systematic reviews and meta-analyses. As a case study, we carried out a scoping review to identify and examine duplicated network meta-analyses (NMAs) in a specific disease setting where several novel therapies have recently emerged: hormone-sensitive metastatic prostate cancer (mHSPC). Methods: MEDLINE and EMBASE were systematically searched, in January 2020, for indirect or mixed treatment comparisons or network meta-analyses of the systemic treatments docetaxel and abiraterone acetate in the mHSPC setting, with a time-to-event outcome reported on the hazard-ratio scale. Eligibility decisions were made, and data extraction performed, by two independent reviewers. Results: A total of 13 eligible reviews were identified, analysing between 3 and 8 randomised comparisons, and comprising between 1773 and 7844 individual patients. Although the included trials and treatments showed a high degree of overlap, we observed considerable variation between identified reviews in terms of review aims, eligibility criteria and included data, statistical methodology, reporting and inference. Furthermore, crucial methodological details and specific source data were often unclear. Conclusions and recommendations: Variation across duplicated NMAs, together with reporting inadequacies, may compromise identification of best-performing treatments. Particularly in fast-moving fields, review authors should be aware of all relevant studies, and of other reviews with potential for overlap or duplication. We recommend that review protocols be published in advance, with greater clarity regarding the specific aims or scope of the project, and that reports include information on how the work builds upon existing knowledge. Source data and results should be clearly and completely presented to allow unbiased interpretation

Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use

Jayne Tierney and colleagues offer guidance on how to spot a well-designed and well-conducted individual participant data meta-analysis

Should Tyrosine Kinase Inhibitors Be Considered for Advanced Non-Small-Cell Lung Cancer Patients With Wild Type EGFR? Two Systematic Reviews and Meta-Analyses of Randomized Trials

Guidance concerning tyrosine kinase inhibitors (TKIs) for patients with wild type epidermal growth factor receptor (EGFR) and advanced non-small-cell lung cancer (NSCLC) after first-line treatment is unclear. We assessed the effect of TKIs as second-line therapy and maintenance therapy after first-line chemotherapy in two systematic reviews and meta-analyses, focusing on patients without EGFR mutations. Systematic searches were completed and data extracted from eligible randomized controlled trials. Three analytical approaches were used to maximize available data. Fourteen trials of second-line treatment (4388 patients) were included. Results showed the effect of TKIs on progression-free survival (PFS) depended on EGFR status (interaction hazard ratio [HR], 2.69; P = .004). Chemotherapy benefited patients with wild type EGFR (HR, 1.31; P < .0001), TKIs benefited patients with mutations (HR, 0.34; P = .0002). Based on 12 trials (85% of randomized patients) the benefits of TKIs on PFS decreased with increasing proportions of patients with wild type EGFR (P = .014). Six trials of maintenance therapy (2697 patients) were included. Results showed that although the effect of TKIs on PFS depended on EGFR status (interaction HR, 3.58; P < .0001), all benefited from TKIs (wild type EGFR: HR, 0.82; P = .01; mutated EGFR: HR, 0.24; P < .0001). There was a suggestion that benefits of TKIs on PFS decreased with increasing proportions of patients with wild type EGFR (P = .11). Chemotherapy should be standard second-line treatment for patients with advanced NSCLC and wild type EGFR. TKIs might be unsuitable for unselected patients. TKIs appear to benefit all patients compared with no active treatment as maintenance treatment, however, direct comparisons with chemotherapy are needed

The accuracy of clinical staging of stage I-IIIa non-small cell lung cancer: An analysis based on individual participant data

BACKGROUND: Clinical staging of NSCLC helps determine prognosis and management of patients; few data exist on accuracy of clinical staging and the impact on treatment and survival of patients. We assessed whether participant or trial characteristics were associated with clinical staging accuracy as well as impact on survival. METHODS: We used individual participant data from RCTs, supplied for a meta-analysis of pre-operative chemotherapy (+/- radiotherapy) versus surgery alone (+/- radiotherapy) in NSCLC. We assessed agreement between clinical TNM (cTNM) stage at randomization and pathological TNM (pTNM) stage, for participants in the control group. RESULTS: Results are based on 698 patients who received surgery alone (+/- radiotherapy) with data for cTNM and pTNM stage. 46% of cases were cTNM stage I, 23% cTNM stage II and 31% cTNM stage IIIa. cTNM stage disagreed with pTNM stage in 48% of cases, with 34% clinically understaged and 14% clinically over-staged. Agreement was not associated with age (p=0.12), gender (p=0.62), histology (p=0.82), staging method (p=0.32) or year of randomisation (p=0.98). Poorer survival in understaged patients was explained by the underlying pTNM stage. Clinical staging failed to detect T4 disease in 10% of cases and misclassified nodal disease in 38%. CONCLUSIONS: This study demonstrates suboptimal agreement between clinical and pathological staging. Discrepancies between clinical and pathological T and N-staging could have led to different treatment decisions in 10% and 38% of cases respectively. There is therefore a need for further research into improving staging accuracy for patients with stage I-IIIa NSCLC

Adding abiraterone to androgen deprivation therapy in men with metastatic hormone-sensitive prostate cancer: a systematic review and meta-analysis

BACKGROUND: There is a need to synthesise the results of numerous randomised controlled trials evaluating the addition of therapies to androgen deprivation therapy (ADT) for men with metastatic hormone-sensitive prostate cancer (mHSPC). This systematic review aims to assess the effects of adding abiraterone acetate plus prednisone/prednisolone (AAP) to ADT. METHODS: Using our framework for adaptive meta-analysis (FAME), we started the review process before trials had been reported and worked collaboratively with trial investigators to anticipate when eligible trial results would emerge. Thus, we could determine the earliest opportunity for reliable meta-analysis and take account of unavailable trials in interpreting results. We searched multiple sources for trials comparing AAP plus ADT versus ADT in men with mHSPC. We obtained results for the primary outcome of overall survival (OS), secondary outcomes of clinical/radiological progression-free survival (PFS) and grade III-IV and grade V toxicity direct from trial teams. Hazard ratios (HRs) for the effects of AAP plus ADT on OS and PFS, Peto Odds Ratios (Peto ORs) for the effects on acute toxicity and interaction HRs for the effects on OS by patient subgroups were combined across trials using fixed-effect meta-analysis. FINDINGS: We identified three eligible trials, one of which was still recruiting (PEACE-1 (NCT01957436)). Results from the two remaining trials (LATITUDE (NCT01715285) and STAMPEDE (NCT00268476)), representing 82% of all men randomised to AAP plus ADT versus ADT (without docetaxel in either arm), showed a highly significant 38% reduction in the risk of death with AAP plus ADT (HR = 0.62, 95% confidence interval [CI] = 0.53-0.71, p = 0.55 × 10(-10)), that translates into a 14% absolute improvement in 3-year OS. Despite differences in PFS definitions across trials, we also observed a consistent and highly significant 55% reduction in the risk of clinical/radiological PFS (HR = 0.45, 95% CI = 0.40-0.51, p = 0.66 × 10(-36)) with the addition of AAP, that translates to a 28% absolute improvement at 3 years. There was no evidence of a difference in the OS benefit by Gleason sum score, performance status or nodal status, but the size of the benefit may vary by age. There were more grade III-IV acute cardiac, vascular and hepatic toxicities with AAP plus ADT but no excess of other toxicities or death. INTERPRETATION: Adding AAP to ADT is a clinically effective treatment option for men with mHSPC, offering an alternative to docetaxel for men who are starting treatment for the first time. Future research will need to address which of these two agents or whether their combination is most effective, and for whom