Protecting Clinical Trial Participants and Protecting Data Integrity: Are We Meeting the Challenges?

Susan Ellenberg discusses alternative approaches towards evaluating data as it accumulates in clinical trials, and to protecting the integrity and preventing undue risks to participants, as the trial continues

Data and Safety Monitoring of COVID-19 Vaccine Clinical Trials

To speed the development of vaccines against SARS-CoV-2, the United States Federal Government has funded multiple phase 3 trials of candidate vaccines. A single 11-member data and safety monitoring board (DSMB) monitors all government-funded trials to ensure coordinated oversight, promote harmonized designs, and allow shared insights related to safety across trials. DSMB reviews encompass 3 domains: (1) the conduct of trials, including overall and subgroup accrual and data quality and completeness; (2) safety, including individual events of concern and comparisons by randomized group; and (3) interim analyses of efficacy when event-driven milestones are met. Challenges have included the scale and pace of the trials, the frequency of safety events related to the combined enrollment of over 100 000 participants, many of whom are older adults or have comorbid conditions that place them at independent risk of serious health events, and the politicized environment in which the trials have taken place

Comparison of nuisance parameters in pediatric versus adult randomized trials: a meta-epidemiologic empirical evaluation

BACKGROUND We wished to compare the nuisance parameters of pediatric vs. adult randomized-trials (RCTs) and determine if the latter can be used in sample size computations of the former. METHODS In this meta-epidemiologic empirical evaluation we examined meta-analyses from the Cochrane Database of Systematic-Reviews, with at least one pediatric-RCT and at least one adult-RCT. Within each meta-analysis of binary efficacy-outcomes, we calculated the pooled-control-group event-rate (CER) across separately all pediatric and adult-trials, using random-effect models and subsequently calculated the control-group event-rate risk-ratio (CER-RR) of the pooled-pediatric-CERs vs. adult-CERs. Within each meta-analysis with continuous outcomes we calculated the pooled-control-group effect standard deviation (CE-SD) across separately all pediatric and adult-trials and subsequently calculated the CE-SD-ratio of the pooled-pediatric-CE-SDs vs. adult-CE-SDs. We then calculated across all meta-analyses the pooled-CER-RRs and pooled-CE-SD-ratios (primary endpoints) and the pooled-magnitude of effect-sizes of CER-RRs and CE-SD-ratios using REMs. A ratio < 1 indicates that pediatric trials have smaller nuisance parameters than adult trials. RESULTS We analyzed 208 meta-analyses (135 for binary-outcomes, 73 for continuous-outcomes). For binary outcomes, pediatric-RCTs had on average 10% smaller CERs than adult-RCTs (summary-CE-RR: 0.90; 95% CI: 0.83, 0.98). For mortality outcomes the summary-CE-RR was 0.48 (95% CIs: 0.31, 0.74). For continuous outcomes, pediatric-RCTs had on average 26% smaller CE-SDs than adult-RCTs (summary-CE-SD-ratio: 0.74). CONCLUSIONS Clinically relevant differences in nuisance parameters between pediatric and adult trials were detected. These differences have implications for design of future studies. Extrapolation of nuisance parameters for sample-sizes calculations from adult-trials to pediatric-trials should be cautiously done

Rigorous Clinical Trial Design in Public Health Emergencies Is Essential.

Randomized clinical trials are the most reliable approaches to evaluating the effects of new treatments and vaccines. During the 2014-2015 West African Ebola epidemic, many argued that such trials were neither ethical nor feasible in an environment of limited health infrastructure and severe disease with a high fatality rate. Consensus among the numerous organizations providing help to the affected areas was never achieved, resulting in fragmented collaboration, delayed study initiation, and ultimately failure to provide definitive evidence on the efficacy of treatments and vaccines. Randomized trials were in fact approved by local ethics boards and initiated, demonstrating that randomized trials, even in such difficult circumstances, are feasible. Improved planning and collaboration among research and humanitarian organizations, and affected communities, in the interepidemic periods are needed to ensure that questions regarding the efficacy of vaccines and treatments can be definitively answered during future public health emergencies

Biomarkers and Noncalcified Coronary Artery Plaque Progression in Older Men Treated With Testosterone.

ObjectiveRecent results from the Cardiovascular Trial of the Testosterone Trials showed that testosterone treatment of older men with low testosterone was associated with greater progression of noncalcified plaque (NCP). We evaluated the effect of anthropometric measures and cardiovascular biomarkers on plaque progression in individuals in the Testosterone Trial.MethodsThe Cardiovascular part of the trial included 170 men aged 65 years or older with low testosterone. Participants received testosterone gel or placebo gel for 12 months. The primary outcome was change in NCP volume from baseline to 12 months, as determined by coronary computed tomography angiography (CCTA). We assayed several markers of cardiovascular risk and analyzed each marker individually in a model as predictive variables and change in NCP as the dependent variable.ResultsOf 170 enrollees, 138 (73 testosterone, 65 placebo) completed the study and were available for the primary analysis. Of 10 markers evaluated, none showed a significant association with the change in NCP volume, but a significant interaction between treatment assignment and waist-hip ratio (WHR) (P = 0.0014) indicated that this variable impacted the testosterone effect on NCP volume. The statistical model indicated that for every 0.1 change in the WHR, the testosterone-induced 12-month change in NCP volume increased by 26.96 mm3 (95% confidence interval, 7.72-46.20).ConclusionAmong older men with low testosterone treated for 1 year, greater WHR was associated with greater NCP progression, as measured by CCTA. Other biomarkers and anthropometric measures did not show statistically significant association with plaque progression

Symptomatic benefits of testosterone treatment in patient subgroups : a systematic review, individual participant data meta-analysis, and aggregate data meta-analysis

Acknowledgments This work was supported by the UK National Institute for Health and Care Research (NIHR)'s Health Technology Assessment Programme (project number 17/68/01). The views expressed herein are those of the authors and not necessarily those of the National Health Service, the NIHR Health Technology Assessment Programme, or the UK Department of Health and Social Care. The Health Services Research Unit at the University of Aberdeen is funded by the Chief Scientist Office of the Scottish Government Health and Social Care Directorates. The Section of Endocrinology and Investigative Medicine at Imperial College London is funded by grants from the Medical Research Council, the Biotechnology and Biological Sciences Research Council, NIHR, an Integrative Mammalian Biology Capacity Building Award, and an FP7-HEALTH-2009-241592 EuroCHIP grant, and is supported by the NIHR Biomedical Research Centre Funding Scheme. WSD is funded by an NIHR Research Professorship. CNJ is funded by an NIHR Post-Doctoral Fellowship. ShB receives NIH research grant funding. The authors are grateful to the clinical and methodological experts and patient partners who contributed to the advisory group for this study.Peer reviewedPublisher PD

Symptomatic benefits of testosterone treatment in patient subgroups: a systematic review, individual participant data meta-analysis, and aggregate data meta-analysis

Background Testosterone replacement therapy is known to improve sexual function in men younger than 40 years with pathological hypogonadism. However, the extent to which testosterone alleviates sexual dysfunction in older men and men with obesity is unclear, despite the fact that testosterone is being increasingly prescribed to these patient populations. We aimed to evaluate whether subgroups of men with low testosterone derive any symptomatic benefit from testosterone treatment. Methods We did a systematic review and meta-analysis to evaluate characteristics associated with symptomatic benefit of testosterone treatment versus placebo in men aged 18 years and older with a baseline serum total testosterone concentration of less than 12 nmol/L. We searched major electronic databases (MEDLINE, Embase, Science Citation Index, and the Cochrane Central Register of Controlled Trials) and clinical trial registries for reports published in English between Jan 1, 1992, and Aug 27, 2018. Anonymised individual participant data were requested from the investigators of all identified trials. Primary (cardiovascular) outcomes from this analysis have been published previously. In this report, we present the secondary outcomes of sexual function, quality of life, and psychological outcomes at 12 months. We did a one-stage individual participant data meta-analysis with a random-effects linear regression model, and a two-stage meta-analysis integrating individual participant data with aggregated data from studies that did not provide individual participant data. This study is registered with PROSPERO, CRD42018111005. Findings 9871 citations were identified through database searches. After exclusion of duplicates and publications not meeting inclusion criteria, 225 full texts were assessed for inclusion, of which 109 publications reporting 35 primary studies (with a total 5601 participants) were included. Of these, 17 trials provided individual participant data (3431 participants; median age 67 years [IQR 60–72]; 3281 [97%] of 3380 aged ≥40 years) Compared with placebo, testosterone treatment increased 15-item International Index of Erectile Function (IIEF-15) total score (mean difference 5·52 [95% CI 3·95–7·10]; τ²=1·17; n=1412) and IIEF-15 erectile function subscore (2·14 [1·40–2·89]; τ²=0·64; n=1436), reaching the minimal clinically important difference for mild erectile dysfunction. These effects were not found to be dependent on participant age, obesity, presence of diabetes, or baseline serum total testosterone. However, absolute IIEF-15 scores reached during testosterone treatment were subject to thresholds in patient age and baseline serum total testosterone. Testosterone significantly improved Aging Males’ Symptoms score, and some 12-item or 36-item Short Form Survey quality of life subscores compared with placebo, but it did not significantly improve psychological symptoms (measured by Beck Depression Inventory). Interpretation In men aged 40 years or older with baseline serum testosterone of less than 12 nmol/L, short-to-mediumterm testosterone treatment could provide clinically meaningful treatment for mild erectile dysfunction, irrespective of patient age, obesity, or degree of low testosterone. However, due to more severe baseline symptoms, the absolute level of sexual function reached during testosterone treatment might be lower in older men and men with obesity

Adverse cardiovascular events and mortality in men during testosterone treatment : an individual patient and aggregate data meta-analysis

Funding National Institute for Health Research Health Technology Assessment Programme. Acknowledgments This work was supported by the National Institute for Health Research Health Technology Assessment (NIHR HTA) Programme (project no 17/68/01). The views expressed are those of the authors and not necessarily those of the National Health Service, the NIHR HTA Programme, or the Department of Health and Social Care, UK. The funders were not actively involved in the research process at any stage. The study design; collection, analysis, and interpretation of data; writing of the manuscript; and decision to submit for publication were performed independent of the funders. The Health Services Research Unit at the University of Aberdeen is funded by the Chief Scientist Office of the Scottish Government Health and Social Care Directorates. The Section of Endocrinology and Investigative Medicine at Imperial College London is funded by grants from the Medical Research Council, Biotechnology and Biological Sciences Research Council, NIHR, an Integrative Mammalian Biology Capacity Building Award, an FP7-HEALTH-2009-241592 EuroCHIP grant, and is supported by the NIHR Biomedical Research Centre Funding Scheme. The following authors are also funded as follows: NIHR Research Professorship (WSD), NIHR post-doctoral fellowship (CNJ). SBhasin receives National Institutes of Health research grant funding. The authors are grateful to Prakash Abraham, Alison Avenell, Craig Ramsay, Graham Scotland, Neil Scott, and Finlay MacKenzie for their advice; and to the many individuals from academia and industry who helped in the conduct of this study.Peer reviewedPublisher PD

Symptomatic benefits of testosterone treatment in patient subgroups: a systematic review, individual participant data meta-analysis, and aggregate data meta-analysis

BACKGROUND: Testosterone replacement therapy is known to improve sexual function in men younger than 40 years with pathological hypogonadism. However, the extent to which testosterone alleviates sexual dysfunction in older men and men with obesity is unclear, despite the fact that testosterone is being increasingly prescribed to these patient populations. We aimed to evaluate whether subgroups of men with low testosterone derive any symptomatic benefit from testosterone treatment. METHODS: We did a systematic review and meta-analysis to evaluate characteristics associated with symptomatic benefit of testosterone treatment versus placebo in men aged 18 years and older with a baseline serum total testosterone concentration of less than 12 nmol/L. We searched major electronic databases (MEDLINE, Embase, Science Citation Index, and the Cochrane Central Register of Controlled Trials) and clinical trial registries for reports published in English between Jan 1, 1992, and Aug 27, 2018. Anonymised individual participant data were requested from the investigators of all identified trials. Primary (cardiovascular) outcomes from this analysis have been published previously. In this report, we present the secondary outcomes of sexual function, quality of life, and psychological outcomes at 12 months. We did a one-stage individual participant data meta-analysis with a random-effects linear regression model, and a two-stage meta-analysis integrating individual participant data with aggregated data from studies that did not provide individual participant data. This study is registered with PROSPERO, CRD42018111005. FINDINGS: 9871 citations were identified through database searches. After exclusion of duplicates and publications not meeting inclusion criteria, 225 full texts were assessed for inclusion, of which 109 publications reporting 35 primary studies (with a total 5601 participants) were included. Of these, 17 trials provided individual participant data (3431 participants; median age 67 years [IQR 60-72]; 3281 [97%] of 3380 aged ≥40 years) Compared with placebo, testosterone treatment increased 15-item International Index of Erectile Function (IIEF-15) total score (mean difference 5·52 [95% CI 3·95-7·10]; τ 2=1·17; n=1412) and IIEF-15 erectile function subscore (2·14 [1·40-2·89]; τ 2=0·64; n=1436), reaching the minimal clinically important difference for mild erectile dysfunction. These effects were not found to be dependent on participant age, obesity, presence of diabetes, or baseline serum total testosterone. However, absolute IIEF-15 scores reached during testosterone treatment were subject to thresholds in patient age and baseline serum total testosterone. Testosterone significantly improved Aging Males' Symptoms score, and some 12-item or 36-item Short Form Survey quality of life subscores compared with placebo, but it did not significantly improve psychological symptoms (measured by Beck Depression Inventory). INTERPRETATION: In men aged 40 years or older with baseline serum testosterone of less than 12 nmol/L, short-to-medium-term testosterone treatment could provide clinically meaningful treatment for mild erectile dysfunction, irrespective of patient age, obesity, or degree of low testosterone. However, due to more severe baseline symptoms, the absolute level of sexual function reached during testosterone treatment might be lower in older men and men with obesity. FUNDING: National Institute for Health and Care Research Health Technology Assessment Programme