Nonregistration, discontinuation, and nonpublication of randomized trials: A repeated metaresearch analysis

BACKGROUND We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs. METHODS AND FINDINGS We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations. CONCLUSIONS We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research

Validity of mobile electronic data capture in clinical studies: a pilot study in a pediatric population.

BACKGROUND: Clinical studies in children are necessary yet conducting multiple visits at study centers remains challenging. The success of "care-at-home" initiatives and remote clinical trials suggests their potential to facilitate conduct of pediatric studies. This pilot aimed to study the feasibility of remotely collecting valid (i.e. complete and correct) saliva samples and clinical data utilizing mobile technology. METHODS: Single-center, prospective pilot study in children undergoing elective tonsillectomy at the University of Basel Children's Hospital. Data on pain scores and concomitant medication and saliva samples were collected by caregivers on two to four inpatient study days and on three consecutive study days at home. A tailored mobile application developed for this study supported data collection. The primary endpoint was the proportion of complete and correct caregiver-collected data (pain scale) and saliva samples in the at-home setting. Secondary endpoints included the proportion of complete and correct saliva samples in the inpatient setting, subjective feasibility for caregivers, and study cost. RESULTS: A total number of 23 children were included in the study of which 17 children, median age 6.0 years (IQR 5.0, 7.4), completed the study. During the at-home phase, 71.9% [CI = 64.4, 78.6] of all caregiver-collected pain assessments and 53.9% [CI = 44.2, 63.4] of all saliva samples were complete and correct. Overall, 64.7% [CI = 58.7, 70.4] of all data collected by caregivers at home was complete and correct. The predominant reason for incorrectness of data was adherence to the timing of predefined patient actions. Participating caregivers reported high levels of satisfaction and willingness to participate in similar trials in the future. Study costs for a potential sample size of 100 patients were calculated to be 20% lower for the at-home than for a traditional in-patient study setting. CONCLUSIONS: Mobile device supported studies conducted at home may provide a cost-effective approach to facilitate conduct of clinical studies in children. Given findings in this pilot study, data collection at home may focus on electronic data capture rather than biological sampling

The worldwide clinical trial research response to the COVID-19 pandemic - the first 100 days

Background: Never before have clinical trials drawn as much public attention as those testing interventions for COVID-19. We aimed to describe the worldwide COVID-19 clinical research response and its evolution over the first 100 days of the pandemic. Methods: Descriptive analysis of planned, ongoing or completed trials by April 9, 2020 testing any intervention to treat or prevent COVID-19, systematically identified in trial registries, preprint servers, and literature databases. A survey was conducted of all trials to assess their recruitment status up to July 6, 2020. Results: Most of the 689 trials (overall target sample size 396,366) were small (median sample size 120; interquartile range [IQR] 60-300) but randomized (75.8%; n=522) and were often conducted in China (51.1%; n=352) or the USA (11%; n=76). 525 trials (76.2%) planned to include 155,571 hospitalized patients, and 25 (3.6%) planned to include 96,821 health-care workers. Treatments were evaluated in 607 trials (88.1%), frequently antivirals (n=144) or antimalarials (n=112); 78 trials (11.3%) focused on prevention, including 14 vaccine trials. No trial investigated social distancing. Interventions tested in 11 trials with >5,000 participants were also tested in 169 smaller trials (median sample size 273; IQR 90-700). Hydroxychloroquine alone was investigated in 110 trials. While 414 trials (60.0%) expected completion in 2020, only 35 trials (4.1%; 3,071 participants) were completed by July 6. Of 112 trials with detailed recruitment information, 55 had recruited <20% of the targeted sample; 27 between 20-50%; and 30 over 50% (median 14.8% [IQR 2.0-62.0%]). Conclusions: The size and speed of the COVID-19 clinical trials agenda is unprecedented. However, most trials were small investigating a small fraction of treatment options. The feasibility of this research agenda is questionable, and many trials may end in futility, wasting research resources. Much better coordination is needed to respond to global health threats

Uncertainties and controversies in axillary management of patients with breast cancer

The aims of this Oncoplastic Breast Consortium and European Breast Cancer Research Association of Surgical Trialists initiative were to identify uncertainties and controversies in axillary management of early breast cancer and to recommend appropriate strategies to address them. By use of Delphi methods, 15 questions were prioritized by more than 250 breast surgeons, patient advocates and radiation oncologists from 60 countries. Subsequently, a global virtual consensus panel considered available data, ongoing studies and resource utilization. It agreed that research should no longer be prioritized for standardization of axillary imaging, de-escalation of axillary surgery in node-positive cancer and risk evaluation of modern surgery and radiotherapy. Instead, expert consensus recommendations for clinical practice should be based on current evidence and updated once results from ongoing studies become available. Research on de-escalation of radiotherapy and identification of the most relevant endpoints in axillary management should encompass a meta-analysis to identify knowledge gaps, followed by a Delphi process to prioritize and a consensus conference to refine recommendations for specific trial designs. Finally, treatment of residual nodal disease after surgery was recommended to be assessed in a prospective register

Oncoplastic Breast Consortium consensus conference on nipple-sparing mastectomy

Purpose Indications for nipple-sparing mastectomy (NSM) have broadened to include the risk reducing setting and locally advanced tumors, which resulted in a dramatic increase in the use of NSM. The Oncoplastic Breast Consortium consensus conference on NSM and immediate reconstruction was held to address a variety of questions in clinical practice and research based on published evidence and expert panel opinion. Methods The panel consisted of 44 breast surgeons from 14 countries across four continents with a background in gynecology, general or reconstructive surgery and a practice dedicated to breast cancer, as well as a patient advocate. Panelists presented evidence summaries relating to each topic for debate during the in-person consensus conference. The iterative process in question development, voting, and wording of the recommendations followed the modified Delphi methodology. Results Consensus recommendations were reached in 35, majority recommendations in 24, and no recommendations in the remaining 12 questions. The panel acknowledged the need for standardization of various aspects of NSM and immediate reconstruction. It endorsed several oncological contraindications to the preservation of the skin and nipple. Furthermore, it recommended inclusion of patients in prospective registries and routine assessment of patient-reported outcomes. Considerable heterogeneity in breast reconstruction practice became obvious during the conference. Conclusions In case of conflicting or missing evidence to guide treatment, the consensus conference revealed substantial disagreement in expert panel opinion, which, among others, supports the need for a randomized trial to evaluate the safest and most efficacious reconstruction techniques

Oncoplastic breast consortium recommendations for mastectomy and whole breast reconstruction in the setting of post-mastectomy radiation therapy

Aim: Demand for nipple-and skin-sparing mastectomy (NSM/SSM) with immediate breast reconstruction (BR) has increased at the same time as indications for post-mastectomy radiation therapy (PMRT) have broadened. The aim of the Oncoplastic Breast Consortium initiative was to address relevant questions arising with this clinically challenging scenario. Methods: A large global panel of oncologic, oncoplastic and reconstructive breast surgeons, patient advocates and radiation oncologists developed recommendations for clinical practice in an iterative process based on the principles of Delphi methodology. Results: The panel agreed that surgical technique for NSM/SSM should not be formally modified when PMRT is planned with preference for autologous over implant-based BR due to lower risk of long-term complications and support for immediate and delayed-immediate reconstructive approaches. Nevertheless, it was strongly believed that PMRT is not an absolute contraindication for implant-based or other types of BR, but no specific recom-mendations regarding implant positioning, use of mesh or timing were made due to absence of high-quality evidence. The panel endorsed use of patient-reported outcomes in clinical practice. It was acknowledged that the shape and size of reconstructed breasts can hinder radiotherapy planning and attention to details of PMRT techniques is important in determining aesthetic outcomes after immediate BR. Conclusions: The panel endorsed the need for prospective, ideally randomised phase III studies and for surgical and radiation oncology teams to work together for determination of optimal sequencing and techniques for PMRT for each patient in the context of BRPeer reviewe

Oncoplastic Breast Consortium consensus conference on nipple-sparing mastectomy.

Purpose Indications for nipple-sparing mastectomy (NSM) have broadened to include the risk reducing setting and locally advanced tumors, which resulted in a dramatic increase in the use of NSM. The Oncoplastic Breast Consortium consensus conference on NSM and immediate reconstruction was held to address a variety of questions in clinical practice and research based on published evidence and expert panel opinion. Methods The panel consisted of 44 breast surgeons from 14 countries across four continents with a background in gynecology, general or reconstructive surgery and a practice dedicated to breast cancer, as well as a patient advocate. Panelists presented evidence summaries relating to each topic for debate during the in-person consensus conference. The iterative process in question development, voting, and wording of the recommendations followed the modified Delphi methodology. Results Consensus recommendations were reached in 35, majority recommendations in 24, and no recommendations in the remaining 12 questions. The panel acknowledged the need for standardization of various aspects of NSM and immediate reconstruction. It endorsed several oncological contraindications to the preservation of the skin and nipple. Furthermore, it recommended inclusion of patients in prospective registries and routine assessment of patient-reported outcomes. Considerable heterogeneity in breast reconstruction practice became obvious during the conference. Conclusions In case of conflicting or missing evidence to guide treatment, the consensus conference revealed substantial disagreement in expert panel opinion, which, among others, supports the need for a randomized trial to evaluate the safest and most efficacious reconstruction techniques

Surgical hand antisepsis with alcohol-based hand rub : comparison of effectiveness after 1.5 and 3 minutes of application

OBJECTIVE: Research has shown 1.5 minutes of surgical hand antisepsis with alcohol-based hand rub to be at least as effective under experimental conditions as the 3-minute reference disinfection recommended by European Norm 12791. The aim of the present study was to validate the effectiveness of 1.5 minutes of surgical hand antisepsis in a clinical setting by comparing the effectiveness of 1.5- and 3-minute applications of alcohol-based hand rub (45% vol/vol 2-propanol, 30% vol/vol 1-propanol, and 0.2% mecetronium ethylsulphate). DESIGN: Prospective crossover trial in which each surgeon served as his or her own control, with individual randomization to the 1.5- or the 3-minute group during the first part of the trial. SETTING: Basel University Hospital, Switzerland. PARTICIPANTS: Thirty-two surgeons with different levels of postdoctoral training. METHODS: We measured the bactericidal effectiveness of 1.5 minutes and 3 minutes of surgical hand antisepsis with alcohol-based hand rub by assessing the mean (+/-SD) log10 number of colony-forming units before the application of hand rub (baseline), after the application of hand rub (immediate effect), and after surgery (sustained effect) so as to follow European Norm 12791 as closely as possible. RESULTS: The immediate mean (+/-SD) log10 reduction in colony-forming units (cfu) was 2.26 +/- 1.13 log10 cfu for the 1.5-minute group and 3.01 +/- 1.06 log10 cfu for the 3-minute group (P = .204). Similarly, there was no statistically significant difference between the 2 groups with respect to the sustained effect; the mean (+/-SD) log10 increase in bacterial density during surgery was 1.08 +/- 1.13 log10 cfu for the 1.5-minute group and 0.95 +/- 1.27 log10 cfu for the 3-minute group (P = .708). No adverse effects were recorded. CONCLUSION: In this clinical trial, surgical hand antisepsis with alcohol-based hand rub resulted in a similar bacterial reduction, regardless of whether it was applied for 3 or 1.5 minutes, which confirms experimental data generated with healthy volunteers

A longitudinal assessment of trial protocols approved by research ethics committees: the Adherance to SPIrit REcommendations in the UK (ASPIRE-UK) study

Background To assess the quality of reporting of RCT protocols approved by UK research ethics committees before and after the publication of the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline. Methods We had access to RCT study protocols that received ethical approval in the UK in 2012 (n=103) and 2016 (n=108). From those, we assessed the adherence to the 33 SPIRIT items (i.e. a total of 64 components of the 33 SPIRIT items). We descriptively analysed the adherence to SPIRIT guidelines as proportion of adequately reported items (median and interquartile range [IQR]) and stratified the results by year of approval and sponsor. Results The proportion of reported SPIRIT items increased from a median of 64.9% (IQR, 57.6–69.2%) in 2012 to a median of 72.5% (IQR, 65.3–78.3%) in 2016. Industry-sponsored RCTs reported more SPIRIT items in 2012 (median 67.4%; IQR, 64.1–69.4%) compared to non-industry-sponsored trials (median 59.8%; IQR, 46.5–67.7%). This gap between industry- and non-industry-sponsored trials increased in 2016 (industry-sponsored: median 75.6%; IQR, 71.2–79.0% vs non-industry-sponsored: median 65.3%; IQR, 51.6–76.3%). Conclusions The adherence to SPIRIT guidelines has improved in the UK from 2012 to 2016 but remains on a modest level, especially for non-industry-sponsored RCTs

Reliability of Trial Information Across Registries for Trials With Multiple Registrations: A Systematic Review

Importance: Clinical trial registries are important for gaining an overview of ongoing research efforts and for deterring and identifying publication bias and selective outcome reporting. The reliability of the information in trial registries is uncertain. Objective: To assess the reliability of information across registries for trials with multiple registrations. Evidence review: For this systematic review, 360 protocols of randomized clinical trials (RCTs) approved by research ethics committees in Switzerland, the UK, Canada, and Germany in 2012 were evaluated. Clinical trial registries were searched from March to September 2019 for corresponding registrations of these RCTs. For RCTS that were recorded in more than 1 clinical trial registry, key trial characteristics that should be identical among all trial registries (ie, sponsor, funding source, primary outcome, target sample size, trial status, date of first patient enrollment, results available, and main publication indexed) were extracted in duplicate. Agreement between the different trial registries for these key characteristics was analyzed descriptively. Data analyses were conducted from May 1 to November 30, 2020. Representatives from clinical trial registries were interviewed to discuss the study findings between February 1 and March 31, 2021. Findings: The analysis included 197 RCTs registered in more than 1 trial registry (151 in 2 registries and 46 in 3 registries), with 188 trials in ClinicalTrials.gov, 185 in the European Union Drug Regulating Authorities Clinical Trials Database (EudraCT), 20 in ISRCTN, and 47 in other registries. The agreement of key information across all registries was as follows: 178 of 197 RCTs (90%; 95% CI, 85%-94%) for sponsor, 18 of 20 (90%; 95% CI, 68%-99%) for funding source (funding was not reported on ClinicalTrials.gov), 154 of 197 (78%; 95% CI, 72%-84%) for primary outcome, 90 of 197 (46%; 95% CI, 39%-53%) for trial status, 122 of 194 (63%; 95% CI, 56%-70%) for target sample size, and 43 of 57 (75%; 95% CI, 62%-86%) for the date of first patient enrollment when the comparison time was increased to 30 days (date of first patient enrollment was not reported on EudraCT). For results availability in trial registries, agreement was 122 of 197 RCTs (62%; 95% CI, 55%-69%) for summary data reported in the registry and 91 of 197 (46%; 95% CI, 39%-53%) for whether a published article with the main results was indexed. Different legal requirements were stated as the main reason for inconsistencies by representatives of clinical trial registries. Conclusions and relevance: In this systematic review, for a substantial proportion of registered RCTs, information about key trial characteristics was inconsistent across trial registries, raising concerns about the reliability of the information provided in these registries. Further harmonization across clinical trial registries may be necessary to increase their usefulness