Trial Registration for Public Trust: Making the Case for Medical Devices

Recently, several pharmaceutical companies have been shown to have withheld negative clinical trial results from the public. These incidents have resulted in a concerted global effort to register all trials at inception, so that all subsequent results can be tracked regardless of whether they are positive or negative. These trial registration policies have been driven in large part by concern about the pharmaceutical sector. The medical device industry is much smaller, and different from the pharmaceutical industry in some fundamental ways. This paper examines the issues surrounding registration of device trials and argues that these differences with pharmaceutical should not exempt device trials from registration

Reporting of Methodologic Information on Trial Registries for Quality Assessment: A Study of Trial Records Retrieved from the WHO Search Portal

Background: Although randomized clinical trials (RCTs) are considered the gold standard of evidence, their reporting is often suboptimal. Trial registries have the potential to contribute important methodologic information for critical appraisal of study results. Methods and Findings: The objective of the study was to evaluate the reporting of key methodologic study characteristics in trial registries. We identified a random sample (n = 265) of actively recruiting RCTs using the World Health Organization International Clinical Trials Registry Platform (ICTRP) search portal in 2008. We assessed the reporting of relevant domains from the Cochrane Collaboration’s ‘Risk of bias’ tool and other key methodological aspects. Our primary outcomes were the proportion of registry records with adequate reporting of random sequence generation, allocation concealment, blinding, and trial outcomes. Two reviewers independently assessed each record. Weighted overall proportions in the ICTRP search portal for adequate reporting of sequence generation, allocation concealment, blinding (including and excluding open label RCT) and primary outcomes were 5.7% (95% CI 3.0–8.4%), 1.4% (0–2.8%), 41% (35–47%), 8.4% (4.1–13%), and 66% (60–72%), respectively. The proportion of adequately reported RCTs was higher for registries that used specific methodological fields for describing methods of randomization and allocation concealment compared to registries that did not. Concerning other key methodological aspects, weighted overall proportions of RCTs with adequately reported items were as follows: eligibility criteria (81%), secondary outcomes (46%), harm (5%) follow-up duration (62%), description of the interventions (53%) and sample size calculation (1%). Conclusions: Trial registries currently contain limited methodologic information about registered RCTs. In order to permit adequate critical appraisal of trial results reported in journals and registries, trial registries should consider requesting details on key RCT methods to complement journal publications. Full protocols remain the most comprehensive source of methodologic information and should be made publicly available

Epidermal RAF prevents allergic skin disease

The RAS pathway is central to epidermal homeostasis, and its activation in tumors or in Rasopathies correlates with hyperproliferation. Downstream of RAS, RAF kinases are actionable targets regulating keratinocyte turnover; however, chemical RAF inhibitors paradoxically activate the pathway, promoting epidermal proliferation. We generated mice with compound epidermis restricted BRAF/RAF1 ablation. In these animals, transient barrier defects and production of chemokines and Th2-type cytokines by keratinocytes cause a disease akin to human atopic dermatitis, characterized by IgE responses and local and systemic inflammation. Mechanistically, BRAF and RAF1 operate independently to balance MAPK signaling: BRAF promotes ERK activation, while RAF1 dims stress kinase activation. In vivo, JNK inhibition prevents disease onset, while MEK/ERK inhibition in mice lacking epidermal RAF1 phenocopies it. These results support a primary role of keratinocytes in the pathogenesis of atopic dermatitis, and the animals lacking BRAF and RAF1 in the epidermis represent a useful model for this disease

Completeness and Changes in Registered Data and Reporting Bias of Randomized Controlled Trials in ICMJE Journals after Trial Registration Policy

We assessed the adequacy of randomized controlled trial (RCT) registration, changes to registration data and reporting completeness for articles in ICMJE journals during 2.5 years after registration requirement policy.For a set of 149 reports of 152 RCTs with ClinicalTrials.gov registration number, published from September 2005 to April 2008, we evaluated the completeness of 9 items from WHO 20-item Minimum Data Set relevant for assessing trial quality. We also assessed changes to the registration elements at the Archive site of ClinicalTrials.gov and compared published and registry data.RCTs were mostly registered before 13 September 2005 deadline (n = 101, 66.4%); 118 (77.6%) started recruitment before and 31 (20.4%) after registration. At the time of registration, 152 RCTs had a total of 224 missing registry fields, most commonly 'Key secondary outcomes' (44.1% RCTs) and 'Primary outcome' (38.8%). More RCTs with post-registration recruitment had missing Minimum Data Set items than RCTs with pre-registration recruitment: 57/118 (48.3%) vs. 24/31 (77.4%) (χ(2) (1) = 7.255, P = 0.007). Major changes in the data entries were found for 31 (25.2%) RCTs. The number of RCTs with differences between registered and published data ranged from 21 (13.8%) for Study type to 118 (77.6%) for Target sample size.ICMJE journals published RCTs with proper registration but the registration data were often not adequate, underwent substantial changes in the registry over time and differed in registered and published data. Editors need to establish quality control procedures in the journals so that they continue to contribute to the increased transparency of clinical trials

Compliance of clinical trial registries with the World Health Organization minimum data set : a survey

BACKGROUND: Since September 2005 the International Committee of Medical Journal Editors has required that trials be registered in accordance with the World Health Organization (WHO) minimum dataset, in order to be considered for publication. The objective is to evaluate registries' and individual trial records' compliance with the 2006 version of the WHO minimum data set. METHODS: A retrospective evaluation of 21 online clinical trial registries (international, national, specialty, pharmaceutical industry and local) from April 2005 to February 2007 and a cross-sectional evaluation of a stratified random sample of 610 trial records from the 21 registries. RESULTS: Among 11 registries that provided guidelines for registration, the median compliance with the WHO criteria were 14 out of 20 items (range 6 to 20). In the period April 2005-February 2007, six registries increased their compliance by six data items, on average. None of the local registry websites published guidelines on the trial data items required for registration. Slightly more than half (330/610; 54.1%, 95% CI 50.1% - 58.1%) of trial records completed the contact details criteria while 29.7% (181/610, 95% CI 26.1% - 33.5%) completed the key clinical and methodological data fields. CONCLUSION: While the launch of the WHO minimum data set seemed to positively influence registries with better standardisation of approaches, individual registry entries are largely incomplete. Initiatives to ensure quality assurance of registries and trial data should be encouraged. Peer reviewers and editors should scrutinise clinical trial registration records to ensure consistency with WHO's core content requirements when considering trial-related publications

Do trialists endorse clinical trial registration? Survey of a Pubmed sample

<p>Abstract</p> <p>Introduction</p> <p>Despite intense interest in trial registration, there is a wide gap between theoretical postulates on trial registration and its implementation worldwide.</p> <p>Objective</p> <p>We aimed to evaluate trialists views about current international guidelines on trial registration, including the World Health Organization's (WHO) International Clinical Trials Registry Platform (ICTRP) policies and the Ottawa Statement, as well as their intention to register any future clinical trials they conduct.</p> <p>Methods</p> <p>We identified all 40,158 PUBMED-indexed clinical trials published from May 2005 to May 2006 using an advanced search strategy. From a random sample of 500 confirmed clinical trials, corresponding authors with e-mail contact addresses were surveyed.</p> <p>Results</p> <p>A total of 275 (60%) questionnaires from 45 countries were completed. 31% of the respondents had received only nonindustry funding during the past ten years, while 5% and 61% had received only industry or mixed funding respectively. Approximately two third of participants supported registration of all 20 WHO Data Set items, and endorsed the Ottawa Statement part 1 and part 2. Delayed public disclosure of some essential data in instances where they may be considered sensitive for competitive commercial reasons was supported by 30% of the participants, whereas immediate disclosure was supported by 53%. Only 21% of participants had registered all of their ongoing trials since 2005, while 47% stated that they would provide the 20 WHO Data Set items to a publicly accessible register for all their future clinical trials; a significantly higher proportion of participants who received only nonindustry funding (62%) was found among those who would always provide the 20 WHO items for future trials, compared to 42% of participants who received mixed or only industry funding. Among those who were undecided about endorsing registration. One third of participants expressed a lack of sufficient knowledge as the primary reason.</p> <p>Conclusion</p> <p>Although disagreement was apparent on certain issues, our findings illustrate that trial registration is gradually becoming part of the current research paradigm internationally. Our results also suggest that researchers require more knowledge to inform their decision to comply with the International standards at this early stage of voluntary trial registration.</p

Deficiencies in the transfer and availability of clinical trials evidence: A review of existing systems and standards

Background: Decisions concerning drug safety and efficacy are generally based on pivotal evidence provided by clinical trials. Unfortunately, finding the relevant clinical trials is difficult and their results are only available in text-based reports. Systematic reviews aim to provide a comprehensive overview of the evidence in a specific area, but may not provide the data required for decision making. Methods: We review and analyze the existing information systems and standards for aggregate level clinical trials information from the perspective of systematic review and evidence-based decision making. Results: The technology currently used has major shortcomings, which cause deficiencies in the transfer, traceability and availability of clinical trials information. Specifically, data available to decision makers is insufficiently structured, and consequently the decisions cannot be properly traced back to the underlying evidence. Regulatory submission, trial publication, trial registration, and systematic review produce unstructured datasets that are insufficient for supporting evidence-based decision making. Conclusions: The current situation is a hindrance to policy decision makers as it prevents fully transparent decision making and the development of more advanced decision support systems. Addressing the identified deficiencies would enable more efficient, informed, and transparent evidence-based medical decision making

Likely country of origin in publications on randomised controlled trials and controlled clinical trials during the last 60 years

BACKGROUND: The number of publications on clinical trials is unknown as well as the countries publishing most trial reports. To try to examine these questions we performed an ecological study. METHODS: We searched the 454,449 records on publications in The Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library, Issue 3, 2005 (CD-ROM version) for possible country of origin. We inspected a random sample of 906 records for information on country and type of trial. RESULTS: There was an exponential growth of publications on randomised controlled trials and controlled clinical trials since 1946, but the growth seems to have seized since 2000. We identified the possible country of origin of 210,974 publications (46.4%). The USA is leading with about 46,789 publications followed by UK, Germany, Italy, the Netherlands, Canada, and France. Sweden becomes the leader with 891 publications per million inhabitants during the last 60 years followed by Denmark (n = 864), New Zealand (n = 791), Finland (n = 781), the Netherlands (n = 570), Switzerland (n = 547), and Norway (n = 543). In depth assessment of the random sample backed these findings. CONCLUSION: Many records lacked country of origin, even after the additional scrutiny. The number of publications on clinical trials increased exponentially until the turn of the century. Rather small, democratic, and wealthy countries take the lead when the number of publications on clinical trials is calculated based on million inhabitants. If all countries produced the same number of trials as these countries, this could mean thousands of new effective treatments during the next 60 years

The Quality of Registration of Clinical Trials

BACKGROUND: Lack of transparency in clinical trial conduct, publication bias and selective reporting bias are still important problems in medical research. Through clinical trials registration, it should be possible to take steps towards resolving some of these problems. However, previous evaluations of registered records of clinical trials have shown that registered information is often incomplete and non-meaningful. If these studies are accurate, this negates the possible benefits of registration of clinical trials. METHODS AND FINDINGS: A 5% sample of records of clinical trials that were registered between 17 June 2008 and 17 June 2009 was taken from the International Clinical Trials Registry Platform (ICTRP) database and assessed for the presence of contact information, the presence of intervention specifics in drug trials and the quality of primary and secondary outcome reporting. 731 records were included. More than half of the records were registered after recruitment of the first participant. The name of a contact person was available in 94.4% of records from non-industry funded trials and 53.7% of records from industry funded trials. Either an email address or a phone number was present in 76.5% of non-industry funded trial records and in 56.5% of industry funded trial records. Although a drug name or company serial number was almost always provided, other drug intervention specifics were often omitted from registration. Of 3643 reported outcomes, 34.9% were specific measures with a meaningful time frame. CONCLUSIONS: Clinical trials registration has the potential to contribute substantially to improving clinical trial transparency and reducing publication bias and selective reporting. These potential benefits are currently undermined by deficiencies in the provision of information in key areas of registered records

Association of trial registration with the results and conclusions of published trials of new oncology drugs

<p>Abstract</p> <p>Background</p> <p>Registration of clinical trials has been introduced largely to reduce bias toward statistically significant results in the trial literature. Doubts remain about whether advance registration alone is an adequate measure to reduce selective publication, selective outcome reporting, and biased design. One of the first areas of medicine in which registration was widely adopted was oncology, although the bulk of registered oncology trials remain unpublished. The net influence of registration on the literature remains untested. This study compares the prevalence of favorable results and conclusions among published reports of registered and unregistered randomized controlled trials of new oncology drugs.</p> <p>Methods</p> <p>We conducted a cross-sectional study of published original research articles reporting clinical trials evaluating the efficacy of drugs newly approved for antimalignancy indications by the United States Food and Drug Administration (FDA) from 2000 through 2005. Drugs receiving first-time approval for indications in oncology were identified using the FDA web site and Thomson Centerwatch. Relevant trial reports were identified using PubMed and the Cochrane Library. Evidence of advance trial registration was obtained by a search of clinicaltrials.gov, WHO, ISRCTN, NCI-PDQ trial databases and corporate trial registries, as well as articles themselves. Data on blinding, results for primary outcomes, and author conclusions were extracted independently by two coders. Univariate and multivariate logistic regression identified associations between favorable results and conclusions and independent variables including advance registration, study design characteristics, and industry sponsorship.</p> <p>Results</p> <p>Of 137 original research reports from 115 distinct randomized trials assessing 25 newly approved drugs for treating cancer, the 54 publications describing data from trials registered prior to publication were as likely to report statistically significant efficacy results and reach conclusions favoring the test drug (for results, OR = 1.77; 95% CI = 0.87 to 3.61) as reports of trials not registered in advance. In multivariate analysis, reports of prior registered trials were again as likely to favor the test drug (OR = 1.29; 95% CI = 0.54 to 3.08); large sample sizes and surrogate outcome measures were statistically significant predictors of favorable efficacy results at p < 0.05. Subgroup analysis of the main reports from each trial (n = 115) similarly indicated that registered trials were as likely to report results favoring the test drug as trials not registered in advance (OR = 1.11; 95% CI = 0.44 to 2.80), and also that large trials and trials with nonstringent blinding were significantly more likely to report results favoring the test drug.</p> <p>Conclusions</p> <p>Trial registration alone, without a requirement for full reporting of research results, does not appear to reduce a bias toward results and conclusions favoring new drugs in the clinical trials literature. Our findings support the inclusion of full results reporting in trial registers, as well as protocols to allow assessment of whether results have been completely reported.</p