Application of methods for central statistical monitoring in clinical trials

Background On-site source data verification is a common and expensive activity, with little evidence that it is worthwhile. Central statistical monitoring (CSM) is a cheaper alternative, where data checks are performed by the coordinating centre, avoiding the need to visit all sites. Several publications have suggested methods for CSM; however, few have described their use in real trials. Methods R-programs were created to check data at either the subject level (7 tests within 3 programs) or site level (9 tests within 8 programs) using previously described methods or new ones we developed. These aimed to find possible data errors such as outliers, incorrect dates, or anomalous data patterns; digit preference, values too close or too far from the means, unusual correlation structures, extreme variances which may indicate fraud or procedural errors and under-reporting of adverse events. The methods were applied to three trials, one of which had closed and has been published, one in follow-up, and a third to which fabricated data were added. We examined how well the methods work, discussing their strengths and limitations. Results The R-programs produced simple tables or easy-to-read figures. Few data errors were found in the first two trials, and those added to the third were easily detected. The programs were able to identify patients with outliers based on single or multiple variables. They also detected (1) fabricated patients, generated to have values too close to the multivariate mean, or with too low variances in repeated measurements, and (2) sites which had unusual correlation structures or too few adverse events. Some methods were unreliable if applied to centres with few patients or if data were fabricated in a way which did not fit the assumptions used to create the programs. Outputs from the R-programs are interpreted using examples. Limitations Detecting data errors is relatively straightforward; however, there are several limitations in the detection of fraud: some programs cannot be applied to small trials or to centres with few patients (<10) and data falsified in a manner which does not fit the program’s assumptions may not be detected. In addition, many tests require a visual assessment of the output (showing flagged participants or sites), before data queries are made or on-site visits performed. Conclusions CSM is a worthwhile alternative to on-site data checking and may be used to limit the number of site visits by targeting only sites which are picked up by the programs. We summarise the methods, show how they are implemented and that they can be easy to interpret. The methods can identify incorrect or unusual data for a trial subject, or centres where the data considered together are too different to other centres and therefore should be reviewed, possibly through an on-site visit

Developing a disease prevention strategy in the Caribbean: the importance of assessing animal health related risks at the regional level

In 2009, the Caribbean Animal Health Network (CaribVET) conducted a survey among Caribbean national Veterinary Services to assess perceptions towards the use of risk assessment (RA) by animal health services in the region and to identify the main exotic diseases of concern in the region and their means of introduction. The results showed that the introduction of live animals was considered the most likely route of introduction of exotic animal pathogens into the region, followed by the informal introduction of animal products by boat passengers. The use of RA was considered important (in descending order): (1) to avoid or reduce contamination of the human food chain (food safety); (2) to identify vulnerability factors for potential impact of emerging (exotic) and re-emerging diseases in order to improve emergency plans; (3) to prevent the introduction of exotic diseases through live animals for trade; and (4) to identify high-risk areas for introduction of exotic diseases. The diseases considered by the countries/territories with a highest introduction risk were Highly pathogenic avian influenza (16), Foot and mouth disease (10), Rabies (9), Newcastle disease (7) and Classical swine fever (6). The results were used to define a regional strategy for assessing animal health risks that highlights the importance of intra-regional exchanges. (Texte intégral

A potential new enriching trial design for selecting non-small-cell lung cancer patients with no predictive biomarker for trials based on both histology and early tumor response: further analysis of a thalidomide trial

There are few predictive biomarkers for antiangiogenic trials in lung cancer. We examine a potential treatment strategy in which a patient group is enriched using both histology and an early assessment of response during standard chemotherapy, and where a new agent is given for the remainder of chemotherapy and as maintenance. We performed a retrospective analysis of 722 stage IIIB/IV non-small-cell lung cancer patients from a double-blind placebo-controlled trial of thalidomide or placebo 100-200 mg/day, combined with gemcitabine/carboplatin (for up to four cycles), then given as single agent maintenance therapy. There was a significant statistical interaction between treatment and histology, with a possible benefit among squamous cell cancer (SCC) patients. We examined 150 SCC patients who were "nonprogressors" (stable disease or complete/partial response) after completing the second chemotherapy cycle. Endpoints were progression-free survival (PFS) and overall survival (OS). Among the 150 patients nonprogressors after cycle 2 (thalidomide, n = 72; placebo, n = 78; baseline characteristics were similar), the hazard ratios (HRs) were: OS = 0.76 (95% CI: 0.54-1.07) and PFS = 0.69 (95% CI: 0.50-0.97). In 57 patients who had a complete/partial response, the HRs were: OS = 0.63 (95% CI: 0.34-1.15) and PFS = 0.50 (95% CI: 0.28-0.88). SCC patients who were nonprogressors after 2 cycles of standard chemotherapy showed evidence of a benefit from thalidomide when taken for the remainder of chemotherapy and as maintenance. This strategy based on histology and, importantly, early assessment of tumor response, as a means of patient enrichment, could be examined in other lung cancer studies. Such an approach might be suitable for trials where there are no predictive biomarkers

Smaller sample sizes for phase II trials based on exact tests with actual error rates by trading-off their nominal levels of significance and power

Background: Sample sizes for single-stage phase II clinical trials in the literature are often based on exact (binomial) tests with levels of significance (alpha (α) 80%). This is because there is not always a sample size where α and power are exactly equal to 5% and 80%, respectively. Consequently, the opportunity to trade-off small amounts of α and power for savings in sample sizes may be lost. Methods: Sample-size tables are presented for single-stage phase II trials based on exact tests with actual levels of significance and power. Trade-off in small amounts of α and power allows the researcher to select from several possible designs with potentially smaller sample sizes compared with existing approaches. We provide SAS macro coding and an R function, which for a given treatment difference, allow researchers to examine all possible sample sizes for specified differences are provided. Results: In a single-arm study with P0 (standard treatment)=10% and P1 (new treatment)=20%, and specified α=5% and power=80%, the A’Hern approach yields n=78 (exact α=4.53%, power=80.81%). However, by relaxing α to 5.67% and power to 77.7%, a sample size of 65 can be used (a saving of 13 patients). Interpretation: The approach we describe is especially useful for trials in rare disorders, or for proof-of-concept studies, where it is important to minimise the trial duration and financial costs, particularly in single-arm cancer trials commonly associated with expensive treatment options

Research in progress—LungSEARCH: a randomised controlled trial of surveillance for the early detection of lung cancer in a high-risk group

Abstract Low-dose CT screening for lung cancer is effective but expensive. Therefore, cheaper or more focused screening strategies may be required. LungSEARCH is a randomised prospective trial of 1568 high-risk individuals (ie, current or former moderate to heavy smokers with mild/moderate COPD) who undergo either annual sputum cytology/cytometry testing or no screening. Those with abnormal sputum then receive annual CT and fluorescent bronchoscopy for the remainder of 5 years, to identify early stage lung cancer. It is hoped that these simple initial tests could identify those requiring expensive CT scans, and the aim is to demonstrate a stage shift towards early stage cancers. Trial registration numbers ISRCTN: ISRCTN80745975, clinicaltrials.gov: NCT00512746

Smaller sample sizes for phase II trials based on exact tests with actual error rates by trading-off their nominal levels of significance and power

This work is published under the standard license to publish agreement. After 12 months the work will become freely available and the license terms will switch to a Creative Commons Attribution-NonCommercial-Share Alike 3.0 Unported License

Building capacities in Caribbean animal health in the : The VEP (Veterinary Epidemiologist / Para-Epidemiologist) Project

Disease surveillance and control within the Caribbean has historically been difficult. The region is made up of over 31 countries, territories, and protectorates, with concomitant differences in language, culture, and historical experiences. Given the diversity of challenges the region faces in terms of disease introduction and spread, there is a need for longer-term, sustainable training in epidemiology, surveillance, and emergency response. The Veterinary Epidemiology/Para-epidemiology Project (VEP) was a four-year, capacity-building project conducted in 9 countries in the Caribbean region: Antigua and Barbuda, Barbados, Dominica, Dominican Republic, Grenada, Haiti, St. Lucia, St. Kitts and Nevis, and St. Vincent and the Grenadines. Project participants (10) received training in 7 key domains: epidemiologic methods, disease surveillance, diagnostic tests and sample handling, emergency preparedness and response, data management, communication and coordination, and management and leadership. Both didactic and hands-on trainings were emphasized, and all participants were required to complete an epidemiologic study in their respective countries. Project participants were mentored by experienced epidemiologists in the design and implementation of their studies. Lessons learned were identified which contributed to the success of the project overall. Coordination of the technical component of the project through the regional network for animal health, CaribVET, ensured that the project had both national and regional relevancy. Although costly, the VEP brought the participants together frequently and provided opportunities to build relationships, which strengthened cross-border communication and collaboration in the region overall. (Texte intégral

Life expectancy difference and life expectancy ratio: two measures of treatment effects in randomised trials with non-proportional hazards

The hazard ratio (HR) is the most common measure of treatment effect in clinical trials that use time-to-event outcomes such as survival. When survival curves cross over or separate only after a considerable time, the proportional hazards assumption of the Cox model is violated, and HR can be misleading. We present two measures of treatment effects for situations where the HR changes over time: the life expectancy difference (LED) and life expectancy ratio (LER). LED is the difference between mean survival times in the intervention and control arms. LER is the ratio of these two times. LED and LER can be calculated for at least two time intervals during the trial, allowing for curves where the treatment effect changes over time. The two measures are readily interpretable as absolute and relative gains or losses in life expectancy

Publishing interim results of randomised clinical trials in peer-reviewed journals

Background: Interim analyses of randomised controlled trials are sometimes published before the final results are available. In several cases, the treatment effects were noticeably different after patient recruitment and follow-up completed. We therefore conducted a literature review of peer-reviewed journals to compare the reported treatment effects between interim and final publications and to examine the magnitude of the difference. Methods: We performed an electronic search of MEDLINE from 1990 to 2014 (keywords: ‘clinical trial’ OR ‘clinical study’ AND ‘random*’ AND ‘interim’ OR ‘preliminary’), and we manually identified the corresponding final publication. Where the electronic search produced a final report in which the abstract cited interim results, we found the interim publication. We also manually searched every randomised controlled trial in eight journals, covering a range of impact factors and general medical and specialist publications (1996–2014). All paired articles were checked to ensure that the same comparison between interventions was available in both. Results: In all, 63 studies are included in our review, and the same quantitative comparison was available in 58 of these. The final treatment effects were smaller than the interim ones in 39 (67%) trials and the same size or larger in 19 (33%). There was a marked reduction, defined as a ≥20% decrease in the size of the treatment effect from interim to final analysis, in 11 (19%) trials compared to a marked increase in 3 (5%), p = 0.057. The magnitude of percentage change was larger in trials where commercial support was reported, and increased as the proportion of final events at the interim report decreased in trials where commercial support was reported (interaction p = 0.023). There was no evidence of a difference between trials that stopped recruitment at the interim analysis where this was reported as being pre-specified versus those that were not pre-specified (interaction p = 0.87). Conclusion: Published interim trial results were more likely to be associated with larger treatment effects than those based on the final report. Publishing interim results should be discouraged, in order to have reliable estimates of treatment effects for clinical decision-making, regulatory authority reviews and health economic analyses. Our work should be expanded to include conference publications and manual searches of additional journal publications