Development of a standardised set of metrics for monitoring site performance in multicentre randomised trials : a Delphi study

Funding This study was supported by an NIHR Clinical Trials Unit Support Funding grant for supporting efficient and innovative delivery of NIHR research. The views expressed are those of the authors and not necessarily those of the National Health Service, the NIHR or the Department of Health and Social Care. The Health Services Research Unit, University of Aberdeen, receives core funding from the Chief Scientist Office of the Scottish Government Health Directorates. The study was not registered. Availability of data and materials The data generated or analysed during the current study are included in this published article (and its supplementary information files). Additional information is available from the corresponding author on reasonable request.Peer reviewedPublisher PD

Development of a standardised set of metrics for monitoring site performance in multicentre randomised trials: a Delphi study

BackgroundSite performance is key to the success of large multicentre randomised trials. A standardised set of clear and accessible summaries of site performance could facilitate the timely identification and resolution of potential problems, minimising their impact.The aim of this study was to identify and agree a core set of key performance metrics for managing multicentre randomised trials.MethodsWe used a mixed methods approach to identify potential metrics and to achieve consensus about the final set, adapting methods that are recommended by the COMET Initiative for developing core outcome sets in health care.We used performance metrics identified from our systematic search and focus groups to create an online Delphi survey. We invited respondents to score each metric for inclusion in the final core set, over three survey rounds. Metrics scored as critical by ≥70% and unimportant by 50% of participants voting for inclusion were retained.ResultsRound 1 of the Delphi survey presented 28 performance metrics, and a further six were added in round 2. Of 294 UK-based stakeholders who registered for the Delphi survey, 211 completed all three rounds.At the consensus meeting, 17 metrics were discussed and voted on: 15 metrics were retained following survey round 3, plus two others that were preferred by consensus meeting participants. Consensus was reached on a final core set of eight performance metrics in three domains: (1) recruitment and retention, (2) data quality and (3) protocol compliance. A simple tool for visual reporting of the metrics is available from the Nottingham Clinical Trials Unit website.ConclusionsWe have established a core set of metrics for measuring the performance of sites in multicentre randomised trials. These metrics could improve trial conduct by enabling researchers to identify and address problems before trials are adversely affected. Future work could evaluate the effectiveness of using the metrics and reporting tool

An investigation of the mechanisms underpinning the association of p-glycoprotein with resistant disease in acute myeloid leukaemia

EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Monitoring performance of sites within multicentre randomised trials: a systematic review of performance metrics

Abstract Background Large multicentre trials are complex and expensive projects. A key factor for their successful planning and delivery is how well sites meet their targets in recruiting and retaining participants, and in collecting high-quality, complete data in a timely manner. Collecting and monitoring easily accessible data relevant to performance of sites has the potential to improve trial management efficiency. The aim of this systematic review was to identify metrics that have either been proposed or used for monitoring site performance in multicentre trials. Methods We searched the Cochrane Library, five biomedical bibliographic databases (CINAHL, EMBASE, Medline, PsychINFO and SCOPUS) and Google Scholar for studies describing ways of monitoring or measuring individual site performance in multicentre randomised trials. Records identified were screened for eligibility. For included studies, data on study content were extracted independently by two reviewers, and disagreements resolved by discussion. Results After removing duplicate citations, we identified 3188 records. Of these, 21 were eligible for inclusion and yielded 117 performance metrics. The median number of metrics reported per paper was 8, range 1–16. Metrics broadly fell into six categories: site potential; recruitment; retention; data collection; trial conduct and trial safety. Conclusions This review identifies a list of metrics to monitor site performance within multicentre randomised trials. Those that would be easy to collect, and for which monitoring might trigger actions to mitigate problems at site level, merit further evaluation

Resistance to spontaneous apoptosis in acute myeloid leukaemia blasts is associated with p-glycoprotein expression and function, but not with the presence of FLT3 internal tandem duplications

The ability of acute myeloid leukaemia (AML) blasts to survive in culture has been associated with poor patient response to chemotherapy. Other biological factors predicting an adverse outcome include p-glycoprotein (pgp) expression, which is associated with a reduced remission rate, and the presence of fms-like tyrosine kinase 3 gene (FLT3) internal tandem duplications (ITDs), predictive of a high rate of leukaemic relapse. Our previous work has indicated a drug efflux-independent role for pgp in apoptosis resistance. We measured spontaneous in vitro apoptosis in 58 primary AML samples to establish its relationship with functional and phenotypic pgp and with FLT3 ITDs. Cells were incubated for 48 h in a suspension culture, and the remaining viable cells were counted by flow cytometry. Median survival was 38% of baseline values. Resistance to spontaneous apoptosis was strongly associated with pgp (MRK-16 antibody) expression (P = 0·001) and with pgp functional activity (P < 0·001). FLT3 ITDs, found in 20 cases, were inversely associated with functional pgp activity: thus, the median pgp modulation ratio was 2·0 in FLT3 wild-type cases and 1·38 in ITD cases (P = 0·018). Also, the presence of FLT3 ITDs was not associated with in vitro apoptosis resistance. In conclusion, we have found that the presence of FLT3 ITDs is not related to AML blast survival in vitro, and is inversely associated with pgp activity, whereas pgp expression and activity are associated with resistance to spontaneous apoptosis. These results may help to explain the differing adverse effects of pgp (on remission induction) and FLT3 ITDs (on relapse) in AML