Impact of question order on prioritisation of outcomes in the development of a core outcome set: a randomised controlled trial

BACKGROUND: Core outcome set (COS) developers increasingly employ Delphi surveys to elicit stakeholders' opinions of which outcomes to measure and report in trials of a particular condition or intervention. Research outside of Delphi surveys and COS development demonstrates that question order can affect response rates and lead to 'context effects', where prior questions determine an item's meaning and influence responses. This study examined the impact of question order within a Delphi survey for a COS for oesophageal cancer surgery. METHODS: A randomised controlled trial was nested within the Delphi survey. Patients and health professionals were randomised to receive a survey including clinical and patient-reported outcomes (PROs), where the PRO section appeared first or last. Participants rated (1-9) the importance of 68 items for inclusion in a COS (ratings 7-9 considered 'essential'). Analyses considered the impact of question order on: (1) survey response rates; (2) participants' responses; and (3) items retained at end of the survey. RESULTS: In total, 116 patients and 71 professionals returned completed surveys. Question order did not affect response rates among patients, but fewer professionals responded when clinical items appeared first (difference = 31.3%, 95% confidence interval [CI] = 13.6-48.9%, P = 0.001). Question order led to different context effects within patients and professionals. While patients rated clinical items highly, irrespective of question order, more PROs were rated essential when appearing last rather than first (difference = 23.7%, 95% CI = 10.5-40.8%). Among professionals, the greatest impact was on clinical items; a higher percentage rated essential when appearing last (difference = 11.6%, 95% CI = 0.0-23.3%). An interaction between question order and the percentage of PRO/clinical items rated essential was observed for patients (P = 0.025) but not professionals (P = 0.357). Items retained for further consideration at the end of the survey were dependent on question order, with discordant items (retained by one question order group only) observed in patients (18/68 [26%]) and professionals (20/68 [29%]). CONCLUSIONS: In the development of a COS, participants' ratings of potential outcomes within a Delphi survey depend on the context (order) in which the outcomes are asked, consequently impacting on the final COS. Initial piloting is recommended with consideration of the randomisation of items in the survey to reduce potential bias. TRIAL REGISTRATION: The randomised controlled trial reported within this paper was nested within the development of a core outcome set to investigate processes in core outcome set development. Outcomes were not health-related and trial registration was not therefore applicable

Progression criteria in trials with an internal pilot : an audit of publicly funded randomised controlled trials

Background With millions of pounds spent annually on medical research in the UK, it is important that studies are spending funds wisely. Internal pilots offer the chance to stop a trial early if it becomes apparent that the study will not be able to recruit enough patients to show whether an intervention is clinically effective. This study aims to assess the use of internal pilots in individually randomised controlled trials funded by the Health Technology Assessment (HTA) programme and to summarise the progression criteria chosen in these trials. Methods Studies were identified from reports of the HTA committees’ funding decisions from 2012 to 2016. In total, 242 trials were identified of which 134 were eligible to be included in the audit. Protocols for the eligible studies were located on the NIHR Journals website, and if protocols were not available online then study managers were contacted to provide information. Results Over two-thirds (72.4%) of studies said in their protocol that they would include an internal pilot phase for their study and 37.8% of studies without an internal pilot had done an external pilot study to assess the feasibility of the full study. A typical study with an internal pilot has a target sample size of 510 over 24 months and aims to recruit one-fifth of their total target sample size within the first one-third of their recruitment time. There has been an increase in studies adopting a three-tiered structure for their progression rules in recent years, with 61.5% (16/26) of studies using the system in 2016 compared to just 11.8% (2/17) in 2015. There was also a rise in the number of studies giving a target recruitment rate in their progression criteria: 42.3% (11/26) in 2016 compared to 35.3% (6/17) in 2015. Conclusions Progression criteria for an internal pilot are usually well specified but targets vary widely. For the actual criteria, red/amber/green systems have increased in popularity in recent years. Trials should justify the targets they have set, especially where targets are low

Developing a real-time electronic symptom monitoring system for patients after discharge following cancer-related surgery

Background: Patients undergoing major cancer surgery frequently require post-acute care for complications and adverse effects. Enhanced recovery after surgery programmes mean that patients are increasingly discharged home earlier. Symptom/complication detection post-discharge is sub-optimal. Systematic patient monitoring post-discharge following surgery may be optimally achieved through routine electronic patient-reported outcome (ePRO) data capture. ePRO systems that employ clinical algorithms to guide management of patients and automatically alert clinicians of clinically-concerning symptoms can improve patient outcomes and decrease hospital admissions. ePRO systems that provide individually-tailored self-management advice and integrate live ePRO data into electronic health records (EHR) may also advance personalised health and patient-centred care. This study aims to develop a hospital EHR-integrated ePRO system to improve detection and management of complications post-discharge following cancer-related surgery. Methods: The ePRO system was developed in two phases: (1) Development of a web-based ePRO symptom-report from validated European Organisation for Research and Treatment of Cancer (EORTC) questionnaires, clinical opinion and patient interviews, followed by hospital EHR integration; (2) Development of clinical algorithms triggering symptom severity-dependent patient advice and clinician alerts from: (i) prospectively-collected patient-completed ePRO symptom-report data; (ii) stakeholder meetings; (iii) patient interviews. Patient advice was developed from: (i) clinician-patient telephone consultations and patient interviews; (ii) review of hospital patient information leaflets (PIL) and patient support websites. Results: Phase 1, including interviews with 18 patients, identified 35 symptom-report items. In phase 2, 130/300 (43%) screened patients were eligible. 61 (47%) consented to participate and 59 (97%) provided 444 complete self-reports. Stakeholder meetings (9 clinicians, 1 patient/public representative) and patient interviews (n = 66) refined advice/alert accuracy. 15 telephone consultations, 7 patient interviews and review of 28 PILs and 3 patient support websites identified 4 themes to inform self-management advice. Comparisons between ePRO symptom-report data, telephone consultations and clinical events/outcomes (n = 27 patients) further refined clinical algorithms. Conclusions: A hospital EHR-integrated ePRO system that alerts clinicians and provides patient self-management advice has been developed to improve the detection and management of problems and complications after discharge following surgery. An ongoing pilot study will inform a multicentre randomised trial to evaluate the effectiveness of the ePRO system compared to usual care

A real-time electronic symptom monitoring system for patients after discharge following surgery: a pilot study in cancer-related surgery

Background: Advances in peri-operative care of surgical oncology patients result in shorter hospital stays. Earlier discharge may bring benefits, but complications can occur while patients are recovering at home. Electronic patient-reported outcome (ePRO) systems may enhance remote, real-time symptom monitoring and detection of complications after hospital discharge, thereby improving patient safety and outcomes. Evidence of the effectiveness of ePRO systems in surgical oncology is lacking. This pilot study evaluated the feasibility of a real-time electronic symptom monitoring system for patients after discharge following cancer-related upper gastrointestinal surgery. Methods: A pilot study in two UK hospitals included patients who had undergone cancer-related upper gastrointestinal surgery. Participants completed the ePRO symptom-report at discharge, twice in the first week and weekly post-discharge. Symptom-report completeness, system actions, barriers to using the ePRO system and technical performance were examined. The ePRO surgery system is an online symptom-report that allows clinicians to view patient symptom-reports within hospital electronic health records and was developed as part of the eRAPID project. Clinically derived algorithms provide patients with tailored self-management advice, prompts to contact a clinician or automated clinician alerts depending on symptom severity. Interviews with participants and clinicians determined the acceptability of the ePRO system to support patients and their clinical management during recovery. Results: Ninety-one patients were approached, of which 40 consented to participate (27 male, mean age 64 years). Symptom-report response rates were high (range 63–100%). Of 197 ePRO completions analysed, 76 (39%) triggered self-management advice, 72 (36%) trigged advice to contact a clinician, 9 (5%) triggered a clinician alert and 40 (20%) did not require advice. Participants found the ePRO system reassuring, providing timely information and advice relevant to supporting their recovery. Clinicians regarded the system as a useful adjunct to usual care, by signposting patients to seek appropriate help and enhancing their understanding of patients’ experiences during recovery. Conclusion: Use of the ePRO system for the real-time, remote monitoring of symptoms in patients recovering from cancer-related upper gastrointestinal surgery is feasible and acceptable. A definitive randomised controlled trial is needed to evaluate the impact of the system on patients’ wellbeing after hospital discharge

Associations between an Obesity Related Genetic Variant (FTO rs9939609) and Prostate Cancer Risk

Observational studies suggest that obese men have a lower risk of incident prostate cancer, but an increased risk of advanced and fatal cancers. These observations could be due to confounding, detection bias, or a biological effect of obesity. Genetic studies are less susceptible to confounding than observational epidemiology and can suggest how associations between phenotypes (such as obesity) and diseases arise. To determine whether the associations between obesity and prostate cancer are causal, we conducted a genetic association study of the relationship between a single nucleotide polymorphism known to be associated with obesity (FTO rs9939609) and prostate cancer. Data are from a population-based sample of 1550 screen-detected prostate cancers, 1815 age- and general practice matched controls with unrestricted prostate specific antigen (PSA) values and 1175 low-PSA controls (PSA <0.5 ng/ml). The rs9939609 A allele, which was associated with higher BMI in the sample, was inversely associated with overall (odds ratio (OR) versus all controls  = 0.93; 95% confidence interval (CI): 0.85–1.02 p = 0.12 per allele) and low-grade (OR = 0.90; 0.81–0.99 p = 0.03 per allele) prostate cancer risk, but positively associated with high-grade cancer among cases (OR high- versus low-grade cancer  = 1.16; 0.99–1.37 p = 0.07 per allele). Although evidence for these effects was weak, they are consistent with observational data based on BMI phenotypes and suggest that the observed association between obesity and prostate cancer is not due to confounding. Further research should confirm these findings, extend them to other BMI-related genetic variants and determine whether they are due to detection bias or obesity-related hormonal changes

A Randomised controlled trial of Energetic Activity for Depression in Young people (READY): A multi-site feasibility trial protocol

Background: Prevalence of depression is increasing in young people, and there is a need to develop and evaluate behavioural interventions which may provide benefits equal to or greater than talking therapies or pharmacological alternatives. Exercise could be beneficial for young people living with depression, but robust, large-scale trials of effectiveness and the impact of exercise intensity are lacking. This study aims to test whether a randomised controlled trial (RCT) of an intervention targeting young people living with depression is feasible by determining whether it is possible to recruit and retain young people, develop and deliver the intervention as planned, and evaluate training and delivery. Methods: The design is a three-arm cluster randomised controlled feasibility trial with embedded process evaluation. Participants will be help-seeking young people, aged 13–17 years experiencing mild to moderate low mood or depression, referred from three counties in England. The intervention will be delivered by registered exercise professionals, supported by mental health support workers, twice a week for 12 weeks. The three arms will be high-intensity exercise, low-intensity exercise, and a social activity control. All arms will receive a ‘healthy living’ behaviour change session prior to each exercise session and the two exercise groups are energy matched. The outcomes are referral, recruitment, and retention rates; attendance at exercise sessions; adherence to and ability to reach intensity during exercise sessions; proportions of missing data; adverse events, all measured at baseline, 3, and 6 months; resource use; and reach and representativeness. Discussion: UK National Health Service (NHS) policy is to provide young people with advice about using exercise to help depression but there is no evidence-based exercise intervention to either complement or as an alternative to medication or talking therapies. UK National Institute for Health and Care Excellence (NICE) guidelines suggest that exercise can be an effective treatment, but the evidence base is relatively weak. This feasibility trial will provide evidence about whether it is feasible to recruit and retain young people to a full RCT to assess the effectiveness and cost-effectiveness of an exercise intervention for depression. Trial registration: ISRCTN, ISRCTN66452702. Registered 9 April 2020

Patient-reported outcomes in the ProtecT randomized trial of clinically localized prostate cancer treatments: Study design, and baseline urinary, bowel and sexual function and quality of life

Objectives: To present the baseline patient-reported outcome measures (PROMs) in the Prostate Testing for Cancer and Treatment (ProtecT) randomized trial comparing active monitoring, radical prostatectomy and external-beam conformal radiotherapy for localized prostate cancer and to compare results with other populations. Materials and Methods: A total of 1643 randomized men, aged 50-69 years and diagnosed with clinically localized disease identified by prostate-specific antigen (PSA) testing, in nine UK cities in the period 1999-2009 were included. Validated PROMs for disease-specific (urinary, bowel and sexual function) and condition-specific impact on quality of life (Expanded Prostate Index Composite [EPIC], 2005 onwards; International Consultation on Incontinence Questionnaire-Urinary Incontinence [ICIQ-UI], 2001 onwards; the International Continence Society short-form male survey [ICSmaleSF]; anxiety and depression (Hospital Anxiety and Depression Scale [HADS]), generic mental and physical health (12-item short-form health survey [SF-12]; EuroQol quality-of-life survey, the EQ-5D-3L) were assessed at prostate biopsy clinics before randomization. Descriptive statistics are presented by treatment allocation and by men's age at biopsy and PSA testing time points for selected measures. Results: A total of 1438 participants completed biopsy questionnaires (88%) and 77-88% of these were analysed for individual PROMs. Fewer than 1% of participants were using pads daily (5/754). Storage lower urinary tract symptoms were frequent (e.g. nocturia 22%, 312/1423). Bowel symptoms were rare, except for loose stools (16%, 118/754). One third of participants reported erectile dysfunction (241/735) and for 16% (118/731) this was a moderate or large problem. Depression was infrequent (80/1399, 6%) but 20% of participants (278/1403) reported anxiety. Sexual function and bother were markedly worse in older men (65-70 years), whilst urinary bother and physical health were somewhat worse than in younger men (49-54 years, all P < 0.001). Bowel health, urinary function and depression were unaltered by age, whilst mental health and anxiety were better in older men (P < 0.001). Only minor differences existed in mental or physical health, anxiety and depression between PSA testing and biopsy assessments. Conclusion: The ProtecT trial baseline PROMs response rates were high. Symptom frequencies and generic quality of life were similar to those observed in populations screened for prostate cancer and control subjects without cancer