'Trial Exegesis': Methods for Synthesizing Clinical and Patient Reported Outcome (PRO) Data in Trials to Inform Clinical Practice:A Systematic Review

PURPOSE:The CONSORT extension for patient reported outcomes (PROs) aims to improve reporting, but guidance on the optimal integration with clinical data is lacking. This study examines in detail the reporting of PROs and clinical data from randomized controlled trials (RCTs) in gastro-intestinal cancer to inform design and reporting of combined PRO and clinical data from trials to improve the 'take home' message for clinicians to use in practice. MATERIALS AND METHODS:The case study was undertaken in gastro-intestinal cancer trials. Well-conducted RCTs reporting PROs with validated instruments were identified and categorized into those combining PRO and clinical data in a single paper, or those separating data into linked primary and supplemental papers. Qualitative methods were developed to examine reporting of the critical interpretation of the trial results (trial exegesis) in the papers in relation of the PRO and clinical outcomes and applied to each publication category. Results were used to inform recommendations for practice. RESULTS:From 1917 screened abstracts, 49 high quality RCTs were identified reported in 36 combined and 15 linked primary and supplemental papers. In-depth analysis of manuscript text identified three categories for understanding trial exegesis: where authors reported a "detailed", "general", or absent PRO rationale and integrated interpretation of clinical and PRO results. A total of 11 (30%) and 6 (16%) combined papers reported "detailed" PRO rationale and integrated interpretation of results although only 2 (14%) and 1 (7%) primary papers achieved the same standard respectively. Supplemental papers provide better information with 11 (73%) and 3 (20%) achieving "detailed" rationale and integrated interpretation of results. Supplemental papers, however, were published a median of 20 months after the primary RCT data in lower impact factor journals (median 16.8 versus 5.2). CONCLUSION:It is recommended that single papers, with detailed PRO rationale and integrated PRO and clinical data are published to optimize trial exegesis. Further work to examine whether this improves the use of PRO data to inform practice is needed

Three nested randomized controlled trials of peer only or multiple stakeholder group feedback within Delphi surveys during core outcome and information set development

Top 10 items rated essential in round 1. (DOCX 17 kb

Developing core outcomes sets: methods for identifying and including patient-reported outcomes (PROs)

BACKGROUND: Synthesis of patient-reported outcome (PRO) data is hindered by the range of available PRO measures (PROMs) composed of multiple scales and single items with differing terminology and content. The use of core outcome sets, an agreed minimum set of outcomes to be measured and reported in all trials of a specific condition, may improve this issue but methods to select core PRO domains from the many available PROMs are lacking. This study examines existing PROMs and describes methods to identify health domains to inform the development of a core outcome set, illustrated with an example. METHODS: Systematic literature searches identified validated PROMs from studies evaluating radical treatment for oesophageal cancer. PROM scale/single item names were recorded verbatim and the frequency of similar names/scales documented. PROM contents (scale components/single items) were examined for conceptual meaning by an expert clinician and methodologist and categorised into health domains. A patient advocate independently checked this categorisation. RESULTS: Searches identified 21 generic and disease-specific PROMs containing 116 scales and 32 single items with 94 different verbatim names. Identical names for scales were repeatedly used (for example, ‘physical function’ in six different measures) and others were similar (overlapping face validity) although component items were not always comparable. Based on methodological, clinical and patient expertise, 606 individual items were categorised into 32 health domains. CONCLUSION: This study outlines a methodology for identifying candidate PRO domains from existing PROMs to inform a core outcome set to use in clinical trials

Impact of question order on prioritisation of outcomes in the development of a core outcome set:A randomised controlled trial

Abstract Background Core outcome set (COS) developers increasingly employ Delphi surveys to elicit stakeholders’ opinions of which outcomes to measure and report in trials of a particular condition or intervention. Research outside of Delphi surveys and COS development demonstrates that question order can affect response rates and lead to ‘context effects’, where prior questions determine an item’s meaning and influence responses. This study examined the impact of question order within a Delphi survey for a COS for oesophageal cancer surgery. Methods A randomised controlled trial was nested within the Delphi survey. Patients and health professionals were randomised to receive a survey including clinical and patient-reported outcomes (PROs), where the PRO section appeared first or last. Participants rated (1–9) the importance of 68 items for inclusion in a COS (ratings 7–9 considered ‘essential’). Analyses considered the impact of question order on: (1) survey response rates; (2) participants’ responses; and (3) items retained at end of the survey. Results In total, 116 patients and 71 professionals returned completed surveys. Question order did not affect response rates among patients, but fewer professionals responded when clinical items appeared first (difference = 31.3%, 95% confidence interval [CI] = 13.6–48.9%, P = 0.001). Question order led to different context effects within patients and professionals. While patients rated clinical items highly, irrespective of question order, more PROs were rated essential when appearing last rather than first (difference = 23.7%, 95% CI = 10.5–40.8%). Among professionals, the greatest impact was on clinical items; a higher percentage rated essential when appearing last (difference = 11.6%, 95% CI = 0.0–23.3%). An interaction between question order and the percentage of PRO/clinical items rated essential was observed for patients (P = 0.025) but not professionals (P = 0.357). Items retained for further consideration at the end of the survey were dependent on question order, with discordant items (retained by one question order group only) observed in patients (18/68 [26%]) and professionals (20/68 [29%]). Conclusions In the development of a COS, participants’ ratings of potential outcomes within a Delphi survey depend on the context (order) in which the outcomes are asked, consequently impacting on the final COS. Initial piloting is recommended with consideration of the randomisation of items in the survey to reduce potential bias. Trial registration The randomised controlled trial reported within this paper was nested within the development of a core outcome set to investigate processes in core outcome set development. Outcomes were not health-related and trial registration was not therefore applicable