Maximising the impact of patient-reported outcome trial results to benefit patients and society

There is an increasing need to demonstrate the return on medical research investment through benefit to patients, society and the economy. Patient-reported outcomes (PROs), such as quality of life and symptom data, are increasingly collected in clinical trials and may provide evidence, which can lead to a range of impacts. However it is unclear whether PRO impact is realised in practice. In addition, the different types of impact associated with PRO trial results, their barriers and facilitators, and appropriate impact metrics are not well defined. The doctoral research constituting this thesis adopted a mixed-methods approach with the aim of: a) synthesising existing methodological frameworks for healthcare research impact; b) determining the range of potential impacts associated with PRO data collected in trials, identifying potential PRO impact metrics and barriers and defining common facilitators to maximise PRO impact and; c) examining real-world evidence of PRO trial data impact and highlight optimal pathways to such impact. A number of studies were undertaken to address the aims. First, a systematic review of the literature identified 24 existing non-PRO-specific frameworks and over 80 impact metrics, which were then synthesised into a novel impact matrix and a simplified consolidated methodological framework for use by researchers and other stakeholders to help maximise the impact of healthcare research. Second, informed by this framework, an additional systematic review sought to determine the potential impact of PRO data collected in clinical trials and examined real world evidence of PRO trial data impact based on Research Excellence Framework (REF). This systemic review suggested that PRO trial data has the potential to inform clinical practice, clinical guidelines and, health policy; support drug approval, pricing and reimbursement decisions and; inform clinical and shared decision-making and consent for treatment. Furthermore, this second systematic review highlighted perceived methodological problems regarding the design, conduct and analysis and reporting of PRO data from clinical trials; which may hinder the impact of PRO data from clinical findings. Potential facilitators aimed at maximising PRO trial impact were also identified. The review identified 12 (n=69, 17%) REF 2014 impact case studies, which reported impact directly attributable to PRO findings. Including changes to international clinical guidelines and national guidelines, influencing cost-effectiveness analysis and drug approvals. Finally, in order to gain deeper understanding about the topics identified in the second systematic review, 24 semi-structured qualitative interviews were conducted with international stakeholders. Interviewees suggested PRO trial findings could lead to impact in the five impact categories identified in the aforementioned ‘pathways to research impact’ methodological framework. However, it was suggested that broader international stakeholder collaboration is required to tackle existing barriers and maximise the realisation of PRO trial impact on patients and society. In conclusion, this thesis has identified a range of potential impacts from PRO data which may benefit patients and society. However, a number of barriers need to be addressed to fully realise these benefits. This research highlights that the measurement of research impact, and specifically PRO research impact, is an essential exercise to better allocate limited funding, provide accountability and minimise research waste. Nonetheless, determining and implementing impact metrics is a complex task and will require greater stakeholder collaboration and engagement throughout the research pathway

Processes of change used to fulfill with the recommendations of healthy practice of Acsm

The stages and processes of change of the Transtheoretical Model have been used to design programs that facilitate exercise adherence. The stages that explain when people change refer to pre-contemplation (PC = inactive without any intention to change), contemplation (C = inactive with intention to change), preparation (P = active but not fulfilling the recommendations of the American College of Sports Medicine [ACSM]), action (A = has complied with the recommendations of the ACSM but for less than six months) and maintenance (M = has complied with the recommendations ACSM for more than six months). The processes that explain how this change occurs are divided into cognitive processes (CP), implying thoughts, attitudes and awareness, and behavioral processes (BP), which involve actions. This model suggests that the effectiveness of the change depends on doing the right things (processes) at the right moment (stage)

A systematic review assessing the quality of patient reported outcomes measures in dry eye diseases

Background: Patient-reported outcome measures (PROMs) can provide valuable insights on the impact of a disease or treatment on a patient’s health-related quality of life. In ophthalmology, particularly in dry eye disease (DED) and ocular surface disease (OSD), it is unclear whether the available PROMs were developed using comprehensive guidelines. To address this, we evaluated the methodological quality of studies assessing the psychometric properties of PROMs in DED and OSD [PROSPERO registration number CRD42019142328]. Methods: Four databases were searched; reference list and citation searching of included studies was also conducted. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist was used to appraise the quality of the studies evaluating the psychometric properties of PROMs used in DED and OSD. Results: The search strategy (S3 Table) retrieved 5,761 records, 573 duplicates were removed, 5,188 abstracts were screened and 127 full-text articles were retrieved for further review. Of these, 118 full-text articles did not meet the eligibility criteria and were excluded. Reference list and citation searching, identified an additional 8 articles bringing the total numbers of papers reviewed to 17. In general, psychometric properties such as content validity, measurement error and structural validity were not assessed by the studies included in this review. Studies reviewing The Impact of Dry Eye on Everyday Life (IDEEL) presented with the highest quality scores together with the Ocular Surface Disease Index (OSDI) questionnaire. Conclusions: The quality of studies evaluating PROMs in DED and OSD was considered using the COSMIN standards. The majority of the studies evaluating PROMs included in this review did not meet the recommended COSMIN criteria and the quality of the PROMs evaluated is not assured. Further evaluation of their psychometric properties is required if these are going to be used in clinical practice or research

Patient-reported outcomes in integrated health and social care:A scoping review

Background: Patient-reported outcomes (PROs) have potential to support integrated health and social care research and practice; however, evidence of their utilisation has not been synthesised. Objective: To identify PRO measures utilised in integrated care and adult social care research and practice and to chart the evidence of implementation factors influencing their uptake. Design: Scoping review of peer-reviewed literature. Data sources: Six databases (01 January 2010 to 19 May 2023). Study selection: Articles reporting PRO use with adults (18+ years) in integrated care or social care settings. Review methods: We screened articles against pre-specified eligibility criteria; 36 studies (23%) were extracted in duplicate for verification. We summarised the data using thematic analysis and descriptive statistics. Results: We identified 159 articles reporting on 216 PRO measures deployed in a social care or integrated care setting. Most articles used PRO measures as research tools. Eight (5.0%) articles used PRO measures as an intervention. Articles focused on community-dwelling participants (35.8%) or long-term care home residents (23.9%), with three articles (1.9%) focussing on integrated care settings. Stakeholders viewed PROs as feasible and acceptable, with benefits for care planning, health and wellbeing monitoring as well as quality assurance. Patient-reported outcome measure selection, administration and PRO data management were perceived implementation barriers. Conclusion: This scoping review showed increasing utilisation of PROs in adult social care and integrated care. Further research is needed to optimise PROs for care planning, design effective training resources and develop policies and service delivery models that prioritise secure, ethical management of PRO data

Patient-reported outcomes in integrated health and social care:A scoping review

Background: Patient-reported outcomes (PROs) have potential to support integrated health and social care research and practice; however, evidence of their utilisation has not been synthesised. Objective: To identify PRO measures utilised in integrated care and adult social care research and practice and to chart the evidence of implementation factors influencing their uptake. Design: Scoping review of peer-reviewed literature. Data sources: Six databases (01 January 2010 to 19 May 2023). Study selection: Articles reporting PRO use with adults (18+ years) in integrated care or social care settings. Review methods: We screened articles against pre-specified eligibility criteria; 36 studies (23%) were extracted in duplicate for verification. We summarised the data using thematic analysis and descriptive statistics. Results: We identified 159 articles reporting on 216 PRO measures deployed in a social care or integrated care setting. Most articles used PRO measures as research tools. Eight (5.0%) articles used PRO measures as an intervention. Articles focused on community-dwelling participants (35.8%) or long-term care home residents (23.9%), with three articles (1.9%) focussing on integrated care settings. Stakeholders viewed PROs as feasible and acceptable, with benefits for care planning, health and wellbeing monitoring as well as quality assurance. Patient-reported outcome measure selection, administration and PRO data management were perceived implementation barriers. Conclusion: This scoping review showed increasing utilisation of PROs in adult social care and integrated care. Further research is needed to optimise PROs for care planning, design effective training resources and develop policies and service delivery models that prioritise secure, ethical management of PRO data

“Give us the tools!” - development of knowledge transfer tools to support the involvement of patient partners in the development of clinical trial protocols with patient-reported outcomes (PROs), in accordance with SPIRIT-PRO extension

Objectives (a) To adapt the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)-patient-reported outcome (PRO) Extension guidance to a user-friendly format for patient partners and (b) to codesign a web-based tool to support the dissemination and uptake of the SPIRIT-PRO Extension by patient partners.Design A 1-day patient and public involvement session.Participants Seven patient partners.Methods A patient partner produced an initial lay summary of the SPIRIT-PRO guideline and a glossary. We held a 1-day PPI session in November 2019 at the University of Birmingham. Five patient partners discussed the draft lay summary, agreed on the final wording, codesigned and agreed the final content for both tools. Two additional patient partners were involved in writing the manuscript. The study compiled with INVOLVE guidelines and was reported according to the Guidance for Reporting Involvement of Patients and the Public 2 checklist.Results Two user-friendly tools were developed to help patients and members of the public be involved in the codesign of clinical trials collecting PROs. The first tool presents a lay version of the SPIRIT-PRO Extension guidance. The second depicts the most relevant points, identified by the patient partners, of the guidance through an interactive flow diagram.Conclusions These tools have the potential to support the involvement of patient partners in making informed contributions to the development of PRO aspects of clinical trial protocols, in accordance with the SPIRIT-PRO Extension guidelines. The involvement of patient partners ensured the tools focused on issues most relevant to them

The need for ethical guidance for the use of patient-reported outcomes (PROs) in 2 research and clinical practice

To the Editor—Patient-reported outcomes (PROs) are increasingly being used in clinical research to provide evidence of the benefits and risk of therapy from a patient perspective. PRO data from clinical trials can inform regulatory approvals and drug labeling, clinical guideline development and health policy1. Approximately one third of clinical trials include PROs collected through the use of patient questionnaires2. Beyond trials, PRO data are also increasingly captured in observational research and routine clinical care to provide information on the burden of disease and real-world evidence of treatment safety and effectiveness3, for audit and benchmarking1, and to monitor the status of patients and provide timely care tailored to individual needs. For instance, a study demonstrated that systematic web-based collection of information on symptoms led to improved health-related quality of life, survival and quality-adjusted survival, and fewer visits to the emergency room and hospitalization, among patients receiving chemotherapy for advanced solid tumors4. Patients value PRO trial results, as they can enhance clinician–patient communication about treatment options, which helps patients to feel more empowered in shared decision-making around their care5

Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines

The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77–94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines

Antimicrobial resistance among migrants in Europe: a systematic review and meta-analysis

BACKGROUND: Rates of antimicrobial resistance (AMR) are rising globally and there is concern that increased migration is contributing to the burden of antibiotic resistance in Europe. However, the effect of migration on the burden of AMR in Europe has not yet been comprehensively examined. Therefore, we did a systematic review and meta-analysis to identify and synthesise data for AMR carriage or infection in migrants to Europe to examine differences in patterns of AMR across migrant groups and in different settings. METHODS: For this systematic review and meta-analysis, we searched MEDLINE, Embase, PubMed, and Scopus with no language restrictions from Jan 1, 2000, to Jan 18, 2017, for primary data from observational studies reporting antibacterial resistance in common bacterial pathogens among migrants to 21 European Union-15 and European Economic Area countries. To be eligible for inclusion, studies had to report data on carriage or infection with laboratory-confirmed antibiotic-resistant organisms in migrant populations. We extracted data from eligible studies and assessed quality using piloted, standardised forms. We did not examine drug resistance in tuberculosis and excluded articles solely reporting on this parameter. We also excluded articles in which migrant status was determined by ethnicity, country of birth of participants' parents, or was not defined, and articles in which data were not disaggregated by migrant status. Outcomes were carriage of or infection with antibiotic-resistant organisms. We used random-effects models to calculate the pooled prevalence of each outcome. The study protocol is registered with PROSPERO, number CRD42016043681. FINDINGS: We identified 2274 articles, of which 23 observational studies reporting on antibiotic resistance in 2319 migrants were included. The pooled prevalence of any AMR carriage or AMR infection in migrants was 25·4% (95% CI 19·1-31·8; I2 =98%), including meticillin-resistant Staphylococcus aureus (7·8%, 4·8-10·7; I2 =92%) and antibiotic-resistant Gram-negative bacteria (27·2%, 17·6-36·8; I2 =94%). The pooled prevalence of any AMR carriage or infection was higher in refugees and asylum seekers (33·0%, 18·3-47·6; I2 =98%) than in other migrant groups (6·6%, 1·8-11·3; I2 =92%). The pooled prevalence of antibiotic-resistant organisms was slightly higher in high-migrant community settings (33·1%, 11·1-55·1; I2 =96%) than in migrants in hospitals (24·3%, 16·1-32·6; I2 =98%). We did not find evidence of high rates of transmission of AMR from migrant to host populations. INTERPRETATION: Migrants are exposed to conditions favouring the emergence of drug resistance during transit and in host countries in Europe. Increased antibiotic resistance among refugees and asylum seekers and in high-migrant community settings (such as refugee camps and detention facilities) highlights the need for improved living conditions, access to health care, and initiatives to facilitate detection of and appropriate high-quality treatment for antibiotic-resistant infections during transit and in host countries. Protocols for the prevention and control of infection and for antibiotic surveillance need to be integrated in all aspects of health care, which should be accessible for all migrant groups, and should target determinants of AMR before, during, and after migration. FUNDING: UK National Institute for Health Research Imperial Biomedical Research Centre, Imperial College Healthcare Charity, the Wellcome Trust, and UK National Institute for Health Research Health Protection Research Unit in Healthcare-associated Infections and Antimictobial Resistance at Imperial College London