Methods for conducting international Delphi surveys to optimise global participation in core outcome set development: a case study in gastric cancer informed by a comprehensive literature review

Copyright © 2021, The Author(s) Open Access. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.Background: Core outcome sets (COS) should be relevant to key stakeholders and widely applicable and usable. Ideally, they are developed for international use to allow optimal data synthesis from trials. Electronic Delphi surveys are commonly used to facilitate global participation; however, this has limitations. It is common for these surveys to be conducted in a single language potentially excluding those not fluent in that tongue. The aim of this study is to summarise current approaches for optimising international participation in Delphi studies and make recommendations for future practice. Methods: A comprehensive literature review of current approaches to translating Delphi surveys for COS development was undertaken. A standardised methodology adapted from international guidance derived from 12 major sets of translation guidelines in the field of outcome reporting was developed. As a case study, this was applied to a COS project for surgical trials in gastric cancer to translate a Delphi survey into 7 target languages from regions active in gastric cancer research. Results: Three hundred thirty-two abstracts were screened and four studies addressing COS development in rheumatoid and osteoarthritis, vascular malformations and polypharmacy were eligible for inclusion. There was wide variation in methodological approaches to translation, including the number of forward translations, the inclusion of back translation, the employment of cognitive debriefing and how discrepancies and disagreements were handled. Important considerations were identified during the development of the gastric cancer survey including establishing translation groups, timelines, understanding financial implications, strategies to maximise recruitment and regulatory approvals. The methodological approach to translating the Delphi surveys was easily reproducible by local collaborators and resulted in an additional 637 participants to the 315 recruited to complete the source language survey. Ninety-nine per cent of patients and 97% of healthcare professionals from non-English-speaking regions used translated surveys. Conclusion: Consideration of the issues described will improve planning by other COS developers and can be used to widen international participation from both patients and healthcare professionals.This study is funded by the National Institute for Health Research (NIHR) Doctoral Research Fellowship Grant (DRF-2015-08-023). JMB is partially funded by the NIHR Bristol Biomedical Research Centre and the MRC ConDUCT-II Hub for Trials Methodology Research. PRW was funded by the MRC North West Hub for Trials Methodology Research (Grant ref: MR/K025635/01).info:eu-repo/semantics/publishedVersio

Uncovering Important Drivers of the Increase in the Use of Virtual Care Technologies in Nursing Care: Quantitative Analysis From the 2020 National Survey of Canadian Nurses

BackgroundCanadian nurses are at the forefront of patient care delivery. Although the use of digital health technologies for care delivery is gaining momentum in Canada, nurses are encouraged to integrate virtual care into their practice. In early 2020, more Canadian nurses delivered care virtually compared with 3 years ago. ObjectiveThis study seeks to uncover the professional characteristics of Canadian nurses accessing virtual care in 2020, understand how these characteristics differ across types of technologies, investigate whether the nurses accessing virtual care possess the skills and knowledge needed to use these technologies, and determine the important drivers of the uptake of virtual care observed in 2020. MethodsWe used data from the 2017 and 2020 National Survey of Canadian Nurses. This survey collected data on the use of digital health technologies in nursing practice. It concerned regulated nursing professionals working in different health care settings and from different domains of nursing practice. We combined the chi-square independence test and logistic regression analysis to uncover the most relevant drivers of virtual care uptake by nurses in 2020. ResultsIn early 2020, before the declaration of the COVID-19 pandemic, nurses who delivered care virtually were predominantly nurse practitioners (135/159, 84.9%) and more likely to work in a primary or community care setting (202/367, 55%) and in an urban setting (194/313, 61.9%). Factors such as nursing designation (P<.001), perceived quality of care at the health facility where the nurses practiced (P<.001), and the type of patient record–keeping system they had access to (P=.04) had a statistically significant effect on the probability of nurses to deliver care virtually in early 2020. Furthermore, nurses’ perception of the quality of care they delivered through virtual technologies was statistically associated with their perception of the skills (χ24=308.7; P<.001) and knowledge (χ24=283.4; P<.001) to use these technologies. ConclusionsThis study emphasizes the critical importance of nursing designation, geographic location, and type of patient record–keeping system in predicting virtual care integration in nursing practice. The findings related to geographic location can be used by decision-makers for better allocation of digital health resources among care settings in rural and urban areas. Similarly, the disparities observed across nursing designations have some implications for the digital training of nurses at all levels of practice. Finally, the association between electronic medical record use and uptake of virtual care could accelerate the implementation of more modernized record-keeping systems in care settings. Hence, this could advance interoperability and improve health care delivery

Advancing Primary Care Use of Electronic Medical Records in Canada

In 2010, the federal government's Economic Action Plan funded Canada Health Infoway to co-invest with provinces, territories, and health care providers in electronic medical records (EMRs) in primary care. The goal is to help improve access to care, quality of health services, and productivity of the health system, as well as to deliver economic benefits. The decision to fund EMRs was consistent with a long-term framework for digital health established in consultation with stakeholders across the country, spurred by analysis demonstrating the economic impact of such investments and data on Canada's low rate of EMR use in primary care compared with other countries. The decision reflected widespread public and stakeholder consensus regarding the importance of such investments. EMR adoption has more than doubled since 2006, with evaluations identifying efficiency and patient care benefits (e.g., reduced time managing laboratory test results and fewer adverse drug events) in community-based practices. These benefits are expected to rise further as EMR adoption continues to grow and practices gain more experience with their use

Advancing Primary Care Use of Electronic Medical Records in Canada

In 2010, the federal government's Economic Action Plan funded Canada Health Infoway to co-invest with provinces, territories, and health care providers in electronic medical records (EMRs) in primary care. The goal is to help improve access to care, quality of health services, and productivity of the health system, as well as to deliver economic benefits. The decision to fund EMRs was consistent with a long-term framework for digital health established in consultation with stakeholders across the country, spurred by analysis demonstrating the economic impact of such investments and data on Canada's low rate of EMR use in primary care compared with other countries. The decision reflected widespread public and stakeholder consensus regarding the importance of such investments. EMR adoption has more than doubled since 2006, with evaluations identifying efficiency and patient care benefits (e.g., reduced time managing laboratory test results and fewer adverse drug events) in community-based practices. These benefits are expected to rise further as EMR adoption continues to grow and practices gain more experience with their use. En 2010, le Plan d'Action Economique du gouvernement fédéral a doté financièrement Inforoute Santé du Canada pour aider les provinces, les territoires et les producteurs de soins à investir dans l'utilisation des dossiers médicaux électroniques (DME) en soins primaires. L'objectif est d'améliorer l'accès aux soins, la qualité des services délivrés et la productivité d'ensemble du système de soins, ainsi que de soutenir l'économie. Cette décision de financer les DME découle logiquement d'un engagement de long terme en faveur de la santé digitale, établi après consultations des principaux acteurs à travers le pays, et motivé par une analyse établissant l'impact économique de tels investissements ainsi que des données sur le faible taux d'utilisation des DME en soins primaire relativement à d'autres pays. La décision reflète un consensus partagé parmi les acteurs et le public sur le fait que de tels investissements sont importants. Le taux d'adoption des DME a plus que doublé depuis 2006 et les exercices d'évaluations pointent des gains d'efficience ou pour les patients (par exemple, les délais de retour des examens de laboratoire pourraient être réduits, ainsi que la fréquence des événements iatrogènes médicamenteux) en médecine de famille. Ces gains devraient croître avec l'augmentation de l'adoption des DME, à mesure que les praticiens deviennent plus expérimentés dans leur utilisation

Advancing Primary Care Use of Electronic Medical Records in Canada

In 2010, the federal government's Economic Action Plan funded Canada Health Infoway to co-invest with provinces, territories, and health care providers in electronic medical records (EMRs) in primary care. The goal is to help improve access to care, quality of health services, and productivity of the health system, as well as to deliver economic benefits. The decision to fund EMRs was consistent with a long-term framework for digital health established in consultation with stakeholders across the country, spurred by analysis demonstrating the economic impact of such investments and data on Canada's low rate of EMR use in primary care compared with other countries. The decision reflected widespread public and stakeholder consensus regarding the importance of such investments. EMR adoption has more than doubled since 2006, with evaluations identifying efficiency and patient care benefits (e.g., reduced time managing laboratory test results and fewer adverse drug events) in community-based practices. These benefits are expected to rise further as EMR adoption continues to grow and practices gain more experience with their use

Connecting Families to Their Health Record and Care Team: The Use, Utility, and Impact of a Client/Family Health Portal at a Children's Rehabilitation Hospital

Background: Health care portals have the potential to provide consumers with timely, transparent access to health care information and engage them in the care process. Objective: The objective was to examine the use, utility, and impact on engagement in care and caregiver-provider communication of a client/family portal providing access to electronic health records (EHRs) and secure, 2-way e-messaging with care providers. Methods: We conducted a prospective, mixed-methods study involving collection of caregivers’ portal usage information over a 14-month period (from portal introduction in January 2015 to the end of the study period in March 2016), a Web-based survey for caregivers administered after a minimum of 2 months’ exposure to the portal and repeated 2 months later, and focus groups or individual interviews held with caregivers and service providers at the same points in time. The survey assessed caregivers’ perceptions of the utility of and satisfaction with the EHR and e-messaging, and the portal’s impact on client engagement and perceptions of caregiver-provider communication. A total of 18 caregivers (parents) completed surveys and 6 also took part in focus groups or interviews. In addition, 5 service providers from different disciplines took part in focus groups or interviews. Results: Although usage patterns varied, the typical pattern was a steady level of use (2.5 times a month over an average of 9 months), which is higher than typically reported use. The portal pages most frequently accessed were the home page, health record main page, appointment main page, and reports main page. The Web-based survey captured caregivers’ perceptions of usefulness of and satisfaction with the EHR and portal messaging, as well as the portal’s impact on their engagement in care and perceptions of caregiver-provider communication. The surveys indicated a moderate degree of utility of and satisfaction with the portal features, and a low but emerging impact on engagement in care and caregiver-provider communication (survey scales measuring these outcomes displayed excellent internal consistency, with Cronbach alpha ranging from .89 to .95). Qualitative themes from focus groups and interviews supported and extended the survey findings. Caregivers and service providers saw appreciable information benefits and provided recommendations to increase portal use and utility. Caregivers focused on the scope of organizational adoption of the portal system and indicated their hopes for the future of the portal, whereas service providers were concerned about how to best manage their investment of time and effort in preparing client-friendly reports and messaging clients via the portal. Conclusions: Overall, the findings show the promise of the portal and the need for ongoing evaluation to show the portal’s ultimate potential in enhancing engagement in care and communication with care providers.Canada Health Infoway Inc. funded the demonstration project supporting the development and evaluation of Holland Bloorview Kids Rehabilitation Hospital’s client/family EHR portal. Canada Health Infoway Inc. also covered the publication costs for this article

Experiences and Outcomes of Using e-Prescribing for Opioids: Rapid Scoping Review

Backgrounde-Prescribing is designed to assist in facilitating safe and appropriate prescriptions for patients. Currently, it is unknown to what extent e-prescribing for opioids influences experiences and outcomes. To address this gap, a rapid scoping review was conducted. ObjectiveThis rapid scoping review aims to (1) explore how e-prescribing has been used clinically; (2) examine the effects of e-prescribing on clinical outcomes, the patient or clinician experience, service delivery, and policy; and (3) identify current gaps in the present literature to inform future studies and recommendations. MethodsA rapid scoping review was conducted following the guidance of the JBI 2020 scoping review methodology and the World Health Organization guide to rapid reviews. A comprehensive literature search was completed by an expert librarian from inception until November 16, 2022. Three databases were electronically searched: MEDLINE (Ovid), Embase (Ovid), and Scopus (Elsevier). The search criteria were as follows: (1) e-prescribing programs targeted to the use or misuse of opioids, including those that were complemented or accompanied by clinically focused initiatives, and (2) a primary research study of experimental, quasi-experimental, observational, qualitative, or mixed methods design. An additional criterion of an ambulatory component of e-prescribing (eg, e-prescribing occurred upon discharge from acute care) was added at the full-text stage. No language limitations or filters were applied. All articles were double screened by trained reviewers. Gray literature was manually searched by a single reviewer. Data were synthesized using a descriptive approach. ResultsUpon completing screening, 34 articles met the inclusion criteria: 32 (94%) peer-reviewed studies and 2 (6%) gray literature documents (1 thesis study and 1 report). All 33 studies had a quantitative component, with most highlighting e-prescribing from acute care settings to community settings (n=12, 36%). Only 1 (3%) of the 34 articles provided evidence on e-prescribing in a primary care setting. Minimal prescriber, pharmacist, and clinical population characteristics were reported. The main outcomes identified were related to opioid prescribing rates, alerts (eg, adverse drug events and drug-drug interactions), the quantity and duration of opioid prescriptions, the adoption of e-prescribing technology, attitudes toward e-prescribing, and potential challenges with the implementation of e-prescribing into clinical practice. e-Prescribing, including key features such as alerts and dose order sets, may reduce prescribing errors. ConclusionsThis rapid scoping review highlights initial promising results with e-prescribing and opioid therapy management. It is important that future work explores the experience of prescribers, pharmacists, and patients using e-prescribing for opioid therapy management with an emphasis on prescribers in the community and primary care. Developing a common set of quality indicators for e-prescribing of opioids will help build a stronger evidence base. Understanding implementation considerations will be of importance as the technology is integrated into clinical practice and health systems