Implementation outcome assessment instruments used in physical healthcare settings and their measurement properties:a systematic review protocol

INTRODUCTION: Over the past 10 years, research into methods that promote the uptake, implementation and sustainability of evidence-based interventions has gathered pace. However, implementation outcomes are defined in different ways and assessed by different measures; the extent to which these measures are valid and reliable is unknown. The aim of this systematic review is to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings, to advance the use of precise and accurate measures.  METHODS AND ANALYSIS: The following databases will be searched from inception to March 2017: MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. Grey literature will be sought via HMIC, OpenGrey, ProQuest for theses and Web of Science Conference Proceedings Citation Index-Science. Reference lists of included studies and relevant reviews will be hand searched. Three search strings will be combined to identify eligible studies: (1) implementation literature, (2) implementation outcomes and (3) measurement properties. Screening of titles, abstracts and full papers will be assessed for eligibility by two reviewers independently and any discrepancies resolved via consensus with the wider team. The methodological quality of the studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. A set of bespoke criteria to determine the quality of the instruments will be used, and the relationship between instrument usability and quality will be explored.  ETHICS AND DISSEMINATION: Ethical approval is not necessary for systematic review protocols. Researchers and healthcare professionals can use the findings of this systematic review to guide the selection of implementation outcomes instruments, based on their psychometric quality, to assess the impact of their implementation efforts. The findings will also provide a useful guide for reviewers of papers and grants to determine the psychometric quality of the measures used in implementation research.  TRIAL REGISTRATION NUMBER: International Prospective Register of Systematic Reviews (PROSPERO): CRD42017065348

Negotiating the 'grey area between normal social drinking and being a smelly tramp':a qualitative study of people searching for help online to reduce their drinking

INTRODUCTION AND AIMS: Delivering brief interventions for hazardous and harmful drinking on the Internet may broaden the availability of services and overcome some barriers to accessing help in person. The Down Your Drink (DYD) website, an extended brief intervention, attracted a large number of people looking to reduce their drinking. The aim was to explore the experiences of this e-help seeking population.  METHOD: Semi-structured interviews were conducted with participants in the DYD trial - an online trial of the effectiveness of DYD compared with an information-only website. Interviewees were asked how they came across the DYD website. Interviews were recorded and transcribed verbatim. Data were analysed by a multidisciplinary team using detailed thematic analysis.  RESULTS: Eighteen participants were interviewed. Most interviewees perceived their drinking to be a problem, which led them to search the Internet and register for the DYD trial in order to gain access to an intervention to help them reduce their drinking. The type of help required varied from information on the harms of drinking to help with a recognized problem. The privacy of the Internet was perceived as important when searching for help with drinking, as this avoids the stigma and embarrassment associated with help seeking in person. Almost all interviewees perceived a lack of services both online and offline for people wanting to moderate their drinking.  CONCLUSION: There is a perceived gap in services for hazardous and harmful drinkers wanting to reduce their drinking which could be addressed using online interventions

Regulation and accreditation of addictive behaviour applications—navigating the landscape

Background: mHealth applications (apps) for addictive behaviours offer widespread provision of digital support, with particular benefits for stigmatized groups and those with poor access to treatment services. Regulation and accreditation may encourage the uptake and use of evidence-based addictive behaviour apps, yet this is a complex and confusing landscape. We navigate international regulatory and accreditation guidance, explore some of the implementation challenges and provide implications for app developers, health-care professionals and app users. Analysis: We explore the classification of health and wellbeing, blended support and clinical therapy apps as medical devices by country to help readers navigate the complexity of the guidance. We describe an addictive behaviour app classified as a medical device and explore the innovative approaches to regulation that are currently emerging. We discuss the use of curated on-line app libraries that adhere to thresholds for characteristics such as quality, user satisfaction or effectiveness, which we hope will become the starting-point in the search for suitable apps, rather than commercial app stores. We also explore the ethical concerns associated with apps and how curated libraries address these. Conclusions: International regulation of applications as medical devices varies across countries and would benefit from standardization in a simple, usable and transparent format. Efforts to provide accreditation of non-medical device applications are also variable, and public bodies provide mixed messages concerning endorsement. Health-care professionals and users are encouraged to use accredited applications for addictive behaviours where they exist, or explore other forms of digital intervention with a stronger evidence base

Development and implementation of a national quality improvement skills curriculum for urology residents in the United Kingdom: A prospective multi-method, multi-center study

Background: Surgical quality improvement (QI) is a global priority. We report the design and proof-of concept testing of a QI skills curriculum for urology residents. Methods: ‘Umbrella review’ of QI curricula (Phase-1); development of draft QI curriculum (Phase-2); curriculum review by Steering Committee of urologists (Attendings & Residents), QI and medical education experts and patients (Phase-3); proof-of-concept testing (Phase-4). Results: Phase-1: Six systematic reviews were identified of 4,332 search hits. Most curricula are developed/evaluated in the USA; use mixed teaching methods (incl. didactic, QI exercises & self-reflection); and introduce core QI techniques (e.g., Plan-Do-Study-Act). Phase-2: curriculum drafted. Phase-3: the curriculum was judged to represent state-of-the-art, relevant QI training. Stronger patient involvement element was incorporated. Phase-4: the curriculum was delivered to 43 urology residents. The delivery was feasible; the curriculum implementable; and a knowledge-skills-attitudes evaluation approach successful. Conclusion: We have developed a practical QI curriculum, for further evaluation and national implementation

Contextual factors that impact the implementation of patient portals with a focus on older people in acute care hospitals: a scoping review

Background: Older people are the highest users of health services but are less likely to use a patient portal than younger people. Objective: This scoping review aimed to identify and synthesize the literature on contextual factors that impact the implementation of patient portals in acute care hospitals and among older people. Methods: A scoping review was conducted according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. The following databases were searched from 2010 to June 2020: MEDLINE and Embase via the Ovid platform, CINAHL and PsycINFO via the EBSCO platform, and the Cochrane Library. Eligible reviews were published in English; focused on the implementation of tethered patient portals; included patients, health care professionals, managers, and budget holders; and aimed at identifying the contextual factors (ie, barriers and facilitators) that impact the implementation of patient portals. Review titles and abstracts and full-text publications were screened in duplicate. The study characteristics were charted by one author and checked for accuracy by a second author. The NASSS (Non-adoption, Abandonment, Scale-up, Spread, and Sustainability) framework was used to synthesize the findings. Results: In total, 10 systematic reviews published between 2015 and 2020 were included in the study. Of these, 3 (30%) reviews addressed patient portals in acute care hospitals, and 2 (20%) reviews addressed the implementation of patient portals among older people in multiple settings (including acute care hospitals). To maximize the inclusion of the literature on patient portal implementation, we also included 5 reviews of systematic reviews that examined patient portals in multiple care settings (including acute care hospitals). Contextual factors influencing patient portal implementation tended to cluster in specific NASSS domains, namely the condition, technology, and value proposition. Certain aspects within these domains received more coverage than others, such as sociocultural factors and comorbidities, the usability and functionality aspects of the technology, and the demand-side value. There are gaps in the literature pertinent to the consideration of the provision of patient portals for older people in acute care hospitals, including the lack of consideration of the diversity of older adults and their needs, the question of interoperability between systems (likely to be important where care involves multiple services), the involvement of lay caregivers, and looking beyond short-term implementation to ways in which portal use can be sustained. Conclusions: We identified important contextual factors that impact patient portal implementation and key gaps in the literature. Future research should focus on evaluating strategies that address disparities in use and promote engagement with patient portals among older people in acute care settings

Impact of Financial Incentives on Alcohol Consumption Recording in Primary Health Care Among Adults with Schizophrenia and Other Psychoses:A Cross-Sectional and Retrospective Cohort Study

Aims: Lack of financial incentive is a frequently cited barrier to alcohol screening in primary care. The Quality and Outcomes Framework (QOF) pay for performance scheme has reimbursed UK primary care practices for alcohol screening in people with schizophrenia since April 2011. This study aimed to determine the impact of financial incentives on alcohol screening by comparing rates of alcohol recording in people with versus those without schizophrenia between 2000 and 2013. Methods: Cross-sectional and retrospective cohort study. Alcohol data were extracted from The Health Improvement Network (THIN) database of UK primary care records using (a) Read Codes for level of alcohol consumption, (b) continuous measures of drinking (e.g. units a week) and (c) Read Codes for types of screening test. Results: A total of 14,860 individuals (54% (8068) men and 46% (6792) women) from 409 general practices aged 18–99 years with schizophrenia were identified during April 2011–March 2013. Of these, 11,585 (78%) had an alcohol record, of which 99% (8150/8257) of Read Codes for level of consumption were eligible for recompense in the QOF. There was an 839% increase in alcohol recording among people with schizophrenia over the 13-year period (rate ratio per annum increase 1.19 (95% CI 1.18–1.20)) compared with a 62% increase among people without a severe mental illness (rate ratio per annum increase 1.04 (95% CI 1.03–1.05)). Conclusion: Financial incentives offered by the QOF appear to have a substantial impact on alcohol screening among people with schizophrenia in UK primary care. Short summary: Alcohol screening among people with schizophrenia increased dramatically in primary health care following the introduction of the UK pay for performance incentive scheme (Quality and Outcomes Framework) for severe mental illness, with an 839% rise (>8-fold increase) compared with a 62% increase among people without a over the 13-year study period (2000–2013)

Validation of the AUDIT-C in adults seeking help with their drinking online

Abstract Background The abbreviated Alcohol Use Disorder Identification Test for Consumption (AUDIT-C) is rapidly becoming the alcohol screening tool of choice for busy practitioners in clinical settings and by researchers keen to limit assessment burden and reactivity. Cut-off scores for detecting drinking above recommended limits vary by population, setting, country and potentially format. This validation study aimed to determine AUDIT-C thresholds that indicated risky drinking among a population of people seeking help over the Internet. Method The data in this study were collected in the pilot phase of the Down Your Drink trial, which recruited people seeking help over the Internet and randomised them to a web-based intervention or an information-only website. Sensitivity, specificity, and positive and negative likelihood ratios were calculated for AUDIT-C scores, relative to weekly consumption that indicated drinking above limits and higher risk drinking. Receiver-operating characteristic (ROC) curves were created to assess the performance of different cut-off scores on the AUDIT-C for men and women. Past week alcohol consumption was used as the reference-standard and was collected via the TOT-AL, a validated online measure of past week drinking. Results AUDIT-C scores were obtained from 3720 adults (2053 female and 1667 male) searching the internet for help with drinking, mostly from the UK. The area under the ROC curve for risky drinking was 0.84 (95% CI 0.80, 0.87) (female) and 0.80 (95% CI 0.76, 0.84) (male). AUDIT-C cut-off scores for detecting risky drinking that maximise the sum of sensitivity and specificity were ≥8 for women and ≥8 for men; whereas those identifying the highest proportion of correctly classified individuals were ≥4 for women and ≥5 for men. AUDIT-C cut-off scores for detecting higher risk drinking were also calculated. Conclusions AUDIT-C cut-off scores for identifying alcohol consumption above weekly limits in this largely UK based study population were substantially higher than those reported in other validation studies. Researchers and practitioners should select AUDIT-C cut-off scores according to the purpose of identifying risky drinkers and hence the relative importance of sensitivity and/or specificity

User Preferences for Content, Features, and Style for an App to Reduce Harmful Drinking in Young Adults:Analysis of User Feedback in App Stores and Focus Group Interviews

BACKGROUND: Electronic screening and brief intervention (eSBI) is effective in reducing weekly alcohol consumption when delivered by a computer. Mobile phone apps demonstrate promise in delivering eSBI; however, few have been designed with an evidence-based and user-informed approach.  OBJECTIVE: This study aims to explore from a user perspective, preferences for content, appearance, and operational features to inform the design of a mobile phone app for reducing quantity and frequency of drinking in young adults engaged in harmful drinking (18-30 year olds).  METHODS: Phase 1 included a review of user reviews of available mobile phone apps that support a reduction in alcohol consumption. Apps were identified on iTunes and Google Play and were categorized into alcohol reduction support, entertainment, blood alcohol content measurement (BAC), or other. eSBI apps with ≥18 user reviews were subject to a content analysis, which coded praise, criticism, and recommendations for app content, functionality, and esthetics. Phase 2 included four focus groups with young adults drinking at harmful levels and residing in South London to explore their views on existing eSBI apps and preferences for future content, functionality, and appearance. Detailed thematic analysis of the data was undertaken.  RESULTS: In Phase 1, of the 1584 apps extracted, 201 were categorized as alcohol reduction, 154 as BAC calculators, 509 as entertainment, and 720 as other. We classified 32 apps as eSBI apps. Four apps had ≥18 user reviews: Change for Life Drinks Tracker, Drinksmeter, Drinkaware, and Alcohol Units Calculator. The highest proportion of content praises were for information and feedback provided in the apps (12/27, 44%), followed by praise for the monitoring features (5/27, 19%). Many (8/12, 67%) criticisms were for the drinking diary; all of these were related to difficulty entering drinks. Over half (18/32, 56%) of functionality criticisms were descriptions of software bugs, and over half of those (10/18, 56%) were for app crashing or freezing. Drinksmeter and Alcohol Units Calculator were the most highly praised apps overall (23/57 and 22/57; 39% of praise overall). In Phase 2, two main themes were identified. The meaningfulness theme reflected how young adults thought apps needed to be tailored to the interests and values of their age group, particularly emphasizing content and feedback around broader health and well-being factors such as exercise, diet, and image. The community theme suggested that young adults want to be able to engage with other app users, both in groups of friends and with online users for motivation and support.  CONCLUSIONS: Targeted and relevant information and feedback, in addition to easy-to-use monitoring tools, were found to be important features of a mobile phone app to support a reduction in drinking. Future app development should consider tailoring all app aspects to the needs of young adults, considering broader well-being monitoring tools and online community functions

Pilot implementation and evaluation of a national quality improvement taught curriculum for urology residents: Lessons from the United Kingdom

Background : We report the immediate educational impact of a previously developed quality improvement (QI) curriculum for UK urology residents. Materials and methods : Prospective pre/post-training evaluation, using the Kirkpatrick framework: residents’ QI knowledge, skills and attitudes were assessed via standardized assessments. We report descriptive/inferential statistics and scales psychometric analyses. Results : Ninety-eight residents from across the UK provided full datasets. Scale reliability was good (Cronbach-alphas = 0.485–0.924). Residents' subjective knowledge (Mpre = 2.71, SD = 0.787; Mpost = 3.97, SD = 0.546); intentions to initiate QI (Mpre = 3.65, SD = 0.643; Mpost = 4.09, SD = 0.642); attitudes towards doing QI (Mpre = 3.67, SD = 0.646; Mpost = 4.11, SD = 0.591); attitudes towards QI at work (Mpre = 3.80, SD = 0.511; Mpost = 4.00, SD = 0.495); and attitudes towards influencing QI (Mpre = 3.65, SD = 0.482; Mpost = 3.867, SD = 0.473) all improved post-training (all ps  0.05). Residents’ satisfaction was high. Conclusions : Our novel QI training is educationally sound and feasible to deliver. Longitudinal evaluation and scalability are planned