Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

INTRODUCTION: Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation. METHODS: Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized. RESULTS: Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%). CONCLUSION: TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science's translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the "AI chasm" continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice

Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

2023 Hogg, Al-Zubaidy, Keane, Hughes, Beyer and Maniatopoulos.Introduction: Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation. Methods: Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized. Results: Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%). Conclusion: TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science\u27s translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the “AI chasm” continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice

A Mixed Methods Systematic Review of the Effectiveness, Acceptability, and Feasibility of Advanced Care Plans for Older Adults Without Life-Limiting Conditions

Context: Advance care planning (ACP) is a comprehensive procedure aimed at helping individuals understand and articulate their values, life goals, and preferences concerning future medical treatment. Despite extensive research on ACP in populations with terminal illnesses, dementia, and those in long-term care, there is a lack of focus on its impact among older adults without life-limiting conditions.Objectives: To investigate the effectiveness, acceptability, and feasibility of ACP for older adults without life-limiting conditions.Methods: We searched 11 electronic databases, spanning from inception to November 2023, complemented by extensive grey literature and reference searches. Rigorous quality assessments were conducted using the Mixed Methods Appraisal Tool (MMAT). Our approach adopted a dynamic convergent mixed-methods design, incorporating thematic and narrative synthesis.Findings: From over 12,600 citations, a total of 16 studies, comprising four randomised controlled trials (RCTs), nine qualitative studies, and three mixed methods studies met the inclusion criteria. Limited findings indicate that ACP interventions are generally effective in improving document completion rates and reducing hospital readmissions. Acceptability and feasibility of these interventions were high, although significantly influenced by cultural and religious factors.Limitations: Evidence supporting the effectiveness, acceptability, and feasibility of ACP in reducing unplanned hospital admissions in older adults without life-limiting conditions was limited. We excluded observations based on unwell older people, though some material with unclear distinctions may have been included. Quality assessments revealed that one of four RCTs had a high risk of bias, three had unclear risks; all nine qualitative studies had low risk; and one of three mixed methods studies had low risk while two had unclear risks.Implications: Further targeted research is necessary to assess the intervention’s value for this population. Rigorous real-world evidence studies involving older adults without life-limiting conditions and their proxies is crucial to enabling providers to tailor ACPs to diverse populations, whilst respecting individuals’ religious and cultural beliefs

Identification of the factors associated with outcomes in a condition management programme

<p>Background: A requirement of the Government’s Pathways to Work (PtW) agenda was to introduce a Condition Management Programme (CMP). The aim of the present study was to identify the differences between those who engaged and made progress in this telephone-based biopsychosocial intervention, in terms of their health, and those who did not and to determine the client and practitioner characteristics and programme elements associated with success in a programme aimed at improving health.</p> <p>Methods: Data were obtained from the CMP electronic spreadsheets and clients paper-based case records. CMP standard practice was that questionnaires were administered during the pre- and post-assessment phases over the telephone. Each client’s record contains their socio-demographic data, their primary health condition, as well as the pre- and post-intervention scores of the health assessment tool administered. Univariate and multivariate statistical analysis was used to investigate the relationships between the database variables. Clients were included in the study if their records were available for analysis from July 2006 to December 2007.</p> <p> Results: On average there were 112 referrals per month, totalling 2016 referrals during the evaluation period. The majority (62.8%) of clients had a mental-health condition. Successful completion of the programme was 28.5% (575 “completers”; 144 “discharges”). Several factors, such as age, health condition, mode of contact, and practitioner characteristics, were significant determinants of participation and completion of the programme. The results showed that completion of the CMP was associated with a better mental-health status, by reducing the number of clients that were either anxious, depressed or both, before undertaking the programme, from 74% to 32.5%.</p> <p>Conclusions: Our findings showed that an individual's characteristics are associated with success in the programme, defined as completing the intervention and demonstrating an improved health status. This study provides some evidence that the systematic evaluation of such programmes and interventions could identify ways in which they could be improved.</p&gt

Factors influencing implementation and sustainability of interventions to improve oral health and related health behaviours in adults experiencing severe and multiple disadvantage: a mixed-methods systematic review

ObjectivesAmong people experiencing severe and multiple disadvantage (SMD), poor oral health is common and linked to smoking, substance use and high sugar intake. Studies have explored interventions addressing oral health and related behaviours; however, factors related to the implementation of these interventions remain unclear. This mixed-methods systematic review aimed to synthesise evidence on the implementation and sustainability of interventions to improve oral health and related health behaviours among adults experiencing SMD.MethodsBibliographic databases (MEDLINE, EMBASE, PsycINFO, CINAHL, EBSCO, Scopus) and grey literature were searched from inception to February 2023. Studies meeting the inclusion criteria were screened and extracted independently by two researchers. Quality appraisal was undertaken, and results were synthesised using narrative and thematic analyses.ResultsSeventeen papers were included (published between 1995 and 2022). Studies were mostly of moderate quality and included views from SMD groups and service providers. From the qualitative synthesis, most findings were related to aspects such as trust, resources and motivation levels of SMD groups and service providers. None of the studies reported on diet and none included repeated offending (one of the aspects of SMD). From the quantitative synthesis, no difference was observed in programme attendance between the interventions and usual care, although there was some indication of sustained improvements in participation in the intervention group.ConclusionThis review provides some evidence that trust, adequate resources and motivation levels are potentially important in implementing interventions to improve oral health and substance use among SMD groups. Further research is needed from high quality studies and focusing on diet in this population.PROSPERO registration numberCRD42020202416.</jats:sec

Biochemical Characterization of a Trypanosomatid Isolated from the Plant Amaranthus retroflexus

A protozoan flagelate has recently been isolated from Amaranthus retroflexus. This plant grows near economically important crops in southeastern Spain, which are known to be parasitized by Phytomonas spp. The present study focuses on the characterization of the energy metabolism of this new isolate. These flagellates utilize glucose efficiently as their primary energy source, although they are unable to completely degrade it. They excrete ethanol, acetate, glycine, and succinate in lower amount, as well as ammonium. The presence of glycosomes was indicated by the early enzymes of the glycolytic pathway, one enzyme of the glycerol pathway (glycerol kinase), and malate dehydrogenase. No evidence of a fully functional citric-acid cycle was found. In the absence of catalase activity, these flagellates showed significant superoxide dismutase activity located in the glycosomal and cytosolic fractions. These trypanosomes, despite being morphologically and metabolically similar to other Phytomonas isolated from the same area, showed significant differences, suggesting that they are phylogenetically different species

Dynamics of Co-Transcriptional Pre-mRNA Folding Influences the Induction of Dystrophin Exon Skipping by Antisense Oligonucleotides

Antisense oligonucleotides (AONs) mediated exon skipping offers potential therapy for Duchenne muscular dystrophy. However, the identification of effective AON target sites remains unsatisfactory for lack of a precise method to predict their binding accessibility. This study demonstrates the importance of co-transcriptional pre-mRNA folding in determining the accessibility of AON target sites for AON induction of selective exon skipping in DMD. Because transcription and splicing occur in tandem, AONs must bind to their target sites before splicing factors. Furthermore, co-transcriptional pre-mRNA folding forms transient secondary structures, which redistributes accessible binding sites. In our analysis, to approximate transcription elongation, a “window of analysis” that included the entire targeted exon was shifted one nucleotide at a time along the pre-mRNA. Possible co-transcriptional secondary structures were predicted using the sequence in each step of transcriptional analysis. A nucleotide was considered “engaged” if it formed a complementary base pairing in all predicted secondary structures of a particular step. Correlation of frequency and localisation of engaged nucleotides in AON target sites accounted for the performance (efficacy and efficiency) of 94% of 176 previously reported AONs. Four novel insights are inferred: (1) the lowest frequencies of engaged nucleotides are associated with the most efficient AONs; (2) engaged nucleotides at 3′ or 5′ ends of the target site attenuate AON performance more than at other sites; (3) the performance of longer AONs is less attenuated by engaged nucleotides at 3′ or 5′ ends of the target site compared to shorter AONs; (4) engaged nucleotides at 3′ end of a short target site attenuates AON efficiency more than at 5′ end

Protecting Vulnerable Road Users from Injury

Aymery Constant and Emmanuel Lagarde discuss policies to protect pedestrians, and pedal and motor cyclists, from injury