Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

INTRODUCTION: Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation. METHODS: Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized. RESULTS: Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%). CONCLUSION: TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science's translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the "AI chasm" continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice

Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

2023 Hogg, Al-Zubaidy, Keane, Hughes, Beyer and Maniatopoulos.Introduction: Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation. Methods: Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized. Results: Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%). Conclusion: TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science\u27s translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the “AI chasm” continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice

Identification of the factors associated with outcomes in a condition management programme

<p>Background: A requirement of the Government’s Pathways to Work (PtW) agenda was to introduce a Condition Management Programme (CMP). The aim of the present study was to identify the differences between those who engaged and made progress in this telephone-based biopsychosocial intervention, in terms of their health, and those who did not and to determine the client and practitioner characteristics and programme elements associated with success in a programme aimed at improving health.</p> <p>Methods: Data were obtained from the CMP electronic spreadsheets and clients paper-based case records. CMP standard practice was that questionnaires were administered during the pre- and post-assessment phases over the telephone. Each client’s record contains their socio-demographic data, their primary health condition, as well as the pre- and post-intervention scores of the health assessment tool administered. Univariate and multivariate statistical analysis was used to investigate the relationships between the database variables. Clients were included in the study if their records were available for analysis from July 2006 to December 2007.</p> <p> Results: On average there were 112 referrals per month, totalling 2016 referrals during the evaluation period. The majority (62.8%) of clients had a mental-health condition. Successful completion of the programme was 28.5% (575 “completers”; 144 “discharges”). Several factors, such as age, health condition, mode of contact, and practitioner characteristics, were significant determinants of participation and completion of the programme. The results showed that completion of the CMP was associated with a better mental-health status, by reducing the number of clients that were either anxious, depressed or both, before undertaking the programme, from 74% to 32.5%.</p> <p>Conclusions: Our findings showed that an individual's characteristics are associated with success in the programme, defined as completing the intervention and demonstrating an improved health status. This study provides some evidence that the systematic evaluation of such programmes and interventions could identify ways in which they could be improved.</p&gt

Factors influencing implementation and sustainability of interventions to improve oral health and related health behaviours in adults experiencing severe and multiple disadvantage: a mixed-methods systematic review

ObjectivesAmong people experiencing severe and multiple disadvantage (SMD), poor oral health is common and linked to smoking, substance use and high sugar intake. Studies have explored interventions addressing oral health and related behaviours; however, factors related to the implementation of these interventions remain unclear. This mixed-methods systematic review aimed to synthesise evidence on the implementation and sustainability of interventions to improve oral health and related health behaviours among adults experiencing SMD.MethodsBibliographic databases (MEDLINE, EMBASE, PsycINFO, CINAHL, EBSCO, Scopus) and grey literature were searched from inception to February 2023. Studies meeting the inclusion criteria were screened and extracted independently by two researchers. Quality appraisal was undertaken, and results were synthesised using narrative and thematic analyses.ResultsSeventeen papers were included (published between 1995 and 2022). Studies were mostly of moderate quality and included views from SMD groups and service providers. From the qualitative synthesis, most findings were related to aspects such as trust, resources and motivation levels of SMD groups and service providers. None of the studies reported on diet and none included repeated offending (one of the aspects of SMD). From the quantitative synthesis, no difference was observed in programme attendance between the interventions and usual care, although there was some indication of sustained improvements in participation in the intervention group.ConclusionThis review provides some evidence that trust, adequate resources and motivation levels are potentially important in implementing interventions to improve oral health and substance use among SMD groups. Further research is needed from high quality studies and focusing on diet in this population.PROSPERO registration numberCRD42020202416.</jats:sec

Biochemical Characterization of a Trypanosomatid Isolated from the Plant Amaranthus retroflexus

A protozoan flagelate has recently been isolated from Amaranthus retroflexus. This plant grows near economically important crops in southeastern Spain, which are known to be parasitized by Phytomonas spp. The present study focuses on the characterization of the energy metabolism of this new isolate. These flagellates utilize glucose efficiently as their primary energy source, although they are unable to completely degrade it. They excrete ethanol, acetate, glycine, and succinate in lower amount, as well as ammonium. The presence of glycosomes was indicated by the early enzymes of the glycolytic pathway, one enzyme of the glycerol pathway (glycerol kinase), and malate dehydrogenase. No evidence of a fully functional citric-acid cycle was found. In the absence of catalase activity, these flagellates showed significant superoxide dismutase activity located in the glycosomal and cytosolic fractions. These trypanosomes, despite being morphologically and metabolically similar to other Phytomonas isolated from the same area, showed significant differences, suggesting that they are phylogenetically different species

Dynamics of Co-Transcriptional Pre-mRNA Folding Influences the Induction of Dystrophin Exon Skipping by Antisense Oligonucleotides

Antisense oligonucleotides (AONs) mediated exon skipping offers potential therapy for Duchenne muscular dystrophy. However, the identification of effective AON target sites remains unsatisfactory for lack of a precise method to predict their binding accessibility. This study demonstrates the importance of co-transcriptional pre-mRNA folding in determining the accessibility of AON target sites for AON induction of selective exon skipping in DMD. Because transcription and splicing occur in tandem, AONs must bind to their target sites before splicing factors. Furthermore, co-transcriptional pre-mRNA folding forms transient secondary structures, which redistributes accessible binding sites. In our analysis, to approximate transcription elongation, a “window of analysis” that included the entire targeted exon was shifted one nucleotide at a time along the pre-mRNA. Possible co-transcriptional secondary structures were predicted using the sequence in each step of transcriptional analysis. A nucleotide was considered “engaged” if it formed a complementary base pairing in all predicted secondary structures of a particular step. Correlation of frequency and localisation of engaged nucleotides in AON target sites accounted for the performance (efficacy and efficiency) of 94% of 176 previously reported AONs. Four novel insights are inferred: (1) the lowest frequencies of engaged nucleotides are associated with the most efficient AONs; (2) engaged nucleotides at 3′ or 5′ ends of the target site attenuate AON performance more than at other sites; (3) the performance of longer AONs is less attenuated by engaged nucleotides at 3′ or 5′ ends of the target site compared to shorter AONs; (4) engaged nucleotides at 3′ end of a short target site attenuates AON efficiency more than at 5′ end

Protecting Vulnerable Road Users from Injury

Aymery Constant and Emmanuel Lagarde discuss policies to protect pedestrians, and pedal and motor cyclists, from injury

Reduced costs with bisoprolol treatment for heart failure - An economic analysis of the second Cardiac Insufficiency Bisoprolol Study (CIBIS-II)

Background Beta-blockers, used as an adjunctive to diuretics, digoxin and angiotensin converting enzyme inhibitors, improve survival in chronic heart failure. We report a prospectively planned economic analysis of the cost of adjunctive beta-blocker therapy in the second Cardiac Insufficiency BIsoprolol Study (CIBIS II). Methods Resource utilization data (drug therapy, number of hospital admissions, length of hospital stay, ward type) were collected prospectively in all patients in CIBIS . These data were used to determine the additional direct costs incurred, and savings made, with bisoprolol therapy. As well as the cost of the drug, additional costs related to bisoprolol therapy were added to cover the supervision of treatment initiation and titration (four outpatient clinic/office visits). Per them (hospital bed day) costings were carried out for France, Germany and the U.K. Diagnosis related group costings were performed for France and the U.K. Our analyses took the perspective of a third party payer in France and Germany and the National Health Service in the U.K. Results Overall, fewer patients were hospitalized in the bisoprolol group, there were fewer hospital admissions perpatient hospitalized, fewer hospital admissions overall, fewer days spent in hospital and fewer days spent in the most expensive type of ward. As a consequence the cost of care in the bisoprolol group was 5-10% less in all three countries, in the per them analysis, even taking into account the cost of bisoprolol and the extra initiation/up-titration visits. The cost per patient treated in the placebo and bisoprolol groups was FF35 009 vs FF31 762 in France, DM11 563 vs DM10 784 in Germany and pound 4987 vs pound 4722 in the U.K. The diagnosis related group analysis gave similar results. Interpretation Not only did bisoprolol increase survival and reduce hospital admissions in CIBIS II, it also cut the cost of care in so doing. This `win-win' situation of positive health benefits associated with cost savings is Favourable from the point of view of both the patient and health care systems. These findings add further support for the use of beta-blockers in chronic heart failure