Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

INTRODUCTION: Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation. METHODS: Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized. RESULTS: Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%). CONCLUSION: TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science's translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the "AI chasm" continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice

Evaluating the translation of implementation science to clinical artificial intelligence: a bibliometric study of qualitative research

2023 Hogg, Al-Zubaidy, Keane, Hughes, Beyer and Maniatopoulos.Introduction: Whilst a theoretical basis for implementation research is seen as advantageous, there is little clarity over if and how the application of theories, models or frameworks (TMF) impact implementation outcomes. Clinical artificial intelligence (AI) continues to receive multi-stakeholder interest and investment, yet a significant implementation gap remains. This bibliometric study aims to measure and characterize TMF application in qualitative clinical AI research to identify opportunities to improve research practice and its impact on clinical AI implementation. Methods: Qualitative research of stakeholder perspectives on clinical AI published between January 2014 and October 2022 was systematically identified. Eligible studies were characterized by their publication type, clinical and geographical context, type of clinical AI studied, data collection method, participants and application of any TMF. Each TMF applied by eligible studies, its justification and mode of application was characterized. Results: Of 202 eligible studies, 70 (34.7%) applied a TMF. There was an 8-fold increase in the number of publications between 2014 and 2022 but no significant increase in the proportion applying TMFs. Of the 50 TMFs applied, 40 (80%) were only applied once, with the Technology Acceptance Model applied most frequently (n = 9). Seven TMFs were novel contributions embedded within an eligible study. A minority of studies justified TMF application (n = 51,58.6%) and it was uncommon to discuss an alternative TMF or the limitations of the one selected (n = 11,12.6%). The most common way in which a TMF was applied in eligible studies was data analysis (n = 44,50.6%). Implementation guidelines or tools were explicitly referenced by 2 reports (1.0%). Conclusion: TMFs have not been commonly applied in qualitative research of clinical AI. When TMFs have been applied there has been (i) little consensus on TMF selection (ii) limited description of selection rationale and (iii) lack of clarity over how TMFs inform research. We consider this to represent an opportunity to improve implementation science\u27s translation to clinical AI research and clinical AI into practice by promoting the rigor and frequency of TMF application. We recommend that the finite resources of the implementation science community are diverted toward increasing accessibility and engagement with theory informed practices. The considered application of theories, models and frameworks (TMF) are thought to contribute to the impact of implementation science on the translation of innovations into real-world care. The frequency and nature of TMF use are yet to be described within digital health innovations, including the prominent field of clinical AI. A well-known implementation gap, coined as the “AI chasm” continues to limit the impact of clinical AI on real-world care. From this bibliometric study of the frequency and quality of TMF use within qualitative clinical AI research, we found that TMFs are usually not applied, their selection is highly varied between studies and there is not often a convincing rationale for their selection. Promoting the rigor and frequency of TMF use appears to present an opportunity to improve the translation of clinical AI into practice

An evaluation of gender equity in different models of primary care practices in Ontario

Background: The World Health Organization calls for more work evaluating the effect of health care reforms on gender equity in developed countries. We performed this evaluation in Ontario, Canada where primary care models resulting from reforms co-exist. // Methods: This cross sectional study of primary care practices uses data collected in 2005-2006. Healthcare service models included in the study consist of fee for service (FFS) based, salaried, and capitation based. We compared the quality of care delivered to women and men in practices of each model. We performed multi-level, multivariate regressions adjusting for patient socio-demographic and economic factors to evaluate vertical equity, and adjusting for these and health factors in evaluating horizontal equity. We measured seven dimensions of health service delivery (e.g. accessibility and continuity) and three dimensions of quality of care using patient surveys (n = 5,361) and chart abstractions (n = 4,108). // Results: Health service delivery measures were comparable in women and men, with differences ≤ 2.2% in all seven dimensions and in all models. Significant gender differences in the health promotion subjects addressed were observed. Female specific preventive manoeuvres were more likely to be performed than other preventive care. Men attending FFS practices were more likely to receive influenza immunization than women (Adjusted odds ratio: 1.75, 95% confidence intervals (CI) 1.05, 2.92). There was no difference in the other three prevention indicators. FFS practices were also more likely to provide recommended care for chronic diseases to men than women (Adjusted difference of -11.2%, CI -21.7, -0.8). A similar trend was observed in Community Health Centers (CHC). // Conclusions: The observed differences in the type of health promotion subjects discussed are likely an appropriate response to the differential healthcare needs between genders. Chronic disease care is non equitable in FFS but not in capitation based models. We recommend that efforts to monitor and address gender based differences in the delivery of chronic disease management in primary care be pursued.Funding for the original study on which this research is based was provided by the Ontario Ministry of Health and Long Term Care Primary Health Care Transition Fund. The views expressed in this report are the views of the authors and do not necessarily reflect those of the Ontario Ministry of Health and Long Term Care

Allergic inflammation does not impact chemical-induced carcinogenesis in the lungs of mice

<p>Abstract</p> <p>Background</p> <p>Although the relationship between allergic inflammation and lung carcinogenesis is not clearly defined, several reports suggest an increased incidence of lung cancer in patients with asthma. We aimed at determining the functional impact of allergic inflammation on chemical carcinogenesis in the lungs of mice.</p> <p>Methods</p> <p>Balb/c mice received single-dose urethane (1 g/kg at day 0) and two-stage ovalbumin during tumor initiation (sensitization: days -14 and 0; challenge: daily at days 6-12), tumor progression (sensitization: days 70 and 84; challenge: daily at days 90-96), or chronically (sensitization: days -14 and 0; challenge: daily at days 6-12 and thrice weekly thereafter). In addition, interleukin (IL)-5 deficient and wild-type C57BL/6 mice received ten weekly urethane injections. All mice were sacrificed after four months. Primary end-points were number, size, and histology of lung tumors. Secondary end-points were inflammatory cells and mediators in the airspace compartment.</p> <p>Results</p> <p>Ovalbumin provoked acute allergic inflammation and chronic remodeling of murine airways, evident by airspace eosinophilia, IL-5 up-regulation, and airspace enlargement. Urethane resulted in formation of atypical alveolar hyperplasias, adenomas, and adenocarcinomas in mouse lungs. Ovalbumin-induced allergic inflammation during tumor initiation, progression, or continuously did not impact the number, size, or histologic distribution of urethane-induced pulmonary neoplastic lesions. In addition, genetic deficiency in IL-5 had no effect on urethane-induced lung tumorigenesis.</p> <p>Conclusions</p> <p>Allergic inflammation does not impact chemical-induced carcinogenesis of the airways. These findings suggest that not all types of airway inflammation influence lung carcinogenesis and cast doubt on the idea of a mechanistic link between asthma and lung cancer.</p

Critical Transition in Tissue Homeostasis Accompanies Murine Lung Senescence

BACKGROUND: Respiratory dysfunction is a major contributor to morbidity and mortality in aged populations. The susceptibility to pulmonary insults is attributed to "low pulmonary reserve", ostensibly reflecting a combination of age-related musculoskeletal, immunologic and intrinsic pulmonary dysfunction. METHODS/PRINCIPAL FINDINGS: Using a murine model of the aging lung, senescent DBA/2 mice, we correlated a longitudinal survey of airspace size and injury measures with a transcriptome from the aging lung at 2, 4, 8, 12, 16 and 20 months of age. Morphometric analysis demonstrated a nonlinear pattern of airspace caliber enlargement with a critical transition occurring between 8 and 12 months of age marked by an initial increase in oxidative stress, cell death and elastase activation which is soon followed by inflammatory cell infiltration, immune complex deposition and the onset of airspace enlargement. The temporally correlative transcriptome showed exuberant induction of immunoglobulin genes coincident with airspace enlargement. Immunohistochemistry, ELISA analysis and flow cytometry demonstrated increased immunoglobulin deposition in the lung associated with a contemporaneous increase in activated B-cells expressing high levels of TLR4 (toll receptor 4) and CD86 and macrophages during midlife. These midlife changes culminate in progressive airspace enlargement during late life stages. CONCLUSION/SIGNIFICANCE: Our findings establish that a tissue-specific aging program is evident during a presenescent interval which involves early oxidative stress, cell death and elastase activation, followed by B lymphocyte and macrophage expansion/activation. This sequence heralds the progression to overt airspace enlargement in the aged lung. These signature events, during middle age, indicate that early stages of the aging immune system may have important correlates in the maintenance of tissue morphology. We further show that time-course analyses of aging models, when informed by structural surveys, can reveal nonintuitive signatures of organ-specific aging pathology

The tenth data release of the Sloan digital sky survey: First spectroscopic data from the SDSS-iii apache point observatory galactic evolution experiment

The Sloan Digital Sky Survey (SDSS) has been in operation since 2000 April. This paper presents the tenth public data release (DR10) from its current incarnation, SDSS-III. This data release includes the first spectroscopic data from the Apache Point Observatory Galaxy Evolution Experiment (APOGEE), along with spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS) taken through 2012 July. The APOGEE instrument is a near-infrared R ~ 22,500 300-fiber spectrograph covering 1:514-1:696 μm. The APOGEE survey is studying the chemical abundances and radial velocities of roughly 100,000 red giant star candidates in the bulge, bar, disk, and halo of the Milky Way. DR10 includes 178,397 spectra of 57,454 stars, each typically observed three or more times, from APOGEE. Derived quantities from these spectra (radial velocities, effective temperatures, surface gravities, and metallicities) are also included. DR10 also roughly doubles the number of BOSS spectra over those included in the ninth data release. DR10 includes a total of 1,507,954 BOSS spectra, comprising 927,844 galaxy spectra; 182,009 quasar spectra; and 159,327 stellar spectra, selected over 6373.2 deg2.This is an author-created, un-copyedited version of an article accepted for publication in The Astrophysical Journal Supplement Series. The publisher is not responsible for any errors or omissions in this version of the manuscript or any version derived from it. The Version of Record is available online at http://dx.doi.org/10.1088/0067-0049/211/2/17. The accepted version will be under embargo until the 18th March 2015

High-Anxious Individuals Show Increased Chronic Stress Burden, Decreased Protective Immunity, and Increased Cancer Progression in a Mouse Model of Squamous Cell Carcinoma

In spite of widespread anecdotal and scientific evidence much remains to be understood about the long-suspected connection between psychological factors and susceptibility to cancer. The skin is the most common site of cancer, accounting for nearly half of all cancers in the US, with approximately 2–3 million cases of non-melanoma cancers occurring each year worldwide. We hypothesized that a high-anxious, stress-prone behavioral phenotype would result in a higher chronic stress burden, lower protective-immunity, and increased progression of the immuno-responsive skin cancer, squamous cell carcinoma. SKH1 mice were phenotyped as high- or low-anxious at baseline, and subsequently exposed to ultraviolet-B light (1 minimal erythemal dose (MED), 3 times/week, 10-weeks). The significant strengths of this cancer model are that it uses a normal, immunocompetent, outbred strain, without surgery/injection of exogenous tumor cells/cell lines, and produces lesions that resemble human tumors. Tumors were counted weekly (primary outcome), and tissues collected during early and late phases of tumor development. Chemokine/cytokine gene-expression was quantified by PCR, tumor-infiltrating helper (Th), cytolytic (CTL), and regulatory (Treg) T cells by immunohistochemistry, lymph node T and B cells by flow cytometry, adrenal and plasma corticosterone and tissue vascular-endothelial-growth-factor (VEGF) by ELISA. High-anxious mice showed a higher tumor burden during all phases of tumor development. They also showed: higher corticosterone levels (indicating greater chronic stress burden), increased CCL22 expression and Treg infiltration (increased tumor-recruited immuno-suppression), lower CTACK/CCL27, IL-12, and IFN-γ gene-expression and lower numbers of tumor infiltrating Th and CTLs (suppressed protective immunity), and higher VEGF concentrations (increased tumor angiogenesis/invasion/metastasis). These results suggest that the deleterious effects of high trait anxiety could be: exacerbated by life-stressors, accentuated by the stress of cancer diagnosis/treatment, and mediate increased tumor progression and/or metastasis. Therefore, it may be beneficial to investigate the use of chemotherapy-compatible anxiolytic treatments immediately following cancer diagnosis, and during cancer treatment/survivorship