Leveraging Explainable Artificial Intelligence to Optimize Clinical Decision Support

OBJECTIVE: To develop and evaluate a data-driven process to generate suggestions for improving alert criteria using explainable artificial intelligence (XAI) approaches. METHODS: We extracted data on alerts generated from January 1, 2019 to December 31, 2020, at Vanderbilt University Medical Center. We developed machine learning models to predict user responses to alerts. We applied XAI techniques to generate global explanations and local explanations. We evaluated the generated suggestions by comparing with alert\u27s historical change logs and stakeholder interviews. Suggestions that either matched (or partially matched) changes already made to the alert or were considered clinically correct were classified as helpful. RESULTS: The final dataset included 2 991 823 firings with 2689 features. Among the 5 machine learning models, the LightGBM model achieved the highest Area under the ROC Curve: 0.919 [0.918, 0.920]. We identified 96 helpful suggestions. A total of 278 807 firings (9.3%) could have been eliminated. Some of the suggestions also revealed workflow and education issues. CONCLUSION: We developed a data-driven process to generate suggestions for improving alert criteria using XAI techniques. Our approach could identify improvements regarding clinical decision support (CDS) that might be overlooked or delayed in manual reviews. It also unveils a secondary purpose for the XAI: to improve quality by discovering scenarios where CDS alerts are not accepted due to workflow, education, or staffing issues

Monoclonal antibody targeting of fibroblast growth factor receptor 1c ameliorates obesity and glucose intolerance via central mechanisms.

We have generated a novel monoclonal antibody targeting human FGFR1c (R1c mAb) that caused profound body weight and body fat loss in diet-induced obese mice due to decreased food intake (with energy expenditure unaltered), in turn improving glucose control. R1c mAb also caused weight loss in leptin-deficient ob/ob mice, leptin receptor-mutant db/db mice, and in mice lacking either the melanocortin 4 receptor or the melanin-concentrating hormone receptor 1. In addition, R1c mAb did not change hypothalamic mRNA expression levels of Agrp, Cart, Pomc, Npy, Crh, Mch, or Orexin, suggesting that R1c mAb could cause food intake inhibition and body weight loss via other mechanisms in the brain. Interestingly, peripherally administered R1c mAb accumulated in the median eminence, adjacent arcuate nucleus and in the circumventricular organs where it activated the early response gene c-Fos. As a plausible mechanism and coinciding with the initiation of food intake suppression, R1c mAb induced hypothalamic expression levels of the cytokines Monocyte chemoattractant protein 1 and 3 and ERK1/2 and p70 S6 kinase 1 activation

Adenovirus-5-Vectored P. falciparum Vaccine Expressing CSP and AMA1. Part B: Safety, Immunogenicity and Protective Efficacy of the CSP Component

Background: A protective malaria vaccine will likely need to elicit both cell-mediated and antibody responses. As adenovirus vaccine vectors induce both these responses in humans, a Phase 1/2a clinical trial was conducted to evaluate the efficacy of an adenovirus serotype 5-vectored malaria vaccine against sporozoite challenge.\ud \ud Methodology/Principal Findings: NMRC-MV-Ad-PfC is an adenovirus vector encoding the Plasmodium falciparum 3D7 circumsporozoite protein (CSP). It is one component of a two-component vaccine NMRC-M3V-Ad-PfCA consisting of one adenovector encoding CSP and one encoding apical membrane antigen-1 (AMA1) that was evaluated for safety and immunogenicity in an earlier study (see companion paper, Sedegah et al). Fourteen Ad5 seropositive or negative adults received two doses of NMRC-MV-Ad-PfC sixteen weeks apart, at 1x1010 particle units per dose. The vaccine was safe and well tolerated. All volunteers developed positive ELISpot responses by 28 days after the first immunization (geometric mean 272 spot forming cells/million[sfc/m]) that declined during the following 16 weeks and increased after the second dose to levels that in most cases were less than the initial peak (geometric mean 119 sfc/m). CD8+ predominated over CD4+ responses, as in the first clinical trial. Antibody responses were poor and like ELISpot responses increased after the second immunization but did not exceed the initial peak. Pre-existing neutralizing antibodies (NAb) to Ad5 did not affect the immunogenicity of the first dose, but the fold increase in NAb induced by the first dose was significantly associated with poorer antibody responses after the second dose, while ELISpot responses remained unaffected. When challenged by the bite of P. falciparum-infected mosquitoes, two of 11 volunteers showed a delay in the time to patency compared to infectivity controls, but no volunteers were sterilely protected.\ud \ud Significance: The NMRC-MV-Ad-PfC vaccine expressing CSP was safe and well tolerated given as two doses, but did not provide sterile protection

Ten-year mortality, disease progression, and treatment-related side effects in men with localised prostate cancer from the ProtecT randomised controlled trial according to treatment received

Background The ProtecT trial reported intention-to-treat analysis of men with localised prostate cancer randomly allocated to active monitoring (AM), radical prostatectomy, and external beam radiotherapy. Objective To report outcomes according to treatment received in men in randomised and treatment choice cohorts. Design, setting, and participants This study focuses on secondary care. Men with clinically localised prostate cancer at one of nine UK centres were invited to participate in the treatment trial comparing AM, radical prostatectomy, and radiotherapy. Intervention Two cohorts included 1643 men who agreed to be randomised and 997 who declined randomisation and chose treatment. Outcome measurements and statistical analysis Analysis was carried out to assess mortality, metastasis and progression and health-related quality of life impacts on urinary, bowel, and sexual function using patient-reported outcome measures. Analysis was based on comparisons between groups defined by treatment received for both randomised and treatment choice cohorts in turn, with pooled estimates of intervention effect obtained using meta-analysis. Differences were estimated with adjustment for known prognostic factors using propensity scores. Results and limitations According to treatment received, more men receiving AM died of PCa (AM 1.85%, surgery 0.67%, radiotherapy 0.73%), whilst this difference remained consistent with chance in the randomised cohort (p = 0.08); stronger evidence was found in the exploratory analyses (randomised plus choice cohort) when AM was compared with the combined radical treatment group (p = 0.003). There was also strong evidence that metastasis (AM 5.6%, surgery 2.4%, radiotherapy 2.7%) and disease progression (AM 20.35%, surgery 5.87%, radiotherapy 6.62%) were more common in the AM group. Compared with AM, there were higher risks of sexual dysfunction (95% at 6 mo) and urinary incontinence (55% at 6 mo) after surgery, and of sexual dysfunction (88% at 6 mo) and bowel dysfunction (5% at 6 mo) after radiotherapy. The key limitations are the potential for bias when comparing groups defined by treatment received and changes in the protocol for AM during the lengthy follow-up required in trials of screen-detected PCa. Conclusions Analyses according to treatment received showed increased rates of disease-related events and lower rates of patient-reported harms in men managed by AM compared with men managed by radical treatment, and stronger evidence of greater PCa mortality in the AM group. Patient summary More than 95 out of every 100 men with low or intermediate risk localised prostate cancer do not die of prostate cancer within 10 yr, irrespective of whether treatment is by means of monitoring, surgery, or radiotherapy. Side effects on sexual and bladder function are better after active monitoring, but the risks of spreading of prostate cancer are more common

BHPR research: qualitative1. Complex reasoning determines patients' perception of outcome following foot surgery in rheumatoid arhtritis

Background: Foot surgery is common in patients with RA but research into surgical outcomes is limited and conceptually flawed as current outcome measures lack face validity: to date no one has asked patients what is important to them. This study aimed to determine which factors are important to patients when evaluating the success of foot surgery in RA Methods: Semi structured interviews of RA patients who had undergone foot surgery were conducted and transcribed verbatim. Thematic analysis of interviews was conducted to explore issues that were important to patients. Results: 11 RA patients (9 ♂, mean age 59, dis dur = 22yrs, mean of 3 yrs post op) with mixed experiences of foot surgery were interviewed. Patients interpreted outcome in respect to a multitude of factors, frequently positive change in one aspect contrasted with negative opinions about another. Overall, four major themes emerged. Function: Functional ability & participation in valued activities were very important to patients. Walking ability was a key concern but patients interpreted levels of activity in light of other aspects of their disease, reflecting on change in functional ability more than overall level. Positive feelings of improved mobility were often moderated by negative self perception ("I mean, I still walk like a waddling duck”). Appearance: Appearance was important to almost all patients but perhaps the most complex theme of all. Physical appearance, foot shape, and footwear were closely interlinked, yet patients saw these as distinct separate concepts. Patients need to legitimize these feelings was clear and they frequently entered into a defensive repertoire ("it's not cosmetic surgery; it's something that's more important than that, you know?”). Clinician opinion: Surgeons' post operative evaluation of the procedure was very influential. The impact of this appraisal continued to affect patients' lasting impression irrespective of how the outcome compared to their initial goals ("when he'd done it ... he said that hasn't worked as good as he'd wanted to ... but the pain has gone”). Pain: Whilst pain was important to almost all patients, it appeared to be less important than the other themes. Pain was predominately raised when it influenced other themes, such as function; many still felt the need to legitimize their foot pain in order for health professionals to take it seriously ("in the end I went to my GP because it had happened a few times and I went to an orthopaedic surgeon who was quite dismissive of it, it was like what are you complaining about”). Conclusions: Patients interpret the outcome of foot surgery using a multitude of interrelated factors, particularly functional ability, appearance and surgeons' appraisal of the procedure. While pain was often noted, this appeared less important than other factors in the overall outcome of the surgery. Future research into foot surgery should incorporate the complexity of how patients determine their outcome Disclosure statement: All authors have declared no conflicts of interes

Effect of Hydrocortisone on Mortality and Organ Support in Patients With Severe COVID-19: The REMAP-CAP COVID-19 Corticosteroid Domain Randomized Clinical Trial.

Importance: Evidence regarding corticosteroid use for severe coronavirus disease 2019 (COVID-19) is limited. Objective: To determine whether hydrocortisone improves outcome for patients with severe COVID-19. Design, Setting, and Participants: An ongoing adaptive platform trial testing multiple interventions within multiple therapeutic domains, for example, antiviral agents, corticosteroids, or immunoglobulin. Between March 9 and June 17, 2020, 614 adult patients with suspected or confirmed COVID-19 were enrolled and randomized within at least 1 domain following admission to an intensive care unit (ICU) for respiratory or cardiovascular organ support at 121 sites in 8 countries. Of these, 403 were randomized to open-label interventions within the corticosteroid domain. The domain was halted after results from another trial were released. Follow-up ended August 12, 2020. Interventions: The corticosteroid domain randomized participants to a fixed 7-day course of intravenous hydrocortisone (50 mg or 100 mg every 6 hours) (n = 143), a shock-dependent course (50 mg every 6 hours when shock was clinically evident) (n = 152), or no hydrocortisone (n = 108). Main Outcomes and Measures: The primary end point was organ support-free days (days alive and free of ICU-based respiratory or cardiovascular support) within 21 days, where patients who died were assigned -1 day. The primary analysis was a bayesian cumulative logistic model that included all patients enrolled with severe COVID-19, adjusting for age, sex, site, region, time, assignment to interventions within other domains, and domain and intervention eligibility. Superiority was defined as the posterior probability of an odds ratio greater than 1 (threshold for trial conclusion of superiority >99%). Results: After excluding 19 participants who withdrew consent, there were 384 patients (mean age, 60 years; 29% female) randomized to the fixed-dose (n = 137), shock-dependent (n = 146), and no (n = 101) hydrocortisone groups; 379 (99%) completed the study and were included in the analysis. The mean age for the 3 groups ranged between 59.5 and 60.4 years; most patients were male (range, 70.6%-71.5%); mean body mass index ranged between 29.7 and 30.9; and patients receiving mechanical ventilation ranged between 50.0% and 63.5%. For the fixed-dose, shock-dependent, and no hydrocortisone groups, respectively, the median organ support-free days were 0 (IQR, -1 to 15), 0 (IQR, -1 to 13), and 0 (-1 to 11) days (composed of 30%, 26%, and 33% mortality rates and 11.5, 9.5, and 6 median organ support-free days among survivors). The median adjusted odds ratio and bayesian probability of superiority were 1.43 (95% credible interval, 0.91-2.27) and 93% for fixed-dose hydrocortisone, respectively, and were 1.22 (95% credible interval, 0.76-1.94) and 80% for shock-dependent hydrocortisone compared with no hydrocortisone. Serious adverse events were reported in 4 (3%), 5 (3%), and 1 (1%) patients in the fixed-dose, shock-dependent, and no hydrocortisone groups, respectively. Conclusions and Relevance: Among patients with severe COVID-19, treatment with a 7-day fixed-dose course of hydrocortisone or shock-dependent dosing of hydrocortisone, compared with no hydrocortisone, resulted in 93% and 80% probabilities of superiority with regard to the odds of improvement in organ support-free days within 21 days. However, the trial was stopped early and no treatment strategy met prespecified criteria for statistical superiority, precluding definitive conclusions. Trial Registration: ClinicalTrials.gov Identifier: NCT02735707

Albiglutide and cardiovascular outcomes in patients with type 2 diabetes and cardiovascular disease (Harmony Outcomes): a double-blind, randomised placebo-controlled trial

Background: Glucagon-like peptide 1 receptor agonists differ in chemical structure, duration of action, and in their effects on clinical outcomes. The cardiovascular effects of once-weekly albiglutide in type 2 diabetes are unknown. We aimed to determine the safety and efficacy of albiglutide in preventing cardiovascular death, myocardial infarction, or stroke. Methods: We did a double-blind, randomised, placebo-controlled trial in 610 sites across 28 countries. We randomly assigned patients aged 40 years and older with type 2 diabetes and cardiovascular disease (at a 1:1 ratio) to groups that either received a subcutaneous injection of albiglutide (30–50 mg, based on glycaemic response and tolerability) or of a matched volume of placebo once a week, in addition to their standard care. Investigators used an interactive voice or web response system to obtain treatment assignment, and patients and all study investigators were masked to their treatment allocation. We hypothesised that albiglutide would be non-inferior to placebo for the primary outcome of the first occurrence of cardiovascular death, myocardial infarction, or stroke, which was assessed in the intention-to-treat population. If non-inferiority was confirmed by an upper limit of the 95% CI for a hazard ratio of less than 1·30, closed testing for superiority was prespecified. This study is registered with ClinicalTrials.gov, number NCT02465515. Findings: Patients were screened between July 1, 2015, and Nov 24, 2016. 10 793 patients were screened and 9463 participants were enrolled and randomly assigned to groups: 4731 patients were assigned to receive albiglutide and 4732 patients to receive placebo. On Nov 8, 2017, it was determined that 611 primary endpoints and a median follow-up of at least 1·5 years had accrued, and participants returned for a final visit and discontinuation from study treatment; the last patient visit was on March 12, 2018. These 9463 patients, the intention-to-treat population, were evaluated for a median duration of 1·6 years and were assessed for the primary outcome. The primary composite outcome occurred in 338 (7%) of 4731 patients at an incidence rate of 4·6 events per 100 person-years in the albiglutide group and in 428 (9%) of 4732 patients at an incidence rate of 5·9 events per 100 person-years in the placebo group (hazard ratio 0·78, 95% CI 0·68–0·90), which indicated that albiglutide was superior to placebo (p<0·0001 for non-inferiority; p=0·0006 for superiority). The incidence of acute pancreatitis (ten patients in the albiglutide group and seven patients in the placebo group), pancreatic cancer (six patients in the albiglutide group and five patients in the placebo group), medullary thyroid carcinoma (zero patients in both groups), and other serious adverse events did not differ between the two groups. There were three (<1%) deaths in the placebo group that were assessed by investigators, who were masked to study drug assignment, to be treatment-related and two (<1%) deaths in the albiglutide group. Interpretation: In patients with type 2 diabetes and cardiovascular disease, albiglutide was superior to placebo with respect to major adverse cardiovascular events. Evidence-based glucagon-like peptide 1 receptor agonists should therefore be considered as part of a comprehensive strategy to reduce the risk of cardiovascular events in patients with type 2 diabetes. Funding: GlaxoSmithKline

Large expert-curated database for benchmarking document similarity detection in biomedical literature search

Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency-Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.Peer reviewe