Transparency and Trust in Human-AI-Interaction: The Role of Model-Agnostic Explanations in Computer Vision-Based Decision Support

Computer Vision, and hence Artificial Intelligence-based extraction of information from images, has increasingly received attention over the last years, for instance in medical diagnostics. While the algorithms' complexity is a reason for their increased performance, it also leads to the "black box" problem, consequently decreasing trust towards AI. In this regard, "Explainable Artificial Intelligence" (XAI) allows to open that black box and to improve the degree of AI transparency. In this paper, we first discuss the theoretical impact of explainability on trust towards AI, followed by showcasing how the usage of XAI in a health-related setting can look like. More specifically, we show how XAI can be applied to understand why Computer Vision, based on deep learning, did or did not detect a disease (malaria) on image data (thin blood smear slide images). Furthermore, we investigate, how XAI can be used to compare the detection strategy of two different deep learning models often used for Computer Vision: Convolutional Neural Network and Multi-Layer Perceptron. Our empirical results show that i) the AI sometimes used questionable or irrelevant data features of an image to detect malaria (even if correctly predicted), and ii) that there may be significant discrepancies in how different deep learning models explain the same prediction. Our theoretical discussion highlights that XAI can support trust in Computer Vision systems, and AI systems in general, especially through an increased understandability and predictability

Combined impact of healthy lifestyle factors on colorectal cancer: a large European cohort study

Background: Excess body weight, physical activity, smoking, alcohol consumption and certain dietary factors are individually related to colorectal cancer (CRC) risk; however, little is known about their joint effects. The aim of this study was to develop a healthy lifestyle index (HLI) composed of five potentially modifiable lifestyle factors – healthy weight, physical activity, non-smoking, limited alcohol consumption and a healthy diet, and to explore the association of this index with CRC incidence using data collected within the European Prospective Investigation into Cancer and Nutrition (EPIC) cohort. Methods: In the EPIC cohort, a total of 347,237 men and women, 25- to 70-years old, provided dietary and lifestyle information at study baseline (1992 to 2000). Over a median follow-up time of 12 years, 3,759 incident CRC cases were identified. The association between a HLI and CRC risk was evaluated using Cox proportional hazards regression models and population attributable risks (PARs) have been calculated. Results: After accounting for study centre, age, sex and education, compared with 0 or 1 healthy lifestyle factors, the hazard ratio (HR) for CRC was 0.87 (95% confidence interval (CI): 0.44 to 0.77) for two factors, 0.79 (95% CI: 0.70 to 0.89) for three factors, 0.66 (95% CI: 0.58 to 0.75) for four factors and 0.63 (95% CI: 0.54 to 0.74) for five factors; P-trend <0.0001. The associations were present for both colon and rectal cancers, HRs, 0.61 (95% CI: 0.50 to 0.74; P for trend <0.0001) for colon cancer and 0.68 (95% CI: 0.53 to 0.88; P-trend <0.0001) for rectal cancer, respectively (P-difference by cancer sub-site = 0.10). Overall, 16% of the new CRC cases (22% in men and 11% in women) were attributable to not adhering to a combination of all five healthy lifestyle behaviours included in the index. Conclusions: Combined lifestyle factors are associated with a lower incidence of CRC in European populations characterized by western lifestyles. Prevention strategies considering complex targeting of multiple lifestyle factors may provide practical means for improved CRC prevention. Electronic supplementary material The online version of this article (doi:10.1186/s12916-014-0168-4) contains supplementary material, which is available to authorized users

Genomic analyses inform on migration events during the peopling of Eurasia.

High-coverage whole-genome sequence studies have so far focused on a limited number of geographically restricted populations, or been targeted at specific diseases, such as cancer. Nevertheless, the availability of high-resolution genomic data has led to the development of new methodologies for inferring population history and refuelled the debate on the mutation rate in humans. Here we present the Estonian Biocentre Human Genome Diversity Panel (EGDP), a dataset of 483 high-coverage human genomes from 148 populations worldwide, including 379 new genomes from 125 populations, which we group into diversity and selection sets. We analyse this dataset to refine estimates of continent-wide patterns of heterozygosity, long- and short-distance gene flow, archaic admixture, and changes in effective population size through time as well as for signals of positive or balancing selection. We find a genetic signature in present-day Papuans that suggests that at least 2% of their genome originates from an early and largely extinct expansion of anatomically modern humans (AMHs) out of Africa. Together with evidence from the western Asian fossil record, and admixture between AMHs and Neanderthals predating the main Eurasian expansion, our results contribute to the mounting evidence for the presence of AMHs out of Africa earlier than 75,000 years ago.Support was provided by: Estonian Research Infrastructure Roadmap grant no 3.2.0304.11-0312; Australian Research Council Discovery grants (DP110102635 and DP140101405) (D.M.L., M.W. and E.W.); Danish National Research Foundation; the Lundbeck Foundation and KU2016 (E.W.); ERC Starting Investigator grant (FP7 - 261213) (T.K.); Estonian Research Council grant PUT766 (G.C. and M.K.); EU European Regional Development Fund through the Centre of Excellence in Genomics to Estonian Biocentre (R.V.; M.Me. and A.Me.), and Centre of Excellence for Genomics and Translational Medicine Project No. 2014-2020.4.01.15-0012 to EGC of UT (A.Me.) and EBC (M.Me.); Estonian Institutional Research grant IUT24-1 (L.S., M.J., A.K., B.Y., K.T., C.B.M., Le.S., H.Sa., S.L., D.M.B., E.M., R.V., G.H., M.K., G.C., T.K. and M.Me.) and IUT20-60 (A.Me.); French Ministry of Foreign and European Affairs and French ANR grant number ANR-14-CE31-0013-01 (F.-X.R.); Gates Cambridge Trust Funding (E.J.); ICG SB RAS (No. VI.58.1.1) (D.V.L.); Leverhulme Programme grant no. RP2011-R-045 (A.B.M., P.G. and M.G.T.); Ministry of Education and Science of Russia; Project 6.656.2014/K (S.A.F.); NEFREX grant funded by the European Union (People Marie Curie Actions; International Research Staff Exchange Scheme; call FP7-PEOPLE-2012-IRSES-number 318979) (M.Me., G.H. and M.K.); NIH grants 5DP1ES022577 05, 1R01DK104339-01, and 1R01GM113657-01 (S.Tis.); Russian Foundation for Basic Research (grant N 14-06-00180a) (M.G.); Russian Foundation for Basic Research; grant 16-04-00890 (O.B. and E.B); Russian Science Foundation grant 14-14-00827 (O.B.); The Russian Foundation for Basic Research (14-04-00725-a), The Russian Humanitarian Scientific Foundation (13-11-02014) and the Program of the Basic Research of the RAS Presidium “Biological diversity” (E.K.K.); Wellcome Trust and Royal Society grant WT104125AIA & the Bristol Advanced Computing Research Centre (http://www.bris.ac.uk/acrc/) (D.J.L.); Wellcome Trust grant 098051 (Q.A.; C.T.-S. and Y.X.); Wellcome Trust Senior Research Fellowship grant 100719/Z/12/Z (M.G.T.); Young Explorers Grant from the National Geographic Society (8900-11) (C.A.E.); ERC Consolidator Grant 647787 ‘LocalAdaptatio’ (A.Ma.); Program of the RAS Presidium “Basic research for the development of the Russian Arctic” (B.M.); Russian Foundation for Basic Research grant 16-06-00303 (E.B.); a Rutherford Fellowship (RDF-10-MAU-001) from the Royal Society of New Zealand (M.P.C.)

Cyclosporin A exacerbates mercuric chloride-induced vasculitis in the Brown Norway rat

BACKGROUND: Administration of mercuric chloride (HgCl2) to the Brown Norway (BN) rat induces a necrotizing leukocytoclastic vasculitis (most marked in the gut) and anti-myeloperoxidase (anti-MPO) antibodies. The development of autoimmunity in the BN rat is a T cell-dependent phenomenon, and there is evidence that the induction of autoantibodies and tissue injury is a Th2-driven process. Cyclosporin A (CyA) is an anti-T cell agent with a dose-dependent differential effect on Th cell subsets that can ameliorate or enhance autoimmune responses. In the BN it can suppress HgCl2-induced autoantibody production, but the effect on tissue injury has not been previously examined. EXPERIMENTAL DESIGN: We have studied the effect of CyA given 'early' (Days 1-10, concurrently with the HgCl2) or 'late' (Days 11- 14) on tissue injury and autoantibody response. Serial blood samples were taken for anti-glomerular basement membrane, anti-MPO, and IgE antibody levels. Necropsies were performed on animals killed on Day 15. The presence and extent of vasculitis was scored macroscopically and histologically. Controls were incorporated to assess the effect of vehicle and of CyA alone. RESULTS: CyA given early delayed the rise in anti-MPO and anti-glomerular basement membrane levels and ameliorated tissue injury, whereas CyA given late, although suppressing the rise in anti-MPO and anti-glomerular basement membrane antibodies, caused a marked exacerbation of vasculitis. CONCLUSIONS: The effect of CyA depends on the timing of treatment with respect to HgCl2. Anti-MPO antibodies are not of primary importance in the pathogenesis of tissue injury. The late effect may be due to a direct toxic effect on the endothelium or to loss of a protective T cell subset. These observations have implications for the use of CyA in the treatment of systemic vasculitis in humans.link_to_subscribed_fulltex

Animal models of systemic vasculitis

Necrotizing leucocytoclastic vasclitis in the histopathological hallmark of the small vessel systemic vasculitides (SV), a group of human diseases commonly associated with anti-neutrophil cytoplasm autoantibodies (ANCA). Necrotizing vasculitis is seen in a number of experimental systems, but none of these provide an ideal animal model for human SV. Vasculitis occurs in serum sickness reactions; in murine models of systemic lupus erythematosus; in association with infection, particularly chronic viral infections; and after treatment with certain drugs or inflammatory mediators. 'Spontaneous' vasculitis has been reported in specific mouse strains, especially with ageing, and in some larger species. The size of vessel involved and the type of inflammatory cells predominating are variable in these experimental situations, and none of these models feature antibodies analogous to ANCA. We have recently reported that Brown Norway rats treated with mercuric chloride (HgCl2) develop necrotizing leucocytoclastic vasculitis, especially in the gut, and also develop antibodies to myeloperoxidase (MPO) which recognize smilar determinants on MPO to those bound by a subset of ANCA. Transfer of serum from HgCl2-treated rats to naive animals does not induce tissue injury. Preliminary experiments using pooled immunoglobulin or an anti-CD4 monoclonal antibody did not show useful therapeutic benefit from these treatments. HgCl2-induced vasculitis has weaknesses as an animal model of human SV, but is the only experimental model in which anti-MPO autoantibodies have so far been demonstrated, and therefore may be of particular relevance to ANCA-associated SV.link_to_subscribed_fulltex

Further characterization of an animal model of systemic vasculitis

link_to_subscribed_fulltex

Role of neutrophils in the pathogenesis of experimental vasculitis

In the Brown-Norway rat, mercuric chloride (HgCl2) induces an autoimmune syndrome characterized by high IgE levels. There is widespread necrotizing leukocytoclastic vasculitis involving lung, skin, mucous membranes, pancreas, liver, and gut, with tissue injury being most marked in the cecum. As in systemic vasculitis in man, there are neutrophils at the site of tissue injury and the animals develop anti-neutrophil cytoplasmic antibodies, which in the Brown-Norway rat are directed against myeloperoxidase. To determine whether neutrophils are involved in the pathogenesis of the vasculitis, we have used a monoclonal antibody that was reported to deplete neutrophils in other rat strains. Rats treated with HgCl2 received antibody by intravenous injection at various time points. Serial blood samples were taken for neutrophil counts and to assay for anti- myeloperoxidase and IgE antibodies. The guts of animals killed after antibody therapy were scored for vasculitic changes and neutrophil infiltrate. RP3 (but not the control antibody MAC6) was shown to bind to Brown-Norway rat neutrophils and to block glycogen-induced influx of neutrophils into the peritoneum. When given at peak disease, RP3 caused a dose-dependent reduction in tissue injury with a marked reduction in circulating blood neutrophil numbers and in tissue neutrophil infiltrate. RP3 treatment did not affect the rise in titer of IgE and anti-myeloperoxidase antibodies. The data presented demonstrate that in this model neutrophils are necessary for the induction of vasculitis and that the degree of vasculitis correlates with neutrophil number. To our knowledge, this study is the first to provide direct evidence for a role for neutrophils in vasculitis. We suggest that antibodies directed against neutrophils, especially if they deplete neutrophils, may be useful in the therapy of vasculitis in man.link_to_subscribed_fulltex

Interleukin-4 gene expression in mercury-induced autoimmunity

Mercuric chloride (HgCl2) induces autoimmunity in Brown Norway (BN) rats, with necrotizing vasculitis in the gut. Circumstantial evidence implicates the T(h)2 subset of CD4+ T lymphocytes, which produces IL-4. We developed a quantitative polymerase chain reaction (PCR) technique to quantify IL-4 gene expression. A phagemid containing rat IL-4 cDNA was modified to act as the template for a synthetic RNA construct; a known amount of synthetic RNA was added to total RNA from spleen and caecum of BN rats at various times after HgCl2, followed by reverse transcriptase PCR. IL-4 gene expression increased markedly in spleen and caecum after HgCl2. Splenic levels peaked by 10 days at approximately five-times baseline, then returned towards normal as the autoimmune response was spontaneously regulated. Caecal IL-4 expression peaked at 48 h, at which time we observed a previously unreported early phase of tissue injury, with necrotizing vasculitis qualitatively similar to that reported previously in the later phases of the model. These data support a key role for IL-4 in this experimental model of autoimmunity. The quantitative PCR technique can be modified for analysis of other cytokines, allowing further investigation of the role of T cell subsets in this model.link_to_subscribed_fulltex

Nitric oxide contributes to tissue injury in mercuric chloride-induced autoimmunity

Recent data has suggested a role for nitric oxide (NO) both in the induction of immunity and as an effector of tissue injury in experimental models of inflammation. In this study, we have tested the efficacy of two inhibitors of NO synthase, N(G)-monomethyl-L-arginine (L-NMMA) and aminoguanidine (AG), to modify the autoimmune leucocytoclastic necrotizing vasculitis which develops following the administration of mercuric chloride (HgCl2) to the Brown Norway rat. Neither agent affected the induction of autoimmunity as judged by plasma IgE titres or the degree of tissue neutrophil infiltration; however, L-NMMA did significantly attenuate tissue injury scores. We conclude that inhibition of NO synthase does not influence the induction of autoimmunity by HgCl2, but that NO does contribute to the development of tissue injury in this experimental model.link_to_subscribed_fulltex