Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networks

Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems. However, these deep models are perceived as "black box" methods considering the lack of understanding of their internal functioning. There has been a significant recent interest in developing explainable deep learning models, and this paper is an effort in this direction. Building on a recently proposed method called Grad-CAM, we propose a generalized method called Grad-CAM++ that can provide better visual explanations of CNN model predictions, in terms of better object localization as well as explaining occurrences of multiple object instances in a single image, when compared to state-of-the-art. We provide a mathematical derivation for the proposed method, which uses a weighted combination of the positive partial derivatives of the last convolutional layer feature maps with respect to a specific class score as weights to generate a visual explanation for the corresponding class label. Our extensive experiments and evaluations, both subjective and objective, on standard datasets showed that Grad-CAM++ provides promising human-interpretable visual explanations for a given CNN architecture across multiple tasks including classification, image caption generation and 3D action recognition; as well as in new settings such as knowledge distillation.Comment: 17 Pages, 15 Figures, 11 Tables. Accepted in the proceedings of IEEE Winter Conf. on Applications of Computer Vision (WACV2018). Extended version is under review at IEEE Transactions on Pattern Analysis and Machine Intelligenc

Neural Network Attributions: A Causal Perspective

We propose a new attribution method for neural networks developed using first principles of causality (to the best of our knowledge, the first such). The neural network architecture is viewed as a Structural Causal Model, and a methodology to compute the causal effect of each feature on the output is presented. With reasonable assumptions on the causal structure of the input data, we propose algorithms to efficiently compute the causal effects, as well as scale the approach to data with large dimensionality. We also show how this method can be used for recurrent neural networks. We report experimental results on both simulated and real datasets showcasing the promise and usefulness of the proposed algorithm.Comment: 17 pages, 10 Figures. Accepted in the Proceedings of the 36th International Conference on Machine Learning (ICML2019). Modifications: Added github link to code and fixed a typo in Fig.

Does the crowd support innovation? Innovation claims and success on kickstarter

Online crowdfunding is a popular new tool for raising capital to commercialize product innovation. Product innovation must be both novel and useful (1-4). Therefore, we study the role of novelty and usefulness claims on Kickstarter. Startlingly, we find that a single claim of novelty increases project funding by about 200%, a single claim of usefulness increases project funding by about 1200%, and the co-occurrence of novelty and usefulness claims lowers funding by about 26%. Our findings are encouraging because they suggest the crowd strongly supports novelty and usefulness. However, our findings are disappointing because the premise of crowdfunding is to support projects that are innovative, i.e. that are both novel and useful, rather than projects that are only novel or only useful

Network analysis reveals common host protein/s modulating pathogenesis of neurotropic viruses

Network analysis through graph theory provides a quantitative approach to characterize specific proteins and their constituent assemblies that underlie host-pathogen interactions. In the present study, graph theory was used to analyze the interactome designed out of 50 differentially expressing proteins from proteomic analysis of Chandipura Virus (CHPV, Family: Rhabdoviridae) infected mouse brain tissue to identify the primary candidates for intervention. Using the measure of degree centrality, that quantifies the connectedness of a single protein within a milieu of several other interacting proteins, DJ-1 was selected for further molecular validation. To elucidate the generality of DJ-1’s role in propagating infection its role was also monitored in another RNA virus, Japanese Encephalitis Virus (JEV, Family: Flaviviridae) infection. Concurrently, DJ-1 got over-expressed in response to reactive oxygen species (ROS) generation following viral infection which in the early phase of infection migrated to mitochondria to remove dysfunctional mitochondria through the process of mitophagy. DJ-1 was also observed to modulate the viral replication and interferon responses along with low-density lipoprotein (LDL) receptor expression in neurons. Collectively these evidences reveal a comprehensive role for DJ-1 in neurotropic virus infection in the brain

Exploiting the neoantigen landscape for immunotherapy of pancreatic ductal adenocarcinoma

Immunotherapy approaches for pancreatic ductal adenocarcinoma (PDAC) have met with limited success. It has been postulated that a low mutation load may lead to a paucity of T cells within the tumor microenvironment (TME). However, it is also possible that while neoantigens are present, an effective immune response cannot be generated due to an immune suppressive TME. To discern whether targetable neoantigens exist in PDAC, we performed a comprehensive study using genomic profiles of 221 PDAC cases extracted from public databases. Our findings reveal that: (a) nearly all PDAC samples harbor potentially targetable neoantigens; (b) T cells are present but generally show a reduced activation signature; and (c) markers of efficient antigen presentation are associated with a reduced signature of markers characterizing cytotoxic T cells. These findings suggest that despite the presence of tumor specific neoepitopes, T cell activation is actively suppressed in PDAC. Further, we identify iNOS as a potential mediator of immune suppression that might be actionable using pharmacological avenues

Clinical Efficacy of Sodium [99mTc] Pertechnetate from Low Specific Activity 99Mo/99mTc Autosolex Generator in Hospital Radiopharmacy Centre

BACKGROUND: Few nuclear reactors in the world producing high specific activity (HSA) 99Mo using enriched 235U (HEU), are aging and are planned for shut down in the near future. Further, HEU will not be freely available, due to safeguards, and the technology for 99Mo from low-enriched 235U (LEU) is not yet widely accepted since 239Pu contamination in the product is an issue. Production of 99mTc from low specific activity (LSA) 99Mo obtained from 98Mo(n,)99Mo reaction in research reactor and 100Mo(,n)99Mo reaction in accelerator or directly from 100Mo(p,2n)99mTc nuclear reaction in cyclotron, has been explored [1]. The methyl ethyl ketone (MEK) based solvent extraction technique is n well known method for the separation of 99mTc from low specific activity 99Mo. The 99Mo/99mTc autosolex generator [2], a computer controlled automated module, utilizes the conventional MEK solvent extraction method for extraction of 99mTc. Herein, we have validated the usage of autosolex for preparation of pharmacopoeia grade 99mTcO4- from 7.40-27.5 GBq of LSA 99Mo-SodiumMolybdate (99MoO42-) solution and validated the quality of the 99mTcO4- by preparing wide range of 99mTc-radiopharmaceuticals (99mTc-RP). MATERIALS AND METHODS: The 99mTcO4- was extracted from the autosolex as described in [2] starting from 7.40-27.5 GBq of LSA 99MoO42- and subjected to the required physico-chemical and biological quality control (QC) tests. The eluted 99mTcO4- labeled various fourth generation 99mTc radiopharmaceuticals cold kits (99mTc-cold kits) apart from regular 99mTc-cold kits in our centre. Various 99mTc-RP extracted 99mTcO4- using standard procedures [3] were prepared and subjected to required QC as Indian Pharmacopeia monograph [4] and used in scintigraphic imaging in patients. The radiation exposure dose to the operator were compared between autosolex and manual MEK based solvent extraction generator. RESULTS: The extracted 99mTcO4- from autosolex is a clear and colorless solution with pH between 5.0-6.5. The elemental molybdenum (Mo) and aluminum (Al) content <10µg/mL, MEK levels <0.1%, 99Mo breakthrough <0.030% and radiochemical purity (RCP) >98%. All the extracted 99mTcO4- batches complies sterility test, endotoxin limit (EL) <5EU/mL. The RCP of all the labeled 99mTc-RP >95%. The autosolex delivers much less radiation dose to the operator than the convention manually handled MEK based solvent extraction generator. CONCLUSIONS: Autosolex Generator was successfully used to obtain pharmaceutical grade 99mTcO4- from LSA 99MoO42- and generator is safe in radiological and pharmacological point of view. The suitability of the autosolex for use in hospital radiopharmacy was shown by using the 99mTcO4- to prepare various 99mTc-RP and using these 99mTc-RP for scintigraphic imaging in patients

Electoral Uncertainty, Income Inequality and the Middle Class

We investigate how electoral competition affects the income distribution in society. We utilise a standard probabilistic voting setup where parties compete at two stages. Our model delivers that greater electoral competition in a district results in equalisation of incomes therein. We check for these relationships using data from Indian national elections which are combined with consumption expenditure data rounds from the National Sample Survey Organization (1987–8 and 2004–5) to yield a district level panel. Our OLS, 2-SLS and IIV analyses consistently inform that close elections lead to lower inequality and polarisation indicating a larger middle class

Unusual Presentation of Granulomatosis With Polyangitis (Wegener's Granulomatosis)

Objective: To present a case of unusual presentations of granulomatosis with polyangitis (Wegener’s granulomatosis) with parotid swelling and intractable otitis externa. Material and method: A 22-year-old male patient presented with left sided otitis externa with left sided parotid swelling and bilateral nasal obstruction for last two weeks. CT scan of paranasal sinuses showed homogenous mass in both maxillary antra and nasal cavities. FNAC from the parotid swelling was suggestive of granulomatous disease and endoscopic biopsy from the nasal mass showed features of granulomatosis with polyangitis (Wegener’s granulomatosis). CT scan of chest revealed multiple cysts within the lung parenchyma; urine examination showed RBC and pus cells. Renal biopsy showed focal segmental glomerulonephritis. c-ANCA was highly positive and thus the diagnosis of Wegener’s granulomatosis was made. Result: Patient received cyclophosphamide and prednisolone immunsuppressive therapy for one year, which showed marked clinical improvement. Conclusion: Granulomatosis with polyangitis (Wegener’s granulomatosis) is not an uncommon entity for otolarygologists. Its usual presentation mimics chronic rhinosinusitis; but presentations like otitis externa and parotid swelling are rare for this disease