Saliency-based approaches for multidimensional explainability of deep networks

In deep learning, visualization techniques extract the salient patterns exploited by deep networks to perform a task (e.g. image classification) focusing on single images. These methods allow a better understanding of these complex models, empowering the identification of the most informative parts of the input data. Beyond the deep network understanding, visual saliency is useful for many quantitative reasons and applications, both in the 2D and 3D domains, such as the analysis of the generalization capabilities of a classifier and autonomous navigation. In this thesis, we describe an approach to cope with the interpretability problem of a convolutional neural network and propose our ideas on how to exploit the visualization for applications like image classification and active object recognition. After a brief overview on common visualization methods producing attention/saliency maps, we will address two separate points: firstly, we will describe how visual saliency can be effectively used in the 2D domain (e.g. RGB images) to boost image classification performances: as a matter of fact, visual summaries, i.e. a compact representation of an ensemble of saliency maps, can be used to improve the classification accuracy of a network through summary-driven specializations. Then, we will present a 3D active recognition system that allows to consider different views of a target object, overcoming the single-view hypothesis of classical object recognition, making the classification problem much easier in principle. Here we adopt such attention maps in a quantitative fashion, by building a 3D dense saliency volume which fuses together saliency maps obtained from different viewpoints, obtaining a continuous proxy on which parts of an object are more discriminative for a given classifier. Finally, we will show how to inject this representations in a real world application, so that an agent (e.g. robot) can move knowing the capabilities of its classifier

Dissolved humic substances supplied as potential enhancers of Cu, Cd, and Pb adsorption by two different mangrove sediments

Purpose The external supply of humic substances has been recently suggested for the remediation of metal-polluted sediments; however, little is known about how to supply them and their effects on metal mobility. The study sought to investigate the sediment\u2014metals\u2014humic substance interaction in mangrove forest sediments. We aimed to evaluate the sediment adsorption potential in the case of large and rapid metal loads, as recently occurred in the Doce River (Brazil). Materials and methods In each mangrove forest sampling point of the Benevente River (RB) and Vitoria bay (MO), sediments were collected randomly along the river banks at a depth of 0\u201310 cm. Samples were characterized in terms of pH, CEC, organic carbon, texture, specific surface area, and elemental composition. The heavy metal content was measured by mass absorption spectrophotometry. Humic substances were extracted from the sediments according to the International Humic Substances Society (IHSS) method, avoiding separation of fulvic and humic acids. Original sediments were supplemented with humic substances and six Cu, Cd, or Pb concentrations. Freundlich and Langmuir equations were employed to create adsorption isotherms. Results and discussion The two sediments are significantly different, specifically with regard to organic carbon and Fe content, texture, and specific surface area. External humic substances increased the Cu adsorption capacity in both sediments but without an important change in Cu adsorption dynamics. Humic substances slightly increased the sediment adsorption capacity of Pb in RB sediment while they decreased in MO sediment, characterized by lower specific surface area, probably due to coverage of the active adsorption sites. Cd isotherms showed that the different characteristics of sediments alone do not affect Cd adsorption, but coupled with humic substances; Cd affinity for the soil surface increased five times in RB sediments confirming sediment-metal- humic substance interactions. Conclusions Humic substances affect soil metal retention mainly by altering the ion affinity for sediment surface, leading to contrasting results. The Fe concentration could be important depending on specific surface area and humic substance percentage, due to its capacity to form spheroids linked to molecules of humic substances on the clay surface. Several works have been carried out on this research area, but due to the many variables and different metal ions, we recommend further studies

Recognition self-awareness for active object recognition on depth images

We propose an active object recognition framework that introduces the recognition self-awareness, which is an intermediate level of reasoning to decide which views to cover during the object exploration. This is built first by learning a multi-view deep 3D object classifier; subsequently, a 3D dense saliency volume is generated by fusing together single-view visualization maps, these latter obtained by computing the gradient map of the class label on different image planes. The saliency volume indicates which object parts the classifier considers more important for deciding a class. Finally, the volume is injected in the observation model of a Partially Observable Markov Decision Process (POMDP). In practice, the robot decides which views to cover, depending on the expected ability of the classifier to discriminate an object class by observing a specific part. For example, the robot will look for the engine to discriminate between a bicycle and a motorbike, since the classifier has found that part as highly discriminative. Experiments are carried out on depth images with both simulated and real data, showing that our framework predicts the object class with higher accuracy and lower energy consumption than a set of alternatives

Subtotal resection of vestibular schwannoma: evaluation with Ki-67 measurement, magnetic resonance imaging, and long-term observation

Purpose The aim of this study was to compare the postoperative clinical and radiological data of patients with vestibular schwannomas who were initially managed by near total resection (NTR) or subtotal resection (STR). The Ki-67 analysis results were compared with tumor regrowth to determine the presence of a correlation between this proliferative index and postoperative tumor regrowth. Study Design Seventeen adult patients (7 male, 10 female) were retrospectively reviewed. Nine (52.9%) and eight (47.1%) patients underwent NTR and STR, respectively. Postoperative clinical and radiological data associated with vestibular schwannoma growth were compared with the Ki-67 immunohistochemical analysis results. Results Evidence of clinically significant regrowth was observed in four (23.5%) patients. Patients who underwent NTR had a lower rate/incidence of tumor regrowth than did patients who underwent STR. Patients with a higher Ki-67 index had the highest tumor regrowth rates. Conclusions Our study indicates that assessment of the Ki-67 index may be useful for determining the probability of regrowth of vestibular schwannomas when only partial removal is accomplished

Abciximab: a reappraisal of its use in coronary care

Platelet reactivity plays a pivotal role in the pathogenesis of ischemic adverse events during and after acute coronary syndromes (ACS), and percutaneous coronary intervention (PCI). Glycoprotein (GP) IIb/IIIa inhibitors are the strongest antiplatelet agents currently available on the market and three different compounds, namely abciximab, tirofiban, and eptifibatide, have been approved for clinical use. Abciximab has been investigated in the clinical field far more extensively than the other GPIIb/IIIa inhibitors. Abciximab is an anti-integrin Fab fragment of a human – mouse chimeric monoclonal antibody with high affinity and a slow dissociation rate from the GP IIb/IIIa platelet receptor. Abciximab, given shortly before the coronary intervention, is superior to placebo in reducing the acute risk of ischemic complications (EPIC, EPISTENT, EPILOG trials); moreover, in the ISAR-REACT 2 study abciximab has been shown to reduce the risk of adverse events in patients with non ST-segment elevation ACS who are undergoing PCI even after optimal pre-treatment with 600 mg of clopidogrel. Finally, abciximab has been also used in abciximab-coated stent, with only bolus administration regimen and for direct intracoronary use with promising results that may extend and/or modify its current use in clinical practice in future