Now you see me (CME): Concept-based model extraction

Deep Neural Networks (DNNs) have achieved remarkable performance on a range of tasks. A key step to further empowering DNN-based approaches is improving their explainability. In this work we present CME: a concept-based model extraction framework, used for analysing DNN models via concept-based extracted models. Using two case studies (dSprites, and Caltech UCSD Birds), we demonstrate how CME can be used to (i) analyse the concept information learned by a DNN model (ii) analyse how a DNN uses this concept information when predicting output labels (iii) identify key concept information that can further improve DNN predictive performance (for one of the case studies, we showed how model accuracy can be improved by over 14%, using only 30% of the available concepts)

Structural Inductive Biases in Emergent Communication

In order to communicate, humans flatten a complex representation of ideas and their attributes into a single word or a sentence. We investigate the impact of representation learning in artificial agents by developing graph referential games. We empirically show that agents parametrized by graph neural networks develop a more compositional language compared to bag-of-words and sequence models, which allows them to systematically generalize to new combinations of familiar features.Comment: The first two authors contributed equally. Poster presented at CogSci 202

Accessible reasoning with diagrams: From cognition to automation

High-tech systems are ubiquitous and often safety and se- curity critical: reasoning about their correctness is paramount. Thus, precise modelling and formal reasoning are necessary in order to convey knowledge unambiguously and accurately. Whilst mathematical mod- elling adds great rigour, it is opaque to many stakeholders which leads to errors in data handling, delays in product release, for example. This is a major motivation for the development of diagrammatic approaches to formalisation and reasoning about models of knowledge. In this paper, we present an interactive theorem prover, called iCon, for a highly expressive diagrammatic logic that is capable of modelling OWL 2 ontologies and, thus, has practical relevance. Significantly, this work is the first to design diagrammatic inference rules using insights into what humans find accessible. Specifically, we conducted an experiment about relative cognitive benefits of primitive (small step) and derived (big step) inferences, and use the results to guide the implementation of inference rules in iCon

A high resolution search for the tensor glueball candidate [xi] (2230) Crystal Barrel Collaboration

We report results of a high resolution search for the tensor glueball candidate ξ(2230) in a p̄p formation experiment. π0π0 and ηη decay channels were measured in a scan of the mass region 2220 MeV to 2240 MeV. No evidence for the existence of ξ(2230) was found. 95% confidence upper limits for the possible existence of ξ are presented

Molecular genetic identification of skeletal remains from the Second World War Konfin I mass grave in Slovenia

This paper describes molecular genetic identification of one third of the skeletal remains of 88 victims of postwar (June 1945) killings found in the Konfin I mass grave in Slovenia. Living relatives were traced for 36 victims. We analyzed 84 right femurs and compared their genetic profiles to the genetic material of living relatives. We cleaned the bones, removed surface contamination, and ground the bones into powder. Prior to DNA isolation using Biorobot EZ1 (Qiagen), the powder was decalcified. The nuclear DNA of the samples was quantified using the real-time polymerase chain reaction method. We extracted 0.8 to 100 ng DNA/g of bone powder from 82 bones. Autosomal genetic profiles and Y-chromosome haplotypes were obtained from 98% of the bones, and mitochondrial DNA (mtDNA) haplotypes from 95% of the bones for the HVI region and from 98% of the bones for the HVII region. Genetic profiles of the nuclear and mtDNA were determined for reference persons. For traceability in the event of contamination, we created an elimination database including genetic profiles of the nuclear and mtDNA of all persons that had been in contact with the skeletal remains. When comparing genetic profiles, we matched 28 of the 84 bones analyzed with living relatives (brothers, sisters, sons, daughters, nephews, or cousins). The statistical analyses showed a high confidence of correct identification for all 28 victims in the Konfin I mass grave (posterior probability ranged from 99.9% to more than 99.999999%)

Enzymatic Degradation of PrPSc by a Protease Secreted from Aeropyrum pernix K1

BACKGROUND: An R30 fraction from the growth medium of Aeropyrum pernix was analyzed for the protease that can digest the pathological prion protein isoform (PrP(Sc)) from different species (human, bovine, deer and mouse). METHODOLOGY/PRINCIPAL FINDINGS: Degradation of the PrP(Sc) isoform by the R30 fraction and the purified protease was evaluated using the 6H4 anti-PrP monoclonal antibody. Fragments from the N-terminal and C-terminal of PrP(Sc) were also monitored by Western blotting using the EB8 anti-PrP monoclonal antibody, and by dot blotting using the C7/5 anti-PrP monoclonal antibody, respectively. For detection of smaller peptides from incomplete digestion of PrP(Sc), the EB8 monoclonal antibody was used after precipitation with sodium phosphotungstate. Characterization of the purified active protease from the R30 fraction was achieved, through purification by fast protein liquid chromatography, and identification by tandem mass spectrometry the serine metalloprotease pernisine. SDS-PAGE and zymography show the purified pernisine plus its proregion with a molecular weight of ca. 45 kDa, and the mature purified pernisine as ca. 23 kDa. The purified pernisine was active between 58 °C and 99 °C, and between pH 3.5 and 8.0. The temperature and pH optima of the enzymatic activity of the purified pernisine in the presence of 1 mM CaCl(2) were 105 °C ± 0.5 °C and pH 6.5 ± 0.2, respectively. CONCLUSIONS/SIGNIFICANCE: Our study has identified and characterized pernisine as a thermostable serine metalloprotease that is secreted from A. pernix and that can digest the pathological prion protein PrP(Sc)

Improved chemical and electrochemical stability of perovskite oxides with less reducible cations at the surface

Segregation and phase separation of aliovalent dopants on perovskite oxide (ABO3) surfaces are detrimental to the performance of energy conversion systems such as solid oxide fuel/electrolysis cells and catalysts for thermochemical H2O and CO2 splitting. One key reason behind the instability of perovskite oxide surfaces is the electrostatic attraction of the negatively charged A-site dopants (for example, ) by the positively charged oxygen vacancies () enriched at the surface. Here we show that reducing the surface concentration improves the oxygen surface exchange kinetics and stability significantly, albeit contrary to the well-established understanding that surface oxygen vacancies facilitate reactions with O2 molecules. We take La0.8Sr0.2CoO3 (LSC) as a model perovskite oxide, and modify its surface with additive cations that are more and less reducible than Co on the B-site of LSC. By using ambient-pressure X-ray absorption and photoelectron spectroscopy, we proved that the dominant role of the less reducible cations is to suppress the enrichment and phase separation of Sr while reducing the concentration of and making the LSC more oxidized at its surface. Consequently, we found that these less reducible cations significantly improve stability, with up to 30 times faster oxygen exchange kinetics after 54 h in air at 530 °C achieved by Hf addition onto LSC. Finally, the results revealed a 'volcano' relation between the oxygen exchange kinetics and the oxygen vacancy formation enthalpy of the binary oxides of the additive cations. This volcano relation highlights the existence of an optimum surface oxygen vacancy concentration that balances the gain in oxygen exchange kinetics and the chemical stability loss