Robustness Verification of Support Vector Machines

We study the problem of formally verifying the robustness to adversarial examples of support vector machines (SVMs), a major machine learning model for classification and regression tasks. Following a recent stream of works on formal robustness verification of (deep) neural networks, our approach relies on a sound abstract version of a given SVM classifier to be used for checking its robustness. This methodology is parametric on a given numerical abstraction of real values and, analogously to the case of neural networks, needs neither abstract least upper bounds nor widening operators on this abstraction. The standard interval domain provides a simple instantiation of our abstraction technique, which is enhanced with the domain of reduced affine forms, which is an efficient abstraction of the zonotope abstract domain. This robustness verification technique has been fully implemented and experimentally evaluated on SVMs based on linear and nonlinear (polynomial and radial basis function) kernels, which have been trained on the popular MNIST dataset of images and on the recent and more challenging Fashion-MNIST dataset. The experimental results of our prototype SVM robustness verifier appear to be encouraging: this automated verification is fast, scalable and shows significantly high percentages of provable robustness on the test set of MNIST, in particular compared to the analogous provable robustness of neural networks

Systematizing Policy Learning: From Monolith to Dimensions

notes: The authors wish to express their gratitude to the Norwegian Political Science Association Annual Conference, 6 January 2010, University of Agder, Kristiansand, participants of the ‘Establishing Causality in Policy Learning’ panel at the American Political Science Association (APSA) annual meeting,2–5 September 2010,Washington DC, and the European Consortium of Political Research (ECPR) Joint Sessions, St Gallen, 12–17 April 2011, workshop 2. Dunlop and Radaelli gratefully acknowledge the support of the European Research Council, grant on Analysis of Learning in Regulatory Governance, ALREG, http://centres.exeter.ac.uk/ceg/research/ALREG/index.php.publication-status: AcceptedThe definitive version is available at www.blackwell-synergy.com and also from DOI: 10.1111/j.1467-9248.2012.00982.xThe field of policy learning is characterised by concept stretching and lack of systematic findings. To systematize them, we combine the classic Sartorian approach to classification with the more recent insights on explanatory typologies. At the outset, we classify per genus et differentiam – distinguishing between the genus and the different species within it. By drawing on the technique of explanatory typologies to introduce a basic model of policy learning, we identify four major genera in the literature. We then generate variation within each cell by using rigorous concepts drawn from adult education research. Specifically, we conceptualize learning as control over the contents and goals of knowledge. By looking at learning through the lenses of knowledge utilization, we show that the basic model can be expanded to reveal sixteen different species. These types are all conceptually possible, but are not all empirically established in the literature. Up until now the scope conditions and connections among types have not been clarified. Our reconstruction of the field sheds light on mechanisms and relations associated with alternatives operationalizations of learning and the role of actors in the process of knowledge construction and utilization. By providing a comprehensive typology, we mitigate concept stretching problems and aim to lay the foundations for the systematic comparison across and within cases of policy learning.European Research Council, grant no 230267 on Analysis of Learning in Regulatory Governance, ALREG

ISL1 Directly Regulates FGF10 Transcription during Human Cardiac Outflow Formation

The LIM homeodomain gene Islet-1 (ISL1) encodes a transcription factor that has been associated with the multipotency of human cardiac progenitors, and in mice enables the correct deployment of second heart field (SHF) cells to become the myocardium of atria, right ventricle and outflow tract. Other markers have been identified that characterize subdomains of the SHF, such as the fibroblast growth factor Fgf10 in its anterior region. While functional evidence of its essential contribution has been demonstrated in many vertebrate species, SHF expression of Isl1 has been shown in only some models. We examined the relationship between human ISL1 and FGF10 within the embryonic time window during which the linear heart tube remodels into four chambers. ISL1 transcription demarcated an anatomical region supporting the conserved existence of a SHF in humans, and transcription factors of the GATA family were co-expressed therein. In conjunction, we identified a novel enhancer containing a highly conserved ISL1 consensus binding site within the FGF10 first intron. ChIP and EMSA demonstrated its direct occupation by ISL1. Transcription mediated by ISL1 from this FGF10 intronic element was enhanced by the presence of GATA4 and TBX20 cardiac transcription factors. Finally, transgenic mice confirmed that endogenous factors bound the human FGF10 intronic enhancer to drive reporter expression in the developing cardiac outflow tract. These findings highlight the interest of examining developmental regulatory networks directly in human tissues, when possible, to assess candidate non-coding regions that may be responsible for congenital malformations

Coe Genes Are Expressed in Differentiating Neurons in the Central Nervous System of Protostomes

Genes of the coe (collier/olfactory/early B-cell factor) family encode Helix-Loop-Helix transcription factors that are widely conserved in metazoans and involved in many developmental processes, neurogenesis in particular. Whereas their functions during vertebrate neural tube formation have been well documented, very little is known about their expression and role during central nervous system (CNS) development in protostomes. Here we characterized the CNS expression of coe genes in the insect Drosophila melanogaster and the polychaete annelid Platynereis dumerilii, which belong to different subgroups of protostomes and show strikingly different modes of development. In the Drosophila ventral nerve cord, we found that the Collier-expressing cells form a subpopulation of interneurons with diverse molecular identities and neurotransmitter phenotypes. We also demonstrate that collier is required for the proper differentiation of some interneurons belonging to the Eve-Lateral cluster. In Platynereis dumerilii, we cloned a single coe gene, Pdu-coe, and found that it is exclusively expressed in post mitotic neural cells. Using an original technique of in silico 3D registration, we show that Pdu-coe is co-expressed with many different neuronal markers and therefore that, like in Drosophila, its expression defines a heterogeneous population of neurons with diverse molecular identities. Our detailed characterization and comparison of coe gene expression in the CNS of two distantly-related protostomes suggest conserved roles of coe genes in neuronal differentiation in this clade. As similar roles have also been observed in vertebrates, this function was probably already established in the last common ancestor of all bilaterians

Developmental expression of COE across the Metazoa supports a conserved role in neuronal cell-type specification and mesodermal development

The transcription factor COE (collier/olfactory-1/early B cell factor) is an unusual basic helix–loop–helix transcription factor as it lacks a basic domain and is maintained as a single copy gene in the genomes of all currently analysed non-vertebrate Metazoan genomes. Given the unique features of the COE gene, its proposed ancestral role in the specification of chemosensory neurons and the wealth of functional data from vertebrates and Drosophila, the evolutionary history of the COE gene can be readily investigated. We have examined the ways in which COE expression has diversified among the Metazoa by analysing its expression from representatives of four disparate invertebrate phyla: Ctenophora (Mnemiopsis leidyi); Mollusca (Haliotis asinina); Annelida (Capitella teleta and Chaetopterus) and Echinodermata (Strongylocentrotus purpuratus). In addition, we have studied COE function with knockdown experiments in S. purpuratus, which indicate that COE is likely to be involved in repressing serotonergic cell fate in the apical ganglion of dipleurula larvae. These analyses suggest that COE has played an important role in the evolution of ectodermally derived tissues (likely primarily nervous tissues) and mesodermally derived tissues. Our results provide a broad evolutionary foundation from which further studies aimed at the functional characterisation and evolution of COE can be investigated

5-aminosalicylic acid inhibits stem cell function in human adenoma derived cells: Implications for chemoprophylaxis in colorectal tumorigenesis

Background: Most colorectal cancers (CRC) arise sporadically from precursor lesions: colonic polyps. Polyp resection prevents progression to CRC. Risk of future polyps is proportional to the number and size of polyps detected at screening, allowing identification of high-risk individuals who may benefit from effective chemoprophylaxis. We aimed to investigate the potential of 5-aminosalicylic acid (5-ASA), a medication used in the treatment of ulcerative colitis, as a possible preventative agent for sporadic CRC. Methods: Human colorectal adenoma (PC/AA/C1, S/AN/C1 and S/RG/C2), transformed adenoma PC/AA/C1/SB10 and carcinoma cell lines (LS174T and SW620) were treated with 5-ASA. The effect on growth in two- and three-dimensional (3D) culture, β-catenin transcriptional activity and on cancer stemness properties of the cells were investigated. Results: 5-ASA was shown, in vitro, to inhibit the growth of adenoma cells and suppress β-catenin transcriptional activity. Downregulation of β-catenin was found to repress expression of stem cell marker LGR5 (leucine-rich G protein-coupled receptor-5) and functionally suppress stemness in human adenoma and carcinoma cells using 3D models of tumorigenesis. Conclusions: 5-ASA can suppress the cancer stem phenotype in adenoma-derived cells. Affordable and well-tolerated, 5-ASA is an outstanding candidate as a chemoprophylactic medication to reduce the risk of colorectal polyps and CRC in those at high risk