Analysing Neural Network Topologies: a Game Theoretic Approach

Artificial Neural Networks have shown impressive success in very different application cases. Choosing a proper network architecture is a critical decision for a network\u2019s success, usually done in a manual manner. As a straightforward strategy, large, mostly fully connected architectures are selected, thereby relying on a good optimization strategy to find proper weights while at the same time avoiding overfitting. However, large parts of the final network are redundant. In the best case, large parts of the network become simply irrelevant for later inferencing. In the worst case, highly parameterized architectures hinder proper optimization and allow the easy creation of adverserial examples fooling the network. A first step in removing irrelevant architectural parts lies in identifying those parts, which requires measuring the contribution of individual components such as neurons. In previous work, heuristics based on using the weight distribution of a neuron as contribution measure have shown some success, but do not provide a proper theoretical understanding. Therefore, in our work we investigate game theoretic measures, namely the Shapley value (SV), in order to separate relevant from irrelevant parts of an artificial neural network. We begin by designing a coalitional game for an artificial neural network, where neurons form coalitions and the average contributions of neurons to coalitions yield to the Shapley value. In order to measure how well the Shapley value measures the contribution of individual neurons, we remove low-contributing neurons and measure its impact on the network performance. In our experiments we show that the Shapley value outperforms other heuristics for measuring the contribution of neurons

Water, O2 and Ice in Molecular Clouds

We model the temperature and chemical structure of molecular clouds as a function of depth into the cloud, assuming a cloud of constant density n illuminated by an external FUV (6 eV < E < 13.6 eV) flux G_0 (scaling factor in multiples of the local interstellar field). Extending previous photodissociation region models, we include the freezing of species, simple grain surface chemistry, and desorption (including FUV photodesorption) of ices. We also treat the opaque cloud interior with time-dependent chemistry. Here, under certain conditions, gas phase elemental oxygen freezes out as water ice and the elemental C/O abundance ratio can exceed unity, leading to complex carbon chemistry. Gas phase H2O and O2 peak in abundance at intermediate depth into the cloud, roughly A_V~3-8 from the surface, the depth proportional to ln(G_0/n). Closer to the surface, molecules are photodissociated. Deeper into the cloud, molecules freeze to grain surfaces. At intermediate depths photodissociation rates are attenuated by dust extinction, but photodesorption prevents total freezeout. For G_0 < 500, abundances of H2O and O2 peak at values ~10^(-7), producing columns ~10^(15) per cm^2, independent of G_0 and n. The peak abundances depend primarily on the product of the photodesorption yield of water ice and the grain surface area per H nucleus. At higher values of G_0, thermal desorption of O atoms from grains enhances the gas phase H2O peak abundance and column slightly, whereas the gas phase O2 peak abundance rises to ~10^(-5) and the column to ~2x10^(16) per cm^2. We present simple analytic equations for the abundances as a function of depth which clarify the dependence on parameters. The models are applied to observations of H2O, O2, and water ice in a number of sources, including B68, NGC 2024, and Rho Oph.Comment: 70 pages including 17 figure

A delay and cost balancing protocol for message routing in mobile delay tolerant networks

The increasing pervasiveness of mobile devices with networking capabilities has led to the emergence of Mobile Delay Tolerant Networks (MDTNs). The characteristics of MDTNs, which include frequent and long-term partitions, make message routing a major challenge in these networks. Most of the existing routing protocols either allocate an unlimited number of message copies or use a xed number of message copies to route a message towards its destination. While the first approach unnecessarily oods the network, the rigidity of the second approach makes it ine cient from the viewpoint of message replication. Hence, the question that we address in this paper is: "How to dynamically allocate message copies in order to strike a balance between the delay and cost of message delivery?". We present a novel adaptive multi-step routing protocol for MDTNs. In each routing step, our protocol reasons on the remaining time-tolive of the message in order to allocate the minimum number of copies necessary to achieve a given delivery probability. Experiment results demonstrate that our protocol has a higher delivery ratio and a lower delivery cost compared to the state-of-the-art Spray-and-Wait and Bubble protocols

Acceleration of Autoimmunity by Organochlorine Pesticides in (NZB × NZW)F(1) Mice

Systemic lupus erythematosus (SLE) is an autoimmune disorder that affects women more frequently than men. In the (NZB × NZW)F(1) mouse, a murine SLE model, the presence or absence of estrogen markedly influences the rate of progression of disease. Three organochlorine pesticides with estrogenic effects were administered chronically to ovariectomized female (NZB × NZW)F(1) mice, and we measured the time to development of renal disease, the principal clinical manifestation of lupus in this model. Treatment with chlordecone, methoxychlor, or o,p′-dichlorodiphenyl-trichloroethane (o,p′-DDT) significantly decreased the time to onset of renal impairment, as did treatment with 17β-estradiol used as a positive control. In an expanded study of chlordecone, we found a dose-related early appearance of elevated anti–double-strand DNA autoantibody titers that corresponded with subsequent development of glomerulonephritis. Immunohistofluorescence confirmed early deposition of immune complexes in kidneys of mice treated with chlordecone. These observations are consistent with an effect of these organochlorine pesticides to accelerate the natural course of SLE in the (NZB × NZW)F(1) mouse. Although we originally hypothesized that the effect on progression of autoimmunity was due to estrogenic properties of the pesticides, autoimmune effects and estrogenicity, assessed through measurement of uterine hypertrophy, were not well correlated. This may indicate that uterine hypertrophy is a poor indicator of comparative estrogenic effects of organochlorine pesticides on the immune system, or that the pesticides are influencing autoimmunity through a mode of action unrelated to their estrogenicity

Autoimmune markers and vascular immune deposits in Finkelstein-Seidlmayer vasculitis: Systematic literature review.

Finkelstein-Seidlmayer vasculitis, also called acute hemorrhagic edema of young children or infantile immunoglobulin A vasculitis, is habitually a benign skin-limited small vessel leukocytoclastic vasculitis that mainly affects infants 24 months or less of age. Since this disease is commonly triggered by an infection, an immune-mediated origin has been postulated. To better appreciate the possible underlying immune mechanism of this vasculitis, we addressed circulating autoimmune markers and vascular immune deposits in patients contained in the Acute Hemorrhagic Edema BIbliographic Database, which incorporates all original reports on Finkelstein-Seidlmayer vasculitis. A test for at least one circulating autoimmune marker or a vascular immune deposit was performed in 243 cases. Subunits of complement system C4 resulted pathologically reduced in 4.7% and C3 in 1.4%, rheumatoid factor was detected in 6.1%, and antinuclear antibodies in 1.9% of cases. Antineutrophil cytoplasmic antibodies were never demonstrated. Immunofluorescence studies were performed on 125 skin biopsy specimens and resulted positive for complement subunits in 46%, fibrinogen in 45%, immunoglobulin A in 25%, immunoglobulin M in 24%, immunoglobulin G in 13%, and immunoglobulin E in 4.2% of cases. Infants testing positive for vascular immunoglobulin A deposits did not present a higher prevalence of systemic involvement or recurrences, nor a longer disease duration. In conclusion, we detected a very low prevalence of circulating autoimmune marker positivity in Finkelstein-Seidlmayer patients. Available immunofluorescence data support the notion that immune factors play a relevant role in this vasculitis. Furthermore, vascular immunoglobulin A deposits seem not to play a crucial role in this disease

Photodisintegration of the triton with realistic potentials

The process $\gamma + t \to n + d$ is treated by means of three-body integral equations employing in their kernel the W-Matrix representation of the subsystem amplitudes. As compared to the plane wave (Born) approximation the full solution of the integral equations, which takes into account the final state interaction, shows at low energies a 24% enhancement. The calculations are based on the semirealistic Malfliet-Tjon and the realistic Paris and Bonn B potentials. For comparison with earlier calculations we also present results for the Yamaguchi potential. In the low-energy region a remarkable potential dependence is observed, which vanishes at higher energies.Comment: 16 pages REVTeX, 8 postscript figures included, uses epsfig.st

Tag relatedness in image folksonomies

Folksonomies - networks of users, resources, and tags allow users to easily retrieve, organize and browse web contents. However, their advantages are still limited mainly due to the noisiness of user provided tags. To overcome this issue, we propose an approach for characterizing related tags in folksonomies: we use tag co-occurrence statistics and Laplacian score based feature selection in order to create empirical co-occurrence probability distribution for each tag; then we identify related tags on the basis of the dissimilarity between their distributions. For this purpose, we introduce variant of the Jensen-Shannon Divergence, which is more robust to statistical noise. We experimentally evaluate our approach using WordNet and compare it to a common tag-relatedness approach based on the cosine similarity. The results show the effectiveness of our approach and its advantage over the competing method