NeRN -- Learning Neural Representations for Neural Networks

Neural Representations have recently been shown to effectively reconstruct a wide range of signals from 3D meshes and shapes to images and videos. We show that, when adapted correctly, neural representations can be used to directly represent the weights of a pre-trained convolutional neural network, resulting in a Neural Representation for Neural Networks (NeRN). Inspired by coordinate inputs of previous neural representation methods, we assign a coordinate to each convolutional kernel in our network based on its position in the architecture, and optimize a predictor network to map coordinates to their corresponding weights. Similarly to the spatial smoothness of visual scenes, we show that incorporating a smoothness constraint over the original network's weights aids NeRN towards a better reconstruction. In addition, since slight perturbations in pre-trained model weights can result in a considerable accuracy loss, we employ techniques from the field of knowledge distillation to stabilize the learning process. We demonstrate the effectiveness of NeRN in reconstructing widely used architectures on CIFAR-10, CIFAR-100, and ImageNet. Finally, we present two applications using NeRN, demonstrating the capabilities of the learned representations

Stimulation of the Sphenopalatine Ganglion Induces Reperfusion and Blood-Brain Barrier Protection in the Photothrombotic Stroke Model

The treatment of stroke remains a challenge. Animal studies showing that electrical stimulation of the sphenopalatine ganglion (SPG) exerts beneficial effects in the treatment of stroke have led to the initiation of clinical studies. However, the detailed effects of SPG stimulation on the injured brain are not known.The effect of acute SPG stimulation was studied by direct vascular imaging, fluorescent angiography and laser Doppler flowmetry in the sensory motor cortex of the anaesthetized rat. Focal cerebral ischemia was induced by the rose bengal (RB) photothrombosis method. In chronic experiments, SPG stimulation, starting 15 min or 24 h after photothrombosis, was given for 3 h per day on four consecutive days. Structural damage was assessed using histological and immunohistochemical methods. Cortical functions were assessed by quantitative analysis of epidural electro-corticographic (ECoG) activity continuously recorded in behaving animals.Stimulation induced intensity- and duration-dependent vasodilation and increased cerebral blood flow in both healthy and photothrombotic brains. In SPG-stimulated rats both blood brain-barrier (BBB) opening, pathological brain activity and lesion volume were attenuated compared to untreated stroke animals, with no apparent difference in the glial response surrounding the necrotic lesion.SPG-stimulation in rats induces vasodilation of cortical arterioles, partial reperfusion of the ischemic lesion, and normalization of brain functions with reduced BBB dysfunction and stroke volume. These findings support the potential therapeutic effect of SPG stimulation in focal cerebral ischemia even when applied 24 h after stroke onset and thus may extend the therapeutic window of currently administered stroke medications

Mutations in CPAMD8 cause a unique form of autosomal-recessive anterior segment dysgenesis

Anterior segment dysgeneses (ASDs) comprise a spectrum of developmental disorders affecting the anterior segment of the eye. Here, we describe three unrelated families affected by a previously unclassified form of ASD. Shared ocular manifestations include bilateral iris hypoplasia, ectopia lentis, corectopia, ectropion uveae, and cataracts. Whole-exome sequencing and targeted Sanger sequencing identified mutations in CPAMD8 (C3 and PZP-like alpha-2-macroglobulin domain-containing protein 8) as the cause of recessive ASD in all three families. A homozygous missense mutation in the evolutionarily conserved alpha-2-macroglobulin (A2M) domain of CPAMD8, c.4351T>C (p. Ser1451Pro), was identified in family 1. In family 2, compound heterozygous frameshift, c.2352_2353insC (p.Arg785Glnfs∗23), and splice-site, c.4549-1G>A, mutations were identified. Two affected siblings in the third family were compound heterozygous for splice-site mutations c.700+1G>T and c.4002+1G>A. CPAMD8 splice-site mutations caused aberrant pre-mRNA splicing in vivo or in vitro. Intriguingly, our phylogenetic analysis revealed rodent lineage-specific CPAMD8 deletion, precluding a developmental expression study in mice. We therefore investigated the spatiotemporal expression of CPAMD8 in the developing human eye. RT-PCR and in situ hybridization revealed CPAMD8 expression in the lens, iris, cornea, and retina early in development, including strong expression in the distal tips of the retinal neuroepithelium that form the iris and ciliary body, thus correlating CPAMD8 expression with the affected tissues. Our study delineates a unique form of recessive ASD and defines a role for CPAMD8, a protein of unknown function, in anterior segment development, implying another pathway for the pathogenicity of ASD