Avoiding Kernel Fixed Points: Computing with ELU and GELU Infinite Networks

Analysing and computing with Gaussian processes arising from infinitely wide neural networks has recently seen a resurgence in popularity. Despite this, many explicit covariance functions of networks with activation functions used in modern networks remain unknown. Furthermore, while the kernels of deep networks can be computed iteratively, theoretical understanding of deep kernels is lacking, particularly with respect to fixed-point dynamics. Firstly, we derive the covariance functions of MLPs with exponential linear units and Gaussian error linear units and evaluate the performance of the limiting Gaussian processes on some benchmarks. Secondly, and more generally, we introduce a framework for analysing the fixed-point dynamics of iterated kernels corresponding to a broad range of activation functions. We find that unlike some previously studied neural network kernels, these new kernels exhibit non-trivial fixed-point dynamics which are mirrored in finite-width neural networks.Comment: 18 pages, 9 figures, 2 tables. Corrected name particle capitalisation and formattin

Radial Velocity Studies of Close Binary Stars.VIII

Radial-velocity measurements and sine-curve fits to the orbital velocity variations are presented for the seventh set of ten close binary systems: V410 Aur, V523 Cas, QW Gem, V921 Her, V2357 Oph, V1130 Tau, HN UMa, HX UMa, HD 93917, NSV 223. All systems, but three (V523 Cas, HD 93917, NSV 223), were discovered photometrically by the Hipparcos mission. All systems are double-lined (SB2) binaries and all, but the detached, very close system V1130 Tau, are contact binaries. The broadening-function permitted improvement of the orbital elements for V523 Cas, which was the only system observed before for radial velocity variations. Spectroscopic/visual companions were detected for V410 Aur and HX UMa.Comment: AASTeX5, 4 figures, 3 tables, to appear AJ, June 200

Altered Activation Of The Rostral Anterior Cingulate Cortex In The Context Of Emotional Face Distractors In Children And Adolescents With Anxiety Disorders

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/109274/1/da22289.pd

Neural correlates of explicit and implicit emotion processing in relation to treatment response in pediatric anxiety

Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/136676/1/jcpp12658_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/136676/2/jcpp12658.pd

Autobots: Latent Variable Sequential Set Transformers

Robust multi-agent trajectory prediction is essential for the safe control of robots and vehicles that interact with humans. Many existing methods treat social and temporal information separately and therefore fall short of modelling the joint future trajectories of all agents in a socially consistent way. To address this, we propose a new class of Latent Variable Sequential Set Transformers which autoregressively model multi-agent trajectories. We refer to these architectures as "AutoBots". AutoBots model the contents of sets (e.g. representing the properties of agents in a scene) over time and employ multi-head self-attention blocks over these sequences of sets to encode the sociotemporal relationships between the different actors of a scene. This produces either the trajectory of one ego-agent or a distribution over the future trajectories for all agents under consideration. Our approach works for general sequences of sets and we provide illustrative experiments modelling the sequential structure of the multiple strokes that make up symbols in the Omniglot data. For the single-agent prediction case, we validate our model on the NuScenes motion prediction task and achieve competitive results on the global leaderboard. In the multi-agent forecasting setting, we validate our model on TrajNet. We find that our method outperforms physical extrapolation and recurrent network baselines and generates scene-consistent trajectories.Comment: 21 pages, 15 figures, 5 table

Radial Velocity Studies of Close Binary Stars. IX

Radial-velocity measurements and sine-curve fits to the orbital velocity variations are presented for the eighth set of ten close binary systems: AB And, V402 Aur, V445 Cep, V2082 Cyg, BX Dra, V918 Her, V502 Oph, V1363 Ori, KP Peg, V335 Peg. Half of the systems (V445 Cep, V2082 Cyg, V918 Her, V1363 Ori, V335 Peg) were discovered photometrically by the Hipparcos mission and all systems are double-lined (SB2) contact binaries. The broadening function method permitted improvement of the orbital elements for AB And and V502 Oph. The other systems have been observed for radial velocity variations for the first time; in this group are five bright (V<7.5) binaries: V445 Cep, V2082 Cyg, V918 Her, KP Peg and V335 Peg. Several of the studied systems are prime candidates for combined light and radial-velocity synthesis solutions.Comment: 17+ pages, 2 tables, 4 figure

Association of Genetic Variants With Primary Open-Angle Glaucoma Among Individuals With African Ancestry.

Importance:Primary open-angle glaucoma presents with increased prevalence and a higher degree of clinical severity in populations of African ancestry compared with European or Asian ancestry. Despite this, individuals of African ancestry remain understudied in genomic research for blinding disorders. Objectives:To perform a genome-wide association study (GWAS) of African ancestry populations and evaluate potential mechanisms of pathogenesis for loci associated with primary open-angle glaucoma. Design, Settings, and Participants:A 2-stage GWAS with a discovery data set of 2320 individuals with primary open-angle glaucoma and 2121 control individuals without primary open-angle glaucoma. The validation stage included an additional 6937 affected individuals and 14 917 unaffected individuals using multicenter clinic- and population-based participant recruitment approaches. Study participants were recruited from Ghana, Nigeria, South Africa, the United States, Tanzania, Britain, Cameroon, Saudi Arabia, Brazil, the Democratic Republic of the Congo, Morocco, Peru, and Mali from 2003 to 2018. Individuals with primary open-angle glaucoma had open iridocorneal angles and displayed glaucomatous optic neuropathy with visual field defects. Elevated intraocular pressure was not included in the case definition. Control individuals had no elevated intraocular pressure and no signs of glaucoma. Exposures:Genetic variants associated with primary open-angle glaucoma. Main Outcomes and Measures:Presence of primary open-angle glaucoma. Genome-wide significance was defined as P &lt; 5 × 10-8 in the discovery stage and in the meta-analysis of combined discovery and validation data. Results:A total of 2320 individuals with primary open-angle glaucoma (mean [interquartile range] age, 64.6 [56-74] years; 1055 [45.5%] women) and 2121 individuals without primary open-angle glaucoma (mean [interquartile range] age, 63.4 [55-71] years; 1025 [48.3%] women) were included in the discovery GWAS. The GWAS discovery meta-analysis demonstrated association of variants at amyloid-β A4 precursor protein-binding family B member 2 (APBB2; chromosome 4, rs59892895T&gt;C) with primary open-angle glaucoma (odds ratio [OR], 1.32 [95% CI, 1.20-1.46]; P = 2 × 10-8). The association was validated in an analysis of an additional 6937 affected individuals and 14 917 unaffected individuals (OR, 1.15 [95% CI, 1.09-1.21]; P &lt; .001). Each copy of the rs59892895*C risk allele was associated with increased risk of primary open-angle glaucoma when all data were included in a meta-analysis (OR, 1.19 [95% CI, 1.14-1.25]; P = 4 × 10-13). The rs59892895*C risk allele was present at appreciable frequency only in African ancestry populations. In contrast, the rs59892895*C risk allele had a frequency of less than 0.1% in individuals of European or Asian ancestry. Conclusions and Relevance:In this genome-wide association study, variants at the APBB2 locus demonstrated differential association with primary open-angle glaucoma by ancestry. If validated in additional populations this finding may have implications for risk assessment and therapeutic strategies

Effects of intrauterine exposure to synthetic glucocorticoids on fetal, newborn, and infant hypothalamic-pituitary-adrenal axis function in humans : a systematic review

BACKGROUND: Synthetic glucocorticoids are commonly used in reproductive medicine. Fetal organ systems are highly sensitive to changes in the intrauterine environment, including overexposure to glucocorticoids. Structural and functional alterations resulting from such changes may persist throughout life and have been associated with diverse diseases. One system that could be particularly sensitive to fetal glucocorticoid overexposure is the hypothalamic-pituitary-adrenal (hpa) axis. Many human studies have investigated this possibility, but a systematic review to identify consistent, emergent findings is lacking. METHODS: We systematically review 49 human studies, assessing the effects of intrauterine exposure to synthetic glucocorticoids on fetal, neonate, and infant hpa function. RESULTS: Study quality varied considerably, but the main findings held true after restricting the analyses to higher-quality studies: intrauterine exposure to synthetic glucocorticoids reduces offspring hpa activity under unstimulated conditions after pain but not pharmacological challenge. Although reduced unstimulated hpa function appears to recover within the first 2 wk postpartum, blunted hpa reactivity to pain is likely to persist throughout the first 4 months of life. There is some evidence that the magnitude of the effects is correlated with the total amount of glucocorticoids administered and varies with the time interval between glucocorticoid exposure and hpa assessment. CONCLUSIONS: This systematic review has allowed the demonstration of the way in which intrauterine exposure to various regimens of synthetic glucocorticoids affects various forms of hpa function. As such, it guides future studies in terms of which variables need to be focused on in order to further strengthen the understanding of such therapy, whilst continuing to profit from its clinical benefits