The Dreaming Variational Autoencoder for Reinforcement Learning Environments

Reinforcement learning has shown great potential in generalizing over raw sensory data using only a single neural network for value optimization. There are several challenges in the current state-of-the-art reinforcement learning algorithms that prevent them from converging towards the global optima. It is likely that the solution to these problems lies in short- and long-term planning, exploration and memory management for reinforcement learning algorithms. Games are often used to benchmark reinforcement learning algorithms as they provide a flexible, reproducible, and easy to control environment. Regardless, few games feature a state-space where results in exploration, memory, and planning are easily perceived. This paper presents The Dreaming Variational Autoencoder (DVAE), a neural network based generative modeling architecture for exploration in environments with sparse feedback. We further present Deep Maze, a novel and flexible maze engine that challenges DVAE in partial and fully-observable state-spaces, long-horizon tasks, and deterministic and stochastic problems. We show initial findings and encourage further work in reinforcement learning driven by generative exploration.Comment: Best Student Paper Award, Proceedings of the 38th SGAI International Conference on Artificial Intelligence, Cambridge, UK, 2018, Artificial Intelligence XXXV, 201

Otoferlin acts as a Ca2+ sensor for vesicle fusion and vesicle pool replenishment at auditory hair cell ribbon synapses

Hearing relies on rapid, temporally precise, and sustained neurotransmitter release at the ribbon synapses of sensory cells, the inner hair cells (IHCs). This process requires otoferlin, a six C2-domain, Ca2+-binding transmembrane protein of synaptic vesicles. To decipher the role of otoferlin in the synaptic vesicle cycle, we produced knock-in mice (Otof Ala515,Ala517/Ala515,Ala517) with lower Ca2+-binding affinity of the C2C domain. The IHC ribbon synapse structure, synaptic Ca2+ currents, and otoferlin distribution were unaffected in these mutant mice, but auditory brainstem response wave-I amplitude was reduced. Lower Ca2+ sensitivity and delay of the fast and sustained components of synaptic exocytosis were revealed by membrane capacitance measurement upon modulations of intracellular Ca2+ concentration, by varying Ca2+ influx through voltage-gated Ca2+-channels or Ca2+ uncaging. Otoferlin thus functions as a Ca2+ sensor, setting the rates of primed vesicle fusion with the presynaptic plasma membrane and synaptic vesicle pool replenishment in the IHC active zone

The clinical features of the piriformis syndrome: a systematic review

Piriformis syndrome, sciatica caused by compression of the sciatic nerve by the piriformis muscle, has been described for over 70 years; yet, it remains controversial. The literature consists mainly of case series and narrative reviews. The objectives of the study were: first, to make the best use of existing evidence to estimate the frequencies of clinical features in patients reported to have PS; second, to identify future research questions. A systematic review was conducted of any study type that reported extractable data relevant to diagnosis. The search included all studies up to 1 March 2008 in four databases: AMED, CINAHL, Embase and Medline. Screening, data extraction and analysis were all performed independently by two reviewers. A total of 55 studies were included: 51 individual and 3 aggregated data studies, and 1 combined study. The most common features found were: buttock pain, external tenderness over the greater sciatic notch, aggravation of the pain through sitting and augmentation of the pain with manoeuvres that increase piriformis muscle tension. Future research could start with comparing the frequencies of these features in sciatica patients with and without disc herniation or spinal stenosis

Measurement of the top quark-pair production cross section with ATLAS in pp collisions at \sqrt{s}=7\TeV

A measurement of the production cross-section for top quark pairs(\ttbar) in $pp$ collisions at \sqrt{s}=7 \TeV is presented using data recorded with the ATLAS detector at the Large Hadron Collider. Events are selected in two different topologies: single lepton (electron $e$ or muon $\mu$) with large missing transverse energy and at least four jets, and dilepton ($ee$, $\mu\mu$ or $e\mu$) with large missing transverse energy and at least two jets. In a data sample of 2.9 pb-1, 37 candidate events are observed in the single-lepton topology and 9 events in the dilepton topology. The corresponding expected backgrounds from non-\ttbar Standard Model processes are estimated using data-driven methods and determined to be $12.2 \pm 3.9$ events and $2.5 \pm 0.6$ events, respectively. The kinematic properties of the selected events are consistent with SM \ttbar production. The inclusive top quark pair production cross-section is measured to be \sigmattbar=145 \pm 31 ^{+42}_{-27} pb where the first uncertainty is statistical and the second systematic. The measurement agrees with perturbative QCD calculations.Comment: 30 pages plus author list (50 pages total), 9 figures, 11 tables, CERN-PH number and final journal adde

Inclusive search for same-sign dilepton signatures in pp collisions at root s=7 TeV with the ATLAS detector

An inclusive search is presented for new physics in events with two isolated leptons (e or mu) having the same electric charge. The data are selected from events collected from p p collisions at root s = 7 TeV by the ATLAS detector and correspond to an integrated luminosity of 34 pb(-1). The spectra in dilepton invariant mass, missing transverse momentum and jet multiplicity are presented and compared to Standard Model predictions. In this event sample, no evidence is found for contributions beyond those of the Standard Model. Limits are set on the cross-section in a fiducial region for new sources of same-sign high-mass dilepton events in the ee, e mu and mu mu channels. Four models predicting same-sign dilepton signals are constrained: two descriptions of Majorana neutrinos, a cascade topology similar to supersymmetry or universal extra dimensions, and fourth generation d-type quarks. Assuming a new physics scale of 1 TeV, Majorana neutrinos produced by an effective operator V with masses below 460 GeV are excluded at 95% confidence level. A lower limit of 290 GeV is set at 95% confidence level on the mass of fourth generation d-type quarks

Search for direct pair production of the top squark in all-hadronic final states in proton-proton collisions at s√=8 TeV with the ATLAS detector

The results of a search for direct pair production of the scalar partner to the top quark using an integrated luminosity of 20.1fb−1 of proton–proton collision data at √s = 8 TeV recorded with the ATLAS detector at the LHC are reported. The top squark is assumed to decay via t˜→tχ˜01 or t˜→ bχ˜±1 →bW(∗)χ˜01 , where χ˜01 (χ˜±1 ) denotes the lightest neutralino (chargino) in supersymmetric models. The search targets a fully-hadronic final state in events with four or more jets and large missing transverse momentum. No significant excess over the Standard Model background prediction is observed, and exclusion limits are reported in terms of the top squark and neutralino masses and as a function of the branching fraction of t˜ → tχ˜01 . For a branching fraction of 100%, top squark masses in the range 270–645 GeV are excluded for χ˜01 masses below 30 GeV. For a branching fraction of 50% to either t˜ → tχ˜01 or t˜ → bχ˜±1 , and assuming the χ˜±1 mass to be twice the χ˜01 mass, top squark masses in the range 250–550 GeV are excluded for χ˜01 masses below 60 GeV

Standalone vertex finding in the ATLAS muon spectrometer

A dedicated reconstruction algorithm to find decay vertices in the ATLAS muon spectrometer is presented. The algorithm searches the region just upstream of or inside the muon spectrometer volume for multi-particle vertices that originate from the decay of particles with long decay paths. The performance of the algorithm is evaluated using both a sample of simulated Higgs boson events, in which the Higgs boson decays to long-lived neutral particles that in turn decay to bbar b final states, and pp collision data at √s = 7 TeV collected with the ATLAS detector at the LHC during 2011

Observation of associated near-side and away-side long-range correlations in √sNN=5.02 TeV proton-lead collisions with the ATLAS detector

Two-particle correlations in relative azimuthal angle (Δϕ) and pseudorapidity (Δη) are measured in √sNN=5.02  TeV p+Pb collisions using the ATLAS detector at the LHC. The measurements are performed using approximately 1  μb-1 of data as a function of transverse momentum (pT) and the transverse energy (ΣETPb) summed over 3.1<η<4.9 in the direction of the Pb beam. The correlation function, constructed from charged particles, exhibits a long-range (2<|Δη|<5) “near-side” (Δϕ∼0) correlation that grows rapidly with increasing ΣETPb. A long-range “away-side” (Δϕ∼π) correlation, obtained by subtracting the expected contributions from recoiling dijets and other sources estimated using events with small ΣETPb, is found to match the near-side correlation in magnitude, shape (in Δη and Δϕ) and ΣETPb dependence. The resultant Δϕ correlation is approximately symmetric about π/2, and is consistent with a dominant cos⁡2Δϕ modulation for all ΣETPb ranges and particle pT

Measurement of D*+/- meson production in jets from pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

This paper reports a measurement of D*+/- meson production in jets from proton-proton collisions at a center-of-mass energy of sqrt(s) = 7 TeV at the CERN Large Hadron Collider. The measurement is based on a data sample recorded with the ATLAS detector with an integrated luminosity of 0.30 pb^-1 for jets with transverse momentum between 25 and 70 GeV in the pseudorapidity range |eta| < 2.5. D*+/- mesons found in jets are fully reconstructed in the decay chain: D*+ -> D0pi+, D0 -> K-pi+, and its charge conjugate. The production rate is found to be N(D*+/-)/N(jet) = 0.025 +/- 0.001(stat.) +/- 0.004(syst.) for D*+/- mesons that carry a fraction z of the jet momentum in the range 0.3 < z < 1. Monte Carlo predictions fail to describe the data at small values of z, and this is most marked at low jet transverse momentum.Comment: 10 pages plus author list (22 pages total), 5 figures, 1 table, matches published version in Physical Review

Performance of the CMS Cathode Strip Chambers with Cosmic Rays

The Cathode Strip Chambers (CSCs) constitute the primary muon tracking device in the CMS endcaps. Their performance has been evaluated using data taken during a cosmic ray run in fall 2008. Measured noise levels are low, with the number of noisy channels well below 1%. Coordinate resolution was measured for all types of chambers, and fall in the range 47 microns to 243 microns. The efficiencies for local charged track triggers, for hit and for segments reconstruction were measured, and are above 99%. The timing resolution per layer is approximately 5 ns