Uncovering Instabilities in Variational-Quantum Deep Q-Networks

Deep Reinforcement Learning (RL) has considerably advanced over the past decade. At the same time, state-of-the-art RL algorithms require a large computational budget in terms of training time to converge. Recent work has started to approach this problem through the lens of quantum computing, which promises theoretical speed-ups for several traditionally hard tasks. In this work, we examine a class of hybrid quantum-classical RL algorithms that we collectively refer to as variational quantum deep Q-networks (VQ-DQN). We show that VQ-DQN approaches are subject to instabilities that cause the learned policy to diverge, study the extent to which this afflicts reproduciblity of established results based on classical simulation, and perform systematic experiments to identify potential explanations for the observed instabilities. Additionally, and in contrast to most existing work on quantum reinforcement learning, we execute RL algorithms on an actual quantum processing unit (an IBM Quantum Device) and investigate differences in behaviour between simulated and physical quantum systems that suffer from implementation deficiencies. Our experiments show that, contrary to opposite claims in the literature, it cannot be conclusively decided if known quantum approaches, even if simulated without physical imperfections, can provide an advantage as compared to classical approaches. Finally, we provide a robust, universal and well-tested implementation of VQ-DQN as a reproducible testbed for future experiments.Comment: Authors Maja Franz, Lucas Wolf, Maniraman Periyasamy contributed equally (name order randomised). To be published in the Journal of The Franklin Institut

European scenarios for future biological invasions

1. Invasive alien species are one of the major threats to global biodiversity, ecosystem integrity, nature's contributions to people and human health. While scenarios about potential future developments have been available for other global change drivers for quite some time, we largely lack an understanding of how biological invasions might unfold in the future across spatial scales. 2. Based on previous work on global invasion scenarios, we developed a workflow to downscale global scenarios to a regional and policy-relevant context. We applied this workflow at the European scale to create four European scenarios of biological invasions until 2050 that consider different environmental, socio-economic and socio-cultural trajectories, namely the European Alien Species Narratives (Eur-ASNs). 3. We compared the Eur-ASNs with their previously published global counterparts (Global-ASNs), assessing changes in 26 scenario variables. This assessment showed a high consistency between global and European scenarios in the logic and assumptions of the scenario variables. However, several discrepancies in scenario variable trends were detected that could be attributed to scale differences. This suggests that the workflow is able to capture scale-dependent differences across scenarios. 4. We also compared the Global- and Eur-ASNs with the widely used Global and European Shared Socioeconomic Pathways (SSPs), a set of scenarios developed in the context of climate change to capture different future socio-economic trends. Our comparison showed considerable divergences in the scenario space occupied by the different scenarios, with overall larger differences between the ASNs and SSPs than across scales (global vs. European) within the scenario initiatives. 5. Given the differences between the ASNs and SSPs, it seems that the SSPs do not adequately capture the scenario space relevant to understanding the complex future of biological invasions. This underlines the importance of developing independent but complementary scenarios focussed on biological invasions. The downscaling workflow we implemented and presented here provides a tool to develop such scenarios across different regions and contexts. This is a major step towards an improved understanding of all major drivers of global change, including biological invasions

A scenario-guided strategy for the future management of biological invasions

Future dynamics of biological invasions are highly uncertain because they depend on multiple social–ecological drivers. We used a scenario-based approach to explore potential management options for invasive species in Europe. During two workshops involving a multidisciplinary team of experts, we developed a management strategy arranged into 19 goals relating to policy, research, public awareness, and biosecurity. We conceived solutions for achieving these goals under different plausible future scenarios, and identified four interrelated recommendations around which any long-term strategy for managing invasive species can be structured: (1) a European biosecurity regime, (2) a dedicated communication strategy, (3) data standardization and management tools, and (4) a monitoring and assessment system. Finally, we assessed the feasibility of the management strategy and found substantial differences among scenarios. Collectively, our results indicate that it is time for a new strategy for managing biological invasions in Europe, one that is based on a more integrative approach across socioeconomic sectors and countries

Facilitating CAD/CAM nasoalveolar molding therapy with a novel click-in system for nasal stents ensuring a quick and user-friendly chairside nasal stent exchange

Nasoalveolar molding (NAM) aims to improve nasal symmetry with a nasal stent in cleft lip and palate (CLP) patients. When plates have to be exchanged because of dentoalveolar growth or cleft reduction, the nasal stent has to be mounted onto a new plate. This procedure elongates visiting hours for patients and parents or requires second treatment sessions. This study introduces a quick-lock additive manufacturing solution for chairside nasal stent exchange called RapidNAM. A novel taping retention pin has been designed that enables nasal stent insertion. Patients with unilateral CLP were included in this study. Plaster models were digitalized and measured by two independent observers. Two methods of CAD/CAM-molding therapies were compared: (i) conventional adhesion of a nasal stent (CAD/CAM NAM);(ii) quick-lock system in which the nasal stent was transferred to another plate (RapidNAM). CAD/CAM NAM and its refinement RapidNAM significantly increased the cleft-side nasal height and tilted the nose towards symmetry. The quick-lock system minimizes wire adaptations, since the preexisting stent can be reused. The new nasal stent development seems a feasible solution to minimize visiting hours but with clinically satisfactory results. This new nasal stent system combines traditional elements of NAM with CAD/CAM-technology

Measurements of Higgs boson production and couplings in diboson final states with the ATLAS detector at the LHC

Measurements are presented of production properties and couplings of the recently discovered Higgs boson using the decays into boson pairs, H →γ γ, H → Z Z∗ →4l and H →W W∗ →lνlν. The results are based on the complete pp collision data sample recorded by the ATLAS experiment at the CERN Large Hadron Collider at centre-of-mass energies of √s = 7 TeV and √s = 8 TeV, corresponding to an integrated luminosity of about 25 fb−1. Evidence for Higgs boson production through vector-boson fusion is reported. Results of combined fits probing Higgs boson couplings to fermions and bosons, as well as anomalous contributions to loop-induced production and decay modes, are presented. All measurements are consistent with expectations for the Standard Model Higgs boson

Standalone vertex finding in the ATLAS muon spectrometer

A dedicated reconstruction algorithm to find decay vertices in the ATLAS muon spectrometer is presented. The algorithm searches the region just upstream of or inside the muon spectrometer volume for multi-particle vertices that originate from the decay of particles with long decay paths. The performance of the algorithm is evaluated using both a sample of simulated Higgs boson events, in which the Higgs boson decays to long-lived neutral particles that in turn decay to bbar b final states, and pp collision data at √s = 7 TeV collected with the ATLAS detector at the LHC during 2011

Measurement of the top quark-pair production cross section with ATLAS in pp collisions at \sqrt{s}=7\TeV

A measurement of the production cross-section for top quark pairs(\ttbar) in $pp$ collisions at \sqrt{s}=7 \TeV is presented using data recorded with the ATLAS detector at the Large Hadron Collider. Events are selected in two different topologies: single lepton (electron $e$ or muon $\mu$) with large missing transverse energy and at least four jets, and dilepton ($ee$, $\mu\mu$ or $e\mu$) with large missing transverse energy and at least two jets. In a data sample of 2.9 pb-1, 37 candidate events are observed in the single-lepton topology and 9 events in the dilepton topology. The corresponding expected backgrounds from non-\ttbar Standard Model processes are estimated using data-driven methods and determined to be $12.2 \pm 3.9$ events and $2.5 \pm 0.6$ events, respectively. The kinematic properties of the selected events are consistent with SM \ttbar production. The inclusive top quark pair production cross-section is measured to be \sigmattbar=145 \pm 31 ^{+42}_{-27} pb where the first uncertainty is statistical and the second systematic. The measurement agrees with perturbative QCD calculations.Comment: 30 pages plus author list (50 pages total), 9 figures, 11 tables, CERN-PH number and final journal adde

Measurement of the top quark pair cross section with ATLAS in pp collisions at √s=7 TeV using final states with an electron or a muon and a hadronically decaying τ lepton

A measurement of the cross section of top quark pair production in proton-proton collisions recorded with the ATLAS detector at the Large Hadron Collider at a centre-of-mass energy of 7 TeV is reported. The data sample used corresponds to an integrated luminosity of 2.05 fb -1. Events with an isolated electron or muon and a τ lepton decaying hadronically are used. In addition, a large missing transverse momentum and two or more energetic jets are required. At least one of the jets must be identified as originating from a b quark. The measured cross section, σtt-=186±13(stat.)±20(syst.)±7(lumi.) pb, is in good agreement with the Standard Model prediction

Hunt for new phenomena using large jet multiplicities and missing transverse momentum with ATLAS in 4.7 fb−1 of √s=7 TeV proton-proton collisions

Results are presented of a search for new particles decaying to large numbers of jets in association with missing transverse momentum, using 4.7 fb−1 of pp collision data at s√=7TeV collected by the ATLAS experiment at the Large Hadron Collider in 2011. The event selection requires missing transverse momentum, no isolated electrons or muons, and from ≥6 to ≥9 jets. No evidence is found for physics beyond the Standard Model. The results are interpreted in the context of a MSUGRA/CMSSM supersymmetric model, where, for large universal scalar mass m 0, gluino masses smaller than 840 GeV are excluded at the 95% confidence level, extending previously published limits. Within a simplified model containing only a gluino octet and a neutralino, gluino masses smaller than 870 GeV are similarly excluded for neutralino masses below 100 GeV

Genome-wide association and HLA fine-mapping studies identify risk loci and genetic pathways underlying allergic rhinitis

Allergic rhinitis is the most common clinical presentation of allergy, affecting 400 million people worldwide, with increasing incidence in westernized countries1,2. To elucidate the genetic architecture and understand the underlying disease mechanisms, we carried out a meta-analysis of allergic rhinitis in 59,762 cases and 152,358 controls of European ancestry and identified a total of 41 risk loci for allergic rhinitis, including 20 loci not previously associated with allergic rhinitis, which were confirmed in a replication phase of 60,720 cases and 618,527 controls. Functional annotation implicated genes involved in various immune pathways, and fine mapping of the HLA region suggested amino acid variants important for antigen binding. We further performed genome-wide association study (GWAS) analyses of allergic sensitization against inhalant allergens and nonallergic rhinitis, which suggested shared genetic mechanisms across rhinitis-related traits. Future studies of the identified loci and genes might identify novel targets for treatment and prevention of allergic rhinitis