Prioritized Sweeping Neural DynaQ with Multiple Predecessors, and Hippocampal Replays

During sleep and awake rest, the hippocampus replays sequences of place cells that have been activated during prior experiences. These have been interpreted as a memory consolidation process, but recent results suggest a possible interpretation in terms of reinforcement learning. The Dyna reinforcement learning algorithms use off-line replays to improve learning. Under limited replay budget, a prioritized sweeping approach, which requires a model of the transitions to the predecessors, can be used to improve performance. We investigate whether such algorithms can explain the experimentally observed replays. We propose a neural network version of prioritized sweeping Q-learning, for which we developed a growing multiple expert algorithm, able to cope with multiple predecessors. The resulting architecture is able to improve the learning of simulated agents confronted to a navigation task. We predict that, in animals, learning the world model should occur during rest periods, and that the corresponding replays should be shuffled.Comment: Living Machines 2018 (Paris, France

Exploring out-of-equilibrium quantum magnetism and thermalization in a spin-3 many-body dipolar lattice system

Understanding quantum thermalization through entanglement build-up in isolated quantum systems addresses fundamental questions on how unitary dynamics connects to statistical physics. Here, we study the spin dynamics and approach towards local thermal equilibrium of a macroscopic ensemble of S = 3 spins prepared in a pure coherent spin state, tilted compared to the magnetic field, under the effect of magnetic dipole-dipole interactions. The experiment uses a unit filled array of 104 chromium atoms in a three dimensional optical lattice, realizing the spin-3 XXZ Heisenberg model. The buildup of quantum correlation during the dynamics, especially as the angle approaches pi/2, is supported by comparison with an improved numerical quantum phase-space method and further confirmed by the observation that our isolated system thermalizes under its own dynamics, reaching a steady state consistent with the one extracted from a thermal ensemble with a temperature dictated from the system's energy. This indicates a scenario of quantum thermalization which is tied to the growth of entanglement entropy. Although direct experimental measurements of the Renyi entropy in our macroscopic system are unfeasible, the excellent agreement with the theory, which can compute this entropy, does indicate entanglement build-up.Comment: 12 figure

Microarray Method for the Rapid Detection of Glycosaminoglycan–Protein Interactions

Glycosaminoglycans (GAGs) perform numerous vital functions within the body. As major components of the extracellular matrix, these polysaccharides participate in a diverse array of cell-signaling events. We have developed a simple microarray assay for the evaluation of protein binding to various GAG subclasses. In a single experiment, the binding to all members of the GAG family can be rapidly determined, giving insight into the relative specificity of the interactions and the importance of specific sulfation motifs. The arrays are facile to prepare from commercially available materials

Should the teaching of biological evolution include the origin of life?

The development of mainstream research on the origin of life as an outcome of Darwinian evolution is discussed. It is argued that prebiotic evolution and the origin of life should not be excluded from the syllabus and should be part of classes on biological evolution, and that the transition from non-living to living matter is best understood when seen as part of evolutionary biology. The wide acceptance of evolutionary approaches to the study of the emergence of life in European and Latin American countries is discussed

Search for new phenomena in final states with an energetic jet and large missing transverse momentum in pp collisions at √ s = 8 TeV with the ATLAS detector

Results of a search for new phenomena in final states with an energetic jet and large missing transverse momentum are reported. The search uses 20.3 fb−1 of √ s = 8 TeV data collected in 2012 with the ATLAS detector at the LHC. Events are required to have at least one jet with pT > 120 GeV and no leptons. Nine signal regions are considered with increasing missing transverse momentum requirements between Emiss T > 150 GeV and Emiss T > 700 GeV. Good agreement is observed between the number of events in data and Standard Model expectations. The results are translated into exclusion limits on models with either large extra spatial dimensions, pair production of weakly interacting dark matter candidates, or production of very light gravitinos in a gauge-mediated supersymmetric model. In addition, limits on the production of an invisibly decaying Higgs-like boson leading to similar topologies in the final state are presente

Search for direct pair production of the top squark in all-hadronic final states in proton-proton collisions at s√=8 TeV with the ATLAS detector

The results of a search for direct pair production of the scalar partner to the top quark using an integrated luminosity of 20.1fb−1 of proton–proton collision data at √s = 8 TeV recorded with the ATLAS detector at the LHC are reported. The top squark is assumed to decay via t˜→tχ˜01 or t˜→ bχ˜±1 →bW(∗)χ˜01 , where χ˜01 (χ˜±1 ) denotes the lightest neutralino (chargino) in supersymmetric models. The search targets a fully-hadronic final state in events with four or more jets and large missing transverse momentum. No significant excess over the Standard Model background prediction is observed, and exclusion limits are reported in terms of the top squark and neutralino masses and as a function of the branching fraction of t˜ → tχ˜01 . For a branching fraction of 100%, top squark masses in the range 270–645 GeV are excluded for χ˜01 masses below 30 GeV. For a branching fraction of 50% to either t˜ → tχ˜01 or t˜ → bχ˜±1 , and assuming the χ˜±1 mass to be twice the χ˜01 mass, top squark masses in the range 250–550 GeV are excluded for χ˜01 masses below 60 GeV

Insufficient weight at birth and preschool-age growth in children attending charitably funded crèches in the municipality of Santo André , in the State of São Paulo , Brazil

OBJETIVOS: comparar o crescimento alcançado e a prevalência de baixa estatura na idade pré-escolar entre recém-nascidos de peso insuficiente (PNI) e de peso adequado (PNA). MÉTODOS: foram estudadas 323 crianças com PNI e 886 com PNA de famílias de baixa renda de quinze creches filantrópicas de Santo André, São Paulo, Brasil, em 2001 e 2002. As variáveis foram o escore Z de peso e de estatura para a idade, pelo referencial Center for Disease Control (CDC) and National Center for Health Statistics (NCHS) 2000, comparando-se as médias dos dois grupos. Calculou-se a razão de prevalência (RP) de baixa estatura na idade pré-escolar em decorrência do peso insuficiente ao nascer. RESULTADOS: o escore z médio de peso foi -0,09 e 0,39 e o escore z médio de estatura foi de -0,06 e de 0,24 para as crianças de PNI e de PNA, respectivamente. A prevalência de baixa estatura foi de 2,78% para as crianças com PNI e de 0,79% para aquelas com PNA. A RP de baixa estatura na idade pré-escolar para as crianças de PNI foi de 3,5 (IC95% 1,3-9,4). CONCLUSÕES: as crianças com PNI apresentaram crescimento inferior e maior risco de falhas de crescimento até a idade pré-escolar, sugerindo um efeito negativo do peso insuficiente ao nascer sobre o crescimento infantil.OBJECTIVES: to compare rate of growth and prevalence of low stature at preschool age in children who were underweight at birth and in children born with a normal weight. METHODS: the study covered 323 children born underweight and 886 born with a normal weight from low-income families in fifteen charitably funded crèches in the municipality of Santo André, in the State of São Paulo, Brazil, in 2001 and 2002. The variables used were the z score for weight and height for age, using the Center for Disease Control (CDC) and National Center for Health Statistics (NCHS) 2000 benchmark, comparing the means for the two groups. The prevalence ratio was calculated for low stature in preschool age children resulting from insufficient weight at birth. RESULTS: the z score for weight was -0.09 and 0.39 and the average z score for height was -0.06 and 0.24 for underweight and normal weight at birth, respectively. The prevalence of low stature was 2.78% for children born underweight and 0.79% for normal weight. The PR for low stature at preschool age for children born underweight was 3.5 (CI95% 1.3-9.4). CONCLUSIONS: children born underweight had a lower rate of growth and greater risk of developing a growth disorder up to preschool age, suggesting a negative effect of insufficient birth weight on child growth

Amygdala inputs to prefrontal cortex guide behavior amid conflicting cues of reward and punishment

Orchestrating appropriate behavioral responses in the face of competing signals that predict either rewards or threats in the environment is crucial for survival. The basolateral nucleus of the amygdala (BLA) and prelimbic (PL) medial prefrontal cortex have been implicated in reward-seeking and fear-related responses, but how information flows between these reciprocally connected structures to coordinate behavior is unknown. We recorded neuronal activity from the BLA and PL while rats performed a task wherein competing shock- and sucrose-predictive cues were simultaneously presented. The correlated firing primarily displayed a BLA→PL directionality during the shock-associated cue. Furthermore, BLA neurons optogenetically identified as projecting to PL more accurately predicted behavioral responses during competition than unidentified BLA neurons. Finally photostimulation of the BLA→PL projection increased freezing, whereas both chemogenetic and optogenetic inhibition reduced freezing. Therefore, the BLA→PL circuit is critical in governing the selection of behavioral responses in the face of competing signals.National Institutes of Health (U.S.) (Award 1R25-MH092912-01)National Institute of Mental Health (U.S.) (Grant R01- MH102441-01)National Institutes of Health (U.S.) (Award DP2- DK-102256-01

Primula vulgaris (primrose) genome assembly, annotation and gene expression, with comparative genomics on the heterostyly supergene

Primula vulgaris (primrose) exhibits heterostyly: plants produce self-incompatible pin- or thrum-form flowers, with anthers and stigma at reciprocal heights. Darwin concluded that this arrangement promotes insect-mediated cross-pollination; later studies revealed control by a cluster of genes, or supergene, known as the S (Style length) locus. The P. vulgaris S locus is absent from pin plants and hemizygous in thrum plants (thrum-specific); mutation of S locus genes produces self-fertile homostyle flowers with anthers and stigma at equal heights. Here, we present a 411 Mb P. vulgaris genome assembly of a homozygous inbred long homostyle, representing ~87% of the genome. We annotate over 24,000 P. vulgaris genes, and reveal more genes up-regulated in thrum than pin flowers. We show reduced genomic read coverage across the S locus in other Primula species, including P. veris, where we define the conserved structure and expression of the S locus genes in thrum. Further analysis reveals the S locus has elevated repeat content (64%) compared to the wider genome (37%). Our studies suggest conservation of S locus genetic architecture in Primula, and provide a platform for identification and evolutionary analysis of the S locus and downstream targets that regulate heterostyly in diverse heterostylous species

Determination of diquat by flow injection-chemiluminescence

A simple, economic, sensitive and rapid method for the determination of the pesticide diquat was described. This new method was based on the coupling of flow injection analysis methodology and direct chemiluminescent detection; to the authors' knowledge, this approach had not been used up to now with this pesticide. It was based on its oxidation with ferricyanide in alkaline medium; significant improvements in the analytical signal were achieved by using high temperatures and quinine as sensitiser. Its high throughput (144 h(-1)), together with its low limit of detection (2 ng mL(-1)), achieved without need of preconcentration steps, permitted the reliable quantification of diquat over the linear range of (0.01-0.6) mu g mL(-1) in samples from different origins (river, tap, mineral and ground waters), even in the presence of a 40-fold concentration of paraquat, a pesticide commonly present in the commercial formulations of diquat.López-Paz, JL.; Catalá-Icardo, M.; Antón Garrido, B. (2009). Determination of diquat by flow injection-chemiluminescence. Analytical and Bioanalytical Chemistry. 394(4):1073-1079. doi:10.1007/s00216-009-2609-zS107310793944Hayes WJ Jr, Laws ER Jr (1991) Handbook of pesticide toxicology, Academic Press, San DiegoUS Environmental Protection Agency. http://www.epa.gov/06WDW/contaminants/dw_contamfs/diquat.html (accessed in August 2008)Horwitz W (2000) Official methods of analysis of AOAC International 17th edition. AOAC International, Gaithersburg, MD, USAHara S, Sasaki N, Takase D, Shiotsuka S, Ogata K, Futagami K, Tamura K (2007) Anal Sci 23(5):523–531Rial Otero R, Cancho Grande B, Pérez Lamela C, Simal Gandara J, Aria Estevez M (2006) J Chromatogr Sci 44(9):539–542Aramendia MA, Borau V, Lafont F, Marinas JM, Moreno JM, Porras JM, Urbano FJ (2006) Food Chem 97(1):181–188Nuñez O, Moyano E, Galceran MT (2004) Anal Chim Acta 525(2):183–190Martinez Vidal JL, Belmonte Vega A, Sanchez Lopez FJ, Garrido Frenich AJ (2004) Chromatogr A 1050(2):179–184Lee XP, Kumazawa T, Fujishiro M, Hasegawa C, Arinobu T, Seno H, Sato K (2004) J Mass Spectrom 39(10):1147–1152De Almeida RM, Yonamine M (2007) J Chromatogr B 853(1–2):260–264De Souza D, Machado SAS (2006) Electroanalysis 18(9):862–872De Souza D, Da Silva MRC, Machado SAS (2006) Electroanalysis 18(23):2305–2313Picó Y, Rodriguez R, Manes J (2003) Trends Anal Chem 22(3):133–151Ishiwata T (2004) Bunseki Kagaku 53(8):863–864Carneiro MC, Puignou L, Galcerán MT (2000) Anal Chim Acta 408:263Luque M, Rios A, Valcarcel M (1998) Analyst 123(11):2383–2387Perez Ruiz T, Martínez Lozano C, Tomas V (1991) Int J Environ Anal Chem 44(4):243–252Perez Ruiz T, Martínez Lozano C, Tomas V (1991) Anal Chim Acta 244(1):99–104Townshend A (1990) Analyst 115:495–500López Paz JL, Catalá Icardo M (2008) Anal Chim Acta 625:173–179Pawlicová Z, Sahuquillo I, Catalá Icardo M, García Mateo JV, Martínez Calatayud J (2006) Anal Sci 22:29–34Albert García JR, Catalá Icardo M, Martínez Calatayud J (2006) Talanta 69:608–614Tomlin CDS (1997) The pesticide manual, 11th edn.The British Crop Protection CouncilUKCatalá-Icardo M, Martínez-Calatayud J (2008) Crit Rev Anal Chem 38:118–130Ministerio de Medio Ambiente y Medio Rural y Marino. http://www.marm.es/ (accessed in September 2008)US Environmental Protection Agency. http://www.epa.gov/OGWWDW/contaminants (accessed in October 2008