Prioritized Sweeping Neural DynaQ with Multiple Predecessors, and Hippocampal Replays

During sleep and awake rest, the hippocampus replays sequences of place cells that have been activated during prior experiences. These have been interpreted as a memory consolidation process, but recent results suggest a possible interpretation in terms of reinforcement learning. The Dyna reinforcement learning algorithms use off-line replays to improve learning. Under limited replay budget, a prioritized sweeping approach, which requires a model of the transitions to the predecessors, can be used to improve performance. We investigate whether such algorithms can explain the experimentally observed replays. We propose a neural network version of prioritized sweeping Q-learning, for which we developed a growing multiple expert algorithm, able to cope with multiple predecessors. The resulting architecture is able to improve the learning of simulated agents confronted to a navigation task. We predict that, in animals, learning the world model should occur during rest periods, and that the corresponding replays should be shuffled.Comment: Living Machines 2018 (Paris, France

Exploring out-of-equilibrium quantum magnetism and thermalization in a spin-3 many-body dipolar lattice system

Understanding quantum thermalization through entanglement build-up in isolated quantum systems addresses fundamental questions on how unitary dynamics connects to statistical physics. Here, we study the spin dynamics and approach towards local thermal equilibrium of a macroscopic ensemble of S = 3 spins prepared in a pure coherent spin state, tilted compared to the magnetic field, under the effect of magnetic dipole-dipole interactions. The experiment uses a unit filled array of 104 chromium atoms in a three dimensional optical lattice, realizing the spin-3 XXZ Heisenberg model. The buildup of quantum correlation during the dynamics, especially as the angle approaches pi/2, is supported by comparison with an improved numerical quantum phase-space method and further confirmed by the observation that our isolated system thermalizes under its own dynamics, reaching a steady state consistent with the one extracted from a thermal ensemble with a temperature dictated from the system's energy. This indicates a scenario of quantum thermalization which is tied to the growth of entanglement entropy. Although direct experimental measurements of the Renyi entropy in our macroscopic system are unfeasible, the excellent agreement with the theory, which can compute this entropy, does indicate entanglement build-up.Comment: 12 figure

A comparative study of Tam3 and Ac transposition in transgenic tobacco and petunia plants

Transposition of the Anthirrinum majus Tam3 element and the Zea mays Ac element has been monitored in petunia and tobacco plants. Plant vectors were constructed with the transposable elements cloned into the leader sequence of a marker gene. Agrobacterium tumefaciens-mediated leaf disc transformation was used to introduce the transposable element constructs into plant cells. In transgenic plants, excision of the transposable element restores gene expression and results in a clearly distinguishable phenotype. Based on restored expression of the hygromycin phosphotransferase II (HPTII) gene, we established that Tam3 excises in 30% of the transformed petunia plants and in 60% of the transformed tobacco plants. Ac excises from the HPTII gene with comparable frequencies (30%) in both plant species. When the β-glucuronidase (GUS) gene was used to detect transposition of Tam3, a significantly lower excision frequency (13%) was found in both plant species. It could be shown that deletion of parts of the transposable elements Tam3 and Ac, removing either one of the terminal inverted repeats (TIR) or part of the presumptive transposase coding region, abolished the excision from the marker genes. This demonstrates that excision of the transposable element Tam3 in heterologous plant species, as documented for the autonomous element Ac, also depends on both properties. Southern blot hybridization shows the expected excision pattern and the reintegration of Tam3 and Ac elements into the genome of tobacco plants.

El masaje en la prevención y tratamiento del dolor muscular tardío: una revisión sistemática actualizada

Massage is one of the most widely used therapies for relieving delayed onset muscle soreness (DOMS). The aim of the present study was to determine the effectiveness of massage in the treatment of DOMS, for which a systematic review was carried out in the databases, Pubmed, Scopus, SportDiscus, Web of Science and the Google Scholar search engine using the words key words delayed onset muscle soreness and exercise induced muscle damage combined with massage. This study included 23 articles in which 78% showed a decrease in DOMS while in the remaining 22% there were no improvements or gotten worse. The analysis of these studies allows to conclude that massage is an effective therapy in the treatment of delayed onset muscle soreness.El masaje es una de las terapias más utilizadas para aliviar el dolor muscular tardío (DMT). El objetivo del presente estudio fue determinar la efectividad del masaje en el tratamiento del DMT, para lo cual se llevó a cabo una revisión sistemática en las bases de datos, Pubmed, Scopus, SportDiscus, Web of Science y el buscador Google académico, usando las palabras clave delayed onset muscle soreness y exercise induced muscle damage combinado con massage. Se incluyeron en el estudio 23 artículos en los cuales el 78% mostró disminución del DMT mientras que en el restante 22% no hubo mejoras o bien empeoró. El análisis de los estudios permite concluir que el masaje es una terapia efectiva en el tratamiento del dolor muscular tardío

RNA editing signature during myeloid leukemia cell differentiation

Adenosine deaminases acting on RNA (ADARs) are key proteins for hematopoietic stem cell self-renewal and for survival of differentiating progenitor cells. However, their specific role in myeloid cell maturation has been poorly investigated. Here we show that ADAR1 is present at basal level in the primary myeloid leukemia cells obtained from patients at diagnosis as well as in myeloid U-937 and THP1 cell lines and its expression correlates with the editing levels. Upon phorbol-myristate acetate or Vitamin D3/granulocyte macrophage colony-stimulating factor (GM-CSF)-driven differentiation, both ADAR1 and ADAR2 enzymes are upregulated, with a concomitant global increase of A-to-I RNA editing. ADAR1 silencing caused an editing decrease at specific ADAR1 target genes, without, however, interfering with cell differentiation or with ADAR2 activity. Remarkably, ADAR2 is absent in the undifferentiated cell stage, due to its elimination through the ubiquitin–proteasome pathway, being strongly upregulated at the end of the differentiation process. Of note, peripheral blood monocytes display editing events at the selected targets similar to those found in differentiated cell lines. Taken together, the data indicate that ADAR enzymes play important and distinct roles in myeloid cells

Episodic Therapy for Genital Herpes in Sub-Saharan Africa: A Pooled Analysis from Three Randomized Controlled Trials

BACKGROUND: A randomized controlled trial in South Africa found a beneficial effect of acyclovir on genital ulcer healing, but no effect was seen in trials in Ghana, Central African Republic and Malawi. The aim of this paper is to assess whether the variation in impact of acyclovir on ulcer healing in these trials can be explained by differences in the characteristics of the study populations. METHODOLOGY/PRINCIPAL FINDINGS: Pooled data were analysed to estimate the impact of acyclovir on the proportion of ulcers healed seven days after randomisation by HIV/CD4 status, ulcer aetiology, size and duration before presentation; and impact on lesional HIV-1. Risk ratios (RR) were estimated using Poisson regression with robust standard errors. Of 1478 patients with genital ulcer, most (63%) had herpetic ulcers (16% first episode HSV-2 ulcers), and a further 3% chancroid, 2% syphilis, 0.7% lymphogranuloma venereum and 31% undetermined aetiology. Over half (58%) of patients were HIV-1 seropositive. The median duration of symptoms before presentation was 6 days. Patients on acyclovir were more likely to have a healed ulcer on day 7 (63% vs 57%, RR = 1.08, 95% CI 0.98-1.18), shorter time to healing (p = 0.04) and less lesional HIV-1 RNA (p = 0.03). Small ulcers (<50 mm(2)), HSV-2 ulcers, first episode HSV-2 ulcers, and ulcers in HIV-1 seropositive individuals responded best but the better effectiveness in South Africa was not explained by differences in these factors. CONCLUSIONS/SIGNIFICANCE: There may be slight benefit in adding acyclovir to syndromic management in settings where most ulcers are genital herpes. The stronger effect among HIV-1 infected individuals suggests that acyclovir may be beneficial for GUD/HIV-1 co-infected patients. The high prevalence in this population highlights that genital ulceration in patients with unknown HIV status provides a potential entry point for provider-initiated HIV testing

Substrate-bound outward-open structure of a Na+-coupled sialic acid symporter reveals a new Na+ site

Many pathogenic bacteria utilise sialic acids as an energy source or use them as an external coating to evade immune detection. As such, bacteria that colonise sialylated environments deploy specific transporters to mediate import of scavenged sialic acids. Here, we report a substrate-bound 1.95 Å resolution structure and subsequent characterisation of SiaT, a sialic acid transporter from Proteus mirabilis. SiaT is a secondary active transporter of the sodium solute symporter (SSS) family, which use Na+ gradients to drive the uptake of extracellular substrates. SiaT adopts the LeuT-fold and is in an outward-open conformation in complex with the sialic acid N-acetylneuraminic acid and two Na+ ions. One Na+ binds to the conserved Na2 site, while the second Na+ binds to a new position, termed Na3, which is conserved in many SSS family members. Functional and molecular dynamics studies validate the substrate-binding site and demonstrate that both Na+ sites regulate N-acetylneuraminic acid transport

Correlates of HIV-1 Genital Shedding in Tanzanian Women

BACKGROUND: Understanding the correlates of HIV shedding is important to inform strategies to reduce HIV infectiousness. We examined correlates of genital HIV-1 RNA in women who were seropositive for both herpes simplex virus (HSV)-2 and HIV-1 and who were enrolled in a randomised controlled trial of HSV suppressive therapy (aciclovir 400 mg b.i.d vs. placebo) in Tanzania. METHODOLOGY: Samples, including a cervico-vaginal lavage, were collected and tested for genital HIV-1 and HSV and reproductive tract infections (RTIs) at randomisation and 6, 12 and 24 months follow-up. Data from all women at randomisation and women in the placebo arm during follow-up were analysed using generalised estimating equations to determine the correlates of cervico-vaginal HIV-1 RNA detection and load. PRINCIPAL FINDINGS: Cervico-vaginal HIV-1 RNA was detected at 52.0% of 971 visits among 482 women, and was independently associated with plasma viral load, presence of genital ulcers, pregnancy, bloody cervical or vaginal discharge, abnormal vaginal discharge, cervical ectopy, Neisseria gonorrhoeae, Chlamydia trachomatis, Trichomonas vaginalis, an intermediate bacterial vaginosis score and HSV DNA detection. Similar factors were associated with genital HIV-1 RNA load. CONCLUSIONS: RTIs were associated with increased presence and quantity of genital HIV-1 RNA in this population. These results highlight the importance of integrating effective RTI treatment into HIV care services