Accelerating Value Iteration with Anchoring

Value Iteration (VI) is foundational to the theory and practice of modern reinforcement learning, and it is known to converge at a $\mathcal{O}(\gamma^k)$-rate, where $\gamma$ is the discount factor. Surprisingly, however, the optimal rate for the VI setup was not known, and finding a general acceleration mechanism has been an open problem. In this paper, we present the first accelerated VI for both the Bellman consistency and optimality operators. Our method, called Anc-VI, is based on an \emph{anchoring} mechanism (distinct from Nesterov's acceleration), and it reduces the Bellman error faster than standard VI. In particular, Anc-VI exhibits a $\mathcal{O}(1/k)$-rate for $\gamma\approx 1$ or even $\gamma=1$, while standard VI has rate $\mathcal{O}(1)$ for $\gamma\ge 1-1/k$, where $k$ is the iteration count. We also provide a complexity lower bound matching the upper bound up to a constant factor of $4$, thereby establishing optimality of the accelerated rate of Anc-VI. Finally, we show that the anchoring mechanism provides the same benefit in the approximate VI and Gauss--Seidel VI setups as well

Functional Reciprocity of Amyloids and Antimicrobial Peptides: Rethinking the Role of Supramolecular Assembly in Host Defense, Immune Activation, and Inflammation

Pathological self-assembly is a concept that is classically associated with amyloids, such as amyloid-β (Aβ) in Alzheimer's disease and α-synuclein in Parkinson's disease. In prokaryotic organisms, amyloids are assembled extracellularly in a similar fashion to human amyloids. Pathogenicity of amyloids is attributed to their ability to transform into several distinct structural states that reflect their downstream biological consequences. While the oligomeric forms of amyloids are thought to be responsible for their cytotoxicity via membrane permeation, their fibrillar conformations are known to interact with the innate immune system to induce inflammation. Furthermore, both eukaryotic and prokaryotic amyloids can self-assemble into molecular chaperones to bind nucleic acids, enabling amplification of Toll-like receptor (TLR) signaling. Recent work has shown that antimicrobial peptides (AMPs) follow a strikingly similar paradigm. Previously, AMPs were thought of as peptides with the primary function of permeating microbial membranes. Consistent with this, many AMPs are facially amphiphilic and can facilitate membrane remodeling processes such as pore formation and fusion. We show that various AMPs and chemokines can also chaperone and organize immune ligands into amyloid-like ordered supramolecular structures that are geometrically optimized for binding to TLRs, thereby amplifying immune signaling. The ability of amphiphilic AMPs to self-assemble cooperatively into superhelical protofibrils that form structural scaffolds for the ordered presentation of immune ligands like DNA and dsRNA is central to inflammation. It is interesting to explore the notion that the assembly of AMP protofibrils may be analogous to that of amyloid aggregates. Coming full circle, recent work has suggested that Aβ and other amyloids also have AMP-like antimicrobial functions. The emerging perspective is one in which assembly affords a more finely calibrated system of recognition and response: the detection of single immune ligands, immune ligands bound to AMPs, and immune ligands spatially organized to varying degrees by AMPs, result in different immunologic outcomes. In this framework, not all ordered structures generated during multi-stepped AMP (or amyloid) assembly are pathological in origin. Supramolecular structures formed during this process serve as signatures to the innate immune system to orchestrate immune amplification in a proportional, situation-dependent manner

Functional Reciprocity of Amyloids and Antimicrobial Peptides: Rethinking the Role of Supramolecular Assembly in Host Defense, Immune Activation, and Inflammation

Pathological self-assembly is a concept that is classically associated with amyloids, such as amyloid-β (Aβ) in Alzheimer's disease and α-synuclein in Parkinson's disease. In prokaryotic organisms, amyloids are assembled extracellularly in a similar fashion to human amyloids. Pathogenicity of amyloids is attributed to their ability to transform into several distinct structural states that reflect their downstream biological consequences. While the oligomeric forms of amyloids are thought to be responsible for their cytotoxicity via membrane permeation, their fibrillar conformations are known to interact with the innate immune system to induce inflammation. Furthermore, both eukaryotic and prokaryotic amyloids can self-assemble into molecular chaperones to bind nucleic acids, enabling amplification of Toll-like receptor (TLR) signaling. Recent work has shown that antimicrobial peptides (AMPs) follow a strikingly similar paradigm. Previously, AMPs were thought of as peptides with the primary function of permeating microbial membranes. Consistent with this, many AMPs are facially amphiphilic and can facilitate membrane remodeling processes such as pore formation and fusion. We show that various AMPs and chemokines can also chaperone and organize immune ligands into amyloid-like ordered supramolecular structures that are geometrically optimized for binding to TLRs, thereby amplifying immune signaling. The ability of amphiphilic AMPs to self-assemble cooperatively into superhelical protofibrils that form structural scaffolds for the ordered presentation of immune ligands like DNA and dsRNA is central to inflammation. It is interesting to explore the notion that the assembly of AMP protofibrils may be analogous to that of amyloid aggregates. Coming full circle, recent work has suggested that Aβ and other amyloids also have AMP-like antimicrobial functions. The emerging perspective is one in which assembly affords a more finely calibrated system of recognition and response: the detection of single immune ligands, immune ligands bound to AMPs, and immune ligands spatially organized to varying degrees by AMPs, result in different immunologic outcomes. In this framework, not all ordered structures generated during multi-stepped AMP (or amyloid) assembly are pathological in origin. Supramolecular structures formed during this process serve as signatures to the innate immune system to orchestrate immune amplification in a proportional, situation-dependent manner

Genome of Drosophila suzukii, the spotted wing drosophila.

Drosophila suzukii Matsumura (spotted wing drosophila) has recently become a serious pest of a wide variety of fruit crops in the United States as well as in Europe, leading to substantial yearly crop losses. To enable basic and applied research of this important pest, we sequenced the D. suzukii genome to obtain a high-quality reference sequence. Here, we discuss the basic properties of the genome and transcriptome and describe patterns of genome evolution in D. suzukii and its close relatives. Our analyses and genome annotations are presented in a web portal, SpottedWingFlyBase, to facilitate public access

Wnt activation downregulates olfactomedin-1 in Fallopian tubal epithelial cells:a microenvironment predisposed to tubal ectopic pregnancy

Ectopic pregnancy (EP) occurs when the embryo fails to transit to the uterus and attach to the luminal epithelium of the Fallopian tube (FT). Tubal EP is a common gynecological emergency and more than 95% of EP occurs in the ampullary region of the FT. In humans, Wnt activation and downregulation of olfactomedin-1 (Olfm-1) occur in the receptive endometrium and coincided with embryo implantation in vivo. Whether similar molecular changes happen in the FT leading to EP remains unclear. We hypothesized that activation of Wnt signaling downregulates Olfm-1 expression predisposes to EP. We investigated the spatiotemporal expression of Olfm-1 in FT from non-pregnant women and women with EP, and used a novel trophoblastic spheroid (embryo surrogate)-FT epithelial cell co-culture model (JAr and OE-E6/E7 cells) to study the role of Olfm-1 on spheroid attachment. Olfm-1 mRNA expression in the ampullary region of non-pregnant FT was higher (P0.05) in the follicular phase than in the luteal phase. Ampullary tubal Olfm-1 expression was lower in FT from women with EP compared to normal controls at the luteal phase (histological scoring (H-SCORE)1.30.2 vs 2.40.5; P0.05). Treatment of OE-E6/E7 with recombinant Olfm-1 (0.2-5 g/ml) suppressed spheroid attachment to OE-E6/E7 cells, while activation of Wnt-signaling pathway by Wnt3a or LiCl reduced endogenous Olfm-1 expression and increased spheroid attachment. Conversely, suppression of Olfm-1 expression by RNAi increased spheroid attachment to OE-E6/E7 cells. Taken together, Wnt activation suppresses Olfm-1 expression, and this may predispose a favorable microenvironment of the retained embryo in the FT, leading to EP in humans. © 2012 USCAP, Inc All rights reserved.link_to_OA_fulltex

Sequencing of Tuta absoluta genome to develop SNP genotyping assays for species identification

Tuta absoluta is one of the most devastating pests of fresh market and processing tomatoes. Native to South America, its detection was confined to that continent until 2006 when it was identified in Spain. It has now spread to almost every continent, threatening countries whose economies rely heavily on tomatoes. This insect causes damage to all developmental stages of its host plant, leading to crop losses as high as 80–100%. Although T. absoluta has yet to be found in the USA and China, which makes up a large portion of the tomato production in the world, computer models project a high likelihood of invasion. To halt the continued spread of T. absoluta and limit economic loss associated with tomato supply chain, it is necessary to develop accurate and efficient methods to identify T. absoluta and strengthen surveillance programs. Current identification of T. absoluta relies on examination of morphology and assessment of host plant damage, which are difficult to differentiate from that of native tomato pests. To address this need, we sequenced the genomes of T. absoluta and two closely related Gelechiidae, Keiferia lycopersicella and Phthorimaea operculella, and developed a bioinformatic pipeline to design a panel of 21-SNP markers for species identification. The accuracy of the SNP panel was validated in a multiplex format using the iPLEX chemistry of Agena MassARRAY system. Finally, the new T. absoluta genomic resources we generated can be leveraged to study T. absoluta biology and develop species-specific management strategies.info:eu-repo/semantics/acceptedVersio

Genome-Wide Studies of Histone Demethylation Catalysed by the Fission Yeast Homologues of Mammalian LSD1

In order to gain a more global view of the activity of histone demethylases, we report here genome-wide studies of the fission yeast SWIRM and polyamine oxidase (PAO) domain homologues of mammalian LSD1. Consistent with previous work we find that the two S. pombe proteins, which we name Swm1 and Swm2 (after SWIRM1 and SWIRM2), associate together in a complex. However, we find that this complex specifically demethylates lysine 9 in histone H3 (H3K9) and both up- and down-regulates expression of different groups of genes. Using chromatin-immunoprecipitation, to isolate fragments of chromatin containing either H3K4me2 or H3K9me2, and DNA microarray analysis (ChIP-chip), we have studied genome-wide changes in patterns of histone methylation, and their correlation with gene expression, upon deletion of the swm1+ gene. Using hyper-geometric probability comparisons we uncover genetic links between lysine-specific demethylases, the histone deacetylase Clr6, and the chromatin remodeller Hrp1. The data presented here demonstrate that in fission yeast the SWIRM/PAO domain proteins Swm1 and Swm2 are associated in complexes that can remove methyl groups from lysine 9 methylated histone H3. In vitro, we show that bacterially expressed Swm1 also possesses lysine 9 demethylase activity. In vivo, loss of Swm1 increases the global levels of both H3K9me2 and H3K4me2. A significant accumulation of H3K4me2 is observed at genes that are up-regulated in a swm1 deletion strain. In addition, H3K9me2 accumulates at some genes known to be direct Swm1/2 targets that are down-regulated in the swm1¿ strain. The in vivo data indicate that Swm1 acts in concert with the HDAC Clr6 and the chromatin remodeller Hrp1 to repress gene expression. In addition, our in vitro analyses suggest that the H3K9 demethylase activity requires an unidentified post-translational modification to allow it to act. Thus, our results highlight complex interactions between histone demethylase, deacetylase and chromatin remodelling activities in the regulation of gene expression