Autonomous Reinforcement of Behavioral Sequences in Neural Dynamics

We introduce a dynamic neural algorithm called Dynamic Neural (DN) SARSA(\lambda) for learning a behavioral sequence from delayed reward. DN-SARSA(\lambda) combines Dynamic Field Theory models of behavioral sequence representation, classical reinforcement learning, and a computational neuroscience model of working memory, called Item and Order working memory, which serves as an eligibility trace. DN-SARSA(\lambda) is implemented on both a simulated and real robot that must learn a specific rewarding sequence of elementary behaviors from exploration. Results show DN-SARSA(\lambda) performs on the level of the discrete SARSA(\lambda), validating the feasibility of general reinforcement learning without compromising neural dynamics.Comment: Sohrob Kazerounian, Matthew Luciw are Joint first author

Location and function of retroviral and SV40 sequences that enhance biochemical transformation after microinjection of DNA.

Journal ArticleBiochemical transformation of thymidine-kinase-deficient (TK-) mouse L cells is enhanced 20 to 40 fold when microinjected plasmid DNA contains regions of the genomes of Rous sarcoma virus or simian virus 40 in addition to the complete herpes simplex virus tk gene, irrespective of the orientation and location of the enhancer. The enhancing sequence of RSV DNA has been localized to 143 bp that include 88 bp at the 5' end of the long terminal repeat; the enhancing segment of SV40 DNA lies 42-276 bp upstream from the initiation site for early transcription. The RSV enhancer does not provide a favored integration site within microinjected plasmids and does not affect the frequency of integration into host cell DNA. When microinjected cells were grown into cell lines in nonselective medium, few cells containing integrated HSV tk without RSV DNA could grow in selective medium. In contrast, over 80% of cells from lines containing the HSV tk gene linked to the RSV enhancer could grow in selective medium. Thus the RSV enhancer affects the expression rather than the integration of the tk gene

Analysis of multiply spliced transcripts in lymphoid tissue reservoirs of rhesus macaques infected with RT-SHIV during HAART.

Highly active antiretroviral therapy (HAART) can reduce levels of human immunodeficiency virus type 1 (HIV-1) to undetectable levels in infected individuals, but the virus is not eradicated. The mechanisms of viral persistence during HAART are poorly defined, but some reservoirs have been identified, such as latently infected resting memory CD4⁺ T cells. During latency, in addition to blocks at the initiation and elongation steps of viral transcription, there is a block in the export of viral RNA (vRNA), leading to the accumulation of multiply-spliced transcripts in the nucleus. Two of the genes encoded by the multiply-spliced transcripts are Tat and Rev, which are essential early in the viral replication cycle and might indicate the state of infection in a given population of cells. Here, the levels of multiply-spliced transcripts were compared to the levels of gag-containing RNA in tissue samples from RT-SHIV-infected rhesus macaques treated with HAART. Splice site sequence variation was identified during development of a TaqMan PCR assay. Multiply-spliced transcripts were detected in gastrointestinal and lymphatic tissues, but not the thymus. Levels of multiply-spliced transcripts were lower than levels of gag RNA, and both correlated with plasma virus loads. The ratio of multiply-spliced to gag RNA was greatest in the gastrointestinal samples from macaques with plasma virus loads <50 vRNA copies per mL at necropsy. Levels of gag RNA and multiply-spliced mRNA in tissues from RT-SHIV-infected macaques correlate with plasma virus load

Transcriptional Regulation of Latent Feline Immunodeficiency Virus in Peripheral CD4+ T-lymphocytes

Feline immunodeficiency virus (FIV), the lentivirus of domestic cats responsible for feline AIDS, establishes a latent infection in peripheral blood CD4+ T-cells approximately eight months after experimental inoculation. In this study, cats experimentally infected with the FIV-C strain in the asymptomatic phase demonstrated an estimated viral load of 1 infected cell per approximately 103 CD4+ T-cells, with about 1 copy of viral DNA per cell. Approximately 1 in 10 proviral copies was capable of transcription in the asymptomatic phase. The latent FIV proviral promoter was associated with deacetylated, methylated histones, which is consistent with a condensed chromatin structure. In contrast, the transcriptionally active FIV promoter was associated with histone acetylation and demethylation. In addition, RNA polymerase II appeared to be paused on the latent viral promoter, and short promoter-proximal transcripts were detected. Our findings for the FIV promoter in infected cats are similar to results obtained in studies of human immunodeficiency virus (HIV)-1 latent proviruses in cell culture in vitro studies. Thus, the FIV/cat model may offer insights into in vivo mechanisms of HIV latency and provides a unique opportunity to test novel therapeutic interventions aimed at eradicating latent virus

Species Tropism of Chimeric SHIV Clones Containing HIV-1 Subtype-A and Subtype-E Envelope Genes

AbstractTo analyze HIV-1 genes in a nonhuman primate model for lentivirus infection and AIDS, recombinant SIV/HIV-1 (SHIV) clones were constructed from two HIV-1 subtype-A isolates (HIV-1SF170 and HIV-1Q23–17 from individuals in Africa) and two HIV-1 subtype-E isolates (HIV-19466 and HIV-1CAR402 from AIDS patients in Thailand and Africa), respectively. These four SHIV clones, designated SHIV-A-170, SHIV-A-Q23, SHIV-9466.33, and SHIV-E-CAR, contain envelope (env) genes from the subtype-A or -E viruses. Interestingly, SHIV-A-170, SHIV-A-Q23, and SHIV-9466.33 were restricted for replication in cultures of macaque lymphoid cells, whereas SHIV-E-CAR replicated efficiently in these cells. Additional studies to define the block to replication in macaque cells were focused on the subtype-E clone SHIV-9466.33. A SHIV intragenic env clone, containing sequence-encompassing V1/V2 regions of HIV-1CAR402 and V3/V4/V5 regions of SHIV-9466.33, infected and replicated in macaque lymphoid cells. These results indicated that the sequence-encompassing V1/V2 region of HIV-19466 was responsible for the block of the SHIV-9466.33 replication in macaque cells. Analysis of viral DNA in acutely infected macaque cells revealed that SHIV-9466.33 was blocked at a step at/or before viral DNA synthesis, presumably during the process of virion entry into cells. In a fluorescence-based cell–cell fusion assay, fusion pore formation readily took place in cocultures of cells expressing the SHIV-9466.33 env glycoprotein with macaque T-lymphoid cells. Taken together, these results demonstrated that the block of SHIV-9466.33 replication in macaque cells is at an early step after fusion pore formation but before reverse transcription

Multiplexed measurements of immunomodulator levels in peripheral blood of healthy subjects: Effects of analytical variables based on anticoagulants, age, and gender

Multiplex microbead immunoassay (MMIA) is a powerful technology for a wide range of biomedical and clinical applications. It is important to study the normal concentration ranges of immunomodulators under different sample preparation conditions and age groups of subjects in order to more precisely determine their reference values for use in assessing alterations of their levels in disease. The aim of this study was to determine the plasma concentrations of immunomodulators (cytokines, chemokines, and growth factors) in the peripheral blood from healthy subjects by the use of a large multiplex panel, and to determine the effects of different anticoagulants, age, and gender on the immunomodulator levels. In addition, the assay precision for these biomarker analytes was determined. Plasma samples from 107 healthy subjects, aged 18 to 85 years, were collected in three different anticoagulants (sodium citrate, EDTA, Heparin); corresponding serum samples were also obtained. Multiplex microbead immunoassays were performed for measuring a total of 23 analytes including chemokines, cytokines, and growth factors (IL-1β, IL-1ra, IL-2, IL-6, IL-7, IL-8, IL-12 p70, IL-17, IFN-γ, IP-10, MCP-1, PDGF-BB, RANTES, TNF-α, IL-1a, IL-16, HGF, MIG, TNF-β, PDGF-ABBB, EGF, Flt-3 Ligand, VEGF). For these analytes, our results showed that the anticoagulant affected the concentration measurements and the coefficients of variation. However, the relative levels of the analytes (profiles) of samples collected in a particular anticoagulant are consistent. The analytes IL-1β, IL-7, Flt-3 Ligand, and IL-12p70 show the largest variation (up to fourfold) between the age groups. In addition, no statistically significant differences in the level of the analytes were found between the sexes