Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

Multiple ITS Copies Reveal Extensive Hybridization within Rheum (Polygonaceae), a Genus That Has Undergone Rapid Radiation

During adaptive radiation events, characters can arise multiple times due to parallel evolution, but transfer of traits through hybridization provides an alternative explanation for the same character appearing in apparently non-sister lineages. The signature of hybridization can be detected in incongruence between phylogenies derived from different markers, or from the presence of two divergent versions of a nuclear marker such as ITS within one individual.In this study, we cloned and sequenced ITS regions for 30 species of the genus Rheum, and compared them with a cpDNA phylogeny. Seven species contained two divergent copies of ITS that resolved in different clades from one another in each case, indicating hybridization events too recent for concerted evolution to have homogenised the ITS sequences. Hybridization was also indicated in at least two further species via incongruence in their position between ITS and cpDNA phylogenies. None of the ITS sequences present in these nine species matched those detected in any other species, which provides tentative evidence against recent introgression as an explanation. Rheum globulosum, previously indicated by cpDNA to represent an independent origin of decumbent habit, is indicated by ITS to be part of clade of decumbent species, which acquired cpDNA of another clade via hybridization. However decumbent and glasshouse morphology are confirmed to have arisen three and two times, respectively.These findings suggested that hybridization among QTP species of Rheum has been extensive, and that a role of hybridization in diversification of Rheum requires investigation

Newly uncovered physics of MHD instabilities using 2-D electron cyclotron emission imaging system in toroidal plasmas

Validation of physics models using the newly uncovered physics with a 2-D electron cyclotron emission imaging (ECEi) system for magnetic fusion plasmas has either enhanced the confidence or substantially improved the modeling capability. The discarded "full reconnection model" in sawtooth instability is vindicated and established that symmetry and magnetic shear of the 1/1 kink mode are critical parameters in sawtooth instability. For the 2/1 instability, it is demonstrated that the 2-D data can determine critical physics parameters with a high confidence and the measured anisotropic distribution of the turbulence and its flow in presence of the 2/1 island is validated by the modelled potential and gyro-kinetic calculation. The validation process of the measured reversed-shear Alfveneigenmode (RSAE) structures has improved deficiencies of prior models. The 2-D images of internal structure of the ELMs and turbulence induced by the resonant magnetic perturbation (RMP) have provided an opportunity to establish firm physics basis of the ELM instability and role of RMPs. The importance of symmetry in determining the reconnection time scale and role of magnetic shear of the 1/1 kink mode in sawtooth instability may be relevant to the underlying physics of the violent kink instability of the filament ropes in a solar flare

Gene Expression Profiling of Liver Cancer Stem Cells by RNA-Sequencing

Background: Accumulating evidence supports that tumor growth and cancer relapse are driven by cancer stem cells. Our previous work has demonstrated the existence of CD90 + liver cancer stem cells (CSCs) in hepatocellular carcinoma (HCC). Nevertheless, the characteristics of these cells are still poorly understood. In this study, we employed a more sensitive RNA-sequencing (RNA-Seq) to compare the gene expression profiling of CD90 + cells sorted from tumor (CD90 +CSCs) with parallel non-tumorous liver tissues (CD90 +NTSCs) and elucidate the roles of putative target genes in hepatocarcinogenesis. Methodology/Principal Findings: CD90 + cells were sorted respectively from tumor and adjacent non-tumorous human liver tissues using fluorescence-activated cell sorting. The amplified RNAs of CD90 + cells from 3 HCC patients were subjected to RNA-Seq analysis. A differential gene expression profile was established between CD90 +CSCs and CD90 +NTSCs, and validated by quantitative real-time PCR (qRT-PCR) on the same set of amplified RNAs, and further confirmed in an independent cohort of 12 HCC patients. Five hundred genes were differentially expressed (119 up-regulated and 381 down-regulated genes) between CD90 +CSCs and CD90 +NTSCs. Gene ontology analysis indicated that the over-expressed genes in CD90 +CSCs were associated with inflammation, drug resistance and lipid metabolism. Among the differentially expressed genes, glypican-3 (GPC3), a member of glypican family, was markedly elevated in CD90 +CSCs compared to CD90 +NTSCs. Immunohistochemistry demonstrated that GPC3 was highly expressed in forty-two human liver tumor tissues but absent in adjacent non-tumorous liver tissues. Flow cytometry indicated that GPC3 was highly expressed in liver CD90 +CSCs and mature cancer cells in liver cancer cell lines and human liver tumor tissues. Furthermore, GPC3 expression was positively correlated with the number of CD90 +CSCs in liver tumor tissues. Conclusions/Significance: The identified genes, such as GPC3 that are distinctly expressed in liver CD90 +CSCs, may be promising gene candidates for HCC therapy without inducing damages to normal liver stem cells. © 2012 Ho et al.published_or_final_versio

Rapid and simultaneous detection of human hepatitis B virus and hepatitis C virus antibodies based on a protein chip assay using nano-gold immunological amplification and silver staining method

BACKGROUND: Viral hepatitis due to hepatitis B virus and hepatitis C virus are major public health problems all over the world. Traditional detection methods including polymerase chain reaction (PCR)-based assays and enzyme-linked immunosorbent assays (ELISA) are expensive and time-consuming. In our assay, a protein chip assay using Nano-gold Immunological Amplification and Silver Staining (NIASS) method was applied to detect HBV and HCV antibodies rapidly and simultaneously. METHODS: Chemically modified glass slides were used as solid supports (named chip), on which several antigens, including HBsAg, HBeAg, HBcAg and HCVAg (a mixture of NS3, NS5 and core antigens) were immobilized respectively. Colloidal nano-gold labelled staphylococcal protein A (SPA) was used as an indicator and immunogold silver staining enhancement technique was applied to amplify the detection signals, producing black image on array spots, which were visible with naked eyes. To determine the detection limit of the protein chip assay, a set of model arrays in which human IgG was spotted were structured and the model arrays were incubated with different concentrations of anti-IgG. A total of 305 serum samples previously characterized with commercial ELISA were divided into 4 groups and tested in this assay. RESULTS: We prepared mono-dispersed, spherical nano-gold particles with an average diameter of 15 ± 2 nm. Colloidal nano-gold-SPA particles observed by TEM were well-distributed, maintaining uniform and stable. The optimum silver enhancement time ranged from 8 to 12 minutes. In our assay, the protein chips could detect serum antibodies against HBsAg, HBeAg, HBcAg and HCVAg with the absence of the cross reaction. In the model arrays, the anti-IgG as low as 3 ng/ml could be detected. The data for comparing the protein chip assay with ELISA indicated that no distinct difference (P > 0.05) existed between the results determined by our assay and ELISA respectively. CONCLUSION: Results showed that our assay can be applied with serology for the detection of HBV and HCV antibodies rapidly and simultaneously in clinical detection

Symmetry restoration at high-temperature in two-color and two-flavor lattice gauge theories

We consider the SU(2) gauge theory with Nf=2 flavors of Dirac fundamental fermions. We study the high-temperature behavior of the spectra of mesons, discretizing the theory on anisotropic lattices, and measuring the two-point correlation functions in the temporal direction as well as screening masses in various channels. We identify the (pseudo-)critical temperature as the temperature at which the susceptibility associated with the Polyakov loop has a maximum. At high temperature both the spin-1 and spin-0 sectors of the light meson spectra exhibit enhanced symmetry properties, indicating the restoration of both the global SU(4) and the axial U(1)A symmetries of the model

Curcumin-rich curry diet and pulmonary function in Asian older adults

10.1371/journal.pone.0051753PLoS ONE71

Tool-Use Training in a Species of Rodent: The Emergence of an Optimal Motor Strategy and Functional Understanding

Tool use is defined as the manipulation of an inanimate object to change the position or form of a separate object. The expansion of cognitive niches and tool-use capabilities probably stimulated each other in hominid evolution. To understand the causes of cognitive expansion in humans, we need to know the behavioral and neural basis of tool use. Although a wide range of animals exhibit tool use in nature, most studies have focused on primates and birds on behavioral or psychological levels and did not directly address questions of which neural modifications contributed to the emergence of tool use. To investigate such questions, an animal model suitable for cellular and molecular manipulations is needed.) to use a rake-like tool with their forelimbs to retrieve otherwise out-of-reach rewards. Eventually, they mastered effective use of the tool, moving it in an elegant trajectory. After the degus were well trained, probe tests that examined whether they showed functional understanding of the tool were performed. Degus did not hesitate to use tools of different size, colors, and shapes, but were reluctant to use the tool with a raised nonfunctional blade. Thus, degus understood the functional and physical properties of the tool after extensive training.Our findings suggest that tool use is not a specific faculty resulting from higher intelligence, but is a specific combination of more general cognitive faculties. Studying the brains and behaviors of trained rodents can provide insights into how higher cognitive functions might be broken down into more general faculties, and also what cellular and molecular mechanisms are involved in the emergence of such cognitive functions