When Does Reward Maximization Lead to Matching Law?

What kind of strategies subjects follow in various behavioral circumstances has been a central issue in decision making. In particular, which behavioral strategy, maximizing or matching, is more fundamental to animal's decision behavior has been a matter of debate. Here, we prove that any algorithm to achieve the stationary condition for maximizing the average reward should lead to matching when it ignores the dependence of the expected outcome on subject's past choices. We may term this strategy of partial reward maximization “matching strategy”. Then, this strategy is applied to the case where the subject's decision system updates the information for making a decision. Such information includes subject's past actions or sensory stimuli, and the internal storage of this information is often called “state variables”. We demonstrate that the matching strategy provides an easy way to maximize reward when combined with the exploration of the state variables that correctly represent the crucial information for reward maximization. Our results reveal for the first time how a strategy to achieve matching behavior is beneficial to reward maximization, achieving a novel insight into the relationship between maximizing and matching

Redistribution of Actin during Assembly and Reassembly of the Contractile Ring in Grasshopper Spermatocytes

Cytokinesis in animal cells requires the assembly of an actomyosin contractile ring to cleave the cell. The ring is highly dynamic; it assembles and disassembles during each cell cleavage, resulting in the recurrent redistribution of actin. To investigate this process in grasshopper spermatocytes, we mechanically manipulated the spindle to induce actin redistribution into ectopic contractile rings, around reassembled lateral spindles. To enhance visualization of actin, we folded the spindle at its equator to convert the remnants of the partially assembled ring into a concentrated source of actin. Filaments from the disintegrating ring aligned along reorganizing spindle microtubules, suggesting that their incorporation into the new ring was mediated by microtubules. We tracked incorporation by speckling actin filaments with Qdots and/or labeling them with Alexa 488-phalloidin. The pattern of movement implied that actin was transported along spindle microtubules, before entering the ring. By double-labeling dividing cells, we imaged actin filaments moving along microtubules near the contractile ring. Together, our findings indicate that in one mechanism of actin redistribution, actin filaments are transported along spindle microtubule tracks in a plus-end–directed fashion. After reaching the spindle midzone, the filaments could be transported laterally to the ring. Notably, actin filaments undergo a dramatic trajectory change as they enter the ring, implying the existence of a pulling force. Two other mechanisms of actin redistribution, cortical flow and de novo assembly, are also present in grasshopper, suggesting that actin converges at the nascent contractile ring from diffuse sources within the cytoplasm and cortex, mediated by spindle microtubules

Resistance of Renal Cell Carcinoma to Sorafenib Is Mediated by Potentially Reversible Gene Expression

Purpose: Resistance to antiangiogenic therapy is an important clinical problem. We examined whether resistance occurs at least in part via reversible, physiologic changes in the tumor, or results solely from stable genetic changes in resistant tumor cells. Experimental Design: Mice bearing two human RCC xenografts were treated with sorafenib until they acquired resistance. Resistant 786-O cells were harvested and reimplanted into naïve mice. Mice bearing resistant A498 cells were subjected to a 1 week treatment break. Sorafenib was then again administered to both sets of mice. Tumor growth patterns, gene expression, viability, blood vessel density, and perfusion were serially assessed in treated vs control mice. Results: Despite prior resistance, reimplanted 786-O tumors maintained their ability to stabilize on sorafenib in sequential reimplantation steps. A transcriptome profile of the tumors revealed that the gene expression profile of tumors upon reimplantation reapproximated that of the untreated tumors and was distinct from tumors exhibiting resistance to sorafenib. In A498 tumors, revascularization was noted with resistance and cessation of sorafenib therapy and tumor perfusion was reduced and tumor cell necrosis enhanced with re-exposure to sorafenib. Conclusions: In two RCC cell lines, resistance to sorafenib appears to be reversible. These results support the hypothesis that resistance to VEGF pathway therapy is not solely the result of a permanent genetic change in the tumor or selection of resistant clones, but rather is due to a great extent to reversible changes that likely occur in the tumor and/or its microenvironment

Active behaviour during early development shapes glucocorticoid reactivity

TGlucocorticoids are the final effectors of the stress axis, with numerous targets in the central nervous system and the periphery. They are essential for adaptation, yet currently it is unclear how early life events program the glucocorticoid response to stress. Here we provide evidence that involuntary swimming at early developmental stages can reconfigure the cortisol response to homotypic and heterotypic stress in larval zebrafish (Danio rerio), also reducing startle reactivity and increasing spontaneous activity as well as energy efficiency during active behaviour. Collectively, these data identify a role of the genetically malleable zebrafish for linking early life stress with glucocorticoid function in later life

Integrated Ecosystem Assessment: Lake Ontario Water Management

BACKGROUND: Ecosystem management requires organizing, synthesizing, and projecting information at a large scale while simultaneously addressing public interests, dynamic ecological properties, and a continuum of physicochemical conditions. We compared the impacts of seven water level management plans for Lake Ontario on a set of environmental attributes of public relevance. METHODOLOGY AND FINDINGS: Our assessment method was developed with a set of established impact assessment tools (checklists, classifications, matrices, simulations, representative taxa, and performance relations) and the concept of archetypal geomorphic shoreline classes. We considered each environmental attribute and shoreline class in its typical and essential form and predicted how water level change would interact with defining properties. The analysis indicated that about half the shoreline of Lake Ontario is potentially sensitive to water level change with a small portion being highly sensitive. The current water management plan may be best for maintaining the environmental resources. In contrast, a natural water regime plan designed for greatest environmental benefits most often had adverse impacts, impacted most shoreline classes, and the largest portion of the lake coast. Plans that balanced multiple objectives and avoided hydrologic extremes were found to be similar relative to the environment, low on adverse impacts, and had many minor impacts across many shoreline classes. SIGNIFICANCE: The Lake Ontario ecosystem assessment provided information that can inform decisions about water management and the environment. No approach and set of methods will perfectly and unarguably accomplish integrated ecosystem assessment. For managing water levels in Lake Ontario, we found that there are no uniformly good and bad options for environmental conservation. The scientific challenge was selecting a set of tools and practices to present broad, relevant, unbiased, and accessible information to guide decision-making on a set of management options

Three-Dimensional Neurophenotyping of Adult Zebrafish Behavior

The use of adult zebrafish (Danio rerio) in neurobehavioral research is rapidly expanding. The present large-scale study applied the newest video-tracking and data-mining technologies to further examine zebrafish anxiety-like phenotypes. Here, we generated temporal and spatial three-dimensional (3D) reconstructions of zebrafish locomotion, globally assessed behavioral profiles evoked by several anxiogenic and anxiolytic manipulations, mapped individual endpoints to 3D reconstructions, and performed cluster analysis to reconfirm behavioral correlates of high- and low-anxiety states. The application of 3D swim path reconstructions consolidates behavioral data (while increasing data density) and provides a novel way to examine and represent zebrafish behavior. It also enables rapid optimization of video tracking settings to improve quantification of automated parameters, and suggests that spatiotemporal organization of zebrafish swimming activity can be affected by various experimental manipulations in a manner predicted by their anxiolytic or anxiogenic nature. Our approach markedly enhances the power of zebrafish behavioral analyses, providing innovative framework for high-throughput 3D phenotyping of adult zebrafish behavior

DNA copy number profiling reveals extensive genomic loss in hereditary BRCA1 and BRCA2 ovarian carcinomas

Background: Few studies have attempted to characterise genomic changes occurring in hereditary epithelial ovarian carcinomas (EOCs) and inconsistent results have been obtained. Given the relevance of DNA copy number alterations in ovarian oncogenesis and growing clinical implications of the BRCA-gene status, we aimed to characterise the genomic profiles of hereditary and sporadic ovarian tumours. Methods: High-resolution array Comparative Genomic Hybridisation profiling of 53 familial (21 BRCA1, 6 BRCA2 and 26 non- BRCA1/2) and 15 sporadic tumours in combination with supervised and unsupervised analysis was used to define common and/or specific copy number features. Results: Unsupervised hierarchical clustering did not stratify tumours according to their familial or sporadic condition or to their BRCA1/2 mutation status. Common recurrent changes, spanning genes potentially fundamental for ovarian carcinogenesis, regardless of BRCA mutations, and several candidate subtype-specific events were defined. Despite similarities, greater contribution of losses was revealed to be a hallmark of BRCA1 and BRCA2 tumours. Conclusion: Somatic alterations occurring in the development of familial EOCs do not differ substantially from the ones occurring in sporadic carcinomas. However, some specific features like extensive genomic loss observed in BRCA1/2 tumours may be of clinical relevance helping to identify BRCA-related patients likely to respond to PARP inhibitorsThis study was funded by the Fondo de Investigacio´n Sanitaria (FIS), Instituto de Salud Carlos III (grants CP07/00113 and PS09/01094

Vesicular Stomatitis Virus-Based Ebola Vaccine Is Well-Tolerated and Protects Immunocompromised Nonhuman Primates

Ebola virus (EBOV) is a significant human pathogen that presents a public health concern as an emerging/re-emerging virus and as a potential biological weapon. Substantial progress has been made over the last decade in developing candidate preventive vaccines that can protect nonhuman primates against EBOV. Among these prospects, a vaccine based on recombinant vesicular stomatitis virus (VSV) is particularly robust, as it can also confer protection when administered as a postexposure treatment. A concern that has been raised regarding the replication-competent VSV vectors that express EBOV glycoproteins is how these vectors would be tolerated by individuals with altered or compromised immune systems such as patients infected with HIV. This is especially important as all EBOV outbreaks to date have occurred in areas of Central and Western Africa with high HIV incidence rates in the population. In order to address this concern, we evaluated the safety of the recombinant VSV vector expressing the Zaire ebolavirus glycoprotein (VSVΔG/ZEBOVGP) in six rhesus macaques infected with simian-human immunodeficiency virus (SHIV). All six animals showed no evidence of illness associated with the VSVΔG/ZEBOVGP vaccine, suggesting that this vaccine may be safe in immunocompromised populations. While one goal of the study was to evaluate the safety of the candidate vaccine platform, it was also of interest to determine if altered immune status would affect vaccine efficacy. The vaccine protected 4 of 6 SHIV-infected macaques from death following ZEBOV challenge. Evaluation of CD4+ T cells in all animals showed that the animals that succumbed to lethal ZEBOV challenge had the lowest CD4+ counts, suggesting that CD4+ T cells may play a role in mediating protection against ZEBOV

Identification and developmental expression of the full complement of Cytochrome P450 genes in Zebrafish

© The Authors, 2010. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in BMC Genomics 11 (2010): 643, doi:10.1186/1471-2164-11-643.Increasing use of zebrafish in drug discovery and mechanistic toxicology demands knowledge of cytochrome P450 (CYP) gene regulation and function. CYP enzymes catalyze oxidative transformation leading to activation or inactivation of many endogenous and exogenous chemicals, with consequences for normal physiology and disease processes. Many CYPs potentially have roles in developmental specification, and many chemicals that cause developmental abnormalities are substrates for CYPs. Here we identify and annotate the full suite of CYP genes in zebrafish, compare these to the human CYP gene complement, and determine the expression of CYP genes during normal development. Zebrafish have a total of 94 CYP genes, distributed among 18 gene families found also in mammals. There are 32 genes in CYP families 5 to 51, most of which are direct orthologs of human CYPs that are involved in endogenous functions including synthesis or inactivation of regulatory molecules. The high degree of sequence similarity suggests conservation of enzyme activities for these CYPs, confirmed in reports for some steroidogenic enzymes (e.g. CYP19, aromatase; CYP11A, P450scc; CYP17, steroid 17a-hydroxylase), and the CYP26 retinoic acid hydroxylases. Complexity is much greater in gene families 1, 2, and 3, which include CYPs prominent in metabolism of drugs and pollutants, as well as of endogenous substrates. There are orthologous relationships for some CYP1 s and some CYP3 s between zebrafish and human. In contrast, zebrafish have 47 CYP2 genes, compared to 16 in human, with only two (CYP2R1 and CYP2U1) recognized as orthologous based on sequence. Analysis of shared synteny identified CYP2 gene clusters evolutionarily related to mammalian CYP2 s, as well as unique clusters. Transcript profiling by microarray and quantitative PCR revealed that the majority of zebrafish CYP genes are expressed in embryos, with waves of expression of different sets of genes over the course of development. Transcripts of some CYP occur also in oocytes. The results provide a foundation for the use of zebrafish as a model in toxicological, pharmacological and chemical disease research.This work was supported by NIH grants R01ES015912 and P42ES007381 (Superfund Basic Research Program at Boston University) (to JJS). MEJ was a Guest Investigator at the Woods Hole Oceanographic Institution (WHOI) and was supported by grants from the Swedish research council Formas and Carl Trygger's foundation. AK was a Post-doctoral Fellow at WHOI, and was supported by a fellowship from the Japanese Society for Promotion of Science (JSPS). JZ and TP were Guest Students at the WHOI and were supported by a CAPES Ph.D. Fellowship and CNPq Ph.D. Sandwich Fellowship (JZ), and by a CNPq Ph.D. Fellowship (TP), from Brazil