Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

The Significance of Family History Status in Relation to Neuropsychological Test Performance and Cerebral Glucose Metabolism Studied with Positron Emission Tomography in Older Alcoholic Patients

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/66033/1/j.1530-0277.1998.tb03622.x.pd

Evidence for surprise minimization over value maximization in choice behavior

Classical economic models are predicated on the idea that the ultimate aim of choice is to maximize utility or reward. In contrast, an alternative perspective highlights the fact that adaptive behavior requires agents' to model their environment and minimize surprise about the states they frequent. We propose that choice behavior can be more accurately accounted for by surprise minimization compared to reward or utility maximization alone. Minimizing surprise makes a prediction at variance with expected utility models; namely, that in addition to attaining valuable states, agents attempt to maximize the entropy over outcomes and thus 'keep their options open'. We tested this prediction using a simple binary choice paradigm and show that human decision-making is better explained by surprise minimization compared to utility maximization. Furthermore, we replicated this entropy-seeking behavior in a control task with no explicit utilities. These findings highlight a limitation of purely economic motivations in explaining choice behavior and instead emphasize the importance of belief-based motivations

An extracellular steric seeding mechanism for Eph-ephrin signaling platform assembly

Erythropoetin-producing hepatoma (Eph) receptors are cell-surface protein tyrosine kinases mediating cell-cell communication. Upon activation, they form signaling clusters. We report crystal structures of the full ectodomain of human EphA2 (eEphA2) both alone and in complex with the receptor-binding domain of the ligand ephrinA5 (ephrinA5 RBD). Unliganded eEphA2 forms linear arrays of staggered parallel receptors involving two patches of residues conserved across A-class Ephs. eEphA2-ephrinA5 RBD forms a more elaborate assembly, whose interfaces include the same conserved regions on eEphA2, but rearranged to accommodate ephrinA5 RBD. Cell-surface expression of mutant EphA2s showed that these interfaces are critical for localization at cell-cell contacts and activation-dependent degradation. Our results suggest a 'nucleation' mechanism whereby a limited number of ligand-receptor interactions 'seed' an arrangement of receptors which can propagate into extended signaling arrays

The Worldvolume Action of Kink Solitons in AdS Spacetime

A formalism is presented for computing the higher-order corrections to the worldvolume action of co-dimension one solitons. By modifying its potential, an explicit "kink" solution of a real scalar field in AdS spacetime is found. The formalism is then applied to explicitly compute the kink worldvolume action to quadratic order in two expansion parameters--associated with the hypersurface fluctuation length and the radius of AdS spacetime respectively. Two alternative methods are given for doing this. The results are expressed in terms of the trace of the extrinsic curvature and the intrinsic scalar curvature. In addition to conformal Galileon interactions, we find a non-Galileon term which is never sub-dominant. This method can be extended to any conformally flat bulk spacetime.Comment: 32 pages, 3 figures, typos corrected and additional comments adde

The Characteristics, Experiences and Perceptions of Registered Massage Therapists in New Zealand: Results from a National Survey of Practitioners

Background: Massage therapy is widely recognized as offering many health benefits, with a growing number of studies finding it has value in stress management, pain reduction, and overcoming physical limitations. However, there are few studies of massage therapists practices and perceptions in New Zealand and internationally. This paper reports the findings from the first national survey examining the characteristics, perceptions, and experiences of New Zealand-based massage therapists on a range of aspects related to their role and practices.Purpose: This study sought to ascertain the characteristics, experiences, and perceptions of massage therapists in New Zealand, particularly in the aspects of: integration of health care; attitudes and practices related to research; and evidence and attitudes to registration.Setting: Massage practice in New Zealand (nationwide survey).Participants: Members of Massage New Zealand (a massage practitioners association).Research Design: Massage practitioners were surveyed online, using a 65-part questionnaire, on a range of characteristics of their practices and their attitudes to research, integration, and registration. Statistical analysis was performed using STATA. Statistical significance was set at 0.05.Main Outcome Measures: Four hundred massage therapists (MTs) were invited to participate and 115 responded, providing a response rate of 29%. MTs valued research (95%) and perceived that it had an impact for their practices (88%). Significant correlations were found for research value and: mean case-load (p = .009) and level of academic qualification (p = .004). The majority of MTs (79%) supported integration with conventional practitioners, and 83% referred clients to general practitioners, with 75% receiving referrals from general practitioners. Ninety-three percent of MTs supported registration, with 67% of those supporting statutory registration.Conclusion: Massage practitioners perceive that they make a significant contribution to health care, but area of practice, such as research, and referral and integration into mainstream health care require more in-depth investigation

Coordinated optimization of visual cortical maps (II) Numerical studies

It is an attractive hypothesis that the spatial structure of visual cortical architecture can be explained by the coordinated optimization of multiple visual cortical maps representing orientation preference (OP), ocular dominance (OD), spatial frequency, or direction preference. In part (I) of this study we defined a class of analytically tractable coordinated optimization models and solved representative examples in which a spatially complex organization of the orientation preference map is induced by inter-map interactions. We found that attractor solutions near symmetry breaking threshold predict a highly ordered map layout and require a substantial OD bias for OP pinwheel stabilization. Here we examine in numerical simulations whether such models exhibit biologically more realistic spatially irregular solutions at a finite distance from threshold and when transients towards attractor states are considered. We also examine whether model behavior qualitatively changes when the spatial periodicities of the two maps are detuned and when considering more than 2 feature dimensions. Our numerical results support the view that neither minimal energy states nor intermediate transient states of our coordinated optimization models successfully explain the spatially irregular architecture of the visual cortex. We discuss several alternative scenarios and additional factors that may improve the agreement between model solutions and biological observations.Comment: 55 pages, 11 figures. arXiv admin note: substantial text overlap with arXiv:1102.335

Selected acute phase CSF factors in ischemic stroke: findings and prognostic value

<p>Abstract</p> <p>Background</p> <p>Study aimed at investigation of pathogenic role and prognostic value of several selected cerebrospinal fluid acute phase factors that can reflect the severity of ischemic brain damage.</p> <p>Methods</p> <p>Ninety five acute ischemic stroke patients were investigated. Ischemic region visualized at the twenty fourth hour by conventional Magnetic Resonance Imaging. Stroke severity evaluated by National Institute Health Stroke Scale. One month outcome of disease was assessed by Barthel Index. Cerebrospinal fluid was taken at the sixth hour of stroke onset. CSF pro- and anti-inflammatory cytokines were studied by Enzyme Linked Immunosorbent Assay. Nitric Oxide and Lipoperoxide radical were measured by Electron Paramagnetic Resonance. CSF Nitrate levels were detected using the Griess reagent. Statistics performed by SPSS-11.0.</p> <p><b>Results</b></p> <p>At the sixth hour of stroke onset, cerebrospinal fluid cytokine levels were elevated in patients against controls. Severe stroke patients had increased interleukin-6 content compared to less severe strokes (P < 0.05). Cerebrospinal fluid Electron Paramagnetic Resonance signal of nitric oxide was increased in patients against controls. Severe stroke group had an elevated Electron Paramagnetic Resonance signal of lipoperoxiradical compared to less severe stroke. Cerebrospinal fluid nitrate levels in less severe stroke patients were higher than those for severe stroke and control. Positive correlation was established between the initial interleukin-6 content and ischemic lesion size as well as with National Institute Health Stroke Scale score on the seventh day. Initial interleukin-6 and nitrate levels in cerebrospinal fluid found to be significant for functional outcome of stroke at one month.</p> <p><b>Conclusion</b></p> <p>According to present study the cerebrospinal fluid contents of interleukin-6 and nitrates seem to be the most reliable prognostic factors in acute phase of ischemic stroke.</p

Coordinated optimization of visual cortical maps (I) Symmetry-based analysis

In the primary visual cortex of primates and carnivores, functional architecture can be characterized by maps of various stimulus features such as orientation preference (OP), ocular dominance (OD), and spatial frequency. It is a long-standing question in theoretical neuroscience whether the observed maps should be interpreted as optima of a specific energy functional that summarizes the design principles of cortical functional architecture. A rigorous evaluation of this optimization hypothesis is particularly demanded by recent evidence that the functional architecture of OP columns precisely follows species invariant quantitative laws. Because it would be desirable to infer the form of such an optimization principle from the biological data, the optimization approach to explain cortical functional architecture raises the following questions: i) What are the genuine ground states of candidate energy functionals and how can they be calculated with precision and rigor? ii) How do differences in candidate optimization principles impact on the predicted map structure and conversely what can be learned about an hypothetical underlying optimization principle from observations on map structure? iii) Is there a way to analyze the coordinated organization of cortical maps predicted by optimization principles in general? To answer these questions we developed a general dynamical systems approach to the combined optimization of visual cortical maps of OP and another scalar feature such as OD or spatial frequency preference.Comment: 90 pages, 16 figure