Dopamine and Effort-Based Decision Making

Motivational theories of choice focus on the influence of goal values and strength of reinforcement to explain behavior. By contrast relatively little is known concerning how the cost of an action, such as effort expended, contributes to a decision to act. Effort-based decision making addresses how we make an action choice based on an integration of action and goal values. Here we review behavioral and neurobiological data regarding the representation of effort as action cost, and how this impacts on decision making. Although organisms expend effort to obtain a desired reward there is a striking sensitivity to the amount of effort required, such that the net preference for an action decreases as effort cost increases. We discuss the contribution of the neurotransmitter dopamine (DA) toward overcoming response costs and in enhancing an animal's motivation toward effortful actions. We also consider the contribution of brain structures, including the basal ganglia and anterior cingulate cortex, in the internal generation of action involving a translation of reward expectation into effortful action

Ergodicity-breaking reveals time optimal decision making in humans

Ergodicity describes an equivalence between the expectation value and the time average of observables. Applied to human behaviour, ergodic theories of decision-making reveal how individuals should tolerate risk in different environments. To optimise wealth over time, agents should adapt their utility function according to the dynamical setting they face. Linear utility is optimal for additive dynamics, whereas logarithmic utility is optimal for multiplicative dynamics. Whether humans approximate time optimal behavior across different dynamics is unknown. Here we compare the effects of additive versus multiplicative gamble dynamics on risky choice. We show that utility functions are modulated by gamble dynamics in ways not explained by prevailing decision theory. Instead, as predicted by time optimality, risk aversion increases under multiplicative dynamics, distributing close to the values that maximise the time average growth of wealth. We suggest that our findings motivate a need for explicitly grounding theories of decision-making on ergodic considerations.Comment: 43 pages including supplementary methods & material

Do Killing-Yano tensors form a Lie Algebra?

Killing-Yano tensors are natural generalizations of Killing vectors. We investigate whether Killing-Yano tensors form a graded Lie algebra with respect to the Schouten-Nijenhuis bracket. We find that this proposition does not hold in general, but that it does hold for constant curvature spacetimes. We also show that Minkowski and (anti)-deSitter spacetimes have the maximal number of Killing-Yano tensors of each rank and that the algebras of these tensors under the SN bracket are relatively simple extensions of the Poincare and (A)dS symmetry algebras.Comment: 17 page

Overcoming status quo bias in the human brain

Humans often accept the status quo when faced with conflicting choice alternatives. However, it is unknown how neural pathways connecting cognition with action modulate this status quo acceptance. Here we developed a visual detection task in which subjects tended to favor the default when making difficult, but not easy, decisions. This bias was suboptimal in that more errors were made when the default was accepted. A selective increase in subthalamic nucleus (STN) activity was found when the status quo was rejected in the face of heightened decision difficulty. Analysis of effective connectivity showed that inferior frontal cortex, a region more active for difficult decisions, exerted an enhanced modulatory influence on the STN during switches away from the status quo. These data suggest that the neural circuits required to initiate controlled, nondefault actions are similar to those previously shown to mediate outright response suppression. We conclude that specific prefrontal-basal ganglia dynamics are involved in rejecting the default, a mechanism that may be important in a range of difficult choice scenarios

The cosmological constant and the black hole equation of state

The thermodynamics of black holes in various dimensions are described in the presence of a negative cosmological constant which is treated as a thermodynamic variable, interpreted as a pressure in the equation of state. The black hole mass is then identified with the enthalpy, rather than the internal energy, and heat capacities are calculated at constant pressure not at constant volume. The Euclidean action is associated with a bridge equation for the Gibbs free energy and not the Helmholtz free energy. Quantum corrections to the enthalpy and the equation of state of the BTZ black hole are studied.Comment: 20 pages, 4 figures: some typos corrected in v

Game theory of mind

This paper introduces a model of ‘theory of mind’, namely, how we represent the intentions and goals of others to optimise our mutual interactions. We draw on ideas from optimum control and game theory to provide a ‘game theory of mind’. First, we consider the representations of goals in terms of value functions that are prescribed by utility or rewards. Critically, the joint value functions and ensuing behaviour are optimised recursively, under the assumption that I represent your value function, your representation of mine, your representation of my representation of yours, and so on ad infinitum. However, if we assume that the degree of recursion is bounded, then players need to estimate the opponent's degree of recursion (i.e., sophistication) to respond optimally. This induces a problem of inferring the opponent's sophistication, given behavioural exchanges. We show it is possible to deduce whether players make inferences about each other and quantify their sophistication on the basis of choices in sequential games. This rests on comparing generative models of choices with, and without, inference. Model comparison is demonstrated using simulated and real data from a ‘stag-hunt’. Finally, we note that exactly the same sophisticated behaviour can be achieved by optimising the utility function itself (through prosocial utility), producing unsophisticated but apparently altruistic agents. This may be relevant ethologically in hierarchal game theory and coevolution

Symptoms and quality of life in late stage Parkinson syndromes: a longitudinal community study of predictive factors

BACKGROUND Palliative care is increasingly offered earlier in the cancer trajectory but rarely in Idiopathic Parkinson's Disease(IPD), Progressive Supranuclear Palsy(PSP) or Multiple System Atrophy(MSA). There is little longitudinal data of people with late stage disease to understand levels of need. We aimed to determine how symptoms and quality of life of these patients change over time; and what demographic and clinical factors predicted changes. METHODS We recruited 82 patients into a longitudinal study, consenting patients with a diagnosis of IPD, MSA or PSP, stages 3-5 Hoehn and Yahr(H&Y). At baseline and then on up to 3 occasions over one year, we collected self-reported demographic, clinical, symptom, palliative and quality of life data, using Parkinson's specific and generic validated scales, including the Palliative care Outcome Scale (POS). We tested for predictors using multivariable analysis, adjusting for confounders. FINDINGS Over two thirds of patients had severe disability, over one third being wheelchair-bound/bedridden. Symptoms were highly prevalent in all conditions - mean (SD) of 10.6(4.0) symptoms. More than 50% of the MSA and PSP patients died over the year. Over the year, half of the patients showed either an upward (worsening, 24/60) or fluctuant (8/60) trajectory for POS and symptoms. The strongest predictors of higher levels of symptoms at the end of follow-up were initial scores on POS (AOR 1.30; 95%CI:1.05-1.60) and being male (AOR 5.18; 95% CI 1.17 to 22.92), both were more predictive than initial H&Y scores. INTERPRETATION The findings point to profound and complex mix of non-motor and motor symptoms in patients with late stage IPD, MSA and PSP. Symptoms are not resolved and half of the patients deteriorate. Palliative problems are predictive of future symptoms, suggesting that an early palliative assessment might help screen for those in need of earlier intervention

Accretion Disks Around Black Holes: Twenty Five Years Later

We study the progress of the theory of accretion disks around black holes in last twenty five years and explain why advective disks are the best bet in explaining varied stationary and non-stationary observations from black hole candidates. We show also that the recently proposed advection dominated flows are incorrect.Comment: 30 Latex pages including figures. Kluwer Style files included. Appearing in `Observational Evidence for Black Holes in the Universe', ed. Sandip K. Chakrabarti, Kluwer Academic Publishers (DORDRECHT: Holland

Fractionation of impulsive and compulsive trans-diagnostic phenotypes and their longitudinal associations.

OBJECTIVE: Young adulthood is a crucial neurodevelopmental period during which impulsive and compulsive problem behaviours commonly emerge. While traditionally considered diametrically opposed, impulsive and compulsive symptoms tend to co-occur. The objectives of this study were as follows: (a) to identify the optimal trans-diagnostic structural framework for measuring impulsive and compulsive problem behaviours, and (b) to use this optimal framework to identify common/distinct antecedents of these latent phenotypes. METHOD: In total, 654 young adults were recruited as part of the Neuroscience in Psychiatry Network, a population-based cohort in the United Kingdom. The optimal trans-diagnostic structural model capturing 33 types of impulsive and compulsive problem behaviours was identified. Baseline predictors of subsequent impulsive and compulsive trans-diagnostic phenotypes were characterised, along with cross-sectional associations, using partial least squares. RESULTS: Current problem behaviours were optimally explained by a bi-factor model, which yielded dissociable measures of impulsivity and compulsivity, as well as a general disinhibition factor. Impulsive problem behaviours were significantly explained by prior antisocial and impulsive personality traits, male gender, general distress, perceived dysfunctional parenting and teasing/arguments within friendships. Compulsive problem behaviours were significantly explained by prior compulsive traits and female gender. CONCLUSION: This study demonstrates that trans-diagnostic phenotypes of 33 impulsive and compulsive problem behaviours are identifiable in young adults, utilising a bi-factor model based on responses to a single questionnaire. Furthermore, these phenotypes have different antecedents. The findings yield a new framework for fractionating impulsivity and compulsivity, and suggest different early intervention targets to avert emergence of problem behaviours. This framework may be useful for future biological and clinical dissection of impulsivity and compulsivity

Psychometric properties of a generic, patient-centred palliative care outcome measure of symptom burden for people with progressive long term neurological conditions

Background There is no standard palliative care outcome measure for people with progressive long term neurological conditions (LTNC). This study aims to determine the psychometric properties of a new 8-item palliative care outcome scale of symptom burden (IPOS Neuro-S8) in this population. Data and Methods Data were merged from a Phase II palliative care intervention study in multiple sclerosis (MS) and a longitudinal observational study in idiopathic Parkinson's disease (IPD), multiple system atrophy (MSA) and progressive supranuclear palsy (PSP). The IPOS Neuro-S8 was assessed for its data quality, score distribution, ceiling and floor effects, reliability, factor structure, convergent and discriminant validity, concurrent validity with generic (Palliative care Outcome Scale) and condition specific measures (Multiple Sclerosis Impact Scale; Non-motor Symptoms Questionnaire; Parkinson's Disease Questionnaire), responsiveness and minimally clinically important difference. Results Of the 134 participants, MS patients had a mean Extended Disability Status Scale score 7.8 (SD = 1.0), patients with an IPD, MSA or PSP were in Hoehn & Yahr stage 3±5. The IPOS Neuro-S8 had high data quality (2% missing), mean score 8 (SD = 5; range 0±32), no ceiling effects, borderline floor effects, good internal consistency (Cronbach's α = 0.7) and moderate test-retest reliability (intraclass coefficient = 0.6). The results supported a moderately correlated two-factor structure (Pearson's r = 0.5). It was moderately correlated with generic and condition specific measures (Pearson's r: 0.5±0.6). There was some evidence for discriminant validity in IPD, MSA and PSP (p = 0.020), and for good responsiveness and longitudinal construct validity. Conclusions IPOS Neuro-S8 shows acceptable to promising psychometric properties in common forms of progressive LTNCs. Future work needs to confirm these findings with larger samples and its usefulness in wider disease groups