Zeno’s paradox in decision making

Classical probability theory has been influential in modeling decision processes, despite empirical findings that have been persistently paradoxical from classical perspectives. For such findings, some researchers have been successfully pursuing decision models based on quantum theory. One unique feature of quantum theory is the collapse postulate, which entails that measurements (or in decision making, judgments) reset the state to be consistent with the measured outcome. If there is quantum structure in cognition, then there has to be evidence for the collapse postulate. A striking, a priori prediction, is that opinion change will be slowed down (under idealized conditions frozen) by continuous judgments. In physics, this is the quantum Zeno effect. We demonstrate a quantum Zeno effect in decision making in humans and so provide evidence that advocates the use of quantum principles in decision theory, at least in some cases

Differential Encoding of Factors Influencing Predicted Reward Value in Monkey Rostral Anterior Cingulate Cortex

Background: The value of a predicted reward can be estimated based on the conjunction of both the intrinsic reward value and the length of time to obtain it. The question we addressed is how the two aspects, reward size and proximity to reward, influence the responses of neurons in rostral anterior cingulate cortex (rACC), a brain region thought to play an important role in reward processing. Methods and Findings: We recorded from single neurons while two monkeys performed a multi-trial reward schedule task. The monkeys performed 1–4 sequential color discrimination trials to obtain a reward of 1–3 liquid drops. There were two task conditions, a valid cue condition, where the number of trials and reward amount were associated with visual cues, and a random cue condition, where the cue was picked from the cue set at random. In the valid cue condition, the neuronal firing is strongly modulated by the predicted reward proximity during the trials. Information about the predicted reward amount is almost absent at those times. In substantial subpopulations, the neuronal responses decreased or increased gradually through schedule progress to the predicted outcome. These two gradually modulating signals could be used to calculate the effect of time on the perception of reward value. In the random cue condition, little information about the reward proximity or reward amount is encoded during the course of the trial before reward delivery, but when the reward is actually delivered the responses reflect both the reward proximity and reward amount

Localized microstimulation of primate pregenual cingulate cortex induces negative decision-making

The pregenual anterior cingulate cortex (pACC) has been implicated in human anxiety disorders and depression, but the circuit-level mechanisms underlying these disorders are unclear. In healthy individuals, the pACC is involved in cost-benefit evaluation. We developed a macaque version of an approach-avoidance decision task used to evaluate anxiety and depression in humans and, with multi-electrode recording and cortical microstimulation, we probed pACC function as monkeys performed this task. We found that the macaque pACC has an opponent process-like organization of neurons representing motivationally positive and negative subjective value. Spatial distribution of these two neuronal populations overlapped in the pACC, except in one subzone, where neurons with negative coding were more numerous. Notably, microstimulation in this subzone, but not elsewhere in the pACC, increased negative decision-making, and this negative biasing was blocked by anti-anxiety drug treatment. This cortical zone could be critical for regulating negative emotional valence and anxiety in decision-making.National Institutes of Health (U.S.) (Javits Merit Grant R01 NS025529)United States. Office of Naval Research (N000140710903)National Parkinson Foundation (U.S.) (Lynn Diamond Fellowship

Neural correlates of sexual cue reactivity in individuals with and without compulsive sexual behaviours

Although compulsive sexual behaviour (CSB) has been conceptualized as a "behavioural" addiction and common or overlapping neural circuits may govern the processing of natural and drug rewards, little is known regarding the responses to sexually explicit materials in individuals with and without CSB. Here, the processing of cues of varying sexual content was assessed in individuals with and without CSB, focusing on neural regions identified in prior studies of drug-cue reactivity. 19 CSB subjects and 19 healthy volunteers were assessed using functional MRI comparing sexually explicit videos with non-sexual exciting videos. Ratings of sexual desire and liking were obtained. Relative to healthy volunteers, CSB subjects had greater desire but similar liking scores in response to the sexually explicit videos. Exposure to sexually explicit cues in CSB compared to non-CSB subjects was associated with activation of the dorsal anterior cingulate, ventral striatum and amygdala. Functional connectivity of the dorsal anterior cingulate-ventral striatum-amygdala network was associated with subjective sexual desire (but not liking) to a greater degree in CSB relative to non-CSB subjects. The dissociation between desire or wanting and liking is consistent with theories of incentive motivation underlying CSB as in drug addictions. Neural differences in the processing of sexual-cue reactivity were identified in CSB subjects in regions previously implicated in drug-cue reactivity studies. The greater engagement of corticostriatal limbic circuitry in CSB following exposure to sexual cues suggests neural mechanisms underlying CSB and potential biological targets for interventions

Comparison of choose-a-movie and approach-avoidance paradigms used to measure social motivation

Social motivation is a subjective state which is rather difficult to quantify. It has sometimes been conceptualised as “behavioural effort” to seek social contact. Two paradigms: approach–avoidance (AA) and choose a movie (CAM), based on the same conceptualisation, have been used to measure social motivation in people with and without autism. However, in absence of a direct comparison, it is hard to know which of these paradigms has higher sensitivity in estimating preference for social over non-social stimuli. Here we compare these two tasks for their utility in (1) evaluating social seeking in typical people and (2) identifying the influence of autistic traits on social motivation. Our results suggest that CAM reveals a clear preference for social stimuli over non-social in typical adults but AA fails to do so. Also, social seeking measured with CAM but not AA has a negative relationship between autistic traits

Biased Competition in Visual Processing Hierarchies: A Learning Approach Using Multiple Cues

In this contribution, we present a large-scale hierarchical system for object detection fusing bottom-up (signal-driven) processing results with top-down (model or task-driven) attentional modulation. Specifically, we focus on the question of how the autonomous learning of invariant models can be embedded into a performing system and how such models can be used to define object-specific attentional modulation signals. Our system implements bi-directional data flow in a processing hierarchy. The bottom-up data flow proceeds from a preprocessing level to the hypothesis level where object hypotheses created by exhaustive object detection algorithms are represented in a roughly retinotopic way. A competitive selection mechanism is used to determine the most confident hypotheses, which are used on the system level to train multimodal models that link object identity to invariant hypothesis properties. The top-down data flow originates at the system level, where the trained multimodal models are used to obtain space- and feature-based attentional modulation signals, providing biases for the competitive selection process at the hypothesis level. This results in object-specific hypothesis facilitation/suppression in certain image regions which we show to be applicable to different object detection mechanisms. In order to demonstrate the benefits of this approach, we apply the system to the detection of cars in a variety of challenging traffic videos. Evaluating our approach on a publicly available dataset containing approximately 3,500 annotated video images from more than 1 h of driving, we can show strong increases in performance and generalization when compared to object detection in isolation. Furthermore, we compare our results to a late hypothesis rejection approach, showing that early coupling of top-down and bottom-up information is a favorable approach especially when processing resources are constrained

Measuring the value of social engagement in adults with and without autism

Differences in social communication are commonly reported in autism spectrum condition (ASC). A recent theory attributes this to a reduced motivation to engage with others, that is, deficits in social motivation. However, there are currently few simple, direct, behavioural ways to test this claim. This study uses a new behavioural measure of social motivation to test if preferences for direct gaze and face stimuli are linked to autistic traits or an ASC diagnosis. Our novel choose-a-movie (CAM) paradigm measures the effort participants invest to see particular stimuli. This aspect of social motivation is also known as social seeking. Methods In experiment 1, 80 typical adults completed the CAM task and a measure of autistic traits. In experiment 2, 30 adults with ASC and 24 age/IQ-matched typical adults completed the CAM paradigm. Results The results from study one showed that typical adults prefer social stimuli over non-social, but this preference is weaker in those with higher levels of autistic traits. In study two, adults with ASC showed a significant reduction in their preference for direct gaze but little difference in their preference for faces without direct gaze. Conclusions These data show that social motivation can be measured in a simple, direct, behavioural paradigm. Furthermore, adults with ASC prefer direct gaze less than typical adults but may not avoid faces without direct gaze. This data advance our understanding of how social motivation may differ between those with and without autism

Great Apes' Risk-Taking Strategies in a Decision Making Task

We investigate decision-making behaviour in all four non-human great ape species. Apes chose between a safe and a risky option across trials of varying expected values. All species chose the safe option more often with decreasing probability of success. While all species were risk-seeking, orangutans and chimpanzees chose the risky option more often than gorillas and bonobos. Hence all four species' preferences were ordered in a manner consistent with normative dictates of expected value, but varied predictably in their willingness to take risks

Behavioural Correlate of Choice Confidence in a Discrete Trial Paradigm

How animals make choices in a changing and often uncertain environment is a central theme in the behavioural sciences. There is a substantial literature on how animals make choices in various experimental paradigms but less is known about the way they assess a choice after it has been made in terms of the expected outcome. Here, we used a discrete trial paradigm to characterise how the reward history shaped the behaviour on a trial by trial basis. Rats initiated each trial which consisted of a choice between two drinking spouts that differed in their probability of delivering a sucrose solution. Critically, sucrose was delivered after a delay from the first lick at the spouts – this allowed us to characterise the behavioural profile during the window between the time of choice and its outcome. Rats' behaviour converged to optimum choice, both during the acquisition phase and after the reversal of contingencies. We monitored the post-choice behaviour at a temporal precision of 1 millisecond; lick-response profiles revealed that rats spent more time at the spout with the higher reward probability and exhibited a sparser lick pattern. This was the case when we exclusively examined the unrewarded trials, where the outcome was identical. The differential licking profiles preceded the differential choice ratios and could thus predict the changes in choice behaviour