Active Inference, Novelty and Neglect

In this chapter, we provide an overview of the principles of active inference. We illustrate how different forms of short-term memory are expressed formally (mathematically) through appealing to beliefs about the causes of our sensations and about the actions we pursue. This is used to motivate an approach to active vision that depends upon inferences about the causes of 'what I have seen' and learning about 'what I would see if I were to look there'. The former could manifest as persistent 'delay-period' activity - of the sort associated with working memory, while the latter is better suited to changes in synaptic efficacy - of the sort that underlies short-term learning and adaptation. We review formulations of these ideas in terms of active inference, their role in directing visual exploration and the consequences - for active vision - of their failures. To illustrate the latter, we draw upon some of our recent work on the computational anatomy of visual neglect

Game theory of mind

This paper introduces a model of ‘theory of mind’, namely, how we represent the intentions and goals of others to optimise our mutual interactions. We draw on ideas from optimum control and game theory to provide a ‘game theory of mind’. First, we consider the representations of goals in terms of value functions that are prescribed by utility or rewards. Critically, the joint value functions and ensuing behaviour are optimised recursively, under the assumption that I represent your value function, your representation of mine, your representation of my representation of yours, and so on ad infinitum. However, if we assume that the degree of recursion is bounded, then players need to estimate the opponent's degree of recursion (i.e., sophistication) to respond optimally. This induces a problem of inferring the opponent's sophistication, given behavioural exchanges. We show it is possible to deduce whether players make inferences about each other and quantify their sophistication on the basis of choices in sequential games. This rests on comparing generative models of choices with, and without, inference. Model comparison is demonstrated using simulated and real data from a ‘stag-hunt’. Finally, we note that exactly the same sophisticated behaviour can be achieved by optimising the utility function itself (through prosocial utility), producing unsophisticated but apparently altruistic agents. This may be relevant ethologically in hierarchal game theory and coevolution

Activation in a Frontoparietal Cortical Network Underlies Individual Differences in the Performance of an Embedded Figures Task

The Embedded Figures Test (EFT) requires observers to search for a simple geometric shape hidden inside a more complex figure. Surprisingly, performance in the EFT is negatively correlated with susceptibility to illusions of spatial orientation, such as the Roelofs effect. Using fMRI, we previously demonstrated that regions in parietal cortex are involved in the contextual processing associated with the Roelofs task. In the present study, we found that similar parietal regions (superior parietal cortex and precuneus) were more active during the EFT than during a simple matching task. Importantly, these parietal activations overlapped with regions found to be involved during contextual processing in the Roelofs illusion. Additional parietal and frontal areas, in the right hemisphere, showed strong correlations between brain activity and behavioral performance during the search task. We propose that the posterior parietal regions are necessary for processing contextual information across many different, but related visuospatial tasks, with additional parietal and frontal regions serving to coordinate this processing in participants proficient in the task

Use of fuzzy edge single-photon emission computed tomography analysis in definite Alzheimer's disease - a retrospective study

<p>Abstract</p> <p>Background</p> <p>Definite Alzheimer's disease (AD) requires neuropathological confirmation. Single-photon emission computed tomography (SPECT) may enhance diagnostic accuracy, but due to restricted sensitivity and specificity, the role of SPECT is largely limited with regard to this purpose.</p> <p>Methods</p> <p>We propose a new method of SPECT data analysis. The method is based on a combination of parietal lobe selection (as regions-of-interest (ROI)), 3D fuzzy edge detection, and 3D watershed transformation. We applied the algorithm to three-dimensional SPECT images of human brains and compared the number of watershed regions inside the ROI between AD patients and controls. The Student's two-sample t-test was used for testing domain number equity in both groups.</p> <p>Results</p> <p>AD patients had a significantly reduced number of watershed regions compared to controls (<it>p </it>< 0.01). A sensitivity of 94.1% and specificity of 80% was obtained with a threshold value of 57.11 for the watershed domain number. The narrowing of the SPECT analysis to parietal regions leads to a substantial increase in both sensitivity and specificity.</p> <p>Conclusions</p> <p>Our non-invasive, relatively low-cost, and easy method can contribute to a more precise diagnosis of AD.</p

The Brain Reaction to Viewing Faces of Opposite- and Same-Sex Romantic Partners

We pursued our functional magnetic resonance imaging (fMRI) studies of the neural correlates of romantic love in 24 subjects, half of whom were female (6 heterosexual and 6 homosexual) and half male (6 heterosexual and 6 homosexual). We compared the pattern of activity produced in their brains when they viewed the faces of their loved partners with that produced when they viewed the faces of friends of the same sex to whom they were romantically indifferent. The pattern of activation and de-activation was very similar in the brains of males and females, and heterosexuals and homosexuals. We could therefore detect no difference in activation patterns between these groups

Human Stiff-Person Syndrome IgG Induces Anxious Behavior in Rats

Background: Anxiety is a heterogeneous behavioral domain playing a role in a variety of neuropsychiatric diseases. While anxiety is the cardinal symptom in disorders such as panic disorder, co-morbid anxious behavior can occur in a variety of diseases. Stiff person syndrome (SPS) is a CNS disorder characterized by increased muscle tone and prominent agoraphobia and anxiety. Most patients have high-titer antibodies against glutamate decarboxylase (GAD) 65. The pathogenic role of these autoantibodies is unclear. Methodology/Principal Findings: We re-investigated a 53 year old woman with SPS and profound anxiety for GABA-A receptor binding in the amygdala with (11)C-flumazenil PET scan and studied the potential pathogenic role of purified IgG from her plasma filtrates containing high-titer antibodies against GAD 65. We passively transferred the IgG fraction intrathecally into rats and analyzed the effects using behavioral and in vivo electrophysiological methods. In cell culture, we measured the effect of patient IgG on GABA release from hippocampal neurons. Repetitive intrathecal application of purified patient IgG in rats resulted in an anxious phenotype resembling the core symptoms of the patient. Patient IgG selectively bound to rat amygdala, hippocampus, and frontal cortical areas. In cultured rat hippocampal neurons, patient IgG inhibited GABA release. In line with these experimental results, the GABA-A receptor binding potential was reduced in the patient’s amygdala/hippocampus complex. No motor abnormalities were found in recipient rats. Conclusion/Significance: The observations in rats after passive transfer lead us to propose that anxiety-like behavior can be induced in rats by passive transfer of IgG from a SPS patient positive for anti-GAD 65 antibodies. Anxiety, in this case, thus may be an antibody-mediated phenomenon with consecutive disturbance of GABAergic signaling in the amygdala region

Modeling the Violation of Reward Maximization and Invariance in Reinforcement Schedules

It is often assumed that animals and people adjust their behavior to maximize reward acquisition. In visually cued reinforcement schedules, monkeys make errors in trials that are not immediately rewarded, despite having to repeat error trials. Here we show that error rates are typically smaller in trials equally distant from reward but belonging to longer schedules (referred to as “schedule length effect”). This violates the principles of reward maximization and invariance and cannot be predicted by the standard methods of Reinforcement Learning, such as the method of temporal differences. We develop a heuristic model that accounts for all of the properties of the behavior in the reinforcement schedule task but whose predictions are not different from those of the standard temporal difference model in choice tasks. In the modification of temporal difference learning introduced here, the effect of schedule length emerges spontaneously from the sensitivity to the immediately preceding trial. We also introduce a policy for general Markov Decision Processes, where the decision made at each node is conditioned on the motivation to perform an instrumental action, and show that the application of our model to the reinforcement schedule task and the choice task are special cases of this general theoretical framework. Within this framework, Reinforcement Learning can approach contextual learning with the mixture of empirical findings and principled assumptions that seem to coexist in the best descriptions of animal behavior. As examples, we discuss two phenomena observed in humans that often derive from the violation of the principle of invariance: “framing,” wherein equivalent options are treated differently depending on the context in which they are presented, and the “sunk cost” effect, the greater tendency to continue an endeavor once an investment in money, effort, or time has been made. The schedule length effect might be a manifestation of these phenomena in monkeys

Retinotopic Maps, Spatial Tuning, and Locations of Human Visual Areas in Surface Coordinates Characterized with Multifocal and Blocked fMRI Designs

The localization of visual areas in the human cortex is typically based on mapping the retinotopic organization with functional magnetic resonance imaging (fMRI). The most common approach is to encode the response phase for a slowly moving visual stimulus and to present the result on an individual's reconstructed cortical surface. The main aims of this study were to develop complementary general linear model (GLM)-based retinotopic mapping methods and to characterize the inter-individual variability of the visual area positions on the cortical surface. We studied 15 subjects with two methods: a 24-region multifocal checkerboard stimulus and a blocked presentation of object stimuli at different visual field locations. The retinotopic maps were based on weighted averaging of the GLM parameter estimates for the stimulus regions. In addition to localizing visual areas, both methods could be used to localize multiple retinotopic regions-of-interest. The two methods yielded consistent retinotopic maps in the visual areas V1, V2, V3, hV4, and V3AB. In the higher-level areas IPS0, VO1, LO1, LO2, TO1, and TO2, retinotopy could only be mapped with the blocked stimulus presentation. The gradual widening of spatial tuning and an increase in the responses to stimuli in the ipsilateral visual field along the hierarchy of visual areas likely reflected the increase in the average receptive field size. Finally, after registration to Freesurfer's surface-based atlas of the human cerebral cortex, we calculated the mean and variability of the visual area positions in the spherical surface-based coordinate system and generated probability maps of the visual areas on the average cortical surface. The inter-individual variability in the area locations decreased when the midpoints were calculated along the spherical cortical surface compared with volumetric coordinates. These results can facilitate both analysis of individual functional anatomy and comparisons of visual cortex topology across studies

Group membership and racial bias modulate the temporal estimation of in-group/out-group body movements

Social group categorization has been mainly studied in relation to ownership manipulations involving highly-salient multisensory cues. Here, we propose a novel paradigm that can implicitly activate the embodiment process in the presence of group affiliation information, whilst participants complete a task irrelevant to social categorization. Ethnically White participants watched videos of White- and Black-skinned models writing a proverb. The writing was interrupted 7, 4 or 1 s before completion. Participants were tasked with estimating the residual duration following interruption. A video showing only hand kinematic traces acted as a control condition. Residual duration estimates for out-group and control videos were significantly lower than those for in-group videos only for the longest duration. Moreover, stronger implicit racial bias was negatively correlated to estimates of residual duration for out-group videos. The underestimation bias for the out-group condition might be mediated by implicit embodiment, affective and attentional processes, and finalized to a rapid out-group categorization