A predictive processing theory of sensorimotor contingencies: explaining the puzzle of perceptual presence and its absence in synesthesia

Normal perception involves experiencing objects within perceptual scenes as real, as existing in the world. This property of “perceptual presence” has motivated “sensorimotor theories” which understand perception to involve the mastery of sensorimotor contingencies. However, the mechanistic basis of sensorimotor contingencies and their mastery has remained unclear. Sensorimotor theory also struggles to explain instances of perception, such as synesthesia, that appear to lack perceptual presence and for which relevant sensorimotor contingencies are difficult to identify. On alternative “predictive processing” theories, perceptual content emerges from probabilistic inference on the external causes of sensory signals, however, this view has addressed neither the problem of perceptual presence nor synesthesia. Here, I describe a theory of predictive perception of sensorimotor contingencies which (1) accounts for perceptual presence in normal perception, as well as its absence in synesthesia, and (2) operationalizes the notion of sensorimotor contingencies and their mastery. The core idea is that generative models underlying perception incorporate explicitly counterfactual elements related to how sensory inputs would change on the basis of a broad repertoire of possible actions, even if those actions are not performed. These “counterfactually-rich” generative models encode sensorimotor contingencies related to repertoires of sensorimotor dependencies, with counterfactual richness determining the degree of perceptual presence associated with a stimulus. While the generative models underlying normal perception are typically counterfactually rich (reflecting a large repertoire of possible sensorimotor dependencies), those underlying synesthetic concurrents are hypothesized to be counterfactually poor. In addition to accounting for the phenomenology of synesthesia, the theory naturally accommodates phenomenological differences between a range of experiential states including dreaming, hallucination, and the like. It may also lead to a new view of the (in)determinacy of normal perception

The Future of Memory: Remembering, Imagining, and the Brain

During the past few years, there has been a dramatic increase in research examining the role of memory in imagination and future thinking. This work has revealed striking similarities between remembering the past and imagining or simulating the future, including the finding that a common brain network underlies both memory and imagination. Here we discuss a number of key points that have emerged during recent years, focusing in particular on the importance of distinguishing between temporal and non-temporal factors in analyses of memory and imagination, the nature of differences between remembering the past and imagining the future, the identification of component processes that comprise the default network supporting memory- based simulations, and the finding that this network can couple flexibly with other networks to support complex goal-directed simulations. This growing area of research has broadened our conception of memory by highlighting the many ways in which memory supports adaptive functioning.Psycholog

Goal-Directed Simulation of Past and Future Events: Cognitive and Neuroimaging Approaches

Goal-directed episodic simulation, the imaginative construction of a hypothetical personal event or series of events focused on a specific goal, is essential to our everyday lives. We often imagine how we could solve a problem or achieve a goal in the future, or how we could have avoided a misstep in the past, but many of the behavioral and neural mechanisms underlying such goal-directed simulations have yet to be explored. The three papers of this dissertation investigated the neural correlates of three types of future episodic simulations in Papers 1 and 2 and examined a fourth such simulation directed at past events as an adaptive, constructive process in Paper 3. Some research has associated default network activity with internally-focused, but not with goal-directed cognition. Papers 1 and 2 of this dissertation showed that regions of the default network could form functional networks with regions of the frontoparietal control network while participants imagined solving specific problems or going through a sequence of steps necessary to achieve a personal goal. When participants imagined events they associated with actually attaining a goal, default network regions flexibly coupled with reward-processing regions, providing evidence that the default network can join forces with other networks or components thereof to support goal-directed episodic simulations. Using two distinct paradigms with both young and older adults, Paper 3 focused on episodic counterfactual simulations of how past events could have turned out differently and tested whether counterfactual simulations could affect participants' memory of the original events. Our results revealed that episodic counterfactual simulations can act as a type of internally generated misinformation by causing source confusion between the original event and the imagined counterfactual outcome, especially in older adults. The findings of the three papers in this dissertation lay the groundwork for further research on the behavioral and neural mechanisms of goal-directed episodic simulations, as well as their adaptive functions and possible downsides.Psycholog