Molyneux’s Question and the Semantics of Seeing

The aim of this chapter is to shed new light on the question of what newly sighted subjects are capable of seeing on the basis of previous experience with mind- independent, external objects and their properties through touch alone. This question is also known as “Molyneux’s question.” Much of the empirically driven debate surrounding this question has been centered on the nature of the representational content of the subjects’ visual experiences. It has generally been assumed that the meaning of “seeing” deployed in these disputes is more or less clear and unproblematic, and therefore requires no analysis or clarification. In this chapter, we wish to challenge this assumption. We argue that getting clear on the meaning of “seeing” is the only feasible way to determine whether the empirical attempts to answer Molyneux’s question accurately capture what newly sighted subjects are in fact capable of seeing. Specifically, we show that the dominant interpretations of the empirical results from a recent study (Held et al., 2011) fail to take into account that seeing can be not only purely visual but also epistemic in that it requires background knowledge (such as what an object with a particular viewpointindependent shape looks like from a particular perspective)

Haptic search with finger movements: using more fingers does not necessarily reduce search times

Two haptic serial search tasks were used to investigate how the separations between items, and the number of fingers used to scan them, influence the search time and search strategy. In both tasks participants had to search for a target (cross) between a fixed number of non-targets (circles). The items were placed in a straight line. The target’s position was varied within blocks, and inter-item separation was varied between blocks. In the first experiment participants used their index finger to scan the display. As expected, search time depended on target position as well as on item separation. For larger separations participants’ movements were jerky, resembling ‘saccades’ and ‘fixations’, while for the shortest separation the movements were smooth. When only considering time in contact with an item, search times were the same for all separation conditions. Furthermore, participants never continued their movement after they encountered the target. These results suggest that participants did not use the time during which they were moving between the items to process information about the items. The search times were a little shorter than those in a static search experiment (Overvliet et al. in Percept Psychophys, 2007a), where multiple items were presented to the fingertips simultaneously. To investigate whether this is because the finger was moving or because only one finger was stimulated, we conducted a second experiment in which we asked participants to put three fingers in line and use them together to scan the items. Doing so increased the time in contact with the items for all separations, so search times were presumably longer in the static search experiment because multiple fingers were involved. This may be caused by the time that it takes to switch from one finger to the other

Hand function after nerve repair

Abstract Treatment of injuries to major nerve trunks in the hand and upper extremity remains a major and challenging reconstructive problem. Such injuries may cause long-lasting disabilities in terms of lost fine sensory and motor functions. Nowadays there is no surgical repair technique that can ensure recovery of tactile discrimination in the hand of an adult patient following nerve repair while very young individuals usually regain a complete recovery of functional sensibility. Post-traumatic nerve regeneration is a complex biological process where the outcome depends on multiple biological and environmental factors such as survival of nerve cells, axonal regeneration rate, extent of axonal misdirection, type of injury, type of nerve, level of the lesion, age of the patient and compliance to training. A major problem is the cortical functional reorganization of hand representation which occurs as a result of axonal misdirection. Although protective sensibility usually occurs following nerve repair, tactile discriminative functions seldom recover -a direct result of cortical remapping. Sensory re-education programmes are routinely applied to facilitate understanding of the new sensory patterns provided by the hand. New trends in hand rehabilitation focus on modulation of central nervous processes rather than peripheral factors. Principles are being evolved to maintain the cortical hand representation by using the brain capacity for visuo-tactile and audio-tactile interaction for the initial phase following nerve injury and repair (phase 1). After the start of the re-innervation of the hand (phase 2), selective de-afferentation, such as cutaneous anaesthesia of the forearm of the injured hand, allows expansion of the nerve-injured cortical hand representation, thereby enhancing the effects of sensory relearning. Recent data support the view that training protocols specifically addressing the relearning process substantially increase the possibilities for improved functional outcome after nerve repair

Touching is believing: creating illusions and feeling of embodiment with mid-air haptic technology

Over the last two decades, the sense of touch has received new attention from the scientific community.Several haptic devices have been developed to address the complexity of the sense of touch, the latest addition being mid-air (contactless) haptic technology. An interesting series of previous research has suggested an easier way to tackle the complexity of designing convincing tactile sensations by exploiting tactile illusions. Tactile illusions rely on perceptual shortcuts based on the psychophysics of the tactile receptors. Currently, studies exploring the perceptual space of mid-air haptics and its applicability in the tactile illusions field are still limited in number. This thesis aims to contribute to the field of Human-Computer Interaction (HCI) by investigating the perceptual design space of ultrasonic mid-air haptics technology. Specifically, in a first set of three studies, we investigate the absolute thresholds (minimal amount of a property of astimulus that a user can detect) for control points (CP) at different frequencies on the hand and arm (Study 1). Then we investigate the optimal sampling rate needed to drive the device in an optimal fashion and its relationship with shape size (Study 2). Next, we apply a new technique to increase users’ performance in a shape discrimination task (Study 3). In Study 4, we start the exploration of a tactile illusion of movement using contact touch and later, we apply a similar procedure to investigate the feasibility of creating a tactile illusion of movement between the two non-interconnected hands by using mid-air touch (Study 5). Finally, in Study 6, we explore our sense of touch in VR, while providing an illusion of rain drops through mid-air haptics, to recreate a virtual hand illusion (VHI) to explore the boundaries of our sense of embodiment. Therefore, the contribution of this work is threefold: a) we contribute by adding new knowledge on the psychophysical space for mid-air haptics, b) we test the potential to create realistic tactile sensations by exploiting tactile illusions with mid-air haptic technology, and c) we demonstrate how tactile illusions mediated by mid-air haptics can convey a sense of embodiment in VR environments

Divisions Within the Posterior Parietal Cortex Help Touch Meet Vision

The parietal cortex is divided into two major functional regions: the anterior parietal cortex that includes primary somatosensory cortex, and the posterior parietal cortex (PPC) that includes the rest of the parietal lobe. The PPC contains multiple representations of space. In Dijkerman and de Haan’s (see record 2007-13802-022) model, higher spatial representations are separate from PPC functions. This model should be developed further so that the functions of the somatosensory system are integrated with specific functions within the PPC and higher spatial representations. Through this further specification of the model, one can make better predictions regarding functional interactions between somatosensory and visual systems

Multisensory and sensorimotor origins of the sense of self

Cognitive neuroscience has increasingly focused on studying the subject, i.e. the self, of conscious experience. In order to be the subject of an experience, we generally experience owning a physical body, being located within that body, and being able to distinguish the body and its actions from others. These pre-reflective experiences are based on brain mechanisms of multisensory and sensorimotor integration. In this thesis I investigated how our sense of self, in particular the senses of body ownership and of agency, depend on multimodal bodily signals. I achieved this by using approaches developed by cognitive neuroscience to study how the sense of self relates to the processing of bodily signals: creating bodily illusions with multisensory conflicts through the use of virtual reality and robotics. The first part of this thesis describes the investigation of the sense of body ownership in healthy subjects and in spinal cord injury patients, achieved by inducing conflicts between tactile information and visual feedback. The research presented in the second part of the thesis is centered on the experience of self-touch. There, I have first investigated how the manipulation of reference frames influences the perception of the illusion of self-touch, and second, how active self-touch influences the sense of body ownership. Lastly, in the third part of the thesis, I investigated how experimentally induced multisensory and sensorimotor conflicts perturb the sense of self in healthy subjects and induce experiences similar to certain symptoms observed in neurological and psychiatric disorders. I show that particular conflicts between bodily signals not only affect body perception and sense of agency for motor actions but also propagate to higher levels and influence even the sense of agency for mental representations in healthy subjects. Finally, I discuss my results and their relation to existing knowledge on bodily self-consciousness and position them in a broader picture of our current understanding of the self

Central role of somatosensory processes in sexual arousal as identified by neuroimaging techniques

Research on the neural correlates of sexual arousal is a growing field of research in affective neuroscience. A new approach studying the correlation between the hemodynamic cerebral response and autonomic genital response has enabled distinct brain areas to be identified according to their role in inducing penile erection, on the one hand, and in representing penile sensation, on the othe

What the study of spinal cord injured patients can tell us about the significance of the body in cognition

Although in the last three decades philosophers, psychologists and neuroscientists have produced numerous studies on human cognition, the debate concerning its nature is still heated and current views on the subject are somewhat antithetical. On the one hand, there are those who adhere to a view implying ‘disembodiment’ which suggests that cognition is based entirely on symbolic processes. On the other hand, a family of theories referred to as the Embodied Cognition Theories (ECT) postulate that creating and maintaining cognition is linked with varying degrees of inherence to somatosensory and motor representations. Spinal cord injury induces a massive body-brain disconnection with the loss of sensory and motor bodily functions below the lesion level but without directly affecting the brain. Thus, SCI may represent an optimal model for testing the role of the body in cognition. In this review, we describe post-lesional cognitive modifications in relation to body, space and action representations and various instances of ECT. We discuss the interaction between body-grounded and symbolic processes in adulthood with relevant modifications after body-brain disconnection

Vestibular contributions to the sense of body, self, and others

There is increasing evidence that vestibular signals and the vestibular cortex are not only involved in oculomotor and postural control, but also contribute to higher-level cognition. Yet, despite the effort that has recently been made in the field, the exact location of the human vestibular cortex and its implications in various perceptional, emotional, and cognitive processes remain debated. Here, we argue for a vestibular contribution to what is thought to fundamentally underlie human consciousness, i.e., the bodily self. We will present empirical evidence from various research fields to support our hypothesis of a vestibular contribution to aspects of the bodily self, such as basic multisensory integration, body schema, body ownership, agency, and self-location. We will argue that the vestibular system is especially important for global aspects of the self, most crucially for implicit and explicit spatiotemporal self-location. Furthermore, we propose a novel model on how vestibular signals could not only underlie the perception of the self but also the perception of others, thereby playing an important role in embodied social cognition