To hear or not to hear: Sound Availability Modulates Sensory-Motor Integration

When we walk in place with our eyes closed after a few minutes of walking on a treadmill, we experience an unintentional forward body displacement (drift), called the sensory-motor aftereffect. Initially, this effect was thought to be due to the mismatch experienced during treadmill walking between the visual (absence of optic flow signaling body steadiness) and proprioceptive (muscle spindles firing signaling body displacement) information. Recently, the persistence of this effect has been shown even in the absence of vision, suggesting that other information, such as the sound of steps, could play a role. To test this hypothesis, six cochlear-implanted individuals were recruited and their forward drift was measured before (Control phase) and after (Post Exercise phase) walking on a treadmill while having their cochlear system turned on and turned off. The relevance in testing cochlear-implanted individuals was that when their system is turned off, they perceive total silence, even eliminating the sounds normally obtained from bone conduction. Results showed the absence of the aftereffect when the system was turned off, underlining the fundamental role played by sounds in the control of action and breaking new ground in the use of interactive sound feedback in motor learning and motor development

To hear or not to hear: sound availability modulates sensory-motor integration

When we walk in place with our eyes closed after a few minutes of walking on a treadmill, we experience an unintentional forward body displacement (drift), called the sensory-motor aftereffect. Initially, this effect was thought to be due to the mismatch experienced during treadmill walking between the visual (absence of optic flow signaling body steadiness) and proprioceptive (muscle spindles firing signaling body displacement) information. Recently, the persistence of this effect has been shown even in the absence of vision, suggesting that other information, such as the sound of steps, could play a role. To test this hypothesis, six cochlear-implanted individuals were recruited and their forward drift was measured before (Control phase) and after (Post Exercise phase) walking on a treadmill while having their cochlear system turned on and turned off. The relevance in testing cochlear-implanted individuals was that when their system is turned off, they perceive total silence, even eliminating the sounds normally obtained from bone conduction. Results showed the absence of the aftereffect when the system was turned off, underlining the fundamental role played by sounds in the control of action and breaking new ground in the use of interactive sound feedback in motor learning and motor development

Thermal-tactile integration in object temperature perception

The brain consistently faces a challenge of whether and how to combine the available information sources to estimate the properties of an object explored by hand. While object perception is an inference process involving multisensory inputs, thermal referral (TR) is an illusion demonstrating how interaction between thermal and tactile systems can lead to deviations from physical reality – When observers touch three stimulators simultaneously with the middle three fingers of one hand but only the outer two stimulators are heated (or cooled), thermal uniformity is perceived across three fingers. Here we used TR of warmth to examine the thermal-tactile interaction in object temperature perception. We show that TR is consistent with precision-weighted averaging of thermal sensation across tactile locations. Further, we show that prolonged contact with TR stimulation results in adaptation to the local variations of veridical temperatures instead of the thermal uniformity perceived across three fingers. Our results illuminate the flexibility of processing that underlies thermal-tactile interactions and serve as a basis for thermal display design

Haptic perception

Fueled by novel applications, interest in haptic perception is growing. This paper provides an overview of the state of the art of a number of important aspects of haptic perception. By means of touch we can not only perceive quite different material properties, such as roughness, compliance, friction, coldness and slipperiness, but we can also perceive spatial properties, such as shape, curvature, size and orientation. Moreover, the number of objects we have in our hand can be determined, either by counting or subitizing. All these aspects will be presented and discussed in this paper. Although our intuition tells us that touch provides us with veridical information about our environment, the existence of prominent haptic illusions will show otherwise. Knowledge about haptic perception is interesting from a fundamental viewpoint, but it also is of eminent importance in the technological development of haptic devices. At the end of this paper, a few recent applications will be presented

The Effect of Visual Experience on the Development of Functional Architecture in hMT+

We investigated whether the visual hMT+ cortex plays a role in supramodal representation of sensory flow, not mediated by visual mental imagery. We used functional magnetic resonance imaging to measure neural activity in sighted and congenitally blind individuals during passive perception of optic and tactile flows. Visual motion–responsive cortex, including hMT+, was identified in the lateral occipital and inferior temporal cortices of the sighted subjects by response to optic flow. Tactile flow perception in sighted subjects activated the more anterior part of these cortical regions but deactivated the more posterior part. By contrast, perception of tactile flow in blind subjects activated the full extent, including the more posterior part. These results demonstrate that activation of hMT+ and surrounding cortex by tactile flow is not mediated by visual mental imagery and that the functional organization of hMT+ can develop to subserve tactile flow perception in the absence of any visual experience. Moreover, visual experience leads to a segregation of the motion-responsive occipitotemporal cortex into an anterior subregion involved in the representation of both optic and tactile flows and a posterior subregion that processes optic flow only

The Effect of Visual Experience on the Development of Functional Architecture in hMT+

We investigated whether the visual hMT+ cortex plays a role in supramodal representation of sensory flow, not mediated by visual mental imagery. We used functional magnetic resonance imaging to measure neural activity in sighted and congenitally blind individuals during passive perception of optic and tactile flows. Visual motion-responsive cortex, including hMT+, was identified in the lateral occipital and inferior temporal cortices of the sighted subjects by response to optic flow. Tactile flow perception in sighted subjects activated the more anterior part of these cortical regions but deactivated the more posterior part. By contrast, perception of tactile flow in blind subjects activated the full extent, including the more posterior part. These results demonstrate that activation of hMT+ and surrounding cortex by tactile flow is not mediated by visual mental imagery and that the functional organization of hMT+ can develop to subserve tactile flow perception in the absence of any visual experience. Moreover, visual experience leads to a segregation of the motion-responsive occipitotemporal cortex into an anterior subregion involved in the representation of both optic and tactile flows and a posterior subregion that processes optic flow only

Effects of Stimulus Exploration Length and Time on the Integration of Information in Haptic Softness Discrimination

In haptic perception, information is often sampled serially (e.g., a stimulus is repeatedly indented to estimate its softness), requiring that sensory information is retained and integrated over time. Hence, integration of sequential information is likely affected by memory. Particularly, when two sequentially explored stimuli are compared, integration of information on the second stimulus might be determined by the fading representation of the first stimulus. We investigated how the exploration length of the first stimulus and a temporal delay affect contributions of sequentially gathered estimates of the second stimulus in haptic softness discrimination. Participants subsequently explored two silicon rubber stimuli by indenting the first stimulus one or five times and the second stimulus always three times. In an additional experiment, we introduced a 5-s delay after the first stimulus was indented five times. We show that the longer the first stimulus is explored, the more estimates of the second stimulus' softness contribute to the discrimination of the two stimuli, independent of the delay. This suggests that the exploration length of the first stimulus influences the strength of its representation, persisting at least for 5 s, and determines how much information about the second stimulus is exploited for the comparison

Integration of serial sensory information in haptic perception of softness.

Redundant estimates of an environmental property derived simultaneously from different senses or cues are typically integrated according to the maximum likelihood estimation model (MLE): Sensory estimates are weighted according to their reliabilities, maximizing the percept’s reliability. Mechanisms underlying the integration of sequentially derived estimates from one sense are less clear. Here we investigate the integration of serially sampled redundant information in softness perception. We developed a method to manipulate haptically perceived softness of silicone rubber stimuli during bare-finger exploration. We then manipulated softness estimates derived from single movement segments (indentations) in a multisegmented exploration to assess their contributions to the overall percept. Participants explored two stimuli in sequence, using 2–5 indentations, and reported which stimulus felt softer. Estimates of the first stimulus’s softness contributed to the judgments similarly, whereas for the second stimulus estimates from later compared to earlier indentations contributed less. In line with unequal weighting, the percept’s reliability increased with increasing exploration length less than was predicted by the MLE model. This pattern of results is well explained by assuming that the representation of the first stimulus fades when the second stimulus is explored, which fits with a neurophysiological model of perceptual decisions (Deco, Rolls, & Romo, 2010)

Tactual perception: a review of experimental variables and procedures

This paper reviews literature on tactual perception. Throughout this review we will highlight some of the most relevant variables in touch literature: interaction between touch and other senses; type of stimuli, from abstract stimuli such as vibrations, to two- and three-dimensional stimuli, also considering concrete stimuli such as the relation between familiar and unfamiliar stimuli or the haptic perception of faces; type of participants, separating studies with blind participants, studies with children and adults, and an analysis of sex differences in performance; and finally, type of tactile exploration, considering conditions of active and passive touch, the relevance of movement in touch and the relation between exploration and time. This review intends to present an organised overview of the main variables in touch experiments, attending to the main findings described in literature, to guide the design of future works on tactual perception and memory.This work was funded by the Portuguese “Foundation for Science and Technology” through PhD scholarship SFRH/BD/35918/2007