Representing 3D Space in Working Memory: Spatial Images from Vision, Hearing, Touch, and Language

The chapter deals with a form of transient spatial representation referred to as a spatial image. Like a percept, it is externalized, scaled to the environment, and can appear in any direction about the observer. It transcends the concept of modality, as it can be based on inputs from the three spatial senses, from language, and from long-term memory. Evidence is presented that supports each of the claimed properties of the spatial image, showing that it is quite different from a visual image. Much of the evidence presented is based on spatial updating. A major concern is whether spatial images from different input modalities are functionally equivalent— that once instantiated in working memory, the spatial images from different modalities have the same functional characteristics with respect to subsequent processing, such as that involved in spatial updating. Going further, the research provides some evidence that spatial images are amodal (i.e., do not retain modality-specific features)

Cognitive and Tactile Factors Affecting Human Haptic Performance in Later Life

Background: Vision and haptics are the key modalities by which humans perceive objects and interact with their environment in a target-oriented manner. Both modalities share higher-order neural resources and the mechanisms required for object exploration. Compared to vision, the understanding of haptic information processing is still rudimentary. Although it is known that haptic performance, similar to many other skills, decreases in old age, the underlying mechanisms are not clear. It is yet to be determined to what extent this decrease is related to the age-related loss of tactile acuity or cognitive capacity. Methodology/Principal Findings: We investigated the haptic performance of 81 older adults by means of a cross-modal object recognition test. Additionally, we assessed the subjects ’ tactile acuity with an apparatus-based two-point discrimination paradigm, and their cognitive performance by means of the non-verbal Raven-Standard-Progressive matrices test. As expected, there was a significant age-related decline in performance on all 3 tests. With the exception of tactile acuity, this decline was found to be more distinct in female subjects. Correlation analyses revealed a strong relationship between haptic and cognitive performance for all subjects. Tactile performance, on the contrary, was only significantly correlated with male subjects ’ haptic performance. Conclusions: Haptic object recognition is a demanding task in old age, especially when it comes to the exploration o

Spatial working memory for locations specified by vision and audition: Testing the amodality hypothesis

Spatial working memory can maintain representations from vision, hearing, and touch, representations referred to here as spatial images. The present experiment addressed whether spatial images from vision and hearing that are simultaneously present within working memory retain modality-specific tags or are amodal. Observers were presented with short sequences of targets varying in angular direction, with the targets in a given sequence being all auditory, all visual, or a sequential mixture of the two. On two thirds of the trials, one of the locations was repeated, and observers had to respond as quickly as possible when detecting this repetition. Ancillary detection and localization tasks confirmed that the visual and auditory targets were perceptually comparable. Response latencies in the working memory task showed small but reliable costs in performance on trials involving a sequential mixture of auditory and visual targets, as compared with trials of pure vision or pure audition. These deficits were statistically reliable only for trials on which the modalities of the matching location switched from the penultimate to the final target in the sequence, indicating a switching cost. The switching cost for the pair in immediate succession means that the spatial images representing the target locations retain features of the visual or auditory representations from which they were derived. However, there was no reliable evidence of a performance cost for mixed modalities in the matching pair when the second of the two did not immediately follow the first, suggesting that more enduring spatial images in working memory may be amodal