The evolution and development of visual perspective taking

I outline three conceptions of seeing that a creature might possess: ‘the headlamp conception,’ which involves an understanding of the causal connections between gazing at an object, certain mental states, and behavior; ‘the stage lights conception,’ which involves an understanding of the selective nature of visual attention; and seeing-as. I argue that infants and various nonhumans possess the headlamp conception. There is also evidence that chimpanzees and 3-year-old children have some grasp of seeing-as. However, due to a dearth of studies, there is no evidence that infants or nonhumans possess the stage lights conception of seeing. I outline the kinds of experiments that are needed, and what we stand to learn about the evolution and development of perspective taking

Seeing, Sensing, and Scrutinizing

Large changes in a scene often become difficult to notice if made during an eye movement, image flicker, movie cut, or other such disturbance. It is argued here that this <i>change blindness</i> can serve as a useful tool to explore various aspects of vision. This argument centers around the proposal that focused attention is needed for the explicit perception of change. Given this, the study of change perception can provide a useful way to determine the nature of visual attention, and to cast new light on the way that it is—and is not—involved in visual perception. To illustrate the power of this approach, this paper surveys its use in exploring three different aspects of vision. The first concerns the general nature of <i>seeing</i>. To explain why change blindness can be easily induced in experiments but apparently not in everyday life, it is proposed that perception involves a <i>virtual representation</i>, where object representations do not accumulate, but are formed as needed. An architecture containing both attentional and nonattentional streams is proposed as a way to implement this scheme. The second aspect concerns the ability of observers to detect change even when they have no visual experience of it. This <i>sensing</i> is found to take on at least two forms: detection without visual experience (but still with conscious awareness), and detection without any awareness at all. It is proposed that these are both due to the operation of a nonattentional visual stream. The final aspect considered is the nature of visual attention itself—the mechanisms involved when <i>scrutinizing</i> items. Experiments using controlled stimuli show the existence of various limits on visual search for change. It is shown that these limits provide a powerful means to map out the attentional mechanisms involved

Bodily awareness and novel multisensory features

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop an argument for this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space

A Diagram Is Worth A Dozen Images

Diagrams are common tools for representing complex concepts, relationships and events, often when it would be difficult to portray the same information with natural images. Understanding natural images has been extensively studied in computer vision, while diagram understanding has received little attention. In this paper, we study the problem of diagram interpretation and reasoning, the challenging task of identifying the structure of a diagram and the semantics of its constituents and their relationships. We introduce Diagram Parse Graphs (DPG) as our representation to model the structure of diagrams. We define syntactic parsing of diagrams as learning to infer DPGs for diagrams and study semantic interpretation and reasoning of diagrams in the context of diagram question answering. We devise an LSTM-based method for syntactic parsing of diagrams and introduce a DPG-based attention model for diagram question answering. We compile a new dataset of diagrams with exhaustive annotations of constituents and relationships for over 5,000 diagrams and 15,000 questions and answers. Our results show the significance of our models for syntactic parsing and question answering in diagrams using DPGs

Role of right posterior parietal cortex in maintaining attention to spatial locations over time

Recent models of human posterior parietal cortex (PPC) have variously emphasized its role in spatial perception, visuomotor control or directing attention. However, neuroimaging and lesion studies also suggest that the right PPC might play a special role in maintaining an alert state. Previously, assessments of right-hemisphere patients with hemispatial neglect have revealed significant overall deficits on vigilance tasks, but to date there has been no demonstration of a deterioration of performance over time--a vigilance decrement--considered by some to be a key index of a deficit in maintaining attention. Moreover, sustained attention deficits in neglect have not specifically been related to PPC lesions, and it remains unclear whether they interact with spatial impairments in this syndrome. Here we examined the ability of right-hemisphere patients with neglect to maintain attention, comparing them to stroke controls and healthy individuals. We found evidence of an overall deficit in sustaining attention associated with PPC lesions, even for a simple detection task with stimuli presented centrally. In a second experiment, we demonstrated a vigilance decrement in neglect patients specifically only when they were required to maintain attention to spatial locations, but not verbal material. Lesioned voxels in the right PPC spanning a region between the intraparietal sulcus and inferior parietal lobe were significantly associated with this deficit. Finally, we compared performance on a task that required attention to be maintained either to visual patterns or spatial locations, matched for task difficulty. Again, we found a vigilance decrement but only when attention had to be maintained on spatial information. We conclude that sustaining attention to spatial locations is a critical function of the human right PPC which needs to be incorporated into models of normal parietal function as well as those of the clinical syndrome of hemispatial neglect

Pirate stealth or inattentional blindness?:the effects of target relevance and sustained attention on security monitoring for experienced and naïve operators

Closed Circuit Television (CCTV) operators are responsible for maintaining security in various applied settings. However, research has largely ignored human factors that may contribute to CCTV operator error. One important source of error is inattentional blindness--the failure to detect unexpected but clearly visible stimuli when attending to a scene. We compared inattentional blindness rates for experienced (84 infantry personnel) and naïve (87 civilians) operators in a CCTV monitoring task. The task-relevance of the unexpected stimulus and the length of the monitoring period were manipulated between participants. Inattentional blindness rates were measured using typical post-event questionnaires, and participants' real-time descriptions of the monitored event. Based on the post-event measure, 66% of the participants failed to detect salient, ongoing stimuli appearing in the spatial field of their attentional focus. The unexpected task-irrelevant stimulus was significantly more likely to go undetected (79%) than the unexpected task-relevant stimulus (55%). Prior task experience did not inoculate operators against inattentional blindness effects. Participants' real-time descriptions revealed similar patterns, ruling out inattentional amnesia accounts