Gaze-cueing of attention: Visual attention, social cognition and individual differences

During social interactions, people's eyes convey a wealth of information about their direction of attention and their emotional and mental states. This review aims to provide a comprehensive overview of past and current research into the perception of gaze behavior and its effect on the observer. This encompasses the perception of gaze direction and its influence on perception of the other person, as well as gaze-following behavior such as joint attention, in infant, adult, and clinical populations. Particular focus is given to the gaze-cueing paradigm that has been used to investigate the mechanisms of joint attention. The contribution of this paradigm has been significant and will likely continue to advance knowledge across diverse fields within psychology and neuroscience. (PsycINFO Database Record (c) 2009 APA, all rights reserved) (journal abstract

Moving Attention: Social and Nonsocial Attentional Orienting and Consequences of Shifts for Perception

Our visual environment is incredibly complex. This complexity underscores the importance of visual spatial attention as a triaging mechanism for selecting the locations in our environment that are to receive preferential processing. Attentional resources are constantly deployed via shifts of attention across space, or attentional orienting; this orienting response occurs when someone we are speaking with averts their gaze, when a visually salient event occurs, and during countless other everyday events. In studying attentional orienting, two equally important lines of investigation are the factors that affect responsiveness to attentional cues, and how shifting attention alters perception of stimuli at the attended location. The aim of this thesis was to examine outstanding, yet important, questions about these two important aspects of attentional orienting, using the spatial cueing paradigm to manipulate visual spatial attention. The first part of this thesis examined factors that may affect responsiveness to attentional cues, with a specific focus on the orienting response triggered by social cues (e.g., gaze direction), and, at times, nonsocial cues (e.g., arrows). The first study in this section showed that orienting in response to gaze direction remains intact across levels of social anxiety, an individual-differences variable known to be associated with a range of attentional biases. The next study showed that a nonsocial motion signal equivalent in magnitude to a pupil shift is insufficient to elicit orienting, indicating that the social information contained in a dynamic gaze cue - which involves a pupil shift - is important for eliciting an orienting response. The final study in this section examined the efficiency of orienting by arrow cues, dynamic gaze cues, and static gaze cues, and found that while orienting by both types of gaze cues consistently survived a working memory load and therefore appears to be highly efficient, orienting by arrows was sometimes eliminated by a working memory load and therefore appears to be limited in its efficiency. Taken together, these findings speak to the robustness of the gaze-cueing effect, the importance of the social nature of the cue in generating the effect, and the remarkable efficiency of social orienting. The second part of this thesis examined two outstanding issues regarding the perceptual consequences of attentional orienting. In view of some research indicating that involuntary attentional shifts can harm temporal resolution (i.e., the ability to perceive fine temporal detail), the first study in this section examined whether the effect is a true attentional effect, or the outcome of perceptual conflict between the cue and target. The study found evidence to support the latter account, indicating that there is no true effect of involuntary attentional shifts on temporal resolution. The final study of this thesis examined the effects of attention on naturalistic ensemble processing, which involves the visual system pooling local detail to construct a global percept of a scene. The study found no effects of attentional shifts on this process, indicating that naturalistic ensemble processing is remarkably efficient. Together, these results clarify existing ambiguities concerning the effects of attention on important aspects of perception

Mechanisms of top-down visual spatial attention: computational and behavioral investigations

This thesis examines the mechanisms underlying visual spatial attention. In particular I focused on top-­‐down or voluntary attention, namely the ability to select relevant information and discard the irrelevant according to our goals. Given the limited processing resources of the human brain, which does not allow to process all the available information to the same degree, the ability to correctly allocate processing resources is fundamental for the accomplishment of most everyday tasks. The cost of misoriented attention is that we could miss some relevant information, with potentially serious consequences. In the first study (chapter 2) I will address the issue of the neural substrates of visual spatial attention: what are the neural mechanisms that allow the deployment of visual spatial attention? According to the premotor theory orienting attention to a location in space is equivalent to planning an eye movement to the same location, an idea strongly supported by neuroimaging and neurophysiological evidence. Accordingly, in this study I will present a model that can account for several attentional effects without requiring additional mechanisms separate from the circuits that perform sensorimotor transformations for eye movements. Moreover, it includes a mechanism that allows, within the framework of the premotor theory, to explain dissociations between attention and eye movements that may be invoked to disprove it. In the second model presented (chapter 3) I will further investigate the computational mechanisms underlying sensorimotor transformations. Specifically I will show that a representation in which the amplitude of visual responses is modulated by postural signal is both efficient and plausible, emerging also in a neural network model trained through unsupervised learning (i.e., using only signals locally available at the neuron level). Ultimately this result gives additional support to the approach adopted in the first model. Next, I will present a series of behavioral studies: in the first (chapter 4) I will show that spatial constancy of attention (i.e., the ability to sustain attention at a spatial location across eye movements) is dependent on some properties of the image, namely the presence of continuous visual landmarks at the attended locations. Importantly, this finding helps resolve contrasts between several recent results. In the second behavioral study (chapter 5), I will investigate an often neglected aspect of spatial cueing paradigms, probably the most widely used technique in studies of covert attention: the role of cue predictivity (i.e. the extent to which the spatial cue correctly indicates the location where the target stimulus will appear). Results show that, independently of participant’s awareness, changes  in predictivity result in changes in spatial validity effects, and that reliable shifts of attention can take place also in the absence of a predictive cue. In sum the results question the appropriateness of using predictive cues for delineating pure voluntary shifts of spatial attention. Finally, in the last study I will use a psychophysiological measure, the diameter of the eye’s pupil, to investigate intensive aspects of attention. Event-­‐related pupil dilations accurately mirrored changes in visuospatial awareness induced by a dual-­‐task manipulation that consumed attentional resources. Moreover, results of the primary spatial monitoring task revealed a significant rightward bias, indicated by a greater proportion of missed targets in the left hemifield. Interestingly this result mimics the extinction to double simultaneous stimulation (i.e., the failure to respond to a stimulus when it is presented simultaneously with another stimulus) which is often found in patients with unilateral brain damage. Overall, these studies present an emerging picture of attention as a complex mechanism that even in its volitional aspects is modulated by other non-­‐volitional factors, both external and internal to the individua

Temporal and spatial attention in dyslexia

It was hypothesized that the deficits underlying reading impairment may arise from supra-modal deficits in temporal and spatial attention, disrupting, on the one hand, the ability to segment the temporally ordered phonemes of language and thus the acquisition of decoding skills, and, on the other, the ability to integrate spatially and temporally ordered orthographic information acquired from the fluent visual scanning of written text. Temporal and spatial attentional deficits in dyslexia were investigated using a lateralized visual temporal order judgment (TOJ) paradigm that allowed both sensitivity to temporal order and spatial attentional bias to be measured. Dyslexic and non-dyslexic participants were required to report the temporal order of two simple visual stimuli presented in either the same or different lateral hemifields. Findings indicated that dyslexic participants showed markedly impaired sensitivity to temporal order, and that the degree of impairment was correlated with the severity of their dyslexia. Furthermore, the findings suggested that at least three partially dissociated deficits may underlie both impaired TOJ task performance and reading disorder. One is a deficit associated with difficulty in reporting the temporal order of two visual stimuli, particularly when the first is presented in right hemifield; with slow word recognition and non-word reading; and with deficits in spelling and phonological skill. This constellation of deficits was interpreted as reflecting deficits in networks in left cerebral hemisphere implicated in phoneme-grapheme mapping and visual orienting. The second is a deficit that is associated with a rightward attentional bias; with inaccurate non-word reading that is worse than predicted by phonological skill or by word recognition; and with poor sustained attention. This constellation of impairments was interpreted as evidence of a deficit in right-lateralised networks implicated in the modulation of arousal, and possibly reflecting a “developmental left-neglect” syndrome. A third deficit was associated with impaired temporal order sensitivity, regardless of hemifield presentation; with symptoms of Attentional Deficit and Hyperactivity Disorder (ADHD); and with increased interference from distractor stimuli. This constellation of deficits suggests that the impaired network is implicated in executive control of attention, including conflict resolution and working memory. The results of the investigation as a whole suggests that the reading impairments of dyslexia may arise from attentional deficits that have with substantial overlap with those of ADHD, and include deficits in attentional networks implicated in orienting attention to temporally presented stimuli

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Temporal and spatial attention in dyslexia

It was hypothesized that the deficits underlying reading impairment may arise from supra-modal deficits in temporal and spatial attention, disrupting, on the one hand, the ability to segment the temporally ordered phonemes of language and thus the acquisition of decoding skills, and, on the other, the ability to integrate spatially and temporally ordered orthographic information acquired from the fluent visual scanning of written text. Temporal and spatial attentional deficits in dyslexia were investigated using a lateralized visual temporal order judgment (TOJ) paradigm that allowed both sensitivity to temporal order and spatial attentional bias to be measured. Dyslexic and non-dyslexic participants were required to report the temporal order of two simple visual stimuli presented in either the same or different lateral hemifields. Findings indicated that dyslexic participants showed markedly impaired sensitivity to temporal order, and that the degree of impairment was correlated with the severity of their dyslexia. Furthermore, the findings suggested that at least three partially dissociated deficits may underlie both impaired TOJ task performance and reading disorder. One is a deficit associated with difficulty in reporting the temporal order of two visual stimuli, particularly when the first is presented in right hemifield; with slow word recognition and non-word reading; and with deficits in spelling and phonological skill. This constellation of deficits was interpreted as reflecting deficits in networks in left cerebral hemisphere implicated in phoneme-grapheme mapping and visual orienting. The second is a deficit that is associated with a rightward attentional bias; with inaccurate non-word reading that is worse than predicted by phonological skill or by word recognition; and with poor sustained attention. This constellation of impairments was interpreted as evidence of a deficit in right-lateralised networks implicated in the modulation of arousal, and possibly reflecting a “developmental left-neglect” syndrome. A third deficit was associated with impaired temporal order sensitivity, regardless of hemifield presentation; with symptoms of Attentional Deficit and Hyperactivity Disorder (ADHD); and with increased interference from distractor stimuli. This constellation of deficits suggests that the impaired network is implicated in executive control of attention, including conflict resolution and working memory. The results of the investigation as a whole suggests that the reading impairments of dyslexia may arise from attentional deficits that have with substantial overlap with those of ADHD, and include deficits in attentional networks implicated in orienting attention to temporally presented stimuli