Contributions from cognitive neuroscience to understanding functional mechanisms of visual search.

We argue that cognitive neuroscience can contribute not only information about the neural localization of processes underlying visual search, but also information about the functional nature of these processes. First we present an overview of recent work on whether search for form - colour conjunctions is constrained by processes involved in binding across the two dimensions. Patients with parietal lesions show a selective problem with form - colour conjunctive search relative to a more difficult search task not requiring cross-dimensional binding. This is consistent with an additional process - cross-dimensional binding - being involved in the conjunctive search task. We then review evidence from preview search using electrophysiological, brain imaging, and neuropsychological techniques suggesting preview benefits in search are not simply due to onset capture. Taken together the results highlight the value of using converging evidence from behavioural studies of normal observers and studies using neuroscientific methods. © 2006 Psychology Press Ltd

Eye movements and hazard perception in active and passive driving

Differences in eye movement patterns are often found when comparing passive viewing paradigms to actively engaging in everyday tasks. Arguably, investigations into visuomotor control should therefore be most useful when conducted in settings that incorporate the intrinsic link between vision and action. We present a study that compares oculomotor behaviour and hazard reaction times across a simulated driving task and a comparable, but passive, video-based hazard perception task. We found that participants scanned the road less during the active driving task and fixated closer to the front of the vehicle. Participants were also slower to detect the hazards in the driving task. Our results suggest that the interactivity of simulated driving places increased demand upon the visual and attention systems than simply viewing driving movies. We offer insights into why these differences occur and explore the possible implications of such findings within the wider context of driver training and assessment

Binding - a proposed experiment and a model

The binding problem is regarded as one of today's key questions about brain function. Several solutions have been proposed, yet the issue is still controversial. The goal of this article is twofold. Firstly, we propose a new experimental paradigm requiring feature binding, the "delayed binding response task". Secondly, we propose a binding mechanism employing fast reversible synaptic plasticity to express the binding between concepts. We discuss the experimental predictions of our model for the delayed binding response task

Recognizing Speech in a Novel Accent: The Motor Theory of Speech Perception Reframed

The motor theory of speech perception holds that we perceive the speech of another in terms of a motor representation of that speech. However, when we have learned to recognize a foreign accent, it seems plausible that recognition of a word rarely involves reconstruction of the speech gestures of the speaker rather than the listener. To better assess the motor theory and this observation, we proceed in three stages. Part 1 places the motor theory of speech perception in a larger framework based on our earlier models of the adaptive formation of mirror neurons for grasping, and for viewing extensions of that mirror system as part of a larger system for neuro-linguistic processing, augmented by the present consideration of recognizing speech in a novel accent. Part 2 then offers a novel computational model of how a listener comes to understand the speech of someone speaking the listener's native language with a foreign accent. The core tenet of the model is that the listener uses hypotheses about the word the speaker is currently uttering to update probabilities linking the sound produced by the speaker to phonemes in the native language repertoire of the listener. This, on average, improves the recognition of later words. This model is neutral regarding the nature of the representations it uses (motor vs. auditory). It serve as a reference point for the discussion in Part 3, which proposes a dual-stream neuro-linguistic architecture to revisits claims for and against the motor theory of speech perception and the relevance of mirror neurons, and extracts some implications for the reframing of the motor theory

Effects of mixed versus blocked design on stimulus evaluation: combining underaddative effects.

(from the journal abstract) According to the asynchronous discrete coding model of Miller, two manipulations should display underadditive effects on reaction time if they slow down noncontingent stages associated with the processing of two separable dimensions of a stimulus. Underadditive effects are also predicted by a dual route model when a task variable is factorially varied with design type (mixed vs blocked). Interpretations of both underadditive effects and their combination were evaluated. Intact and degraded stimuli were presented to 18 young adults either in a single block (mixed) or in separate blocks (blocked). Spatial stimulus-response (S-R) compatibility was manipulated in all conditions. Stimulus degradation and S-R compatibility interacted underadditively, but only in blocked presentations. Both interpretations of underadditive effects were supported. Eye-movement registrations provided additional support for the alternative routes model

Motor Preparatory Activity in Posterior Parietal Cortex is Modulated by Subjective Absolute Value

For optimal response selection, the consequences associated with behavioral success or failure must be appraised. To determine how monetary consequences influence the neural representations of motor preparation, human brain activity was scanned with fMRI while subjects performed a complex spatial visuomotor task. At the beginning of each trial, reward context cues indicated the potential gain and loss imposed for correct or incorrect trial completion. FMRI-activity in canonical reward structures reflected the expected value related to the context. In contrast, motor preparatory activity in posterior parietal and premotor cortex peaked in high “absolute value” (high gain or loss) conditions: being highest for large gains in subjects who believed they performed well while being highest for large losses in those who believed they performed poorly. These results suggest that the neural activity preceding goal-directed actions incorporates the absolute value of that action, predicated upon subjective, rather than objective, estimates of one's performance

Uneven integration for perception and action cues in children’s working memory

We examined the development of visual cue integration in a desktop working-memory task using boxes with different visual action cues (opening actions) and perceptual surface cues (colours, monochromatic textures, or images of faces). Children had to recall which box held a hidden toy, based on (a) the action cue, (b) the surface cue, or (c) a conjunction of the two. Results from three experiments show a set of asymmetries in children's integration of action and surface cues. The 18–24-month-olds disregarded colour in conjunction judgements with action; 30–36-month-olds used colour but disregarded texture. Images of faces were not disregarded at either age. We suggest that 18–24-month-olds' disregard of colour, seen previously in reorientation tasks (Hermer & Spelke, 1994), may represent a general phenomenon, likened to uneven integration between the dorsal and ventral streams in early development

Modelling Visual Neglect: Computational Insights into Conscious Perception

Background: Visual neglect is an attentional deficit typically resulting from parietal cortex lesion and sometimes frontal lesion. Patients fail to attend to objects and events in the visual hemifield contralateral to their lesion during visual search. Methodology/Principal Finding: The aim of this work was to examine the effects of parietal and frontal lesion in an existing computational model of visual attention and search and simulate visual search behaviour under lesion conditions. We find that unilateral parietal lesion in this model leads to symptoms of visual neglect in simulated search scan paths, including an inhibition of return (IOR) deficit, while frontal lesion leads to milder neglect and to more severe deficits in IOR and perseveration in the scan path. During simulations of search under unilateral parietal lesion, the model’s extrastriate ventral stream area exhibits lower activity for stimuli in the neglected hemifield compared to that for stimuli in the normally perceived hemifield. This could represent a computational correlate of differences observed in neuroimaging for unconscious versus conscious perception following parietal lesion. Conclusions/Significance: Our results lead to the prediction, supported by effective connectivity evidence, that connections between the dorsal and ventral visual streams may be an important factor in the explanation of perceptua