Selective Attention and Audiovisual Integration: Is Attending to Both Modalities a Prerequisite for Early Integration?

Interactions between multisensory integration and attention were studied using a combined audiovisual streaming design and a rapid serial visual presentation paradigm. Event-related potentials (ERPs) following audiovisual objects (AV) were compared with the sum of the ERPs following auditory (A) and visual objects (V). Integration processes were expressed as the difference between these AV and (A + V) responses and were studied while attention was directed to one or both modalities or directed elsewhere. Results show that multisensory integration effects depend on the multisensory objects being fully attended—that is, when both the visual and auditory senses were attended. In this condition, a superadditive audiovisual integration effect was observed on the P50 component. When unattended, this effect was reversed; the P50 components of multisensory ERPs were smaller than the unisensory sum. Additionally, we found an enhanced late frontal negativity when subjects attended the visual component of a multisensory object. This effect, bearing a strong resemblance to the auditory processing negativity, appeared to reflect late attention-related processing that had spread to encompass the auditory component of the multisensory object. In conclusion, our results shed new light on how the brain processes multisensory auditory and visual information, including how attention modulates multisensory integration processes

Electroencephalographic Brain Dynamics of Memory Encoding in Emotionally Arousing Context

Emotional content/context enhances declarative memory through modulation of encoding and retrieval mechanisms. At encoding, neurophysiological data have consistently demonstrated the subsequent memory effect in theta and gamma oscillations. Yet, the existing studies were focused on the emotional content effect and let the emotional context effect unexplored. We hypothesized that theta and gamma oscillations show higher evoked/induced activity during the encoding of visual stimuli when delivered in an emotionally arousing context. Twenty-five healthy volunteers underwent evoked potentials (EP) recordings using a 21 scalp electrodes montage. They attended to an audiovisual test of emotional declarative memory being randomly assigned to either emotionally arousing or neutral context. Visual stimulus presentation was used as the time-locking event. Grand-averages of the EP and evoked spectral perturbations were calculated for each volunteer. EP showed a higher negative deflection from 80 to 140 ms for the emotional condition. Such effect was observed over central, frontal and prefrontal locations bilaterally. Evoked theta power was higher in left parietal, central, frontal, and prefrontal electrodes from −50 to 300 ms in the emotional condition. Evoked gamma power was higher in the emotional condition with a spatial distribution that overlapped at some points with the theta topography. The early theta power increase could be related to expectancy induced by auditory information processing that facilitates visual encoding in emotional contexts. Together, our results suggest that declarative memory enhancement for both emotional content and emotional context are supported by similar neural mechanisms at encoding, and offer new evidence about the brain processing of relevant environmental stimuli

Object-guided Spatial Attention in Touch: Holding the Same Object with Both Hands Delays Attentional Selection

Abstract Previous research has shown that attention to a specific location on a uniform visual object spreads throughout the entire object. Here we demonstrate that, similar to the visual system, spatial attention in touch can be object guided. We measured event-related brain potentials to tactile stimuli arising from objects held by observers' hands, when the hands were placed either near each other or far apart, holding two separate objects, or when they were far apart but holding a common object. Observers covertly oriented their attention to the left, to the right, or to both hands, following bilaterally presented tactile cues indicating likely tactile target location(s). Attentional modulations for tactile stimuli at attended compared to unattended locations were present in the time range of early somatosensory components only when the hands were far apart, but not when they were near. This was found to reflect enhanced somatosensory processing at attended locations rather than suppressed processing at unattended locations. Crucially, holding a common object with both hands delayed attentional selection, similar to when the hands were near. This shows that the proprioceptive distance effect on tactile attentional selection arises when distant event locations can be treated as separate and unconnected sources of tactile stimulation, but not when they form part of the same object. These findings suggest that, similar to visual attention, both space- and object-based attentional mechanisms can operate when we select between tactile events on our body surface.</jats:p

Attentional modulations of pain perception: evidence from laser evoked potentials

This thesis aims to provide a contribution to the current neurophysiological and psychophysiological understanding of nociception and pain processing in humans. The introduction of high-power, radiant heat stimulators (lasers) in sensory physiology has revolutionised the study of the nociceptive system. Laser pulses activate Aδ and/or C skin nociceptors selectively, i.e. without coactivating deeper, tactile mechanoreceptors, and elicit brain responses that can be detected using electroencephalography, and are called laser-evoked potentials (LEP). This was the technique applied in the two experimental studies reported in the present thesis work. The doctoral dissertation is organized in five chapters. Chapter 1 – Introduction - defines the concepts of nociception and pain. It also provides an introduction to the event related potential technique (ERP), a description of basic biophysics and neurophysiology related to LEP recording, followed by a literature review of its related cortical generators. In addition, the Chapter attempts to draw an elementary parallel between LEPs and other EPs elicited by stimuli belonging to other sensory modalities. Chapter 2 – Determinants of vertex potentials – describes the determinants of neural processes of pain perception and support their interpretation through a neurocognitive model of attention. The mechanism of attention allows allocating resources for selection and integration of this process with working memory requirements. More in detail, cognitive science suggested that the attention mechanism can be divided into two categories: stimulus-driven (or ‘bottom-up’) and goal-directed (or ‘top-down’). ‘Top-down’ and ‘bottom-up’ are treated as key interpretative categories to explain the findings reported in this thesis. Infact, they are metaphors which are used to represent information processing in a hierarchical fashion, where lower levels of processing would rely on the physical features of the stimulus while higher levels would involve comparisons with information stored in memory, selection of relevant information in competition and response to the stimulus. A review of selected literature in the field or ERP studies of sensory processing is provided and interpreted within this framework. The thesis aims to contribute to the understanding of both ‘bottom-up’ and ‘top-down’ mechanisms of attention during nociceptive processing, with two distinct experiments. Chapter 3 – Contribution to the analysis of ‘bottom-up features: “Dishabituation of laser-evoked EEG responses: dissecting the effect of certain and uncertain changes in stimulus modality” - presents a study where the hypothesis that a change of modality (from auditory to nociceptive and vicerversa, rather than no change at all) can significantly modulate brain responses (no matter the subjects expectation of this change) has been tested. The results of this study bring support for a determinant role of saliency (here modulated by the novelty introduced by a change in the stimulus modality) in affecting brain responses to the sensory input. Chapter 4 - Hypnotic modulation of sensory and affective dimensions of pain: a top-down signature on pain experience - introduces a study where hypnotic suggestions were used to draw subject’s attention either on intensity or on unpleasantness of pain perception. Thus, the study aimed to investigate whether this manipulation could induce a dissociation between this two measure of subjective experience and whether LEP could reflect the role of focused attention and expectation in indexing changes of subjective feeling. The results are discussed according to previous literature and to a neurocognitive model of pain processing as observed during an altered state of consciousness known to heighten the fronto-parietal network of sustained attention. In Chapter 5 - General discussion - the findings related to these two different research lines are integrated and discussed considering the existing theoretical accounts. The critical assumption is that the understanding of pain processing would largely benefit from the application of an attention-driven interpretative framework within which can be included different theoretical-epistemological views concerning (II) the Bayesian inference in perception, (III) the motivational account of pain monitoring and control, (IV) the neuroanatomy of homeostatic feeling of body integrity and self-regulation. As conclusive remark, the work presented in this thesis wish to highlight the importance of a renewed concept of ‘pain matrix’, based on its function of potential threat detector and action planner, in order to preserve the integrity of the body. In addition, the interpretation of pain as homeostatic-motivational force naturally carries us to consider the ‘pain matrix’ not as a sensory-specific cortical network but rather as an action-specific network, representing the activity by which the individual identifies and responds purposefully to a sudden, potential threat inside or outside of the body

Modality Switching in a Property Verification Task: An ERP Study of What Happens When Candles Flicker after High Heels Click

The perceptual modalities associated with property words, such as flicker or click, have previously been demonstrated to affect subsequent property verification judgments (Pecher et al., 2003). Known as the conceptual modality switch effect, this finding supports the claim that brain systems for perception and action help subserve the representation of concepts. The present study addressed the cognitive and neural substrate of this effect by recording event-related potentials (ERPs) as participants performed a property verification task with visual or auditory properties in key trials. We found that for visual property verifications, modality switching was associated with an increased amplitude N400. For auditory verifications, switching led to a larger late positive complex. Observed ERP effects of modality switching suggest property words access perceptual brain systems. Moreover, the timing and pattern of the effects suggest perceptual systems impact the decision-making stage in the verification of auditory properties, and the semantic stage in the verification of visual properties

Top-down effects on early visual processing in humans: a predictive coding framework

An increasing number of human electroencephalography (EEG) studies examining the earliest component of the visual evoked potential, the so-called C1, have cast doubts on the previously prevalent notion that this component is impermeable to top-down effects. This article reviews the original studies that (i) described the C1, (ii) linked it to primary visual cortex (V1) activity, and (iii) suggested that its electrophysiological characteristics are exclusively determined by low-level stimulus attributes, particularly the spatial position of the stimulus within the visual field. We then describe conflicting evidence from animal studies and human neuroimaging experiments and provide an overview of recent EEG and magnetoencephalography (MEG) work showing that initial V1 activity in humans may be strongly modulated by higher-level cognitive factors. Finally, we formulate a theoretical framework for understanding top-down effects on early visual processing in terms of predictive coding

Measuring working memory load effects on electrophysiological markers of attention orienting during a simulated drive

Intersection accidents result in a significant proportion of road fatalities, and attention allocation likely plays a role. Attention allocation may depend on (limited) working memory (WM) capacity. Driving is often combined with tasks increasing WM load, consequently impairing attention orienting. This study (n = 22) investigated WM load effects on event-related potentials (ERPs) related to attention orienting. A simulated driving environment allowed continuous lane-keeping measurement. Participants were asked to orient attention covertly towards the side indicated by an arrow, and to respond only to moving cars appearing on the attended side by pressing a button. WM load was manipulated using a concurrent memory task. ERPs showed typical attentional modulation (cue: contralateral negativity, LDAP; car: N1, P1, SN and P3) under low and high load conditions. With increased WM load, lane-keeping performance improved, while dual task performance degraded (memory task: increased error rate; orienting task: increased false alarms, smaller P3). Practitioner Summary: Intersection driver-support systems aim to improve traffic safety and flow. However, in-vehicle systems induce WM load, increasing the tendency to yield. Traffic flow reduces if drivers stop at inappropriate times, reducing the effectiveness of systems. Consequently, driver-support systems could include WM load measurement during driving in the development phase

Modality shift effects mimic multisensory interactions: an event-related potential study

A frequent approach to study interactions of the auditory and the visual system is to measure event-related potentials (ERPs) to auditory, visual, and auditory-visual stimuli (A, V, AV). A nonzero result of the AV − (A + V) comparison indicates that the sensory systems interact at a specific processing stage. Two possible biases weaken the conclusions drawn by this approach: first, subtracting two ERPs from one requires that A, V, and AV do not share any common activity. We have shown before (Gondan and Röder in Brain Res 1073–1074:389–397, 2006) that the problem of common activity can be avoided using an additional tactile stimulus (T) and evaluating the ERP difference (T + TAV) − (TA + TV). A second possible confound is the modality shift effect (MSE): for example, the auditory N1 is increased if an auditory stimulus follows a visual stimulus, whereas it is smaller if the modality is unchanged (ipsimodal stimulus). Bimodal stimuli might be affected less by MSEs because at least one component always matches the preceding trial. Consequently, an apparent amplitude modulation of the N1 would be observed in AV. We tested the influence of MSEs on auditory-visual interactions by comparing the results of AV − (A + V) using (a) all stimuli and using (b) only ipsimodal stimuli. (a) and (b) differed around 150 ms, this indicates that AV − (A + V) is indeed affected by the MSE. We then formally and empirically demonstrate that (T + TAV) − (TA + TV) is robust against possible biases due to the MSE