Defining Auditory-Visual Objects: Behavioral Tests and Physiological Mechanisms

Crossmodal integration is a term applicable to many phenomena in which one sensory modality influences task performance or perception in another sensory modality. We distinguish the term binding as one that should be reserved specifically for the process that underpins perceptual object formation. To unambiguously differentiate binding form other types of integration, behavioral and neural studies must investigate perception of a feature orthogonal to the features that link the auditory and visual stimuli. We argue that supporting true perceptual binding (as opposed to other processes such as decision-making) is one role for cross-sensory influences in early sensory cortex. These early multisensory interactions may therefore form a physiological substrate for the bottom-up grouping of auditory and visual stimuli into auditory-visual (AV) objects

An Object-Based Interpretation of Audiovisual Processing

Visual cues help listeners follow conversation in a complex acoustic environment. Many audiovisual research studies focus on how sensory cues are combined to optimize perception, either in terms of minimizing the uncertainty in the sensory estimate or maximizing intelligibility, particularly in speech understanding. From an auditory perception perspective, a fundamental question that has not been fully addressed is how visual information aids the ability to select and focus on one auditory object in the presence of competing sounds in a busy auditory scene. In this chapter, audiovisual integration is presented from an object-based attention viewpoint. In particular, it is argued that a stricter delineation of the concepts of multisensory integration versus binding would facilitate a deeper understanding of the nature of how information is combined across senses. Furthermore, using an object-based theoretical framework to distinguish binding as a distinct form of multisensory integration generates testable hypotheses with behavioral predictions that can account for different aspects of multisensory interactions. In this chapter, classic multisensory illusion paradigms are revisited and discussed in the context of multisensory binding. The chapter also describes multisensory experiments that focus on addressing how visual stimuli help listeners parse complex auditory scenes. Finally, it concludes with a discussion of the potential mechanisms by which audiovisual processing might resolve competition between concurrent sounds in order to solve the cocktail party problem

Integration of Visual Information in Auditory Cortex Promotes Auditory Scene Analysis through Multisensory Binding

How and where in the brain audio-visual signals are bound to create multimodal objects remains unknown. One hypothesis is that temporal coherence between dynamic multisensory signals provides a mechanism for binding stimulus features across sensory modalities. Here, we report that when the luminance of a visual stimulus is temporally coherent with the amplitude fluctuations of one sound in a mixture, the representation of that sound is enhanced in auditory cortex. Critically, this enhancement extends to include both binding and non-binding features of the sound. We demonstrate that visual information conveyed from visual cortex via the phase of the local field potential is combined with auditory information within auditory cortex. These data provide evidence that early cross-sensory binding provides a bottom-up mechanism for the formation of cross-sensory objects and that one role for multisensory binding in auditory cortex is to support auditory scene analysis

Category label and response location shifts in category learning

The category shift literature suggests that rule-based classification, an important form of explicit learning, is mediated by two separate learned associations: a stimulus-to-label association that associates stimuli and category labels, and a label-to-response association that associates category labels and responses. Three experiments investigate whether information–integration classification, an important form of implicit learning, is also mediated by two separate learned associations. Participants were trained on a rule-based or an information–integration categorization task and then the association between stimulus and category label, or between category label and response location was altered. For rule-based categories, and in line with previous research, breaking the association between stimulus and category label caused more interference than breaking the association between category label and response location. However, no differences in recovery rate emerged. For information–integration categories, breaking the association between stimulus and category label caused more interference and led to greater recovery than breaking the association between category label and response location. These results provide evidence that information–integration category learning is mediated by separate stimulus-to-label and label-to-response associations. Implications for the neurobiological basis of these two learned associations are discussed

Anesthetics Impact the Resolution of Inflammation

Local and volatile anesthetics are widely used for surgery. It is not known whether anesthetics impinge on the orchestrated events in spontaneous resolution of acute inflammation. Here we investigated whether a commonly used local anesthetic (lidocaine) and a widely used inhaled anesthetic (isoflurane) impact the active process of resolution of inflammation.Using murine peritonitis induced by zymosan and a systems approach, we report that lidocaine delayed and blocked key events in resolution of inflammation. Lidocaine inhibited both PMN apoptosis and macrophage uptake of apoptotic PMN, events that contributed to impaired PMN removal from exudates and thereby delayed the onset of resolution of acute inflammation and return to homeostasis. Lidocaine did not alter the levels of specific lipid mediators, including pro-inflammatory leukotriene B(4), prostaglandin E(2) and anti-inflammatory lipoxin A(4), in the cell-free peritoneal lavages. Addition of a lipoxin A(4) stable analog, partially rescued lidocaine-delayed resolution of inflammation. To identify protein components underlying lidocaine's actions in resolution, systematic proteomics was carried out using nanospray-liquid chromatography-tandem mass spectrometry. Lidocaine selectively up-regulated pro-inflammatory proteins including S100A8/9 and CRAMP/LL-37, and down-regulated anti-inflammatory and some pro-resolution peptides and proteins including IL-4, IL-13, TGF-â and Galectin-1. In contrast, the volatile anesthetic isoflurane promoted resolution in this system, diminishing the amplitude of PMN infiltration and shortening the resolution interval (Ri) approximately 50%. In addition, isoflurane down-regulated a panel of pro-inflammatory chemokines and cytokines, as well as proteins known to be active in cell migration and chemotaxis (i.e., CRAMP and cofilin-1). The distinct impact of lidocaine and isoflurane on selective molecules may underlie their opposite actions in resolution of inflammation, namely lidocaine delayed the onset of resolution (T(max)), while isoflurane shortened resolution interval (Ri).Taken together, both local and volatile anesthetics impact endogenous resolution program(s), altering specific resolution indices and selective cellular/molecular components in inflammation-resolution. Isoflurane enhances whereas lidocaine impairs timely resolution of acute inflammation

Emission of Volatile Organic Compounds After Herbivory from Trifolium pratense (L.) Under Laboratory and Field Conditions

Plants emit a wide range of volatile organic compounds in response to damage by herbivores, and many of the compounds have been shown to attract the natural enemies of insect herbivores or serve for inter- and intra-plant communication. Most studies have focused on volatile emission in the laboratory while little is known about emission patterns in the field. We studied the emission of volatiles by Trifolium pratense (red clover) under both laboratory and field conditions. The emission of 24 compounds was quantified in the laboratory, of which eight showed increased emission rates after herbivory by Spodoptera littoralis caterpillars, including (E)-β-ocimene, the most abundant compound, (Z)-β-ocimene, linalool, (E)-β-caryophyllene, (E,E)-α-farnesene, 4,8-dimethyl-1,3,7-nonatriene (DMNT), 1-octen-3-ol, and methyl salicylate (MeSA). While most of these compounds have been reported as herbivore-induced volatiles from a wide range of plant taxa, 1-octen-3-ol seems to be a characteristic volatile of legumes. In the field, T. pratense plants with varying herbivore damage growing in established grassland communities emitted only 13 detectable compounds, and the correlation between herbivore damage and volatile release was more variable than in the laboratory. For example, the emission of (E)-β-ocimene, (Z)-β-ocimene, and DMNT actually declined with damage, while decanal exhibited increased emission with increasing herbivory. Elevated light and temperature increased the emission of many compounds, but the differences in light and temperature conditions between the laboratory and the field could not account for the differences in emission profiles. Our results indicate that the release of volatiles from T. pratense plants in the field is likely to be influenced by additional biotic and abiotic factors not measured in this study. The elucidation of these factors may be important in understanding the physiological and ecological functions of volatiles in plants