Surmising synchrony of sound and sight: Factors explaining variance of audiovisual integration in hurdling, tap dancing and drumming.

Auditory and visual percepts are integrated even when they are not perfectly temporally aligned with each other, especially when the visual signal precedes the auditory signal. This window of temporal integration for asynchronous audiovisual stimuli is relatively well examined in the case of speech, while other natural action-induced sounds have been widely neglected. Here, we studied the detection of audiovisual asynchrony in three different whole-body actions with natural action-induced sounds-hurdling, tap dancing and drumming. In Study 1, we examined whether audiovisual asynchrony detection, assessed by a simultaneity judgment task, differs as a function of sound production intentionality. Based on previous findings, we expected that auditory and visual signals should be integrated over a wider temporal window for actions creating sounds intentionally (tap dancing), compared to actions creating sounds incidentally (hurdling). While percentages of perceived synchrony differed in the expected way, we identified two further factors, namely high event density and low rhythmicity, to induce higher synchrony ratings as well. Therefore, we systematically varied event density and rhythmicity in Study 2, this time using drumming stimuli to exert full control over these variables, and the same simultaneity judgment tasks. Results suggest that high event density leads to a bias to integrate rather than segregate auditory and visual signals, even at relatively large asynchronies. Rhythmicity had a similar, albeit weaker effect, when event density was low. Our findings demonstrate that shorter asynchronies and visual-first asynchronies lead to higher synchrony ratings of whole-body action, pointing to clear parallels with audiovisual integration in speech perception. Overconfidence in the naturally expected, that is, synchrony of sound and sight, was stronger for intentional (vs. incidental) sound production and for movements with high (vs. low) rhythmicity, presumably because both encourage predictive processes. In contrast, high event density appears to increase synchronicity judgments simply because it makes the detection of audiovisual asynchrony more difficult. More studies using real-life audiovisual stimuli with varying event densities and rhythmicities are needed to fully uncover the general mechanisms of audiovisual integration

Impairment of Auditory-Motor Timing and Compensatory Reorganization after Ventral Premotor Cortex Stimulation

Integrating auditory and motor information often requires precise timing as in speech and music. In humans, the position of the ventral premotor cortex (PMv) in the dorsal auditory stream renders this area a node for auditory-motor integration. Yet, it remains unknown whether the PMv is critical for auditory-motor timing and which activity increases help to preserve task performance following its disruption. 16 healthy volunteers participated in two sessions with fMRI measured at baseline and following rTMS (rTMS) of either the left PMv or a control region. Subjects synchronized left or right finger tapping to sub-second beat rates of auditory rhythms in the experimental task, and produced self-paced tapping during spectrally matched auditory stimuli in the control task. Left PMv rTMS impaired auditory-motor synchronization accuracy in the first sub-block following stimulation (p<0.01, Bonferroni corrected), but spared motor timing and attention to task. Task-related activity increased in the homologue right PMv, but did not predict the behavioral effect of rTMS. In contrast, anterior midline cerebellum revealed most pronounced activity increase in less impaired subjects. The present findings suggest a critical role of the left PMv in feed-forward computations enabling accurate auditory-motor timing, which can be compensated by activity modulations in the cerebellum, but not in the homologue region contralateral to stimulation

fMRI Supports the Sensorimotor Theory of Motor Resonance

The neural mechanisms mediating the activation of the motor system during action observation, also known as motor resonance, are of major interest to the field of motor control. It has been proposed that motor resonance develops in infants through Hebbian plasticity of pathways connecting sensory and motor regions that fire simultaneously during imitation or self movement observation. A fundamental problem when testing this theory in adults is that most experimental paradigms involve actions that have been overpracticed throughout life. Here, we directly tested the sensorimotor theory of motor resonance by creating new visuomotor representations using abstract stimuli (motor symbols) and identifying the neural networks recruited through fMRI. We predicted that the network recruited during action observation and execution would overlap with that recruited during observation of new motor symbols. Our results indicate that a network consisting of premotor and posterior parietal cortex, the supplementary motor area, the inferior frontal gyrus and cerebellum was activated both by new motor symbols and by direct observation of the corresponding action. This tight spatial overlap underscores the importance of sensorimotor learning for motor resonance and further indicates that the physical characteristics of the perceived stimulus are irrelevant to the evoked response in the observer

The pressure to communicate efficiently continues to shape language use later in life

Language use is shaped by a pressure to communicate efficiently, yet the tendency towards redundancy is said to increase in older age. The longstanding assumption is that saying more than is necessary is inefficient and may be driven by age-related decline in inhibition (i.e. the ability to filter out irrelevant information). However, recent work proposes an alternative account of efficiency: In certain contexts, redundancy facilitates communication (e.g., when the colour or size of an object is perceptually salient and its mention aids the listener’s search). A critical question follows: Are older adults indiscriminately redundant, or do they modulate their use of redundant information to facilitate communication? We tested efficiency and cognitive capacities in 200 adults aged 19–82. Irrespective of age, adults with better attention switching skills were redundant in efficient ways, demonstrating that the pressure to communicate efficiently continues to shape language use later in life

Orienting asymmetries and lateralized processing of sounds in humans

<p>Abstract</p> <p>Background</p> <p>Lateralized processing of speech is a well studied phenomenon in humans. Both anatomical and neurophysiological studies support the view that nonhuman primates and other animal species also reveal hemispheric differences in areas involved in sound processing. In recent years, an increasing number of studies on a range of taxa have employed an orienting paradigm to investigate lateralized acoustic processing. In this paradigm, sounds are played directly from behind and the direction of turn is recorded. This assay rests on the assumption that a hemispheric asymmetry in processing is coupled to an orienting bias towards the contralateral side. To examine this largely untested assumption, speech stimuli as well as artificial sounds were presented to 224 right-handed human subjects shopping in supermarkets in Germany and in the UK. To verify the lateralized processing of the speech stimuli, we additionally assessed the brain activation in response to presentation of the different stimuli using functional magnetic resonance imaging (fMRI).</p> <p>Results</p> <p>In the naturalistic behavioural experiments, there was no difference in orienting behaviour in relation to the stimulus material (speech, artificial sounds). Contrary to our predictions, subjects revealed a significant left bias, irrespective of the sound category. This left bias was slightly but not significantly stronger in German subjects. The fMRI experiments confirmed that the speech stimuli evoked a significant left lateralized activation in BA44 compared to the artificial sounds.</p> <p>Conclusion</p> <p>These findings suggest that in adult humans, orienting biases are not necessarily coupled with lateralized processing of acoustic stimuli. Our results – as well as the inconsistent orienting biases found in different animal species – suggest that the orienting assay should be used with caution. Apparently, attention biases, experience, and experimental conditions may all affect head turning responses. Because of the complexity of the interaction of factors, the use of the orienting assay to determine lateralized processing of sound stimuli is discouraged.</p

Evidence for multiple rhythmic skills

Rhythms, or patterns in time, play a vital role in both speech and music. Proficiency in a number of rhythm skills has been linked to language ability, suggesting that certain rhythmic processes in music and language rely on overlapping resources. However, a lack of understanding about how rhythm skills relate to each other has impeded progress in understanding how language relies on rhythm processing. In particular, it is unknown whether all rhythm skills are linked together, forming a single broad rhythmic competence, or whether there are multiple dissociable rhythm skills. We hypothesized that beat tapping and rhythm memory/sequencing form two separate clusters of rhythm skills. This hypothesis was tested with a battery of two beat tapping and two rhythm memory tests. Here we show that tapping to a metronome and the ability to adjust to a changing tempo while tapping to a metronome are related skills. The ability to remember rhythms and to drum along to repeating rhythmic sequences are also related. However, we found no relationship between beat tapping skills and rhythm memory skills. Thus, beat tapping and rhythm memory are dissociable rhythmic aptitudes. This discovery may inform future research disambiguating how distinct rhythm competencies track with specific language functions

Surprised at All the Entropy: Hippocampal, Caudate and Midbrain Contributions to Learning from Prediction Errors

Influential concepts in neuroscientific research cast the brain a predictive machine that revises its predictions when they are violated by sensory input. This relates to the predictive coding account of perception, but also to learning. Learning from prediction errors has been suggested for take place in the hippocampal memory system as well as in the basal ganglia. The present fMRI study used an action-observation paradigm to investigate the contributions of the hippocampus, caudate nucleus and midbrain dopaminergic system to different types of learning: learning in the absence of prediction errors, learning from prediction errors, and responding to the accumulation of prediction errors in unpredictable stimulus configurations. We conducted analyses of the regions of interests' BOLD response towards these different types of learning, implementing a bootstrapping procedure to correct for false positives. We found both, caudate nucleus and the hippocampus to be activated by perceptual prediction errors. The hippocampal responses seemed to relate to the associative mismatch between a stored representation and current sensory input. Moreover, its response was significantly influenced by the average information, or Shannon entropy of the stimulus material. In accordance with earlier results, the habenula was activated by perceptual prediction errors. Lastly, we found that the substantia nigra was activated by the novelty of sensory input. In sum, we established that the midbrain dopaminergic system, the hippocampus, and the caudate nucleus were to different degrees significantly involved in the three different types of learning: acquisition of new information, learning from prediction errors and responding to unpredictable stimulus developments. We relate learning from perceptual prediction errors to the concept of predictive coding and related information theoretic accounts

Contorted and ordinary body postures in the human brain

Social interaction and comprehension of non-verbal behaviour requires a representation of people’s bodies. Research into the neural underpinnings of body representation implicates several brain regions including extrastriate and fusiform body areas (EBA and FBA), superior temporal sulcus (STS), inferior frontal gyrus (IFG) and inferior parietal lobule (IPL). The different roles played by these regions in parsing familiar and unfamiliar body postures remain unclear. We examined the responses of this body observation network to static images of ordinary and contorted postures by using a repetition suppression design in functional neuroimaging. Participants were scanned whilst observing static images of a contortionist or a group of objects in either ordinary or unusual configurations, presented from different viewpoints. Greater activity emerged in EBA and FBA when participants viewed contorted compared to ordinary body postures. Repeated presentation of the same posture from different viewpoints lead to suppressed responses in the fusiform gyrus as well as three regions that are characteristically activated by observing moving bodies, namely STS, IFG and IPL. These four regions did not distinguish the image viewpoint or the plausibility of the posture. Together, these data define a broad cortical network for processing static body postures, including regions classically associated with action observation