Investigating the Neural Basis of Audiovisual Speech Perception with Intracranial Recordings in Humans

Speech is inherently multisensory, containing auditory information from the voice and visual information from the mouth movements of the talker. Hearing the voice is usually sufficient to understand speech, however in noisy environments or when audition is impaired due to aging or disabilities, seeing mouth movements greatly improves speech perception. Although behavioral studies have well established this perceptual benefit, it is still not clear how the brain processes visual information from mouth movements to improve speech perception. To clarify this issue, I studied the neural activity recorded from the brain surfaces of human subjects using intracranial electrodes, a technique known as electrocorticography (ECoG). First, I studied responses to noisy speech in the auditory cortex, specifically in the superior temporal gyrus (STG). Previous studies identified the anterior parts of the STG as unisensory, responding only to auditory stimulus. On the other hand, posterior parts of the STG are known to be multisensory, responding to both auditory and visual stimuli, which makes it a key region for audiovisual speech perception. I examined how these different parts of the STG respond to clear versus noisy speech. I found that noisy speech decreased the amplitude and increased the across-trial variability of the response in the anterior STG. However, possibly due to its multisensory composition, posterior STG was not as sensitive to auditory noise as the anterior STG and responded similarly to clear and noisy speech. I also found that these two response patterns in the STG were separated by a sharp boundary demarcated by the posterior-most portion of the Heschl’s gyrus. Second, I studied responses to silent speech in the visual cortex. Previous studies demonstrated that visual cortex shows response enhancement when the auditory component of speech is noisy or absent, however it was not clear which regions of the visual cortex specifically show this response enhancement and whether this response enhancement is a result of top-down modulation from a higher region. To test this, I first mapped the receptive fields of different regions in the visual cortex and then measured their responses to visual (silent) and audiovisual speech stimuli. I found that visual regions that have central receptive fields show greater response enhancement to visual speech, possibly because these regions receive more visual information from mouth movements. I found similar response enhancement to visual speech in frontal cortex, specifically in the inferior frontal gyrus, premotor and dorsolateral prefrontal cortices, which have been implicated in speech reading in previous studies. I showed that these frontal regions display strong functional connectivity with visual regions that have central receptive fields during speech perception

Resting state functional thalamic connectivity abnormalities in patients with post-stroke sleep apnoea: a pilot case-control study

OBJECTIVE: Sleep apnoea is common after stroke, and has adverse effects on the clinical outcome of affected cases. Its pathophysiological mechanisms are only partially known. Increases in brain connectivity after stroke might influence networks involved in arousal modulation and breathing control. The aim of this study was to investigate the resting state functional MRI thalamic hyper connectivity of stroke patients affected by sleep apnoea (SA) with respect to cases not affected, and to healthy controls (HC). PATIENTS AND METHODS: A series of stabilized strokes were submitted to 3T resting state functional MRI imaging and full polysomnography. The ventral-posterior-lateral thalamic nucleus was used as seed. RESULTS: At the between groups comparison analysis, in SA cases versus HC, the regions significantly hyper-connected with the seed were those encoding noxious threats (frontal eye field, somatosensory association, secondary visual cortices). Comparisons between SA cases versus those without SA, revealed in the former group significantly increased connectivity with regions modulating the response to stimuli independently to their potentiality of threat (prefrontal, primary and somatosensory association, superolateral and medial-inferior temporal, associative and secondary occipital ones). Further significantly functionally hyper connections were documented with regions involved also in the modulation of breathing during sleep (pons, midbrain, cerebellum, posterior cingulate cortices), and in the modulation of breathing response to chemical variations (anterior, posterior and para-hippocampal cingulate cortices). CONCLUSIONS: Our preliminary data support the presence of functional hyper connectivity in thalamic circuits modulating sensorial stimuli, in patients with post-stroke sleep apnoea, possibly influencing both their arousal ability and breathing modulation during sleep

Hard to "tune in": neural mechanisms of live face-to-face interaction with high-functioning autistic spectrum disorder

Persons with autism spectrum disorders (ASD) are known to have difficulty in eye contact (EC). This may make it difficult for their partners during face to face communication with them. To elucidate the neural substrates of live inter-subject interaction of ASD patients and normal subjects, we conducted hyper-scanning functional MRI with 21 subjects with autistic spectrum disorder (ASD) paired with typically-developed (normal) subjects, and with 19 pairs of normal subjects as a control. Baseline EC was maintained while subjects performed real-time joint-attention task. The task-related effects were modeled out, and inter-individual correlation analysis was performed on the residual time-course data. ASD-Normal pairs were less accurate at detecting gaze direction than Normal-Normal pairs. Performance was impaired both in ASD subjects and in their normal partners. The left occipital pole (OP) activation by gaze processing was reduced in ASD subjects, suggesting that deterioration of eye-cue detection in ASD is related to impairment of early visual processing of gaze. On the other hand, their normal partners showed greater activity in the bilateral occipital cortex and the right prefrontal area, indicating a compensatory workload. Inter-brain coherence in the right IFG that was observed in the Normal-Normal pairs (Saito et al., 2010) during EC diminished in ASD-Normal pairs. Intra-brain functional connectivity between the right IFG and right superior temporal sulcus (STS) in normal subjects paired with ASD subjects was reduced compared with in Normal-Normal pairs. This functional connectivity was positively correlated with performance of the normal partners on the eye-cue detection. Considering the integrative role of the right STS in gaze processing, inter-subject synchronization during EC may be a prerequisite for eye cue detection by the normal partner

Resting-state connectivity and functional specialization in human medial parieto-occipital cortex

According to recent models of visuo-spatial processing, the medial parieto-occipital cortex is a crucial node of the dorsal visual stream. Evidence from neurophysiological studies in monkeys has indicated that the parieto-occipital sulcus (POS) contains three functionally and cytoarchitectonically distinct areas: the visual area V6 in the fundus of the POS, and the visuo-motor areas V6Av and V6Ad in a progressively dorsal and anterior location with respect to V6. Besides different topographical organization, cytoarchitectonics, and functional properties, these three monkey areas can also be distinguished based on their patterns of cortico-cortical connections. Thanks to wide-field retinotopic mapping, areas V6 and V6Av have been also mapped in the human brain. Here, using a combined approach of resting-state functional connectivity and task-evoked activity by fMRI, we identified a new region in the anterior POS showing a pattern of functional properties and cortical connections that suggests a homology with the monkey area V6Ad. In addition, we observed distinct patterns of cortical connections associated with the human V6 and V6Av which are remarkably consistent with those showed by the anatomical tracing studies in the corresponding monkey areas. Consistent with recent models on visuo-spatial processing, our findings demonstrate a gradient of functional specialization and cortical connections within the human POS, with more posterior regions primarily dedicated to the analysis of visual attributes useful for spatial navigation and more anterior regions primarily dedicated to analyses of spatial information relevant for goal-directed action

Altered white matter connectivity associated with visual hallucinations following occipital stroke

Introduction: Visual hallucinations that arise following vision loss stem from aberrant functional activity in visual cortices and an imbalance of activity across associated cortical and subcortical networks subsequent to visual pathway damage. We sought to determine if structural changes in white matter connectivity play a role in cases of chronic visual hallucinations associated with visual cortical damage. Methods: We performed diffusion tensor imaging (DTI) and probabilistic fiber tractography to assess white matter connectivity in a patient suffering from continuous and disruptive phosphene (simple) visual hallucinations for more than 2 years following right occipital stroke. We compared these data to that of healthy age-matched controls. Results: Probabilistic tractography to reconstruct white matter tracts suggests regeneration of terminal fibers of the ipsilesional optic radiations in the patient. However, arrangement of the converse reconstruction of these tracts, which were seeded from the ipsilesional visual cortex to the intrahemispheric lateral geniculate body, remained disrupted. We further observed compromised structural characteristics, and changes in diffusion (measured using diffusion tensor indices) of white matter tracts in the patient connecting the visual cortex with frontal and temporal regions, and also in interhemispheric connectivity between visual cortices. Conclusions: Cortical remapping and the disruption of communication between visual cortices and remote regions are consistent with our previous functional magnetic resonance imaging (fMRI) data showing imbalanced functional activity of the same regions in this patient (Rafique et al, 2016, Neurology, 87, 1493–1500). Long-term adaptive and disruptive changes in white matter connectivity may account for the rare nature of cases presenting with chronic and continuous visual hallucinations.York University Librarie

EMDR therapy for PTSD after motor vehicle accidents: meta-analytic evidence for specific treatment

Motor vehicle accident (MVA) victims may suffer both acute and post-traumatic stress disorders (PTSD). With PTSD affecting social, interpersonal and occupational functioning, clinicians as well as the National Institute of Health are very interested in identifying the most effective psychological treatment to reduce PTSD. From research findings, eye movement desensitization and reprocessing (EMDR) therapy is considered as one of the effective treatment of PTSD. In this paper, we present the results of a meta-analysis of fMRI studies on PTSD after MVA through activation likelihood estimation. We found that PTSD following MVA is characterized by neural modifications in the anterior cingulate cortex (ACC), a cerebral structure involved in fear-conditioning mechanisms. Basing on previous findings in both humans and animals, which demonstrate that desensitization techniques and extinction protocols act on the limbic system, the effectiveness of EMDR and of cognitive behavioral therapies (CBT) may be related to the fact that during these therapies the ACC is stimulated by desensitization

The Decision Value Computations in the vmPFC and Striatum Use a Relative Value Code That is Guided by Visual Attention

There is a growing consensus in behavioral neuroscience that the brain makes simple choices by first assigning a value to the options under consideration and then comparing them. Two important open questions are whether the brain encodes absolute or relative value signals, and what role attention might play in these computations.Weinvestigated these questions using a human fMRI experiment with a binary choice task in which the fixations to both stimuli were exogenously manipulated to control for the role of visual attention in the valuation computation. We found that the ventromedial prefrontal cortex and the ventral striatum encoded fixation-dependent relative value signals: activity in these areas correlated with the difference in value between the attended and the unattended items. These attention-modulated relative value signals might serve as the input of a comparator system that is used to make a choice