Examining the McGurk illusion using high-field 7 Tesla functional MRI

In natural communication speech perception is profoundly influenced by observable mouth movements. The additional visual information can greatly facilitate intelligibility but incongruent visual information may also lead to novel percepts that neither match the auditory nor the visual information as evidenced by the McGurk effect. Recent models of audiovisual (AV) speech perception accentuate the role of speech motor areas and the integrative brain sites in the vicinity of the superior temporal sulcus (STS) for speech perception. In this event-related 7 Tesla fMRI study we used three naturally spoken syllable pairs with matching AV information and one syllable pair designed to elicit the McGurk illusion. The data analysis focused on brain sites involved in processing and fusing of AV speech and engaged in the analysis of auditory and visual differences within AV presented speech. Successful fusion of AV speech is related to activity within the STS of both hemispheres. Our data supports and extends the audio-visual-motor model of speech perception by dissociating areas involved in perceptual fusion from areas more generally related to the processing of AV incongruence

Neuronal correlates of ADHD in adults with evidence for compensation strategies – a functional MRI study with a Go/No-Go paradigm

Objective: Response inhibition impairment is one of the most characteristic symptoms of attention-deficit/hyperactivity disorder (ADHD). Thus functional magnetic resonance imaging (fMRI) during a Go/No-Go task seems to be an ideal tool for examining neuronal correlates of inhibitory control deficits in ADHD. Prior studies have shown frontostriatal abnormalities in children and adolescents. The aim of our study was to investigate whether adults with ADHD would still show abnormal brain activation in prefrontal brain regions during motor response inhibition tasks

N1 enhancement in synesthesia during visual and audio-visual perception in semantic cross-modal conflict situations: an ERP study

Synesthesia entails a special kind of sensory perception, where stimulation in one sensory modality leads to an internally generated perceptual experience of another, not stimulated sensory modality. This phenomenon can be viewed as an abnormal multisensory integration process as here the synesthetic percept is aberrantly fused with the stimulated modality. Indeed, recent synesthesia research has focused on multimodal processing even outside of the specific synesthesia-inducing context and has revealed changed multimodal integration, thus suggesting perceptual alterations at a global level. Here, we focused on audio-visual processing in synesthesia using a semantic classification task in combination with visually or auditory-visually presented animated and in animated objects in an audio-visual congruent and incongruent manner. Fourteen subjects with auditory-visual and/or grapheme-color synesthesia and 14 control subjects participated in the experiment. During presentation of the stimuli, event-related potentials were recorded from 32 electrodes. The analysis of reaction times and error rates revealed no group differences with best performance for audio-visually congruent stimulation indicating the well-known multimodal facilitation effect. We found enhanced amplitude of the N1 component over occipital electrode sites for synesthetes compared to controls. The differences occurred irrespective of the experimental condition and therefore suggest a global influence on early sensory processing in synesthetes

The effect of multisensory semantic congruency on unisensory object recognition in schizophrenia

Multisensory, as opposed to unisensory processing of stimuli, has been found to enhance the performance (e.g., reaction time, accuracy, and discrimination) of healthy individuals across various tasks. However, this enhancement is not as pronounced in patients with schizophrenia (SZ), indicating impaired multisensory integration (MSI) in these individuals. To the best of our knowledge, no study has yet investigated the impact of MSI deficits in the context of working memory, a domain highly reliant on multisensory processing and substantially impaired in schizophrenia. To address this research gap, we employed two adopted versions of the continuous object recognition task to investigate the effect of single-trail multisensory encoding on subsequent object recognition in 21 schizophrenia patients and 21 healthy controls (HC). Participants were tasked with discriminating between initial and repeated presentations. For the initial presentations, half of the stimuli were audiovisual pairings, while the other half were presented unimodal. The task-relevant stimuli were then presented a second time in a unisensory manner (either auditory stimuli in the auditory task or visual stimuli in the visual task). To explore the impact of semantic context on multisensory encoding, half of the audiovisual pairings were selected to be semantically congruent, while the remaining pairs were not semantically related to each other. Consistent with prior studies, our findings demonstrated that the impact of single-trial multisensory presentation during encoding remains discernible during subsequent object recognition. This influence could be distinguished based on the semantic congruity between the auditory and visual stimuli presented during the encoding. This effect was more robust in the auditory task. In the auditory task, when congruent multisensory pairings were encoded, both participant groups demonstrated a multisensory facilitation effect. This effect resulted in improved accuracy and RT performance. Regarding incongruent audiovisual encoding, as expected, HC did not demonstrate an evident multisensory facilitation effect on memory performance. In contrast, SZs exhibited an atypically accelerated reaction time during the subsequent auditory object recognition. Based on the predictive coding model we propose that this observed deviations indicate a reduced semantic modulatory effect and anomalous predictive errors signaling, particularly in the context of conflicting cross-modal sensory inputs in SZ

A Randomized Study of Food Pictures-Influenced Decision-Making Under Ambiguity in Individuals With Morbid Obesity

Background and Aims In addition to craving responses to salient food cues, the anticipation of short-term rewarding consumption of palatable food may overrun the anticipation of long-term negative consequences of obesity. The present investigation addressed the potential interplay of food cravings and decision-making abilities in individuals with obesity. Method Study 1 included 107 bariatric surgery candidates with class 2/3 obesity (OB-group) and study 2 included 54 individuals with normal weight/pre-obesity (nonOB-group). In both studies, standardized questionnaires concerning food cravings, food addiction, and psychopathology were administered. A cue-reactivity paradigm was used to measure craving responses toward semi-individualized images of highly palatable, processed food/fruit (appetitive food cues) compared to images of raw vegetables (non-appetitive food cues). Decision-making was measured with a modified computerized version of the Iowa Gambling Task (IGT) with food pictures. Both groups were divided into two subgroups that were randomized to different IGT conditions. In one IGT condition the advantageous IGT card decks were covered by pictures of palatable, processed food or fruit and the disadvantageous decks by images of raw vegetables (= congruent condition), and in the other IGT conditionvice versa. Results Participants in the OB-group admitted on average higher craving responses toward palatable, processed food or fruit cues compared to pictures of raw vegetables. This was not the case in the nonOB-group. Contrary to our hypothesis, decision-making performance in both groups was worse when pictures of palatable, processed food or fruit were associated with advantageous IGT card decks compared to performance when those pictures were linked to the disadvantageous decks. The interference effect of food pictures processing on advantageous decision-making has been observed particularly in those individuals of the OB-group who exhibited high craving responses toward palatable, processed food cues or high levels of food addiction. Discussion The results indicate that food pictures processing interferes with decision-making, regardless of weight status. Opposed to the hypothesis, stronger tendencies to avoid than to approach pictures presenting processed, tasty food were observed. Further research should examine how cognitive avoidance tendencies toward processed, high energy food and approach tendencies toward healthy food can be transferred to real life situations

Cognitive control in adults with high-functioning autism spectrum disorder: a study with event-related potentials

IntroductionLittle is known about cognitive control in adults with high-functioning forms of autism spectrum disorder because previous research focused on children and adolescents. Cognitive control is crucial to monitor and readjust behavior after errors to select contextually appropriate reactions. The congruency effect and conflict adaptation are measures of cognitive control. Post-error slowing, error-related negativity and error positivity provide insight into behavioral and electrophysiological correlates of error processing. In children and adolescent with autism spectrum disorder deficits in cognitive control and error processing have been shown by changes in post-error slowing, error-related negativity and error positivity in the flanker task.MethodsWe performed a modified Eriksen flanker task in 17 adults with high-functioning autism spectrum disorder and 17 healthy controls. As behavioral measures of cognitive control and error processing, we included reaction times and error rates to calculate congruency effects, conflict adaptation, and post-error slowing. Event-related potentials namely error-related negativity and error positivity were measured to assess error-related brain activity.ResultsBoth groups of participants showed the expected congruency effects demonstrated by faster and more accurate responses in congruent compared to incongruent trials. Healthy controls exhibited conflict adaptation as they obtained performance benefits after incongruent trials whereas patients with autism spectrum disorder did not. The expected slowing in reaction times after errors was observed in both groups of participants. Individuals with autism spectrum disorder demonstrated enhanced electrophysiological error-processing compared to healthy controls indicated by increased error-related negativity and error positivity difference amplitudes.DiscussionOur findings show that adults with high-functioning autism spectrum disorder do not show the expected upregulation of cognitive control in response to conflicts. This finding implies that previous experiences may have a reduced influence on current behavior in these patients which possibly contributes to less flexible behavior. Nevertheless, we observed intact behavioral reactions after errors indicating that adults with high-functioning autism spectrum disorder can flexibly adjust behavior in response to changed environmental demands when necessary. The enhancement of electrophysiological error-processing indicates that adults with high-functioning autism spectrum disorder demonstrate an extraordinary reactivity toward errors reflecting increased performance monitoring in this subpopulation of autism spectrum disorder patients

Comorbidity of Internet use disorder and attention deficit hyperactivity disorder: Two adult case–control studies

Objectives There is good scientific evidence that attention deficit hyperactivity disorder (ADHD) is both a predictor and a comorbidity of addictive disorders in adulthood. These associations not only focus on substance-related addictions but also on behavioral addictions like gambling disorder and Internet use disorder (IUD). For IUD, systematic reviews have identified ADHD as one of the most prevalent comorbidities besides depressive and anxiety disorders. Yet, there is a need to further understand the connections between both disorders to derive implications for specific treatment and prevention. This is especially the case in adult clinical populations where little is known about these relations so far. This study was meant to further investigate this issue in more detail based on the general hypothesis that there is a decisive intersection of psychopathology and etiology between IUD and ADHD. Methods Two case–control samples were examined at a university hospital. Adult ADHD and IUD patients ran through a comprehensive clinical and psychometrical workup. Results We found support for the hypothesis that ADHD and IUD share psychopathological features. Among patients of each group, we found substantial prevalence rates of a comorbid ADHD in IUD and vice versa. Furthermore, ADHD symptoms were positively associated with media use times and symptoms of Internet addiction in both samples. Discussion Clinical practitioners should be aware of the close relationships between the two disorders both diagnostically and therapeutically. When it comes to regain control over one’s Internet use throughout treatment and rehabilitation, a potential shift of addiction must be kept in mind on side of practitioners and patients

Deficient prepulse inhibition of the startle reflex in schizophrenia using a cross-modal paradigm

Objectives To investigate whether the typically reported deficient sensorimotor gating in patients with schizophrenia using unimodal paradigms can also be detected by a cross-modal paradigm which made use of an electrocutaneous-acoustic coupling of stimuli. Methods Twenty-one male schizophrenia patients took part in a prepulse inhibition (PPI) paradigm with an electrocutaneous prepulse and an acoustic startle-eliciting pulse. Their results were compared with those from nineteen healthy males. Results As expected, the patients showed significantly lower PPI than controls. No associations were found between measures of illness severity and PPI. Discussion To the best of our knowledge, this is the first study showing reduced PPI in patients with schizophrenia by using an electrocutaneous-acoustic prepulse-pulse combination. Hence, this study gives further evidence of a modality-independent sensorimotor gating deficit in schizophrenia. Furthermore, as PPI was also lower than usual in controls using unimodal paradigms, results are interpreted in favour of longer processing times of the electrocutaneous prepulse, which probably led to a shorter perceived stimulus onset asynchrony (SOA) in the brain

Audio-visual speech integration in the superior temporal region is dysfunctional in dyslexia

Dyslexia is an impairment of reading and spelling that affects both children and adults even after many years of schooling. Dyslexic readers have deficits in the integration of auditory and visual inputs but the neural mechanisms of the deficits are still unclear. This fMRI study examined the neural processing of auditorily presented German numbers 0-9 and videos of lip movements of a German native speaker voicing numbers 0-9 in unimodal (auditory or visual) and bimodal (always congruent) conditions in dyslexic readers and their matched fluent readers. We confirmed results of previous studies that the superior temporal gyrus/sulcus plays a critical role in audiovisual speech integration: fluent readers showed greater superior temporal activations for combined audiovisual stimuli than auditory-/visual-only stimuli. Importantly, such an enhancement effect was absent in dyslexic readers. Moreover, the auditory network (bilateral superior temporal regions plus medial PFC) was dynamically modulated during audiovisual integration in fluent, but not in dyslexic readers. These results suggest that superior temporal dysfunction may underly poor audiovisual speech integration in readers with dyslexia

Deficient prepulse inhibition of the startle reflex in schizophrenia using a cross-modal paradigm

Objectives To investigate whether the typically reported deficient sensorimotor gating in patients with schizophrenia using unimodal paradigms can also be detected by a cross-modal paradigm which made use of an electrocutaneous-acoustic coupling of stimuli. Methods Twenty-one male schizophrenia patients took part in a prepulse inhibition (PPI) paradigm with an electrocutaneous prepulse and an acoustic startle-eliciting pulse. Their results were compared with those from nineteen healthy males. Results As expected, the patients showed significantly lower PPI than controls. No associations were found between measures of illness severity and PPI. Discussion To the best of our knowledge, this is the first study showing reduced PPI in patients with schizophrenia by using an electrocutaneous-acoustic prepulse-pulse combination. Hence, this study gives further evidence of a modality-independent sensorimotor gating deficit in schizophrenia. Furthermore, as PPI was also lower than usual in controls using unimodal paradigms, results are interpreted in favour of longer processing times of the electrocutaneous prepulse, which probably led to a shorter perceived stimulus onset asynchrony (SOA) in the brain