The Role of Speech Production System in Audiovisual Speech Perception

Seeing the articulatory gestures of the speaker significantly enhances speech perception. Findings from recent neuroimaging studies suggest that activation of the speech motor system during lipreading enhance speech perception by tuning, in a top-down fashion, speech-sound processing in the superior aspects of the posterior temporal lobe. Anatomically, the superior-posterior temporal lobe areas receive connections from the auditory, visual, and speech motor cortical areas. Thus, it is possible that neuronal receptive fields are shaped during development to respond to speech-sound features that coincide with visual and motor speech cues, in contrast with the anterior/lateral temporal lobe areas that might process speech sounds predominantly based on acoustic cues. The superior-posterior temporal lobe areas have also been consistently associated with auditory spatial processing. Thus, the involvement of these areas in audiovisual speech perception might partly be explained by the spatial processing requirements when associating sounds, seen articulations, and one’s own motor movements. Tentatively, it is possible that the anterior “what” and posterior “where / how” auditory cortical processing pathways are parts of an interacting network, the instantaneous state of which determines what one ultimately perceives, as potentially reflected in the dynamics of oscillatory activity

Auditory-Cortex Short-Term Plasticity Induced by Selective Attention

The ability to concentrate on relevant sounds in the acoustic environment is crucial for everyday function and communication. Converging lines of evidence suggests that transient functional changes in auditory-cortex neurons, “short-term plasticity”, might explain this fundamental function. Under conditions of strongly focused attention, enhanced processing of attended sounds can take place at very early latencies (~50 ms from sound onset) in primary auditory cortex and possibly even at earlier latencies in subcortical structures. More robust selective-attention short-term plasticity is manifested as modulation of responses peaking at ~100 ms from sound onset in functionally specialized nonprimary auditory-cortical areas by way of stimulus-specific reshaping of neuronal receptive fields that supports filtering of selectively attended sound features from task-irrelevant ones. Such effects have been shown to take effect in ~seconds following shifting of attentional focus. There are findings suggesting that the reshaping of neuronal receptive fields is even stronger at longer auditory-cortex response latencies (~300 ms from sound onset). These longer-latency short-term plasticity effects seem to build up more gradually, within tens of seconds after shifting the focus of attention. Importantly, some of the auditory-cortical short-term plasticity effects observed during selective attention predict enhancements in behaviorally measured sound discrimination performance

Alkoholi, tarkkaavaisuus ja akuutit haitat aivojen tapahtumasidonnaisten jännitevasteiden valossa

Summary: Alcohol-induced acute harm in the light of brain event-related potentials and attentional processes

Does short-term hunger increase trust and trustworthiness in a high trust society?

We build on the social heuristics hypothesis, the literature on the glucose model of self-control, and recent challenges on these hypotheses to investigate whether individuals exhibit a change in degree of trust and reciprocation after consumption of a meal. We induce short-term manipulation of hunger followed by the trust game and a decision on whether to leave personal belongings in an unlocked and unsupervised room. Our results are inconclusive. While, we report hungry individuals trusting and reciprocating more than those who have just consumed a meal in a high trust society, we fail to reject the null with small number of observations (N = 101) and experimental sessions (N = 8). In addition, we find no evidence of short-term hunger having an impact on charitable giving or decisions in public good game.Peer reviewe

The Paradox of Fiction Revisited—Improvised Fictional and Real-Life Social Rejections Evoke Associated and Relatively Similar Psychophysiological Responses

Theatre-based practices, such as improvisation, are frequently applied to simulate everyday social interactions. Although the improvisational context is acknowledged as fictional, realistic emotions may emerge, a phenomenon labelled the ‘paradox of fiction’. This study investigated how manipulating the context (real-life versus fictional) modulates psychophysiological reactivity to social rejection during dyadic interactions. We measured psychophysiological responses elicited during real-life (interview) and fictional (improvisation exercises) social rejections. We analysed the heart rate (HR), skin conductance, facial muscle activity, and electrocortical activity (electroencephalographic (EEG) alpha asymmetry) of student teachers (N = 39) during various social rejections (devaluing, interrupting, nonverbal rejection). All social rejections evoked negative EEG alpha asymmetry, a measure reflecting behavioural withdrawal motivation. Psychophysiological responses during real-life and fictional rejections correlated, and rejection type modified the responses. When comparing responses across all rejection types, facial muscle activity and EEG alpha asymmetry did not differ between real-life and fictional rejections, whereas HR decelerated and skin conductance increased during fictional rejections. These findings demonstrate that regardless of cognitive awareness of fictionality, relatively subtle social rejections elicited psychophysiological reactivity indicating emotional arousal and negative valence. These findings provide novel, biological evidence for the application of theatre-based improvisation to studying experientially everyday social encounters

Effects of Improvisation Training on Student Teachers’ Behavioral, Neuroendocrine, and Psychophysiological Responses during the Trier Social Stress Test

Objectives Teaching involves multiple performance situations, potentially causing psychosocial stress. Since the theater-based improvisation method is associated with diminished social stress, we investigated whether improvisation lessened student teachers’ stress responses using the Trier Social Stress Test (TSST; preparatory phase, public speech, and math task). Moreover, we studied the influence of interpersonal confidence (IC) – the belief regarding one’s capability related to effective social interactions – on stress responses. Methods The intervention group (n = 19) received a 7-week (17.5 h) improvisation training, preceded and followed by the TSST. We evaluated experienced stress using a self-report scale, while physiological stress was assessed before (silent 30-s waiting period) and during the TSST tasks using cardiovascular measures (heart rate, heart rate variability [HRV]), electrodermal activation, facial electromyography (f-EMG), and EEG asymmetry. Hypothalamus-pituitary-adrenal (HPA-axis) reactivity was assessed through repeated salivary cortisol sampling. Results Compared to the control group (n = 16), the intervention group exhibited less f-EMG activity before a public speech and higher HRV before the math task. The low IC intervention subgroup reported significantly less stress during the math task. The controls showed a decreased heart rate before the math task, and controls with a low IC exhibited higher HRV during the speech. Self-reported stress and cortisol levels were positively correlated during the post-TSST preparatory phase. Conclusions These findings suggest that improvisation training might diminish stress levels, specifically before a performance. In addition, interpersonal confidence appears to reduce stress responses. The decreased stress responses in the control group suggest adaptation through repetition. Keywords: Improvisation; Anticipatory anxiety; Interpersonal confidence; Psychophysiology; Teacher education; Trier Social Stress TestPeer reviewe

Inferior parietal lobule and early visual areas support elicitation of individualized meanings during narrative listening

Introduction: When listening to a narrative, the verbal expressions translate into meanings and flow of mental imagery. However, the same narrative can be heard quite differently based on differences in listeners' previous experiences and knowledge. We capitalized on such differences to disclose brain regions that support transformation of narrative into individualized propositional meanings and associated mental imagery by analyzing brain activity associated with behaviorally assessed individual meanings elicited by a narrative. Methods: Sixteen right-handed female subjects were instructed to list words that best described what had come to their minds while listening to an eight-minute narrative during functional magnetic resonance imaging (fMRI). The fMRI data were analyzed by calculating voxel-wise intersubject correlation (ISC) values. We used latent semantic analysis (LSA) enhanced with Wordnet knowledge to measure semantic similarity of the produced words between subjects. Finally, we predicted the ISC with the semantic similarity using representational similarity analysis. Results: We found that semantic similarity in these word listings between subjects, estimated using LSA combined with WordNet knowledge, predicting similarities in brain hemodynamic activity. Subject pairs whose individual semantics were similar also exhibited similar brain activity in the bilateral supramarginal and angular gyrus of the inferior parietal lobe, and in the occipital pole. Conclusions: Our results demonstrate, using a novel method to measure interindividual differences in semantics, brain mechanisms giving rise to semantics and associated imagery during narrative listening. During listening to a captivating narrative, the inferior parietal lobe and early visual cortical areas seem, thus, to support elicitation of individual meanings and flow of mental imagery.Peer reviewe

Inter-Subject Synchronization of Prefrontal Cortex Hemodynamic Activity During Natural Viewing

Hemodynamic activity in occipital, temporal, and parietal cortical areas were recently shown to correlate across subjects during viewing of a 30-minute movie clip. However, most of the frontal cortex lacked between-subject correlations. Here we presented 12 healthy naïve volunteers with the first 72 minutes of a movie (“Crash”, 2005, Lions Gate Films) outside of the fMRI scanner to involve the subjects in the plot of the movie, followed by presentation of the last 36 minutes during fMRI scanning. We observed significant between-subjects correlation of fMRI activity in especially right hemisphere frontal cortical areas, in addition to the correlation of activity in temporal, occipital, and parietal areas. It is possible that this resulted from the subjects following the plot of the movie and being emotionally engaged in the movie during fMRI scanning. We further show that probabilistic independent component analysis (ICA) reveals meaningful activations in individual subjects during natural viewing

Lipreading a naturalistic narrative in a female population : Neural characteristics shared with listening and reading

Publisher Copyright: © 2022 The Authors. Brain and Behavior published by Wiley Periodicals LLC.Introduction: Few of us are skilled lipreaders while most struggle with the task. Neural substrates that enable comprehension of connected natural speech via lipreading are not yet well understood. Methods: We used a data-driven approach to identify brain areas underlying the lipreading of an 8-min narrative with participants whose lipreading skills varied extensively (range 6–100%, mean = 50.7%). The participants also listened to and read the same narrative. The similarity between individual participants’ brain activity during the whole narrative, within and between conditions, was estimated by a voxel-wise comparison of the Blood Oxygenation Level Dependent (BOLD) signal time courses. Results: Inter-subject correlation (ISC) of the time courses revealed that lipreading, listening to, and reading the narrative were largely supported by the same brain areas in the temporal, parietal and frontal cortices, precuneus, and cerebellum. Additionally, listening to and reading connected naturalistic speech particularly activated higher-level linguistic processing in the parietal and frontal cortices more consistently than lipreading, probably paralleling the limited understanding obtained via lip-reading. Importantly, higher lipreading test score and subjective estimate of comprehension of the lipread narrative was associated with activity in the superior and middle temporal cortex. Conclusions: Our new data illustrates that findings from prior studies using well-controlled repetitive speech stimuli and stimulus-driven data analyses are also valid for naturalistic connected speech. Our results might suggest an efficient use of brain areas dealing with phonological processing in skilled lipreaders.Peer reviewe