Engaging the articulators enhances perception of concordant visible speech movements

PURPOSE This study aimed to test whether (and how) somatosensory feedback signals from the vocal tract affect concurrent unimodal visual speech perception. METHOD Participants discriminated pairs of silent visual utterances of vowels under 3 experimental conditions: (a) normal (baseline) and while holding either (b) a bite block or (c) a lip tube in their mouths. To test the specificity of somatosensory-visual interactions during perception, we assessed discrimination of vowel contrasts optically distinguished based on their mandibular (English /ɛ/-/æ/) or labial (English /u/-French /u/) postures. In addition, we assessed perception of each contrast using dynamically articulating videos and static (single-frame) images of each gesture (at vowel midpoint). RESULTS Engaging the jaw selectively facilitated perception of the dynamic gestures optically distinct in terms of jaw height, whereas engaging the lips selectively facilitated perception of the dynamic gestures optically distinct in terms of their degree of lip compression and protrusion. Thus, participants perceived visible speech movements in relation to the configuration and shape of their own vocal tract (and possibly their ability to produce covert vowel production-like movements). In contrast, engaging the articulators had no effect when the speaking faces did not move, suggesting that the somatosensory inputs affected perception of time-varying kinematic information rather than changes in target (movement end point) mouth shapes. CONCLUSIONS These findings suggest that orofacial somatosensory inputs associated with speech production prime premotor and somatosensory brain regions involved in the sensorimotor control of speech, thereby facilitating perception of concordant visible speech movements. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.9911846R01 DC002852 - NIDCD NIH HHSAccepted manuscrip

An integrated theory of language production and comprehension

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation (such as semantics, syntax, and phonology). We show (a) how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, (b) how they interweave production and comprehension processes, and (c) how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal

Towards a complete multiple-mechanism account of predictive language processing [Commentary on Pickering & Garrod]

Although we agree with Pickering & Garrod (P&G) that prediction-by-simulation and prediction-by-association are important mechanisms of anticipatory language processing, this commentary suggests that they: (1) overlook other potential mechanisms that might underlie prediction in language processing, (2) overestimate the importance of prediction-by-association in early childhood, and (3) underestimate the complexity and significance of several factors that might mediate prediction during language processing

Colateralization of Broca's area and the visual word form area in left-handers: fMRI evidence

A

Speech Melody Properties in English, Czech and Czech English: Reference and Interference

Two major objectives were set for the present study: to provide reference data for the description of Czech and English F0 contours, and to investigate the limits of the ‘interference hypothesis’ on Czech English data. Altogether, the production of 40 speakers in 2392 breath-group F0 contours was analyzed. The speech of 32 professional speakers of English and Czech provides reference values for various acoustic correlates of pitch level, pitch span and downtrend gradient. These values were subsequently used as a benchmark for a confirmation of the interference hypothesis through comparison with a further sample of 8 non-professional speakers of English and Czech-accented English. The native English speakers of both genders produced significantly higher pitch level indicators, wider pitch span and a steeper downtrend gradient than the reference native speakers of Czech. Although the pitch level of the Czech-accented material lies in between the two reference groups, the pitch span of this group is the narrowest, which indicates that factors of foreign-accentedness other than simply interference are in effect

The diachronic emergence of retroflex segments in three languages

The present study shows that though retroflex segments can be considered articulatorily marked, there are perceptual reasons why languages introduce this class into their phoneme inventory. This observation is illustrated with the diachronic developments of retroflexes in Norwegian (North- Germanic), Nyawaygi (Australian) and Minto-Nenana (Athapaskan). The developments in these three languages are modelled in a perceptually oriented phonological theory, since traditional articulatorily-based features cannot deal with such processes

Defining language impairments in a subgroup of children with autism spectrum disorder

Autism spectrum disorder (ASD) is diagnosed on the basis of core impairments in pragmatic language skills, which are found across all ages and subtypes. In contrast, there is significant heterogeneity in language phenotypes, ranging from nonverbal to superior linguistic abilities, as defined on standardized tests of vocabulary and grammatical knowledge. The majority of children are verbal but impaired in language, relative to age-matched peers. One hypothesis is that this subgroup has ASD and co-morbid specific language impairment (SLI). An experiment was conducted comparing children with ASD to children with SLI and typically developing controls on aspects of language processing that have been shown to be impaired in children with SLI: repetition of nonsense words. Patterns of performance among the children with ASD and language impairment were similar to those with SLI, and contrasted with the children with ASD and no language impairment and typical controls, providing further evidence for the hypothesis that a subgroup of children with ASD has co-morbid SLI. The findings are discussed in the context of brain imaging studies that have explored the neural bases of language impairment in ASD and SLI, and overlap in the genes associated with elevated risk for these disorders.M01 RR00533 - NCRR NIH HHS; R01 DC10290 - NIDCD NIH HHS; U19 DC03610 - NIDCD NIH HH

Long-distance place assimilation with an interacting error pattern in phonological acquisition

Two commonly occurring and independent error patterns in children's early speech are examined to determine how and to what extent they might interact. One error pattern replaces velar consonants with coronals, and the other replaces a coronal with a consonant that agrees in place of articulation with some other consonant elsewhere in the word. A range of interactions is observed within and across children with regard to whether the product of one error pattern can serve as the target of the other. The different interactions motivate different claims about the nature and substance of children's underlying representations, which in some cases may differ from those of the ambient system. An extension to underspecification theory is advanced which allows underlying representations to be radically underspecified and in certain cases also to be specified for a default feature.National Institutes of Health DC00433, RR7031K, DC00076, DC001694 (PI: Gierut)This is an Accepted Manuscript of an article published by Taylor & Francis in Clinical Linguistics & Phonetics on January 1997, available online: http://wwww.tandfonline.com/10.3109/02699209708985198

The left superior temporal gyrus is a shared substrate for auditory short-term memory and speech comprehension: evidence from 210 patients with stroke

Competing theories of short-term memory function make specific predictions about the functional anatomy of auditory short-term memory and its role in language comprehension. We analysed high-resolution structural magnetic resonance images from 210 stroke patients and employed a novel voxel based analysis to test the relationship between auditory short-term memory and speech comprehension. Using digit span as an index of auditory short-term memory capacity we found that the structural integrity of a posterior region of the superior temporal gyrus and sulcus predicted auditory short-term memory capacity, even when performance on a range of other measures was factored out. We show that the integrity of this region also predicts the ability to comprehend spoken sentences. Our results therefore support cognitive models that posit a shared substrate between auditory short-term memory capacity and speech comprehension ability. The method applied here will be particularly useful for modelling structure–function relationships within other complex cognitive domains