Speech vocoding for laboratory phonology

Using phonological speech vocoding, we propose a platform for exploring relations between phonology and speech processing, and in broader terms, for exploring relations between the abstract and physical structures of a speech signal. Our goal is to make a step towards bridging phonology and speech processing and to contribute to the program of Laboratory Phonology. We show three application examples for laboratory phonology: compositional phonological speech modelling, a comparison of phonological systems and an experimental phonological parametric text-to-speech (TTS) system. The featural representations of the following three phonological systems are considered in this work: (i) Government Phonology (GP), (ii) the Sound Pattern of English (SPE), and (iii) the extended SPE (eSPE). Comparing GP- and eSPE-based vocoded speech, we conclude that the latter achieves slightly better results than the former. However, GP - the most compact phonological speech representation - performs comparably to the systems with a higher number of phonological features. The parametric TTS based on phonological speech representation, and trained from an unlabelled audiobook in an unsupervised manner, achieves intelligibility of 85% of the state-of-the-art parametric speech synthesis. We envision that the presented approach paves the way for researchers in both fields to form meaningful hypotheses that are explicitly testable using the concepts developed and exemplified in this paper. On the one hand, laboratory phonologists might test the applied concepts of their theoretical models, and on the other hand, the speech processing community may utilize the concepts developed for the theoretical phonological models for improvements of the current state-of-the-art applications

A longitudinal study of phonological processing skills and reading in bilingual children

French/English bilingual children (N=40) in French language schools participated in an 8-month longitudinal study of the relation between phonological processing skills and reading in French and English. Participants were administered measures of phonological awareness, working memory, naming speed, and reading in both languages. The results of the concurrent analyses show that phonological awareness skills in both French and English were uniquely predictive of reading performance in both languages after accounting for the influences of cognitive ability, reading ability, working memory, and naming speed. These findings support the hypothesis that phonological awareness is strongly related to beginning word reading skill in an alphabetic orthography. The results of the longitudinal analyses also suggest that orthographic depth influences phonological factors related to reading

Exemplar Dynamics Models of the Stability of Phonological Categories

We develop a model for the stability and maintenance of phonological categories. Examples of phonological categories are vowel sounds such as "i" and "e". We model such categories as consisting of collections of labeled exemplars that language users store in their memory. Each exemplar is a detailed memory of an instance of the linguistic entity in question. Starting from an exemplar-level model we derive integro-differential equations for the long-term evolution of the density of exemplars in different portions of phonetic space. Using these latter equations we investigate under what conditions two phonological categories merge or not. Our main conclusion is that for the preservation of distinct phonological categories, it is necessary that anomalous speech tokens of a given category are discarded, and not merely stored in memory as an exemplar of another category.Comment: 6 pages, COGS201

The relationship of phonological ability, speech perception, and auditory perception in adults with dyslexia

This study investigated whether auditory, speech perception and phonological skills are tightly interrelated or independently contributing to reading. We assessed each of these three skills in 36 adults with a past diagnosis of dyslexia and 54 matched normal reading adults. Phonological skills were tested by the typical threefold tasks, i.e. rapid automatic naming, verbal short term memory and phonological awareness. Dynamic auditory processing skills were assessed by means of a frequency modulation (FM) and an amplitude rise time (RT); an intensity discrimination task (ID) was included as a non-dynamic control task. Speech perception was assessed by means of sentences and words in noise tasks. Group analysis revealed significant group differences in auditory tasks (i.e. RT and ID) and in phonological processing measures, yet no differences were found for speech perception. In addition, performance on RT discrimination correlated with reading but this relation was mediated by phonological processing and not by speech in noise. Finally, inspection of the individual scores revealed that the dyslexic readers showed an increased proportion of deviant subjects on the slow-dynamic auditory and phonological tasks, yet each individual dyslexic reader does not display a clear pattern of deficiencies across the levels of processing skills. Although our results support phonological and slow-rate dynamic auditory deficits which relate to literacy, they suggest that at the individual level, problems in reading and writing cannot be explained by the cascading auditory theory. Instead, dyslexic adults seem to vary considerably in the extent to which each of the auditory and phonological factors are expressed and interact with environmental and higher-order cognitive influences

Theories of developmental dyslexia: Insights from a multiple case study of dyslexic adults

A multiple case study was conducted in order to assess three leading theories of developmental dyslexia: the phonological, the magnocellular (auditory and visual) and the cerebellar theories. Sixteen dyslexic and 16 control university students were administered a full battery of psychometric, phonological, auditory, visual and cerebellar tests. Individual data reveal that all 16 dyslexics suffer from a phonological deficit, 10 from an auditory deficit, 4 from a motor deficit, and 2 from a visual magnocellular deficit. Results suggest that a phonological deficit can appear in the absence of any other sensory or motor disorder, and is sufficient to cause a literacy impairment, as demonstrated by 5 of the dyslexics. Auditory disorders, when present, aggravate the phonological deficit, hence the literacy impairment. However, auditory deficits cannot be characterised simply as rapid auditory processing problems, as would be predicted by the magnocellular theory. Nor are they restricted to speech. Contrary to the cerebellar theory, we find little support for the notion that motor impairments, when found, have a cerebellar origin, or reflect an automaticity deficit. Overall, the present data support the phonological theory of dyslexia, while acknowledging the presence of additional sensory and motor disorders in certain individuals

Orthographic input and phonological representations in learners of Chinese as a foreign language.

This paper provides evidence that the second language orthographic input affects the mental representations of L2 phonology in instructed beginner L2 learners. Previous research has shown that orthographic representations affect monolinguals' performance in phonological awareness tasks; in instructed L2 learners such representations could also affect pronunciation. This study looked at the phonological representations of Chinese rimes in beginner learners of Chinese as a foreign language, using a phoneme counting task and a phoneme segmentation task. Results show that learners do not count or segment the main vowel in those syllables where it is not represented in the pinyin (romanisation) orthographic representations. It appears that the pinyin orthographic input is reinterpreted according to L1 phonology-orthography correspondences, and interacts with the phonological input in shaping the phonological representations of Chinese syllables in beginner learners. This explains previous findings that learners of Chinese do not pronounce the main vowel in these syllables

Relationships between working memory, expressive vocabulary and arithmetical reasoning in children with and without intellectual disabilities.

This experiment examined the relationships between working memory and two measures of achievement, namely expressive vocabulary and arithmetical reasoning, in children with and without intellectual disabilities (ID). For 11-12-year-old children with intellectual disabilities, memory measures tapping the central executive were the most important predictors of both expressive vocabulary and arithmetical reasoning, with phonological memory making a small additional contribution to expressive vocabulary. For mainstream 11-12-year-old children, phonological memory was the best predictor of expressive vocabulary, whereas, arithmetical reasoning ability was predicted by visual memory and to a lesser extent phonological memory. The third group of children, 7-8-year-old mainstream children, had been matched on mental age with the intellectual disability group. For these children the most important predictor of expressive vocabulary was phonological memory, with a small additional contribution from visual memory. Arithmetical reasoning was best predicted by memory measures tapping the central executive with an additional contribution from phonological memory. These results suggest that different working memory resources are used by children of varying ages and ability levels to carry out at least some cognitive tasks

The relationship between motor control and phonology in dyslexic children

Background: The goal of this study was to investigate the automaticity/cerebellar theory of dyslexia. We tested phonological skills and cerebellar function in a group of dyslexic 8-12 year old children and their matched controls. Tests administered included the Phonological Assessment Battery, postural stability, bead threading, finger to thumb and time estimation. Results: Dyslexic children were found to be significantly poorer than the controls at all tasks but time estimation. About 75% of dyslexics were more than one standard deviation below controls in phonological ability, and 50% were similarly impaired in motor skills. However, at least part of the discrepancy in motor skills was due to dyslexic individuals who had additional disorders (ADHD and/or DCD). The absence of evidence for a time estimation deficit also casts doubt on the cerebellar origin of the motor deficiency. About half the dyslexic children didn't have any motor problem, and there was no evidence for a causal relationship between motor skills on the one hand and phonological and reading skills on the other. Conclusion: This study provides partial support for the presence of motor problems in dyslexic children, but does not support the hypothesis that a cerebellar dysfunction is the cause of their phonological and reading impairment

Lexicality and frequency in specific language impairment: accuracy and error data from two nonword repetition tests

Purpose: Deficits in phonological working memory and deficits in phonological processing have both been considered potential explanatory factors in Specific Language Impairment (SLI). Manipulations of the lexicality and phonotactic frequency of nonwords enable contrasting predictions to be derived from these hypotheses. Method: 18 typically developing (TD) children and 18 children with SLI completed an assessment battery that included tests of language ability, non-verbal intelligence, and two nonword repetition tests that varied in lexicality and frequency. Results: Repetition accuracy showed that children with SLI were unimpaired for short and simple high lexicality nonwords, whereas clear impairments were shown for all low lexicality nonwords. For low lexicality nonwords, greater repetition accuracy was seen for nonwords constructed from high over low frequency phoneme sequences. Children with SLI made the same proportion of errors that substituted a nonsense syllable for a lexical item as TD children, and this was stable across nonword length. Conclusions: The data show support for a phonological processing deficit in children with SLI, where long-term lexical and sub-lexical phonological knowledge mediate the interpretation of nonwords. However, the data also suggest that while phonological processing may provide a key explanation of SLI, a full account is likely to be multi-faceted