Speaker Independent Acoustic-to-Articulatory Inversion

Acoustic-to-articulatory inversion, the determination of articulatory parameters from acoustic signals, is a difficult but important problem for many speech processing applications, such as automatic speech recognition (ASR) and computer aided pronunciation training (CAPT). In recent years, several approaches have been successfully implemented for speaker dependent models with parallel acoustic and kinematic training data. However, in many practical applications inversion is needed for new speakers for whom no articulatory data is available. In order to address this problem, this dissertation introduces a novel speaker adaptation approach called Parallel Reference Speaker Weighting (PRSW), based on parallel acoustic and articulatory Hidden Markov Models (HMM). This approach uses a robust normalized articulatory space and palate referenced articulatory features combined with speaker-weighted adaptation to form an inversion mapping for new speakers that can accurately estimate articulatory trajectories. The proposed PRSW method is evaluated on the newly collected Marquette electromagnetic articulography - Mandarin Accented English (EMA-MAE) corpus using 20 native English speakers. Cross-speaker inversion results show that given a good selection of reference speakers with consistent acoustic and articulatory patterns, the PRSW approach gives good speaker independent inversion performance even without kinematic training data

Hearing Loss and the Voice

The voice varies according to the context of speech and to the physical and psychological conditions of the human being, and there is always a normal standard for the vocal output. Hearing loss can impair voce production, causing social, educational, and speech limitations, with specific deviation of the communication related to speech and voice. Usually, the voice is not the main focus of the speech-language pathology therapy with individuals with hearing loss, but its deviations can represent such a negative impact on this population that it can interfere on speech intelligibility and crucially compromise the social integration of the individual. The literature vastly explores acoustic and perceptual characteristics of children and adults with hearing loss. Voice problems in individuals with this impairment are directly related to its type and severity, age, gender, and type of hearing device used. While individuals with mild and moderate hearing loss can only present problems with resonance, severely impaired individuals may lack intensity and frequency control, among other alterations. The commonly found vocal deviations include strain, breathiness, roughness, monotone, absence of rhythm, unpleasant quality, hoarseness, vocal fatigue, high pitch, reduced volume, loudness with excessive variation, unbalanced resonance, altered breathing pattern, brusque vocal attack, and imprecise articulation. These characteristics are justified by the incapability of the deaf to control their vocal performance due to the lack of auditory monitoring of their own voice, caused by the hearing loss. Hence, the development of an intelligible speech with a good quality of voice on the hearing impaired is a challenge, despite the sophisticated technological advances of hearing aids, cochlear implants and other implantable devices. The purpose of this chapter is therefore to present an extensive review of the literature and describe our experience regarding the evaluation, diagnosis, and treatment of voice disorders in individuals with hearing loss

Detailed versus gross spectro-temporal cues for the perception of stop consonants

x+182hlm.;24c

Models and analysis of vocal emissions for biomedical applications

This book of Proceedings collects the papers presented at the 3rd International Workshop on Models and Analysis of Vocal Emissions for Biomedical Applications, MAVEBA 2003, held 10-12 December 2003, Firenze, Italy. The workshop is organised every two years, and aims to stimulate contacts between specialists active in research and industrial developments, in the area of voice analysis for biomedical applications. The scope of the Workshop includes all aspects of voice modelling and analysis, ranging from fundamental research to all kinds of biomedical applications and related established and advanced technologies