Comparing articulatory images: An MRI / Ultrasound Tongue Image database

Abstract

This work was supported by an EPSRC grant (EP/I027696/1). Thanks to our ULTRAX project colleagues Steve Renals and Korin Richmond. Scott Semple is supported by the British Heart Foundation Centre of Research Excellence Award. Thanks to Steve Cowen for technical assistance and Annette Cooper for MRI data acquisition.We report the development of a database that will contain paired ultrasound and MRI of tongue movements and shapes from 12 adults, illustrated with pilot data from one speaker. The primary purpose of the database will be to evaluate the informational content of ultrasound tongue images on the basis of the richer articulatory structures visible with MRI, and to provide tongue shape information that can later be incorporated into an image processing algorithm to enhance ultrasound tongue images. Ultrasound is an increasingly popular technique for studying speech production since it provides a real-time image of tongue movements. Its potential as a visualfeedback speech therapy tool has been recognised but has not yet been exploited to any great extent. In part this is because obstruents like /t/ /k/ /ch/,which are important targets for therapy, have tongue shapes in both canonical and common error productions which ultrasound displays rather poorly compared to the more easily-imaged vowels, glides and liquids. By enhancing ultrasound images in real time with information based on our corpus, we aim to create images which we hypothesise will A) be more easily understood by children for clinical feedback B) extend the range and utility of ultrasound generally.caslUltraxArticulate Instruments Ltd. Articulate Assistant Advanced Ultrasound Module User Manual, Revision 2.12, [manual]. Author, Edinburgh, 2010. Bernhardt, B., Gick, B., Bacsfalvi, P., and Adler-Bock, M. Ultrasound in speech therapy with adolescents and adults. Clinical Linguistics & Phonetics, 19: 605-617, 2005. Engwall, O. Assessing Magnetic Resonance Imaging Measurements: Effects of Sustenation, Gravitation, and Coarticulation. In: Harrington, J., Tabain, M., editors, Speech Production: Models, Phonetic Processes, and Techniques. Hove: Psychology Press, 301-314, 2006. ICPLA (International Clinical Phonetics and Linguistics Association). ExtIPA Symbols for Disordered Speech, 2002. IPA (The International Phonetic Association). The International Phonetic Alphabet, 2005. Michi K-I, Yamashita Y, Imai S, Suzuki N and Yoshida H. Role of visual feedback treatment for defective /s/ sounds in patients with cleft palate. Journal of Speech and Hearing Research, 36: 277-285, 1993. Lee, J. and Stone, M. Overlaying Ultrasound to MRI Sequences. Paper presented at Ultrafest V (March, 2010) retrieved May 19th, 2011 from http://www.haskins.yale.edu/conferences/UltrafestV/abstracts.html Scobbie, J.M., Lawson, E., Cowen, S. Cleland, J. and Wrench, A.A. A common coordinate system for mid-sagittal articulatory measurement. Proceedings of Interspeech, Florence, 2011in press. Stone, M. A Guide to Analysing Tongue Motion from Ultrasound Images. Clinical Linguistics and Phonetics, 19: 455-501, 2005. Wrench, A.A., Cleland, J. and Scobbie, J.M. An Ultrasound Protocol for Comparing Tongue Contours: Upright vs. Supine. Proceedings ofpub2477pu

    Similar works