Numerical Study of Laryngeal Control of Phonation using Realistic Finite Element Models of a Canine Larynx

While many may take it for granted, the human voice is an incredible feat. An average person can produce a great variety of voices and change voice characteristics agilely even without formal training. Last several decades of research has established that the production of voice is largely a mechanical process: i.e., the sustained vibration of the vocal folds driven by the glottal air flow. Since one only has a single pair of vocal folds, the versatility comes with the ability to change the mechanical status of the vocal folds, including vocal fold length and thickness, tension, and level of adduction, through activation of the laryngeal muscles. However, the relationship between laryngeal muscle activity and the characteristics of voice is not well understood due to limitations in experimental observation and simplifications in modelling and simulations. The science is still far behind the art. The current research aims to investigate first the relationship between laryngeal muscle activation and the posture of the vocal folds and second the relationship between voice source characteristics and vocal fold mechanical status using more comprehensive numerical models and simulations, thus improving the understanding of the roles of each laryngeal muscle in voice control. To do so, (1) the mechanics involved in vocal fold posturing and vibration, especially muscle contraction; (2) the realistic anatomical structure of the larynx must be considered properly. To achieve this goal, a numerical model of the larynx as realistic as possible was built. The geometry of the laryngeal components was reconstructed from high resolution MRI (Magnetic Resonance Imaging) data of an excised canine larynx, which makes more accurate the representation of the muscles and their sub-compartments, cartilages, and other important anatomical features of the larynx. A previously proposed muscle activation model was implemented in a 3D finite element package and applied to the larynx model to simulate the action of laryngeal muscles. After validation of the numerical model against experimental data, extensive parametric studies involving different combination of muscle activations were conducted to investigate how the voice source is controlled with laryngeal muscles. In the course of this study, some work was done to couple the same finite element tool with a Genetic Algorithm program to inversely determine model parameters in biomechanical models. The method was applied in a collaborated study on shape changes of a fish fin during swimming. This study is presented as a separate chapter at the end of this thesis. The method has potential application in determining parameters in vocal fold models and optimizing clinical vocal fold procedures. This thesis is essentially an assembly of the papers published by the author during the doctoral study, with the addition of an introductory chapter. Chapter 1 reviews the overall principles of voice production, the biomechanical basis of voice control, and past studies on voice control with a focus on the fundamental frequency. Chapter 2 describes the major numerical methods employed in this research with an emphasis on the finite element method. The muscle activation model is also described in this chapter. Chapter 3 describes the building of the larynx model from MRI data and its partial validation. Chapter 4 presents the application of the larynx model to posturing studies, including parametric activation of muscle groups and specific topics related to vocal fold posturing. Chapter 5 describes the change of vocal fold vibration dynamics under the influence of the interaction of the cricothyroid muscle and the thyroarytenoid muscle. The Flow-structure interaction simulations was realized by coupling the larynx model to a simple Bernoulli flow model and a two-stage simulation technique. Chapter 6 concludes the current thesis study. Suggestions for future studies are proposed. Chapter 7 is an independent study that is not related to voice control. It describes a numerical framework that inversely determines and validates model parameters of biomechanical models. The application of the proposed framework to a finite element model of a fish fin is presented

High Fidelity Computational Modeling and Analysis of Voice Production

This research aims to improve the fundamental understanding of the multiphysics nature of voice production, particularly, the dynamic couplings among glottal flow, vocal fold vibration and airway acoustics through high-fidelity computational modeling and simulations. Built upon in-house numerical solvers, including an immersed-boundary-method based incompressible flow solver, a finite element method based solid mechanics solver and a hydrodynamic/aerodynamic splitting method based acoustics solver, a fully coupled, continuum mechanics based fluid-structure-acoustics interaction model was developed to simulate the flow-induced vocal fold vibrations and sound production in birds and mammals. Extensive validations of the model were conducted by comparing to excised syringeal and laryngeal experiments. The results showed that, driven by realistic representations of physiology and experimental conditions, including the geometries, material properties and boundary conditions, the model had an excellent agreement with the experiments on the vocal fold vibration patterns, acoustics and intraglottal flow dynamics, demonstrating that the model is able to reproduce realistic phonatory dynamics during voice production. The model was then utilized to investigate the effect of vocal fold inner structures on voice production. Assuming the human vocal fold to be a three-layer structure, this research focused on the effect of longitudinal variation of layer thickness as well as the cover-body thickness ratio on vocal fold vibrations. The results showed that the longitudinal variation of the cover and ligament layers thicknesses had little effect on the flow rate, vocal fold vibration amplitude and pattern but affected the glottal angle in different coronal planes, which also influenced the energy transfer between glottal flow and the vocal fold. The cover-body thickness ratio had a complex nonlinear effect on the vocal fold vibration and voice production. Increasing the cover-body thickness ratio promoted the excitation of the wave-type modes of the vocal fold, which were also higher-eigenfrequency modes, driving the vibrations to higher frequencies. This has created complex nonlinear bifurcations. The results from the research has important clinical implications on voice disorder diagnosis and treatment as voice disorders are often associated with mechanical status changes of the vocal fold tissues and their treatment often focus on restoring the mechanical status of the vocal folds

Models and Analysis of Vocal Emissions for Biomedical Applications

The Models and Analysis of Vocal Emissions with Biomedical Applications (MAVEBA) workshop came into being in 1999 from the particularly felt need of sharing know-how, objectives and results between areas that until then seemed quite distinct such as bioengineering, medicine and singing. MAVEBA deals with all aspects concerning the study of the human voice with applications ranging from the neonate to the adult and elderly. Over the years the initial issues have grown and spread also in other aspects of research such as occupational voice disorders, neurology, rehabilitation, image and video analysis. MAVEBA takes place every two years always in Firenze, Italy

Compensatory Vocal Folds for Source Voice Generation: Computational Modeling of Vocal Folds Function

Práce se zabývá výpočtovým modelováním funkce lidských hlasivek a vokálního traktu s využitím metody konečných prvků (MKP). Hlas hraje klíčovou roli v lidské komunikaci. Proto je jedním z důležitých cílů současné medicíny vytvořit umělé hlasivky, které by mohly být implantovány pacientům, kterým musely být odstraněny jejich hlasivky původní. Pro pochopení principů tvorby hlasu, určení parametrů, které musí umělé hlasivky splňovat a ověření jejich funkčnosti je možno využít výpočtového modelování. První část práce se zabývá výpočtovým modelováním pro tvorbu lidského hlasu šeptem. V této kapitole byl na MKP modelu vokálního traktu a průdušnice zkoumán vliv velikosti mezihlasivkové mezery na rozložení vlastních frekvencí pro jednotlivé samohlásky. Dále je v práci prezentován rovinný (2D) konečnoprvkový model samobuzeného kmitání lidských hlasivek v interakci s akustickými prostory vokálního traktu. Rovinný model vokálního traktu byl vytvořen na základě snímků z magnetické rezonance (MRI). Pro řešení interakce mezi strukturou a tekutinou je použito explicitní výpočtové schéma s oddělenými řešiči pro strukturu a pro proudění. Vytvořený výpočtový model zahrnuje: velké deformace tkáně hlasivek, kontakt mezi hlasivkami, interakci mezi strukturou a tekutinou, morfování sítě vzduchu podle pohybu hlasivek (metoda Arbitrary Lagrangian-Eulerian), neustálené viskózní a stlačitelné nebo nestlačitelné proudění popsané pomocí Navier-Stokesových rovnic a přerušování proudu vzduchu během uzavření hlasivek. Na tomto modelu jsou zkoumány projevy změn tuhosti a tlumení jednotlivých vrstev (zejména pak laminy proprii). Součástí této výpočtové analýzy je také porovnání chování hlasivek pro stlačitelný a nestlačitelný model proudění. Ze získaných výsledků výpočtu MKP modelu jsou následně vytvářeny videokymogramy (VKG), které umožňují porovnat pohyb mezi jednotlivými variantami modelu a se skutečnými lidskými hlasivkami. V další části práce je potom prezentován prostorový (3D) MKP model samobuzeného kmitání lidských hlasivek. Tento prostorový model vznikl z předchozího rovinného modelu vytažením do třetího rozměru. Na tomto modelu byl opět porovnáván vliv použití stlačitelného a nestlačitelného modelu proudění na pohyb hlasivek a vytvářený zvuk s využitím videokymogramů a zvukových spekter. Poslední část práce se zabývá jednou z možností náhrady přirozeného zdrojového hlasu v podobě plátkového elementu. Chování plátkového elementu bylo zkoumáno na výpočtovém a experimentálním modelu. Experimentální model umožňuje změny v nastavení vzájemné polohy plátku vůči dorazu a provádění akustických a optických měření.This doctoral thesis focuses on computational modelling of human vocal folds and vocal tract functions using finite element method (FEM). Human voice is crucial in human communication. Therefore one of the main targets of current medicine is creation of artificial vocal folds, which would substitute the original vocal folds. The computational modelling can be used to understand principles of voice production, determination of parameters that the artificial vocal folds have to meet and verification of their functionality. First part of this thesis focuses on modelling of human voice creation by whisper. Influence of intraglottal gap on eigenvalues distribution for individual vowels was analysed using FEM vocal tract and trachea model. Further there is presented two-dimensional (2D) finite element model of the flow-induced self-oscillation of the human vocal folds in interaction with acoustic spaces of the vocal tract. The 2D vocal tract model was created on the basis of converting the data from magnetic resonance images (MRI). Explicit coupling scheme with separated solvers for structure and fluid domain was used for modelling of the fluid-structure interaction. Created computational model comprises: large deformations of the vocal folds tissue, contact between vocal folds, fluid-structure interaction, morphing the fluid mesh according to the vocal-fold motion (Arbitrary Lagrangian-Eulerian approach), unsteady viscous compressible or incompressible airflow described by the Navier-Stokes equations and airflow separation during glottis closure. This model is used to analyse the influence of stiffness and damping changes in individual vocal fold tissue layers (in particular in superficial lamina propria). Part of this computational analysis is also comparison of vocal folds behaviour for compressible and incompressible flow model. Videokymograms (VKG) are subsequently created from obtained results of FEM calculations which enable to compare individual variants between themselves and with motion of real human vocal folds. In next part of this thesis is presented three-dimensional (3D) finite element model of the flow-induced self-oscillation of the human vocal folds. This 3D model was created from a previous 2D model by extrude to the third direction. Using this model was again compared influence of compressible and incompressible flow model on vocal folds motion and generated sound by using videokymograms and acoustic spectra. The last part of this thesis focuses on the possibility to replace missing natural source voice in form reed-based element. Behaviour of reed-based element was analysed using computational modelling and using measurements on experimental physical model. The physical model enables changes in setting gap between reed and reed stop and performing acoustical and optical measurements.

The quantal larynx: The stable regions of laryngeal biomechanics and implications for speech production

Purpose: Recent proposals suggest that (a) the high dimensionality of speech motor control may be reduced via modular neuromuscular organization that takes advantage of intrinsic biomechanical regions of stability and (b) computational modeling provides a means to study whether and how such modularization works. In this study, the focus is on the larynx, a structure that is fundamental to speech production because of its role in phonation and numerous articulatory functions. Method: A 3-dimensional model of the larynx was created using the ArtiSynth platform (http://www.artisynth.org). This model was used to simulate laryngeal articulatory states, including inspiration, glottal fricative, modal prephonation, plain glottal stop, vocal–ventricular stop, and aryepiglotto– epiglottal stop and fricative. Results: Speech-relevant laryngeal biomechanics is rich with “quantal” or highly stable regions within muscle activation space. Conclusions: Quantal laryngeal biomechanics complement a modular view of speech control and have implications for the articulatory–biomechanical grounding of numerous phonetic and phonological phenomen

Modeling biomechanical influence of epilaryngeal stricture on the vocal folds: A low-dimensional model of vocal-ventricular coupling

Purpose: Physiological and phonetic studies suggest that, at moderate levels of epilaryngeal stricture, the ventricular folds impinge upon the vocal folds and influence their dynamical behavior, which is thought to be responsible for constricted laryngeal sounds. In this work, the authors examine this hypothesis through biomechanical modeling. Method: The dynamical response of a low-dimensional, lumped-element model of the vocal folds under the influence of vocal-ventricular fold coupling was evaluated. The model was assessed for F0 and cover-mass phase difference. Case studies of simulations of different constricted phonation types and of glottal stop illustrate various additional aspects of model performance. Results: Simulated vocal-ventricular fold coupling lowers F0 and perturbs the mucosal wave. It also appears to reinforce irregular patterns of oscillation, and it can enhance laryngeal closure in glottal stop production. Conclusion: The effects of simulated vocal-ventricular fold coupling are consistent with sounds, such as creaky voice, harsh voice, and glottal stop, that have been observed to involve epilaryngeal stricture and apparent contact between the vocal folds and ventricular folds. This supports the view that vocal-ventricular fold coupling is important in the vibratory dynamics of such sounds and, furthermore, suggests that these sounds may intrinsically require epilaryngeal strictur

The influence of penalization inlet boundary condition on the stability boundary

Grant No. GA19-04477S of Czech Science Foundation and by Grant No. SGS19/154/OHK2/3T/12 of the CTU in Pragu