Behavioral, computational, and neuroimaging studies of acquired apraxia of speech

A critical examination of speech motor control depends on an in-depth understanding of network connectivity associated with Brodmann areas 44 and 45 and surrounding cortices. Damage to these areas has been associated with two conditions-the speech motor programming disorder apraxia of speech (AOS) and the linguistic/grammatical disorder of Broca's aphasia. Here we focus on AOS, which is most commonly associated with damage to posterior Broca's area (BA) and adjacent cortex. We provide an overview of our own studies into the nature of AOS, including behavioral and neuroimaging methods, to explore components of the speech motor network that are associated with normal and disordered speech motor programming in AOS. Behavioral, neuroimaging, and computational modeling studies are indicating that AOS is associated with impairment in learning feedforward models and/or implementing feedback mechanisms and with the functional contribution of BA6. While functional connectivity methods are not yet routinely applied to the study of AOS, we highlight the need for focusing on the functional impact of localized lesions throughout the speech network, as well as larger scale comparative studies to distinguish the unique behavioral and neurological signature of AOS. By coupling these methods with neural network models, we have a powerful set of tools to improve our understanding of the neural mechanisms that underlie AOS, and speech production generally

Phylogenetic and Kinematic Constraints of the Vocal-flight–respiratory Axis

The Motor Theory for Vocal Learning Origin posits that vocal imitation, the substrate for human speech, is a specialization of an ancestral neural pathway in the forebrain that controls locomotor activities. Birds have been the main model for understanding the biology of human speech, however, evolutionary explanations remain contentious and the Motor Theory has not been tested using phylogenetic comparative analysis, a cornerstone of evolutionary biology.Texas Advanced Computing Center (TACC

Voice Analysis to Differentiate the Dopaminergic Response in People With Parkinson's Disease

Humans' voice offers the widest variety of motor phenomena of any human activity. However, its clinical evaluation in people with movement disorders such as Parkinson's disease (PD) lags behind current knowledge on advanced analytical automatic speech processing methodology. Here, we use deep learning-based speech processing to differentially analyze voice recordings in 14 people with PD before and after dopaminergic medication using personalized Convolutional Recurrent Neural Networks (p-CRNN) and Phone Attribute Codebooks (PAC). p-CRNN yields an accuracy of 82.35% in the binary classification of ON and OFF motor states at a sensitivity/specificity of 0.86/0.78. The PAC-based approach's accuracy was slightly lower with 73.08% at a sensitivity/specificity of 0.69/0.77, but this method offers easier interpretation and understanding of the computational biomarkers. Both p-CRNN and PAC provide a differentiated view and novel insights into the distinctive components of the speech of persons with PD. Both methods detect voice qualities that are amenable to dopaminergic treatment, including active phonetic and prosodic features. Our findings may pave the way for quantitative measurements of speech in persons with PD

How can animal studies help to uncover the roles of genes implicated in human speech and language disorders?

The mysterious human propensity for acquiring speech and language has fascinated scientists for decades. A substantial body of evidence suggests that this capacity is rooted in aspects of neurodevelopment that are specified at the genomic level. Researchers have begun to identify genetic factors that increase susceptibility to developmental disorders of speech and language, thereby offering the first molecular entry points into neuronal mechanisms underlying human vocal communication. The identification of genetic variants influencing language acquisition facilitates the analysis of animal models in which the corresponding orthologs are disrupted. At face value, the situation raises aperplexing question: if speech and language are uniquely human, can any relevant insights be gained from investigations of gene function in other species? This chapter addresses the question using the example of FOXP2, a gene implicated in a severe monogenic speech and language disorder. FOXP2 encodes a transcription factor that is highly conserved in vertebrate species, both in terms of protein sequence and expression patterns. Current data suggest that an earlier version of this gene, present in the common ancestor of humans, rodents, and birds, was already involved in establishing neuronal circuits underlying sensory-motor integration and learning of complex motor sequences. This may have represented one of the factors providing a permissive neural environment for subsequent evolution of vocal learning. Thus, dissection of neuromolecular pathways regulated by Foxp2 in nonlinguistic species is a necessary prerequisite for understanding the role of the human version of the gene in speech and language

Neural Plasticity of Language Systems: evidence from fMRI experiments with adult language learners

216 p.Functional specialisation and plasticity are fundamental organising principles of the brain. Language is a uniquely human phenomenon that requires a delicate balance between neural specialisation and plasticity, and language learning offers the perfect window to study these principles in the human brain. Though the human brain exhibits a remarkable ability to support a variety of languages that may be acquired at different points in the life span, the capacity for neural reorganisation decreases with age. Further, language is a complex construct involving linguistic as well as visual, auditory, and motor processes. The current doctoral thesis asked two main questions: (1) Do large-scale functional changes accompany language learning in adulthood? and (2) Are these neural changes similar across different language systems such as reading, speech comprehension, and verbal production? These questions were investigated in three fMRI experiments with adult language learners. In Experiments I and II, comprehension and production were examined in 30-to-60-year-old intermediate and advanced language learners and functional learning-related changes in each modality were comprehensively characterised. In Experiment III, hemispheric lateralisation of reading, speech comprehension, and verbal production were compared and contrasted, and the analyses were extended to a second longitudinal study with a contrasting participant sample. Robust evidence was found for significant functional plasticity well into adulthood, and results showed that different language systems exhibited different patterns of hemispheric specialisation and plasticity. The results have theoretical and practical implications for our understanding of fundamental principles of neural organisation of language, language learning in healthy populations, and language testing and recovery in patients

Symbol Emergence in Robotics: A Survey

Humans can learn the use of language through physical interaction with their environment and semiotic communication with other people. It is very important to obtain a computational understanding of how humans can form a symbol system and obtain semiotic skills through their autonomous mental development. Recently, many studies have been conducted on the construction of robotic systems and machine-learning methods that can learn the use of language through embodied multimodal interaction with their environment and other systems. Understanding human social interactions and developing a robot that can smoothly communicate with human users in the long term, requires an understanding of the dynamics of symbol systems and is crucially important. The embodied cognition and social interaction of participants gradually change a symbol system in a constructive manner. In this paper, we introduce a field of research called symbol emergence in robotics (SER). SER is a constructive approach towards an emergent symbol system. The emergent symbol system is socially self-organized through both semiotic communications and physical interactions with autonomous cognitive developmental agents, i.e., humans and developmental robots. Specifically, we describe some state-of-art research topics concerning SER, e.g., multimodal categorization, word discovery, and a double articulation analysis, that enable a robot to obtain words and their embodied meanings from raw sensory--motor information, including visual information, haptic information, auditory information, and acoustic speech signals, in a totally unsupervised manner. Finally, we suggest future directions of research in SER.Comment: submitted to Advanced Robotic

Integration of Action and Language Knowledge: A Roadmap for Developmental Robotics

“This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder." “Copyright IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.”This position paper proposes that the study of embodied cognitive agents, such as humanoid robots, can advance our understanding of the cognitive development of complex sensorimotor, linguistic, and social learning skills. This in turn will benefit the design of cognitive robots capable of learning to handle and manipulate objects and tools autonomously, to cooperate and communicate with other robots and humans, and to adapt their abilities to changing internal, environmental, and social conditions. Four key areas of research challenges are discussed, specifically for the issues related to the understanding of: 1) how agents learn and represent compositional actions; 2) how agents learn and represent compositional lexica; 3) the dynamics of social interaction and learning; and 4) how compositional action and language representations are integrated to bootstrap the cognitive system. The review of specific issues and progress in these areas is then translated into a practical roadmap based on a series of milestones. These milestones provide a possible set of cognitive robotics goals and test scenarios, thus acting as a research roadmap for future work on cognitive developmental robotics.Peer reviewe

Involvement of the cortico-basal ganglia-thalamocortical loop in developmental stuttering

Stuttering is a complex neurodevelopmental disorder that has to date eluded a clear explication of its pathophysiological bases. In this review, we utilize the Directions Into Velocities of Articulators (DIVA) neurocomputational modeling framework to mechanistically interpret relevant findings from the behavioral and neurological literatures on stuttering. Within this theoretical framework, we propose that the primary impairment underlying stuttering behavior is malfunction in the cortico-basal ganglia-thalamocortical (hereafter, cortico-BG) loop that is responsible for initiating speech motor programs. This theoretical perspective predicts three possible loci of impaired neural processing within the cortico-BG loop that could lead to stuttering behaviors: impairment within the basal ganglia proper; impairment of axonal projections between cerebral cortex, basal ganglia, and thalamus; and impairment in cortical processing. These theoretical perspectives are presented in detail, followed by a review of empirical data that make reference to these three possibilities. We also highlight any differences that are present in the literature based on examining adults versus children, which give important insights into potential core deficits associated with stuttering versus compensatory changes that occur in the brain as a result of having stuttered for many years in the case of adults who stutter. We conclude with outstanding questions in the field and promising areas for future studies that have the potential to further advance mechanistic understanding of neural deficits underlying persistent developmental stuttering.R01 DC007683 - NIDCD NIH HHS; R01 DC011277 - NIDCD NIH HHSPublished versio

Neuroplasticity of language networks in aphasia: advances, updates, and future challenges

Researchers have sought to understand how language is processed in the brain, how brain damage affects language abilities, and what can be expected during the recovery period since the early 19th century. In this review, we first discuss mechanisms of damage and plasticity in the post-stroke brain, both in the acute and the chronic phase of recovery. We then review factors that are associated with recovery. First, we review organism intrinsic variables such as age, lesion volume and location and structural integrity that influence language recovery. Next, we review organism extrinsic factors such as treatment that influence language recovery. Here, we discuss recent advances in our understanding of language recovery and highlight recent work that emphasizes a network perspective of language recovery. Finally, we propose our interpretation of the principles of neuroplasticity, originally proposed by Kleim and Jones (1) in the context of extant literature in aphasia recovery and rehabilitation. Ultimately, we encourage researchers to propose sophisticated intervention studies that bring us closer to the goal of providing precision treatment for patients with aphasia and a better understanding of the neural mechanisms that underlie successful neuroplasticity.P50 DC012283 - NIDCD NIH HHSPublished versio