Influence of TTS systems performance on reaction times in people with aphasia

Text-to-speech (TTS) systems provide fundamental reading support for people with aphasia and reading difficulties. However, artificial voices are more difficult to process than natural voices. The current study is an extended analysis of the results of a clinical experiment investigating which, among three artificial voices and a digitised human voice, is more suitable for people with aphasia and reading impairments. Such results show that the voice synthesised with Ogmios TTS, a concatenative speech synthesis system, caused significantly slower reaction times than the other three voices used in the experiment. The present study explores whether and what voice quality metrics are linked to delayed reaction times. For this purpose, the voices were analysed using an automatic assessment of intelligibility, naturalness, and jitter and shimmer voice quality parameters. This analysis revealed that Ogmios TTS, in general, performed worse than the other voices in all parameters. These observations could explain the significantly delayed reaction times in people with aphasia and reading impairments when listening to Ogmios TTS and could open up consideration about which TTS to choose for compensative devices for these patients based on the voice analysis of these parameters

Use of an integrated multimodal communication treatment with individuals with severe traumatic brain injury

People affected by severe traumatic brain injury (TBI) often live with co-occurring speech and language deficits, including apraxia of speech and dysarthria. Using augmentative and alternative communication (AAC) strategies (e.g., gesturing, writing, speech generating devices and applications) to communicate can help people with TBI compensate for deficits. The most effective method to teach people with TBI to use multiple strategies in resolving communication breakdowns has not been determined. However, recent research suggests the most effective method for teaching with people with aphasia to use AAC strategies to resolve communication breakdowns is an integrated multimodal treatment approach. This study used a multiple baseline, single participant design with 2 participants to measure the outcomes of an integrated multimodal treatment approach implemented with people with severe TBI. Therefore, the purpose of this study was to measure the effectiveness of a multimodal treatment designed to increase communication breakdown resolution and use of alternative communication modalities by individuals with severe TBI. The study included a total of 27 sessions comprised of 4 pretreatment sessions, 20 treatment sessions, and 3 post-treatment sessions. The dependent variables included the total number of modalities produced in a modality probe task and three measures of communication breakdown resolution during a structured, functional task. The results of the study will lead to future research to improve communication treatment for people with TBI. After implementation of the multimodal treatment, both participants increased the number of modalities they produced during the modality probe. However, these changes only resulted in small or absent effects in communication breakdown resolution variables. Visual analysis suggests that the absence of significant effects may relate to the variability in the participants’ performance and some potential gains were noted. Future research should examine use of external aids and cognitive profiles in relation to modality use and success of communicative repair for people with severe TBI

Visuomotor Tracking Abilities of Speakers with Apraxia of Speech or Conduction Aphasia

This investigation examined the visuomotor tracking abilities of persons with apraxia of speech (AOS) or conduction aphasia (CA). In addition, tracking performance was correlated with perceptual judgments of speech accuracy. Five individuals with AOS and four with CA served as participants, as well as an equal number of healthy controls matched by age and gender. Participants tracked predictable (sinusoidal) and unpredictable signals using jaw and lip movements transduced with strain gauges. Tracking performance in participants with AOS was poorest for predictable signals, with decreased kinematic measures of cross-correlation and gain ratio and increased target-tracker difference. In contrast, tracking of the unpredictable signal by participants with AOS was performed as well as for other groups (e.g. participants with CA, healthy controls). Performance of the subjects with AOS on the predictable tracking task was found to strongly correlate with perceptual judgments of speech. These findings suggest that motor control capabilities are impaired in AOS, but not in CA. Results suggest that AOS has its basis in motor programming deficits, not impaired motor execution

Computational Approaches to Modeling Speaker State in the Medical Domain

Recently, researchers in computer science and engineering have begun to explore the possibility of finding speech-based correlates of various medical conditions using automatic, computational methods. If such language cues can be identified and quantified automatically, this information can be used to support diagnosis and treatment of medical conditions in clinical settings and to further fundamental research in understanding cognition. This chapter reviews computational approaches that explore communicative patterns of patients who suffer from medical conditions such as depression, autism spectrum disorders, schizophrenia, and cancer. There are two main approaches discussed: research that explores features extracted from the acoustic signal and research that focuses on lexical and semantic features. We also present some applied research that uses computational methods to develop assistive technologies. In the final sections we discuss issues related to and the future of this emerging field of research

Cross-linguistic study of vocal pathology: perceptual features of spasmodic dysphonia in French-speaking subjects

Clinical characterisation of Spasmodic Dysphonia of the adductor type (SD) in French speakers by Klap and colleagues (1993) appears to differ from that of SD in English. This perceptual analysis aims to describe the phonetic features of French SD. A video of 6 French speakers with SD supplied by Klap and colleagues was analysed for frequency of phonatory breaks, pitch breaks, harshness, creak, breathiness and falsetto voice, rate of production, and quantity of speech output. In contrast to English SD, the French speaking SD patients demonstrated no evidence pitch breaks, but phonatory breaks, harshness and breathiness were prominent features. This verifies the French authors’ (1993) clinical description. These findings suggest that phonetic properties of a specific language may affect the manifestation of pathology in neurogenic voice disorders

Towards Automatic Speech-Language Assessment for Aphasia Rehabilitation

Speech-based technology has the potential to reinforce traditional aphasia therapy through the development of automatic speech-language assessment systems. Such systems can provide clinicians with supplementary information to assist with progress monitoring and treatment planning, and can provide support for on-demand auxiliary treatment. However, current technology cannot support this type of application due to the difficulties associated with aphasic speech processing. The focus of this dissertation is on the development of computational methods that can accurately assess aphasic speech across a range of clinically-relevant dimensions. The first part of the dissertation focuses on novel techniques for assessing aphasic speech intelligibility in constrained contexts. The second part investigates acoustic modeling methods that lead to significant improvement in aphasic speech recognition and allow the system to work with unconstrained speech samples. The final part demonstrates the efficacy of speech recognition-based analysis in automatic paraphasia detection, extraction of clinically-motivated quantitative measures, and estimation of aphasia severity. The methods and results presented in this work will enable robust technologies for accurately recognizing and assessing aphasic speech, and will provide insights into the link between computational methods and clinical understanding of aphasia.PHDComputer Science & EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/140840/1/ducle_1.pd

The Intensive Cognitive-Communication Rehabilitation Program for young adults with acquired brain injury

PURPOSE: This study investigated the effects of an intensive cognitive-communication rehabilitation (ICCR) program for young individuals with chronic acquired brain injury. METHOD: ICCR included classroom lectures; metacognitive instruction, modeling, and application; technology skills training; and individual cognitive-linguistic therapy. Four individuals participated in the intensive program (6 hr with 1-hr lunch break × 4 days × 12 weeks of treatment): 3 participants completed 3 consecutive semesters, and 1 participant completed 1 semester. Two controls did not receive treatment and completed assessments before and after the 12-week treatment interval only. RESULTS: All 4 experimental participants demonstrated significant improvements on at least 1 standardized cognitive-linguistic measure, whereas controls did not. Furthermore, time point significantly predicted participants' scores on 2 of the 4 standardized outcome measures, indicating that as duration in ICCR increased, scores also increased. Participants who completed multiple semesters of ICCR also improved in their therapy and personal goals, classroom behavior, life participation, and quality of life. CONCLUSION: After ICCR, participants showed gains in their cognitive-linguistic functioning, classroom participation, and individual therapy. They also demonstrated improvements outside the classroom and in their overall well-being. There is a gap between the large population of young adults with acquired brain injury who wish to return to higher education and a lack of rehabilitation programs supporting reentry into academic environments; ICCR is a first step in reducing that gap.T32 DC013017 - NIDCD NIH HHSAccepted manuscrip