Using blind source separation techniques to improve speech recognition in bilateral cochlear implant patients

This is the published version, also available here: http://dx.doi.org/10.1121/1.2839887.Bilateral cochlear implants seek to restore the advantages of binaural hearing by improving access to binaural cues. Bilateral implant users are currently fitted with two processors, one in each ear, operating independent of one another. In this work, a different approach to bilateral processing is explored based on blind source separation (BSS) by utilizing two implants driven by a single processor. Sentences corrupted by interfering speech or speech-shaped noise are presented to bilateral cochlear implant users at 0dB signal-to-noise ratio in order to evaluate the performance of the proposed BSS method. Subjects are tested in both anechoic and reverberant settings, wherein the target and masker signals are spatially separated. Results indicate substantial improvements in performance in both anechoic and reverberant settings over the subjects’ daily strategies for both masker conditions and at various locations of the masker. It is speculated that such improvements are due to the fact that the proposed BSS algorithm capitalizes on the variations of interaural level differences and interaural time delays present in the mixtures of the signals received by the two microphones, and exploits that information to spatially separate the target from the masker signals

Using sentence context and mouth cues to aid speech comprehension: an electroencephalographic study on Cochlear Implant users

The research project presented in the thesis explores the electrophysiological correlates of linguistic prediction and audio-visual speech processing in deaf people with Cochlear Implant (CI) and people with normal hearing, in order to explore possible group differences. We implement an experimental paradigm in which participants observe audio-visual speech stimuli that vary for predictability of the last word of the sentence (i.e. the target) and visibility of mouth articulatory movements. During the procedure, we record the electroencephalographic signal (EEG) in order to compare the different experimental conditions in terms of neural oscillations and Event Related Potential (ERP) response to the target word. We also administrate linguistic tests to participants in order to relate behavioural performance to the electrophysiological results. The thesis presents a theoretical overview on prediction in language comprehension, the neural correlates of prediction and audio-visual speech integration and previous studies exploring these processes in CI users. Then, it presents the methods used in the experiment and preliminary data from a subgroup of participants with CI

Auf einem menschlichen Gehörmodell basierende Elektrodenstimulationsstrategie für Cochleaimplantate

Cochleaimplantate (CI), verbunden mit einer professionellen Rehabilitation, haben mehreren hunderttausenden Hörgeschädigten die verbale Kommunikation wieder ermöglicht. Betrachtet man jedoch die Rehabilitationserfolge, so haben CI-Systeme inzwischen ihre Grenzen erreicht. Die Tatsache, dass die meisten CI-Träger nicht in der Lage sind, Musik zu genießen oder einer Konversation in geräuschvoller Umgebung zu folgen, zeigt, dass es noch Raum für Verbesserungen gibt.Diese Dissertation stellt die neue CI-Signalverarbeitungsstrategie Stimulation based on Auditory Modeling (SAM) vor, die vollständig auf einem Computermodell des menschlichen peripheren Hörsystems beruht.Im Rahmen der vorliegenden Arbeit wurde die SAM Strategie dreifach evaluiert: mit vereinfachten Wahrnehmungsmodellen von CI-Nutzern, mit fünf CI-Nutzern, und mit 27 Normalhörenden mittels eines akustischen Modells der CI-Wahrnehmung. Die Evaluationsergebnisse wurden stets mit Ergebnissen, die durch die Verwendung der Advanced Combination Encoder (ACE) Strategie ermittelt wurden, verglichen. ACE stellt die zurzeit verbreitetste Strategie dar. Erste Simulationen zeigten, dass die Sprachverständlichkeit mit SAM genauso gut wie mit ACE ist. Weiterhin lieferte SAM genauere binaurale Merkmale, was potentiell zu einer Verbesserung der Schallquellenlokalisierungfähigkeit führen kann. Die Simulationen zeigten ebenfalls einen erhöhten Anteil an zeitlichen Pitchinformationen, welche von SAM bereitgestellt wurden. Die Ergebnisse der nachfolgenden Pilotstudie mit fünf CI-Nutzern zeigten mehrere Vorteile von SAM auf. Erstens war eine signifikante Verbesserung der Tonhöhenunterscheidung bei Sinustönen und gesungenen Vokalen zu erkennen. Zweitens bestätigten CI-Nutzer, die kontralateral mit einem Hörgerät versorgt waren, eine natürlicheren Klangeindruck. Als ein sehr bedeutender Vorteil stellte sich drittens heraus, dass sich alle Testpersonen in sehr kurzer Zeit (ca. 10 bis 30 Minuten) an SAM gewöhnen konnten. Dies ist besonders wichtig, da typischerweise Wochen oder Monate nötig sind. Tests mit Normalhörenden lieferten weitere Nachweise für die verbesserte Tonhöhenunterscheidung mit SAM.Obwohl SAM noch keine marktreife Alternative ist, versucht sie den Weg für zukünftige Strategien, die auf Gehörmodellen beruhen, zu ebnen und ist somit ein erfolgversprechender Kandidat für weitere Forschungsarbeiten.Cochlear implants (CIs) combined with professional rehabilitation have enabled several hundreds of thousands of hearing-impaired individuals to re-enter the world of verbal communication. Though very successful, current CI systems seem to have reached their peak potential. The fact that most recipients claim not to enjoy listening to music and are not capable of carrying on a conversation in noisy or reverberative environments shows that there is still room for improvement.This dissertation presents a new cochlear implant signal processing strategy called Stimulation based on Auditory Modeling (SAM), which is completely based on a computational model of the human peripheral auditory system.SAM has been evaluated through simplified models of CI listeners, with five cochlear implant users, and with 27 normal-hearing subjects using an acoustic model of CI perception. Results have always been compared to those acquired using Advanced Combination Encoder (ACE), which is today’s most prevalent CI strategy. First simulations showed that speech intelligibility of CI users fitted with SAM should be just as good as that of CI listeners fitted with ACE. Furthermore, it has been shown that SAM provides more accurate binaural cues, which can potentially enhance the sound source localization ability of bilaterally fitted implantees. Simulations have also revealed an increased amount of temporal pitch information provided by SAM. The subsequent pilot study, which ran smoothly, revealed several benefits of using SAM. First, there was a significant improvement in pitch discrimination of pure tones and sung vowels. Second, CI users fitted with a contralateral hearing aid reported a more natural sound of both speech and music. Third, all subjects were accustomed to SAM in a very short period of time (in the order of 10 to 30 minutes), which is particularly important given that a successful CI strategy change typically takes weeks to months. An additional test with 27 normal-hearing listeners using an acoustic model of CI perception delivered further evidence for improved pitch discrimination ability with SAM as compared to ACE.Although SAM is not yet a market-ready alternative, it strives to pave the way for future strategies based on auditory models and it is a promising candidate for further research and investigation

Language development after cochlear implantation: an epigenetic model

Growing evidence supports the notion that dynamic gene expression, subject to epigenetic control, organizes multiple influences to enable a child to learn to listen and to talk. Here, we review neurobiological and genetic influences on spoken language development in the context of results of a longitudinal trial of cochlear implantation of young children with severe to profound sensorineural hearing loss in the Childhood Development after Cochlear Implantation study. We specifically examine the results of cochlear implantation in participants who were congenitally deaf (N = 116). Prior to intervention, these participants were subject to naturally imposed constraints in sensory (acoustic–phonologic) inputs during critical phases of development when spoken language skills are typically achieved rapidly. Their candidacy for a cochlear implant was prompted by delays (n = 20) or an essential absence of spoken language acquisition (n = 96). Observations thus present an opportunity to evaluate the impact of factors that influence the emergence of spoken language, particularly in the context of hearing restoration in sensitive periods for language acquisition. Outcomes demonstrate considerable variation in spoken language learning, although significant advantages exist for the congenitally deaf children implanted prior to 18 months of age. While age at implantation carries high predictive value in forecasting performance on measures of spoken language, several factors show significant association, particularly those related to parent–child interactions. Importantly, the significance of environmental variables in their predictive value for language development varies with age at implantation. These observations are considered in the context of an epigenetic model in which dynamic genomic expression can modulate aspects of auditory learning, offering insights into factors that can influence a child’s acquisition of spoken language after cochlear implantation. Increased understanding of these interactions could lead to targeted interventions that interact with the epigenome to influence language outcomes with intervention, particularly in periods in which development is subject to time-sensitive experience

Rural Cochlear Implant Services: Reflections From Parents and (Re)Habilitation Professionals

Austin, Natalie J. Rural cochlear implant services: Reflections from parents and (re)habilitation professionals. Published Doctor of Philosophy dissertation, University of Northern Colorado, 2020. The idea of what “rural” means and the influence of this setting is very complex. The impact on the resources and services available to the family, school district, and community goes beyond geographic barriers. Despite there being known problems with service provision for children with hearing loss in rural areas, little is being done to improve the support offered to families and professionals working to meet the needs of children who have cochlear implants. The purpose of this phenomenological qualitative study was to take a deeper and more intimate look at service provision for children with cochlear implants in rural areas from the perspective of parents and the professionals who serve them. Seven parents and seven professionals were interviewed about their experiences. Open-ended interview questions were asked with the goal of identifying themes around the overall impact, challenges, and systems of support related to living and working outside of a city center with children who have cochlear implants. Findings related to the overall experiences of living and working in a rural setting were discussed in terms of the simplicity of rural life, benefits of small class sizes, the added commitment for parents, the importance of family involvement, and the need to be creative to meet students’ unique needs. When looking at the challenges with rural services, issues surrounding logistics, parent motivation, local resources, school support, and local teams were highlighted as causes of difficulty. There were many sources of support discussed including positive opportunities for family advocacy, school services, local professionals, outside support services, and the enhancement of peer connections. Due to the paucity of research on service improvement for children with cochlear implants in rural settings, this study will contribute to the body of inquiry on this topic and in turn highlight meaningful implications for the field. Participants in this study were from rural counties within one midwestern state. Future studies would benefit from looking at participants from a range of rural locations throughout the country. Keywords: cochlear implants, rural, deaf, hard-of-hearing, habilitation, rehabilitation, multidisciplinary tea