Deep learning-based denoising streamed from mobile phones improves speech-in-noise understanding for hearing aid users

The hearing loss of almost half a billion people is commonly treated with hearing aids. However, current hearing aids often do not work well in real-world noisy environments. We present a deep learning based denoising system that runs in real time on iPhone 7 and Samsung Galaxy S10 (25ms algorithmic latency). The denoised audio is streamed to the hearing aid, resulting in a total delay of around 75ms. In tests with hearing aid users having moderate to severe hearing loss, our denoising system improves audio across three tests: 1) listening for subjective audio ratings, 2) listening for objective speech intelligibility, and 3) live conversations in a noisy environment for subjective ratings. Subjective ratings increase by more than 40%, for both the listening test and the live conversation compared to a fitted hearing aid as a baseline. Speech reception thresholds, measuring speech understanding in noise, improve by 1.6 dB SRT. Ours is the first denoising system that is implemented on a mobile device, streamed directly to users' hearing aids using only a single channel as audio input while improving user satisfaction on all tested aspects, including speech intelligibility. This includes overall preference of the denoised and streamed signal over the hearing aid, thereby accepting the higher latency for the significant improvement in speech understanding

Effect of Hearing Aid Directionality and Remote Microphone on Speech Intelligibility in Complex Listening Situations

Remote microphones (RMs) have been developed to support hearing aid (HA) users in understanding distant talkers. In traditional clinical applications, a drawback of these systems is the deteriorated speech intelligibility in the near field. This study investigates advantages and disadvantages of clinical RM usage and the effects of different directionality settings of the HAs in complex listening situations in the laboratory. Speech intelligibility was investigated in 15 experienced severely hearing impaired participants in a noisy environment using a dual-task test paradigm where the tasks were presented from either a near field or a far field loudspeaker. Primary and secondary tasks were presented simultaneously so attention had to be shared on both tasks. In a second experiment, two speech intelligibility tests were presented from either the near field or the far field loudspeaker. The tests were interleaved to simulate a complex listening situation with shifting attention. Directional HA microphones yielded better performance than omnidirectional microphones (both combined with a RM) in near field when analyzing both tasks of the dual-task experiment separately. Furthermore, the integrated dual-task test results showed better performance with directional HA microphones compared with the omnidirectional setting (both cases in combination with a RM). These findings were confirmed by the results of the interleaved speech intelligibility test

Development of a German reading span test with dual task design for application in cognitive hearing research

Objective: To report the development of a standardized German version of a reading span test (RST) with a dual task design. Special attention was paid to psycholinguistic control of the test items and time-sensitive scoring. We aim to establish our RST version to use for determining an individual's working memory in the framework of hearing research in German contexts. Design: RST stimuli were controlled and pretested for psycholinguistic factors. The RST task was to read sentences, quickly determine their plausibility, and later recall certain words to determine a listener's individual reading span. RST results were correlated with outcomes of additional sentence-in-noise tests measured in an aided and an unaided listening condition, each at two reception thresholds. Study sample: Item plausibility was pre-determined by 28 native German participants. An additional 62 listeners (45-86 years, M = 69.8) with mild-to-moderate hearing loss were tested for speech intelligibility and reading span in a multicenter study. Results: The reading span test significantly correlated with speech intelligibility at both speech reception thresholds in the aided listening condition. Conclusion: Our German RST is standardized with respect to psycholinguistic construction principles of the stimuli, and is a cognitive correlate of intelligibility in a German matrix speech-in-noise test

Modelling annoyance from combined traffic noise: an experimental study

Annoyance is one of the most studied reactions to noise. Nevertheless, little is known about the effect of the simultaneous occurrence of noise from different sources. Existing models which predict annoyance resulting from combined noise sources are derived from results for single sources and have not yet been validated. The present study empirically investigates actual annoyance as caused from different combinations of road and rail noise in a laboratory experiment. 72 volunteers were exposed to different noise scenarios consisting of combinations of road and rail traffic noise. During noise presentation, test persons had to carry out a task on a personal computer. After each noise scenario, they had to rate their subjective annoyance. A statistical model is derived from the resulting data set, which describes the relationship between noise exposure, task difficulty and annoyance

Evaluation of the preliminary auditory profile test battery in an international multi-centre study

This paper describes the composition and international multi-centre evaluation of a battery of tests termed the preliminary auditory profile. It includes measures of loudness perception, listening effort, speech perception, spectral and temporal resolution, spatial hearing, self-reported disability and handicap, and cognition. Clinical applicability and comparability across different centres are investigated. Headphone tests were conducted in five centres divided over four countries. Effects of test-retest, ear, and centre were investigated. Results for normally-hearing (NH) and hearing-impaired (HI) listeners are presented. Thirty NH listeners aged 19-39 years, and 72 HI listeners aged 22-91 years with a broad range of hearing losses were included. Test-retest reliability was generally good and there were very few right/left ear effects. Results of all tests were comparable across centres for NH listeners after baseline correction to account for necessary differences between test materials. For HI listeners, results were comparable across centres for the language-independent tests. The auditory profile forms a clinical test battery that is applicable in four different languages. Even after baseline correction, differences between test materials have to be taken into account when interpreting results of language-dependent tests in HI listener

Signal processing in hearing aids: results of the HEARCOM project

Digital hearing aids of today allow the application of advanced signal processing strategies. In recent years a number of promising signal processing approaches have been designed and developed. However, most of these different evolutions have been evaluated only in a limited way. Within the framework of the HEARCOM EU-research project a number of signal enhancement techniques have been further developed and evaluated based on a representative set of real-life recordings and physical performance measures. Different auditory profiles, representing common categories of hearing aid users, have been taken into account. A selection of 5 of these signal enhancement techniques (single-channel noise suppression, blind source separation, dereverberation, multi-microphone adaptive processing, feedback reduction) has been implemented on a single common hard- and software test platform, the Master Hearing Aid (MHA). These signal processing strategies have been evaluated perceptually based on speech reception thresholds, listening effort and preference rating, at 5 different test-sites for a number of speech-and-noise listening scenarios. Fifty normal hearing subjects and 100 hearing aid users according to 2 auditory profiles, took part in this stud