Rate-Constrained Collaborative Noise Reduction for Wireless Hearing Aids

Hearing aids are electronic, battery-operated sensing devices which aim at compensating various kinds of hearing impairments. Recent advances in low-power electronics coupled with progresses made in digital signal processing offer the potential for substantial improvements over state-of-the-art systems. Nevertheless, efficient noise reduction in complex listening scenarios remains a challenging task, partly due to the limited number of microphones that can be integrated on such devices. We investigate the noise reduction capability of hearing instruments that may exchange data by means of a rate-constrained wireless link and thus benefit from the signals recorded at both ears of the user. We provide the necessary theoretical results to analyze this collaboration mechanism under two different coding strategies. The first approach takes full benefit of the binaural correlation, while the second neglects it, since binaural statistics are difficult to estimate in a practical setting. The gain achieved by collaborating hearing aids as a function of the communication bit rate is then characterized, both in a monaural and a binaural configuration. The corresponding optimal rate allocation strategies are computed in closed form. While the analytical derivation is limited to a simple acoustic scenario, the latter is shown to capture many of the features of the general problem. In particular, it is observed that the loss incurred by coding schemes which do not consider the binaural correlation is rather negligible in a very noisy environment. Finally, numerical results obtained using real measurements corroborate the potential of our approach in a realistic scenario

Efficient calculation of sensor utility and sensor removal in wireless sensor networks for adaptive signal estimation and beamforming

Wireless sensor networks are often deployed over a large area of interest and therefore the quality of the sensor signals may vary significantly across the different sensors. In this case, it is useful to have a measure for the importance or the so-called "utility" of each sensor, e.g., for sensor subset selection, resource allocation or topology selection. In this paper, we consider the efficient calculation of sensor utility measures for four different signal estimation or beamforming algorithms in an adaptive context. We use the definition of sensor utility as the increase in cost (e.g., mean-squared error) when the sensor is removed from the estimation procedure. Since each possible sensor removal corresponds to a new estimation problem (involving less sensors), calculating the sensor utilities would require a continuous updating of different signal estimators (where is the number of sensors), increasing computational complexity and memory usage by a factor. However, we derive formulas to efficiently calculate all sensor utilities with hardly any increase in memory usage and computational complexity compared to the signal estimation algorithm already in place. When applied in adaptive signal estimation algorithms, this allows for on-line tracking of all the sensor utilities at almost no additional cost. Furthermore, we derive efficient formulas for sensor removal, i.e., for updating the signal estimator coefficients when a sensor is removed, e.g., due to a failure in the wireless link or when its utility is too low. We provide a complexity evaluation of the derived formulas, and demonstrate the significant reduction in computational complexity compared to straightforward implementations

Utility based cross-layer collaboration for speech enhancement in wireless acoustic sensor networks

A wireless acoustic sensor network is considered that is used to estimate a desired speech signal that has been corrupted by noise. The application layer of the WASN derives an optimal filter in a linear MMSE sense. A utility function is then used in conjunction with the MMSE estimate in order to evaluate the most significant signal components from each node in the system. The utility values are used as a cross-layer link between the application layer and the network layer so the nodes transmit the signal components that are deemed most relevant to the estimate while adhering to the power constraints of the system. The simulation results show that a high signal-to-error and signal-to-noise ratio is still achievable while transmitting a subset of signal components

Enhancement by postfiltering for speech and audio coding in ad-hoc sensor networks

Enhancement algorithms for wireless acoustics sensor networks~(WASNs) are indispensable with the increasing availability and usage of connected devices with microphones. Conventional spatial filtering approaches for enhancement in WASNs approximate quantization noise with an additive Gaussian distribution, which limits performance due to the non-linear nature of quantization noise at lower bitrates. In this work, we propose a postfilter for enhancement based on Bayesian statistics to obtain a multidevice signal estimate, which explicitly models the quantization noise. Our experiments using PSNR, PESQ and MUSHRA scores demonstrate that the proposed postfilter can be used to enhance signal quality in ad-hoc sensor networks

Attention-based distributed speech enhancement for unconstrained microphone arrays with varying number of nodes

Speech enhancement promises higher efficiency in ad-hoc microphone arrays than in constrained microphone arrays thanks to the wide spatial coverage of the devices in the acoustic scene. However, speech enhancement in ad-hoc microphone arrays still raises many challenges. In particular, the algorithms should be able to handle a variable number of microphones, as some devices in the array might appear or disappear. In this paper, we propose a solution that can efficiently process the spatial information captured by the different devices of the microphone array, while being robust to a link failure. To do this, we use an attention mechanism in order to put more weight on the relevant signals sent throughout the array and to neglect the redundant or empty channels

RTF-Based Binaural MVDR Beamformer Exploiting an External Microphone in a Diffuse Noise Field

Besides suppressing all undesired sound sources, an important objective of a binaural noise reduction algorithm for hearing devices is the preservation of the binaural cues, aiming at preserving the spatial perception of the acoustic scene. A well-known binaural noise reduction algorithm is the binaural minimum variance distortionless response beamformer, which can be steered using the relative transfer function (RTF) vector of the desired source, relating the acoustic transfer functions between the desired source and all microphones to a reference microphone. In this paper, we propose a computationally efficient method to estimate the RTF vector in a diffuse noise field, requiring an additional microphone that is spatially separated from the head-mounted microphones. Assuming that the spatial coherence between the noise components in the head-mounted microphone signals and the additional microphone signal is zero, we show that an unbiased estimate of the RTF vector can be obtained. Based on real-world recordings, experimental results for several reverberation times show that the proposed RTF estimator outperforms the widely used RTF estimator based on covariance whitening and a simple biased RTF estimator in terms of noise reduction and binaural cue preservation performance.Comment: Accepted at ITG Conference on Speech Communication 201

DNN-based mask estimation for distributed speech enhancement in spatially unconstrained microphone arrays

Deep neural network (DNN)-based speech enhancement algorithms in microphone arrays have now proven to be efficient solutions to speech understanding and speech recognition in noisy environments. However, in the context of ad-hoc microphone arrays, many challenges remain and raise the need for distributed processing. In this paper, we propose to extend a previously introduced distributed DNN-based time-frequency mask estimation scheme that can efficiently use spatial information in form of so-called compressed signals which are pre-filtered target estimations. We study the performance of this algorithm under realistic acoustic conditions and investigate practical aspects of its optimal application. We show that the nodes in the microphone array cooperate by taking profit of their spatial coverage in the room. We also propose to use the compressed signals not only to convey the target estimation but also the noise estimation in order to exploit the acoustic diversity recorded throughout the microphone array.Comment: Submitted to TASL

Control Effort Strategies for Acoustically Coupled Distributed Acoustic Nodes

[EN] This paper considers the effect of effort constraints on the behavior of an active noise control (ANC) system over a distributed network composed of acoustic nodes. A distributed implementation can be desirable in order to provide more flexible, versatile, and scalable ANC systems. In this regard, the distributed version of the multiple error filtered-x least mean square (DMEFxLMS) algorithm that allows collaboration between nodes has shown excellent properties. However, practical constraints need to be considered since, in real scenarios, the acoustic nodes are equipped with power constrained actuators. If these constraints are not considered within the adaptive algorithm, the control signals may increase and saturate the hardware devices, causing system instability. To avoid this drawback, a control effort weighting can be considered in the cost function of the distributed algorithm at each node. Therefore, a control effort strategy over the output signals at each node is used to keep them under a given threshold and ensuring the distributed ANC system stability. Experimental results show that, assuming ideal network communications, the proposed distributed algorithm achieves the same performance as the leaky centralized ANC system. A performance evaluation of several versions of the leaky DMEFxLMS algorithm in realistic scenarios is also included.This work has been supported by European Union ERDF together with Spanish Government through TEC2015-67387-C4-1-R project and Generalitat Valenciana through PROMETEOII/2014/003 project.Antoñanzas-Manuel, C.; Ferrer Contreras, M.; Diego Antón, MD.; Gonzalez, A. (2017). Control Effort Strategies for Acoustically Coupled Distributed Acoustic Nodes. Wireless Communications and Mobile Computing. 2017:1-15. https://doi.org/10.1155/2017/3601802S1152017Akyildiz, I. F., Weilian Su, Sankarasubramaniam, Y., & Cayirci, E. (2002). A survey on sensor networks. IEEE Communications Magazine, 40(8), 102-114. doi:10.1109/mcom.2002.1024422Yick, J., Mukherjee, B., & Ghosal, D. (2008). Wireless sensor network survey. Computer Networks, 52(12), 2292-2330. doi:10.1016/j.comnet.2008.04.002Puccinelli, D., & Haenggi, M. (2005). Wireless sensor networks: applications and challenges of ubiquitous sensing. IEEE Circuits and Systems Magazine, 5(3), 19-31. doi:10.1109/mcas.2005.1507522Xiaojiang Du, & Hsiao-Hwa Chen. (2008). Security in wireless sensor networks. IEEE Wireless Communications, 15(4), 60-66. doi:10.1109/mwc.2008.4599222Al Ameen, M., Liu, J., & Kwak, K. (2010). Security and Privacy Issues in Wireless Sensor Networks for Healthcare Applications. Journal of Medical Systems, 36(1), 93-101. doi:10.1007/s10916-010-9449-4Martinez, K., Hart, J. K., & Ong, R. (2004). Environmental sensor networks. Computer, 37(8), 50-56. doi:10.1109/mc.2004.91Segura-Garcia, J., Felici-Castell, S., Perez-Solano, J. J., Cobos, M., & Navarro, J. M. (2015). Low-Cost Alternatives for Urban Noise Nuisance Monitoring Using Wireless Sensor Networks. IEEE Sensors Journal, 15(2), 836-844. doi:10.1109/jsen.2014.2356342Flammini, A., Ferrari, P., Marioli, D., Sisinni, E., & Taroni, A. (2009). Wired and wireless sensor networks for industrial applications. Microelectronics Journal, 40(9), 1322-1336. doi:10.1016/j.mejo.2008.08.012Lopes, C. G., & Sayed, A. H. (2007). Incremental Adaptive Strategies Over Distributed Networks. IEEE Transactions on Signal Processing, 55(8), 4064-4077. doi:10.1109/tsp.2007.896034Cobos, M., Perez-Solano, J. J., Belmonte, O., Ramos, G., & Torres, A. M. (2016). Simultaneous Ranging and Self-Positioning in Unsynchronized Wireless Acoustic Sensor Networks. IEEE Transactions on Signal Processing, 64(22), 5993-6004. doi:10.1109/tsp.2016.2603972Llerena-Aguilar, C., Gil-Pita, R., Rosa-Zurera, M., Ayllón, D., Utrilla-Manso, M., & Llerena, F. (2016). Synchronization based on mixture alignment for sound source separation in wireless acoustic sensor networks. Signal Processing, 118, 177-187. doi:10.1016/j.sigpro.2015.06.023Elliott, S. J., & Nelson, P. A. (1993). Active noise control. IEEE Signal Processing Magazine, 10(4), 12-35. doi:10.1109/79.248551Elliott, S. J., Joseph, P., Bullmore, A. J., & Nelson, P. A. (1988). Active cancellation at a point in a pure tone diffuse sound field. Journal of Sound and Vibration, 120(1), 183-189. doi:10.1016/0022-460x(88)90343-4Joseph, P., Elliott, S. J., & Nelson, P. A. (1994). Near Field Zones of Quiet. Journal of Sound and Vibration, 172(5), 605-627. doi:10.1006/jsvi.1994.1202Kuo, S. M., & Morgan, D. R. (1999). Active noise control: a tutorial review. Proceedings of the IEEE, 87(6), 943-975. doi:10.1109/5.763310Burgess, J. C. (1981). Active adaptive sound control in a duct: A computer simulation. The Journal of the Acoustical Society of America, 70(3), 715-726. doi:10.1121/1.386908Elliott, S. J., & Boucher, C. C. (1994). Interaction between multiple feedforward active control systems. IEEE Transactions on Speech and Audio Processing, 2(4), 521-530. doi:10.1109/89.326611Grosdidier, P., & Morari, M. (1986). Interaction measures for systems under decentralized control. Automatica, 22(3), 309-319. doi:10.1016/0005-1098(86)90029-4Elliott, S., Stothers, I., & Nelson, P. (1987). A multiple error LMS algorithm and its application to the active control of sound and vibration. IEEE Transactions on Acoustics, Speech, and Signal Processing, 35(10), 1423-1434. doi:10.1109/tassp.1987.1165044Elliott, S. J., & Back, K. H. (1996). Effort constraints in adaptive feedforward control. IEEE Signal Processing Letters, 3(1), 7-9. doi:10.1109/97.475821Qiu, X., & Hansen, C. H. (2001). A study of time-domain FXLMS algorithms with control output constraint. The Journal of the Acoustical Society of America, 109(6), 2815-2823. doi:10.1121/1.1367247Rafaely, B., & Elliot, S. J. (2000). A computationally efficient frequency-domain LMS algorithm with constraints on the adaptive filter. IEEE Transactions on Signal Processing, 48(6), 1649-1655. doi:10.1109/78.845922Kozacky, W. J., & Ogunfunmi, T. (2013). An active noise control algorithm with gain and power constraints on the adaptive filter. EURASIP Journal on Advances in Signal Processing, 2013(1). doi:10.1186/1687-6180-2013-17Mosquera-Sánchez, J. A., Desmet, W., & de Oliveira, L. P. R. (2017). A multichannel amplitude and relative-phase controller for active sound quality control. Mechanical Systems and Signal Processing, 88, 145-165. doi:10.1016/j.ymssp.2016.10.036Rossetti, D. J., Jolly, M. R., & Southward, S. C. (1996). Control effort weighting in feedforward adaptive control systems. The Journal of the Acoustical Society of America, 99(5), 2955-2964. doi:10.1121/1.414877Antoñanzas, C., Ferrer, M., de Diego, M., & Gonzalez, A. (2016). Blockwise Frequency Domain Active Noise Controller Over Distributed Networks. Applied Sciences, 6(5), 124. doi:10.3390/app605012