Structured Sparsity Models for Multiparty Speech Recovery from Reverberant Recordings

We tackle the multi-party speech recovery problem through modeling the acoustic of the reverberant chambers. Our approach exploits structured sparsity models to perform room modeling and speech recovery. We propose a scheme for characterizing the room acoustic from the unknown competing speech sources relying on localization of the early images of the speakers by sparse approximation of the spatial spectra of the virtual sources in a free-space model. The images are then clustered exploiting the low-rank structure of the spectro-temporal components belonging to each source. This enables us to identify the early support of the room impulse response function and its unique map to the room geometry. To further tackle the ambiguity of the reflection ratios, we propose a novel formulation of the reverberation model and estimate the absorption coefficients through a convex optimization exploiting joint sparsity model formulated upon spatio-spectral sparsity of concurrent speech representation. The acoustic parameters are then incorporated for separating individual speech signals through either structured sparse recovery or inverse filtering the acoustic channels. The experiments conducted on real data recordings demonstrate the effectiveness of the proposed approach for multi-party speech recovery and recognition.Comment: 31 page

Refraction and scattering of sound by a shear layer

The angle and amplitude changes for acoustic waves refracted by a circular open jet shear layer were determined. The generalized refraction theory was assessed experimentally for on axis and off axis acoustic source locations as source frequency varied from 1 kHz to 10 kHz and free stream Mach number varied from 0.1 to 0.4. Angle and amplitude changes across the shear layer show good agreement with theory. Experiments confirm that the refraction theory is independent of shear layer thickness, acoustic source frequency, and source type. A generalized theory is, thus, available for correcting far field noise data acquired in open jet test facilities. The effect of discrete tone scattering by the open jet turbulent shear layer was also studied. Scattering effects were investigated over the same Mach number range as frequency varied from 5 kHz to 15 kHz. Attenuation of discrete tone amplitude and tone broadening were measured as a function of acoustic source position and radiation angle. Scattering was found to be stronger at angles close to the open jet axis than at 90 deg, and becomes stronger as the acoustic source position shifts downstream. A scattering analysis provided an estimate of the onset of discrete tone scattering

Noise source identification on large generator units

Abstract unavailable please refer to PD

Spatial dissection of a soundfield using spherical harmonic decomposition

A real-world soundfield is often contributed by multiple desired and undesired sound sources. The performance of many acoustic systems such as automatic speech recognition, audio surveillance, and teleconference relies on its ability to extract the desired sound components in such a mixed environment. The existing solutions to the above problem are constrained by various fundamental limitations and require to enforce different priors depending on the acoustic condition such as reverberation and spatial distribution of sound sources. With the growing emphasis and integration of audio applications in diverse technologies such as smart home and virtual reality appliances, it is imperative to advance the source separation technology in order to overcome the limitations of the traditional approaches. To that end, we exploit the harmonic decomposition model to dissect a mixed soundfield into its underlying desired and undesired components based on source and signal characteristics. By analysing the spatial projection of a soundfield, we achieve multiple outcomes such as (i) soundfield separation with respect to distinct source regions, (ii) source separation in a mixed soundfield using modal coherence model, and (iii) direction of arrival (DOA) estimation of multiple overlapping sound sources through pattern recognition of the modal coherence of a soundfield. We first employ an array of higher order microphones for soundfield separation in order to reduce hardware requirement and implementation complexity. Subsequently, we develop novel mathematical models for modal coherence of noisy and reverberant soundfields that facilitate convenient ways for estimating DOA and power spectral densities leading to robust source separation algorithms. The modal domain approach to the soundfield/source separation allows us to circumvent several practical limitations of the existing techniques and enhance the performance and robustness of the system. The proposed methods are presented with several practical applications and performance evaluations using simulated and real-life dataset

Online monitoring instantaneous 2D temperature distributions in a furnace using acoustic tomography based on frequency division multiplexing

The online and accurate capture of dynamic changes in furnace temperature distribution is crucial for production efficiency improvement and international environmental policy compliance in power plants. To achieve this, a measurement system with a reliable online reconstruction capability and high temporal resolution is necessary. This paper presents a novel technique that can improve the temporal resolution of the currently existing acoustic tomography (AT) system using frequency division multiplexing (FDM). This method allows for concurrent transmissions of acoustic signals in several different frequency bands instead of a sequential manner, which leads to more efficient channel utilization and allows all acoustic signals to be acquired at the same time, so that a better temporal uniformity of multipath acoustic signals can be realized. Theoretical analysis and experiments have been conducted to verify the effectiveness of this technique. The results prove that the proposed method can significantly improve the temporal resolution of the AT system while maintaining the accuracy and robustness of the reconstruction

A good practice guide on the sources and magnitude of uncertainty arising in the practical measurement of environmental noise

A brief introduction to measurement uncertainty, uncertainty budgets, and inter-comparison exercises (repeated measurements), is provided in Chapter 2. The procedure forformulating an uncertainty budget and evaluating magnitudes is outlined in greater detail in Chapter 3. A flow chart summarising this process, and a checklist for the identification of sources of measurement uncertainty are included at the end of the chapter. Two example measurement exercises with corresponding uncertainty budgets are presented in Chapter 4. Some of the more commonly encountered sources of measurement uncertainty are outlined in Chapter5. Where possible, information on magnitudes or pointers to where that information can be found are included. The more important sources of uncertainty are highlighted, and “good practice guidelines” provided to help the practitioner identify means of reducing their effect. Case studies illustrating some of the points made in Chapter 5,and listing of relevant guidelines and further reading are provided in the Appendices

Voice Recognition in Noisy Environment Using Array of Microphone

The performance of voice recognition reduces significantly in noisy environments, where the voice signals are distorted severely by addition of noise signal and reverberations. In such environments we can use array of microphone and use beamforming techniques to reduce the effect of noise signals. Presently, microphone-array-based voice recognition is done in two independent stages: first beamforming by array processing and then sending it for recognition. To reduce the effect of noise that is to reduce the distortion in voice waveform array processing algorithm is designed to enhance the signal before feature extraction and recognition. In Beamforming technique an array of sensors, in our case sensors are microphones, is used so that maximum reception can be achieved in a desired specified direction that is in the presence of noise, by the use of estimation of direction algorithm while signals from undesired direction are rejected though they are of same frequency. This is done by using delay and sum method in which the outputs from an array of microphones are delayed by some time so when they are added together, a particular part of the sound field is amplified over other undesired or interfering sources. Then the focussed voice wave is sent to voice recognition algorithm. Correlation algorithm is used for the voice recognition. The algorithm is based on the fact correlation graph between same signal is symmetric and value of correlation is maximum. The system development for this voice recognizer will be done using MATLAB for this project. Using MATLAB a GUI is created which has different function buttons to perform different tasks

Investigation of Twin Jet Aeroacoustic Properties in the Presence of a Hybrid Wing Body Shield

In preparation for upcoming wind tunnel acoustic experiments of a Hybrid Wing Body (HWB) vehicle with two jet engine simulator units, a series of twin jet aeroacoustic investigations were conducted leading to increased understanding and risk mitigation. A previously existing twin jet nozzle system and a fabricated HWB aft deck fuselage are combined for a 1.9% model scale study of jet nozzle spacing and jet cant angle effects, elevon deflection into the jet plume, and acoustic shielding by the fuselage body. Linear and phased array microphone measurements are made, and data processing includes the use of DAMAS (Deconvolution Approach for the Mapping of Acoustic Sources). Closely-spaced twin jets with a 5 inward cant angle exhibit reduced noise levels compared to their parallel flow counterparts at similar and larger nozzle spacings. A 40 elevon deflection into the twin jet plume, which is required for HWB ground rotation, can significantly increase upstream noise levels (more than 5 dB OASPL) with only minimal increases in the downstream direction. Lastly, DAMAS processing can successfully measure the noise source distribution of multiple shielded jet sources

The free jet as a simulator of forward velocity effects on jet noise

A thorough theoretical and experimental study of the effects of the free-jet shear layer on the transmission of sound from a model jet placed within the free jet to the far-field receiver located outside the free-jet flow was conducted. The validity and accuracy of the free-jet flight simulation technique for forward velocity effects on jet noise was evaluated. Transformation charts and a systematic computational procedure for converting measurements from a free-jet simulation to the corresponding results from a wind-tunnel simulation, and, finally, to the flight case were provided. The effects of simulated forward flight on jet mixing noise, internal noise and shock-associated noise from model-scale unheated and heated jets were established experimentally in a free-jet facility. It was illustrated that the existing anomalies between full-scale flight data and model-scale flight simulation data projected to the flight case, could well be due to the contamination of flight data by engine internal noise