SPARSE ECHO CANCELLATION USING VARIANTS OF LEAST MEAN FOURTH AND LEAST MEAN SQUARE ALGORITHMS

Echo cancellation is the most essential and indispensable component of telephone networks. The impulse responses of most of the networks are sparse in nature; that is, the impulse response has a small percentage of its components with a significant magnitude (large energy), while the rest are zero or small. In these sparse environments, conventional adaptive algorithms like least mean square (LMS) and normalized LMS (NLMS) show substandard and inferior performances. In this paper, the performances of the normalized least mean square (NLMS) algorithm, the normalized least mean fourth (NLMF) and the proportionate normalized least mean fourth (PNLMF) are compared for sparse echo cancellation. The sparseness of both the echo response and the input signal is exploited in this algorithm to achieve improved results at a low computational cost. The PNLMF algorithm showed better results and faster convergence in sparse and non sparse systems, but its results in sparse environments are more impressive. The NLMF algorithm shows good results in sparse environments but not in non-sparse environments. The PNLMS algorithm can be considered superior to the NLMF and NLMS algorithms with respect to the error profile. A modified algorithm, the sparse controlled modified proportionate normalized LMF (SCMPNLMF) algorithm, is proposed, and its performances are compared with the other algorithms

System approach to robust acoustic echo cancellation through semi-blind source separation based on independent component analysis

We live in a dynamic world full of noises and interferences. The conventional acoustic echo cancellation (AEC) framework based on the least mean square (LMS) algorithm by itself lacks the ability to handle many secondary signals that interfere with the adaptive filtering process, e.g., local speech and background noise. In this dissertation, we build a foundation for what we refer to as the system approach to signal enhancement as we focus on the AEC problem. We first propose the residual echo enhancement (REE) technique that utilizes the error recovery nonlinearity (ERN) to "enhances" the filter estimation error prior to the filter adaptation. The single-channel AEC problem can be viewed as a special case of semi-blind source separation (SBSS) where one of the source signals is partially known, i.e., the far-end microphone signal that generates the near-end acoustic echo. SBSS optimized via independent component analysis (ICA) leads to the system combination of the LMS algorithm with the ERN that allows for continuous and stable adaptation even during double talk. Second, we extend the system perspective to the decorrelation problem for AEC, where we show that the REE procedure can be applied effectively in a multi-channel AEC (MCAEC) setting to indirectly assist the recovery of lost AEC performance due to inter-channel correlation, known generally as the "non-uniqueness" problem. We develop a novel, computationally efficient technique of frequency-domain resampling (FDR) that effectively alleviates the non-uniqueness problem directly while introducing minimal distortion to signal quality and statistics. We also apply the system approach to the multi-delay filter (MDF) that suffers from the inter-block correlation problem. Finally, we generalize the MCAEC problem in the SBSS framework and discuss many issues related to the implementation of an SBSS system. We propose a constrained batch-online implementation of SBSS that stabilizes the convergence behavior even in the worst case scenario of a single far-end talker along with the non-uniqueness condition on the far-end mixing system. The proposed techniques are developed from a pragmatic standpoint, motivated by real-world problems in acoustic and audio signal processing. Generalization of the orthogonality principle to the system level of an AEC problem allows us to relate AEC to source separation that seeks to maximize the independence, hence implicitly the orthogonality, not only between the error signal and the far-end signal, but rather, among all signals involved. The system approach, for which the REE paradigm is just one realization, enables the encompassing of many traditional signal enhancement techniques in analytically consistent yet practically effective manner for solving the enhancement problem in a very noisy and disruptive acoustic mixing environment.PhDCommittee Chair: Biing-Hwang Juang; Committee Member: Brani Vidakovic; Committee Member: David V. Anderson; Committee Member: Jeff S. Shamma; Committee Member: Xiaoli M

Advances in Image Processing, Analysis and Recognition Technology

For many decades, researchers have been trying to make computers’ analysis of images as effective as the system of human vision is. For this purpose, many algorithms and systems have previously been created. The whole process covers various stages, including image processing, representation and recognition. The results of this work can be applied to many computer-assisted areas of everyday life. They improve particular activities and provide handy tools, which are sometimes only for entertainment, but quite often, they significantly increase our safety. In fact, the practical implementation of image processing algorithms is particularly wide. Moreover, the rapid growth of computational complexity and computer efficiency has allowed for the development of more sophisticated and effective algorithms and tools. Although significant progress has been made so far, many issues still remain, resulting in the need for the development of novel approaches

Magnetocardiography in unshielded environment based on optical magnetometry and adaptive noise cancellation

This thesis proposes and demonstrates the concept of a magnetocardiographic system employing an array of optically-pumped quantum magnetometers and an adaptive noise cancellation for heart magnetic field measurement within a magnetically-unshielded environment. Optically-pumped quantum magnetometers are based on the use of the atomic-spin-dependent optical properties of an atomic medium. An Mxconfiguration- based optically-pumped quantum magnetometer employing two sensing cells containing caesium vapour is theoretically described and experimentally developed, and the dependence of its sensitivity and frequency bandwidth upon the light power and the alkali vapour temperature is experimentally demonstrated. Furthermore, the capability of the developed magnetometer of measuring very weak magnetic fields is experimentally demonstrated in a magnetically-unshielded environment. The adaptive noise canceller is based on standard Least-Mean-Squares (LMS) algorithms and on two heuristic optimization techniques, namely, Genetic Algorithms (GA) and Particle Swarm Optimization (PSO). The use of these algorithms is investigated for suppressing the power line generated 50Hz interference and recovering of the weak magnetic heart signals from a much higher electromagnetic environmental noise. Experimental results show that all the algorithms can extract a weak heart signal from a much-stronger magnetic noise, detect the P, QRS, and T heart features and highly suppress the common power line noise component at 50 Hz. Moreover, adaptive noise cancellation based on heuristic algorithms is shown to be more efficient than adaptive noise canceller based on standard or normalised LMS algorithm in heart features detection

Impulsive noise cancellation and channel estimation in power line communication systems

Power line communication (PLC) is considered as the most viable enabler of the smart grid. PLC exploits the power line infrastructure for data transmission and provides an economical communication backbone to support the requirements of smart grid applications. Though PLC brings a lot of benefits to the smart grid implementation, impairments such as frequency selective attenuation of the high-frequency communication signal, the presence of impulsive noise (IN) and the narrowband interference (NBI) from closely operating wireless communication systems, make the power line a hostile environament for reliable data transmission. Hence, the main objective of this dissertation is to design signal processing algorithms that are specifically tailored to overcome the inevitable impairments in the power line environment. First, we propose a novel IN mitigation scheme for PLC systems. The proposed scheme actively estimates the locations of IN samples and eliminates the effect of IN only from the contaminated samples of the received signal. By doing so, the typical problem encountered while mitigating the IN is avoided by using passive IN power suppression algorithms, where samples besides the ones containing the IN are also affected creating additional distortion in the received signal. Apart from the IN, the PLC transmission is also impaired by NBI. Exploiting the duality of the problem where the IN is impulsive in the time domain and the NBI is impulsive in the frequency domain, an extended IN mitigation algorithm is proposed in order to accurately estimate and effectively cancel both impairments from the received signal. The numerical validation of the proposed schemes shows improved BER performance of PLC systems in the presence of IN and NBI. Secondly, we pay attention to the problem of channel estimation in the power line environment. The presence of IN makes channel estimation challenging for PLC systems. To accurately estimate the channel, two maximumlikelihood (ML) channel estimators for PLC systems are proposed in this thesis. Both ML estimators exploit the estimated IN samples to determine the channel coefficients. Among the proposed channel estimators, one treats the estimated IN as a deterministic quantity, and the other assumes that the estimated IN is a random quantity. The performance of both estimators is analyzed and numerically evaluated to show the superiority of the proposed estimators in comparison to conventional channel estimation strategies in the presence of IN. Furthermore, between the two proposed estimators, the one that is based on the random approach outperforms the deterministic one in all typical PLC scenarios. However, the deterministic approach based estimator can perform consistent channel estimation regardless of the IN behavior with less computational effort and becomes an efficient channel estimation strategy in situations where high computational complexity cannot be afforded. Finally, we propose two ML algorithms to perform a precise IN support detection. The proposed algorithms perform a greedy search of the samples in the received signal that are contaminated by IN. To design such algorithms, statistics defined for deterministic and random ML channel estimators are exploited and two multiple hypothesis tests are built according to Bonferroni and Benjamini and Hochberg design criteria. Among the proposed estimators, the random ML-based approach outperforms the deterministic ML-based approach while detecting the IN support in typical power line environment. Hence, this thesis studies the power line environment for reliable data transmission to support smart grid. The proposed signal processing schemes are robust and allow PLC systems to effectively overcome the major impairments in an active electrical network.The efficient mitigation of IN and NBI and accurate estimation of channel enhances the applicability of PLC to support critical applications that are envisioned for the future electrical power grid.La comunicación a través de líneas de transmisión eléctricas (PLC) se considera uno de los habilitadores principales de la red eléctrica inteligente (smart grid). PLC explota la infraestructura de la red eléctrica para la transmisión de datos y proporciona una red troncal de comunicación económica para poder cumplir con los requisitos de las aplicaciones para smart grids. Si bien la tecnología PLC aporta muchos beneficios a la implementación de la smart grid, los impedimentos, como la atenuación selectiva en frecuencia de la señal de comunicación, la presencia de ruido impulsivo (IN) y las interferencias de banda estrecha (NBI) de los sistemas de comunicación inalámbrica de operación cercana, hacen que la red eléctrica sea un entorno hostil para la transmisión fiable de datos. En este contexto, el objetivo principal de esta tesis es diseñar algoritmos de procesado de señal que estén específicamente diseñados para superar los impedimentos inevitables en el entorno de la red eléctrica como son IN y NBI. Primeramente, proponemos un nuevo esquema de mitigación de IN en sistemas PLC. El esquema propuesto estima activamente las ubicaciones de las muestras de IN y elimina el efecto de IN solo en las muestras contaminadas de la señal recibida. Al hacerlo, el problema típico que se encuentra al mitigar el IN con técnicas tradicionales (donde también se ven afectadas otras muestras que contienen la IN, creando una distorsión adicional en la señal recibida) se puede evitar con la consiguiente mejora del rendimiento. Aparte de IN, los sistemas PLC también se ven afectados por el NBI. Aprovechando la dualidad del problema (el IN es impulsivo en el dominio del tiempo y el NBI es impulsivo en el dominio de la frecuencia), se propone un algoritmo de mitigación de IN ampliado para estimar con precisión y cancelar efectivamente ambas degradaciones de la señal recibida. La validación numérica de los esquemas propuestos muestra un mejor rendimiento en términos de tasa de error de bit (BER) en sistemas PLC con presencia de IN y NBI. En segundo lugar, prestamos atención al problema de la estimación de canal en entornos PLC. La presencia de IN hace que la estimación de canal sea un desafío para los sistemas PLC futuros. En esta tesis, se proponen dos estimadores de canal para sistemas PLC de máxima verosimilitud (ML) para sistemas PLC. Ambos estimadores ML explotan las muestras IN estimadas para determinar los coeficientes del canal. Entre los estimadores de canal propuestos, uno trata la IN estimada como una cantidad determinista, y la otra asume que la IN estimada es una cantidad aleatoria. El rendimiento de ambos estimadores se analiza y se evalúa numéricamente para mostrar la superioridad de los estimadores propuestos en comparación con las estrategias de estimación de canales convencionales en presencia de IN. Además, entre los dos estimadores propuestos, el que se basa en el enfoque aleatorio supera el determinista en escenarios PLC típicos. Sin embargo, el estimador basado en el enfoque determinista puede llevar a cabo una estimación de canal consistente independientemente del comportamiento de la IN con menos esfuerzo computacional y se convierte en una estrategia de estimación de canal eficiente en situaciones donde no es posible disponer de una alta complejidad computacionalPostprint (published version