Detection of non-stationary dynamics using sub-space based representations, cyclic based and variability constraints

La siguiente Tesis de Maestría propone una metodología para el análisis de series de tiempo no-estacionarias con el propósito de filtrado y detección de ruido en reconocimiento de patrones. La metodología se encuentra dividida en dos etapas: el análisis de comportamientos no-estacionarios que recaen en procesos cíclicos y como diferentes componentes no-periódicos afectan el análisis de la señal. El segundo enfoque, está centrado en el problema de extracción de series de tiempo no-estacionarias que afectan procesos estacionarios. Ambos esquemas están basados en restricciones de (ciclo-)estacionariead y representaciones basadas en subespacios de manera que mediante la evaluación de las dinámicas de la señal sea posible identificar las componentes no-estacionarias indeseadas. Los resultados se muestran para cada enfoque de manera independiente por medio de datos sintéticos y reales, el desempeño obtenido muestra una gran capacidad de detección, rechazo y/o extracción de ruido y artefactos en series de tiempo (ciclo-)estacionarias usando restricciones de estacionariedad así como condiciones cíclicas basadas en la naturaleza de la señalAbstract : The present Master’s Thesis proposes a methodology for the non–stationary time-series analysis for filtering and noise rejection purposes in pattern recognition. The methodology is divided into two different approaches: the analysis of periodic non–stationary behavior that relies into a cyclic process and how additional non–cyclic non–stationarities disrupt and affect the signal processing. Second approach deals with the problem of non–stationary signal extraction that affects inherent weak stationary processes. Both frameworks of analysis take base on (cyclo-)stationary constraints and subspace based representations in order to assess and characterize the signals dynamics to facilitate the identification of the undesired non–stationary components. Results are shown over each approach with different real and synthetic data, the obtained performances show high rejection, detection and extraction capabilities for noise and artifacts in (cyclo)–stationary signals using external and internal based constraints of analysis and high separation capability for stationary signalsMaestrí

A Primal-Dual Proximal Algorithm for Sparse Template-Based Adaptive Filtering: Application to Seismic Multiple Removal

Unveiling meaningful geophysical information from seismic data requires to deal with both random and structured "noises". As their amplitude may be greater than signals of interest (primaries), additional prior information is especially important in performing efficient signal separation. We address here the problem of multiple reflections, caused by wave-field bouncing between layers. Since only approximate models of these phenomena are available, we propose a flexible framework for time-varying adaptive filtering of seismic signals, using sparse representations, based on inaccurate templates. We recast the joint estimation of adaptive filters and primaries in a new convex variational formulation. This approach allows us to incorporate plausible knowledge about noise statistics, data sparsity and slow filter variation in parsimony-promoting wavelet frames. The designed primal-dual algorithm solves a constrained minimization problem that alleviates standard regularization issues in finding hyperparameters. The approach demonstrates significantly good performance in low signal-to-noise ratio conditions, both for simulated and real field seismic data

Blind Source Separation for the Processing of Contact-Less Biosignals

(Spatio-temporale) Blind Source Separation (BSS) eignet sich für die Verarbeitung von Multikanal-Messungen im Bereich der kontaktlosen Biosignalerfassung. Ziel der BSS ist dabei die Trennung von (z.B. kardialen) Nutzsignalen und Störsignalen typisch für die kontaktlosen Messtechniken. Das Potential der BSS kann praktisch nur ausgeschöpft werden, wenn (1) ein geeignetes BSS-Modell verwendet wird, welches der Komplexität der Multikanal-Messung gerecht wird und (2) die unbestimmte Permutation unter den BSS-Ausgangssignalen gelöst wird, d.h. das Nutzsignal praktisch automatisiert identifiziert werden kann. Die vorliegende Arbeit entwirft ein Framework, mit dessen Hilfe die Effizienz von BSS-Algorithmen im Kontext des kamera-basierten Photoplethysmogramms bewertet werden kann. Empfehlungen zur Auswahl bestimmter Algorithmen im Zusammenhang mit spezifischen Signal-Charakteristiken werden abgeleitet. Außerdem werden im Rahmen der Arbeit Konzepte für die automatisierte Kanalauswahl nach BSS im Bereich der kontaktlosen Messung des Elektrokardiogramms entwickelt und bewertet. Neuartige Algorithmen basierend auf Sparse Coding erwiesen sich dabei als besonders effizient im Vergleich zu Standard-Methoden.(Spatio-temporal) Blind Source Separation (BSS) provides a large potential to process distorted multichannel biosignal measurements in the context of novel contact-less recording techniques for separating distortions from the cardiac signal of interest. This potential can only be practically utilized (1) if a BSS model is applied that matches the complexity of the measurement, i.e. the signal mixture and (2) if permutation indeterminacy is solved among the BSS output components, i.e the component of interest can be practically selected. The present work, first, designs a framework to assess the efficacy of BSS algorithms in the context of the camera-based photoplethysmogram (cbPPG) and characterizes multiple BSS algorithms, accordingly. Algorithm selection recommendations for certain mixture characteristics are derived. Second, the present work develops and evaluates concepts to solve permutation indeterminacy for BSS outputs of contact-less electrocardiogram (ECG) recordings. The novel approach based on sparse coding is shown to outperform the existing concepts of higher order moments and frequency-domain features

Seismic characterisation based on time-frequency spectral analysis

We present high-resolution time-frequency spectral analysis schemes to better resolve seismic images for the purpose of seismic and petroleum reservoir characterisation. Seismic characterisation is based on the physical properties of the Earth's subsurface media, and these properties are represented implicitly by seismic attributes. Because seismic traces originally presented in the time domain are non-stationary signals, for which the properties vary with time, we characterise those signals by obtaining seismic attributes which are also varying with time. Among the widely used attributes are spectral attributes calculated through time-frequency decomposition. Time-frequency spectral decomposition methods are employed to capture variations of a signal within the time-frequency domain. These decomposition methods generate a frequency vector at each time sample, referred to as the spectral component. The computed spectral component enables us to explore the additional frequency dimension which exists jointly with the original time dimension enabling localisation and characterisation of patterns within the seismic section. Conventional time-frequency decomposition methods include the continuous wavelet transform and the Wigner-Ville distribution. These methods suffer from challenges that hinder accurate interpretation when used for seismic interpretation. Continuous wavelet transform aims to decompose signals on a basis of elementary signals which have to be localised in time and frequency, but this method suffers from resolution and localisation limitations in the time-frequency spectrum. In addition to smearing, it often emerges from ill-localisation. The Wigner-Ville distribution distributes the energy of the signal over the two variables time and frequency and results in highly localised signal components. Yet, the method suffers from spurious cross-term interference due to its quadratic nature. This interference is misleading when the spectrum is used for interpretation purposes. For the specific application on seismic data the interference obscures geological features and distorts geophysical details. This thesis focuses on developing high fidelity and high-resolution time-frequency spectral decomposition methods as an extension to the existing conventional methods. These methods are then adopted as means to resolve seismic images for petroleum reservoirs. These methods are validated in terms of physics, robustness, and accurate energy localisation, using an extensive set of synthetic and real data sets including both carbonate and clastic reservoir settings. The novel contributions achieved in this thesis include developing time-frequency analysis algorithms for seismic data, allowing improved interpretation and accurate characterisation of petroleum reservoirs. The first algorithm established in this thesis is the Wigner-Ville distribution (WVD) with an additional masking filter. The standard WVD spectrum has high resolution but suffers the cross-term interference caused by multiple components in the signal. To suppress the cross-term interference, I designed a masking filter based on the spectrum of the smoothed-pseudo WVD (SP-WVD). The original SP-WVD incorporates smoothing filters in both time and frequency directions to suppress the cross-term interference, which reduces the resolution of the time-frequency spectrum. In order to overcome this side-effect, I used the SP-WVD spectrum as a reference to design a masking filter, and apply it to the standard WVD spectrum. Therefore, the mask-filtered WVD (MF-WVD) can preserve the high-resolution feature of the standard WVD while suppressing the cross-term interference as effectively as the SP-WVD. The second developed algorithm in this thesis is the synchrosqueezing wavelet transform (SWT) equipped with a directional filter. A transformation algorithm such as the continuous wavelet transform (CWT) might cause smearing in the time-frequency spectrum, i.e. the lack of localisation. The SWT attempts to improve the localisation of the time-frequency spectrum generated by the CWT. The real part of the complex SWT spectrum, after directional filtering, is capable to resolve the stratigraphic boundaries of thin layers within target reservoirs. In terms of seismic characterisation, I tested the high-resolution spectral results on a complex clastic reservoir interbedded with coal seams from the Ordos basin, northern China. I used the spectral results generated using the MF-WVD method to facilitate the interpretation of the sand distribution within the dataset. In another implementation I used the SWT spectral data results and the original seismic data together as the input to a deep convolutional neural network (dCNN), to track the horizons within a 3D volume. Using these application-based procedures, I have effectively extracted the spatial variation and the thickness of thinly layered sandstone in a coal-bearing reservoir. I also test the algorithm on a carbonate reservoir from the Tarim basin, western China. I used the spectrum generated by the synchrosqueezing wavelet transform equipped with directional filtering to characterise faults, karsts, and direct hydrocarbon indicators within the reservoir. Finally, I investigated pore-pressure prediction in carbonate layers. Pore-pressure variation generates subtle changes in the P-wave velocity of carbonate rocks. This suggests that existing empirical relations capable of predicting pore-pressure in clastic rocks are unsuitable for the prediction in carbonate rocks. I implemented the prediction based on the P-wave velocity and the wavelet transform multi-resolution analysis (WT-MRA). The WT-MRA method can unfold information within the frequency domain via decomposing the P-wave velocity. This enables us to extract and amplify hidden information embedded in the signal. Using Biot's theory, WT-MRA decomposition results can be divided into contributions from the pore-fluid and the rock framework. Therefore, I proposed a pore-pressure prediction model which is based on the pore-fluid contribution, calculated through WT-MRA, to the P-wave velocity.Open Acces

Single channel signal separation using pseudo-stereo model and time-freqency masking

PhD ThesisIn many practical applications, one sensor is only available to record a mixture of a number of signals. Single-channel blind signal separation (SCBSS) is the research topic that addresses the problem of recovering the original signals from the observed mixture without (or as little as possible) any prior knowledge of the signals. Given a single mixture, a new pseudo-stereo mixing model is developed. A “pseudo-stereo” mixture is formulated by weighting and time-shifting the original single-channel mixture. This creates an artificial resemblance of a stereo signal given by one location which results in the same time-delay but different attenuation of the source signals. The pseudo-stereo mixing model relaxes the underdetermined ill-conditions associated with monaural source separation and begets the advantage of the relationship of the signals between the readily observed mixture and the pseudo-stereo mixture. This research proposes three novel algorithms based on the pseudo-stereo mixing model and the binary time-frequency (TF) mask. Firstly, the proposed SCBSS algorithm estimates signals’ weighted coefficients from a ratio of the pseudo-stereo mixing model and then constructs a binary maximum likelihood TF masking for separating the observed mixture. Secondly, a mixture in noisy background environment is considered. Thus, a mixture enhancement algorithm has been developed and the proposed SCBSS algorithm is reformulated using an adaptive coefficients estimator. The adaptive coefficients estimator computes the signal characteristics for each time frame. This property is desirable for both speech and audio signals as they are aptly characterized as non-stationary AR processes. Finally, a multiple-time delay (MTD) pseudo-stereo SINGLE CHANNEL SIGNAL SEPARATION ii mixture is developed. The MTD mixture enhances the flexibility as well as the separability over the originally proposed pseudo-stereo mixing model. The separation algorithm of the MTD mixture has also been derived. Additionally, comparison analysis between the MTD mixture and the pseudo-stereo mixture has also been identified. All algorithms have been demonstrated by synthesized and real-audio signals. The performance of source separation has been assessed by measuring the distortion between original source and the estimated one according to the signal-to-distortion (SDR) ratio. Results show that all proposed SCBSS algorithms yield a significantly better separation performance with an average SDR improvement that ranges from 2.4dB to 5dB per source and they are computationally faster over the benchmarked algorithms.Payap University

Information Theoretic Approaches for Motor-Imagery BCI Systems: Review and Experimental Comparison

Brain computer interfaces (BCIs) have been attracting a great interest in recent years. The common spatial patterns (CSP) technique is a well-established approach to the spatial filtering of the electroencephalogram (EEG) data in BCI applications. Even though CSP was originally proposed from a heuristic viewpoint, it can be also built on very strong foundations using information theory. This paper reviews the relationship between CSP and several information-theoretic approaches, including the Kullback–Leibler divergence, the Beta divergence and the Alpha-Beta log-det (AB-LD)divergence. We also revise other approaches based on the idea of selecting those features that are maximally informative about the class labels. The performance of all the methods will be also compared via experiments.Gobierno Español MICINN TEC2014-53103-

System approach to robust acoustic echo cancellation through semi-blind source separation based on independent component analysis

We live in a dynamic world full of noises and interferences. The conventional acoustic echo cancellation (AEC) framework based on the least mean square (LMS) algorithm by itself lacks the ability to handle many secondary signals that interfere with the adaptive filtering process, e.g., local speech and background noise. In this dissertation, we build a foundation for what we refer to as the system approach to signal enhancement as we focus on the AEC problem. We first propose the residual echo enhancement (REE) technique that utilizes the error recovery nonlinearity (ERN) to "enhances" the filter estimation error prior to the filter adaptation. The single-channel AEC problem can be viewed as a special case of semi-blind source separation (SBSS) where one of the source signals is partially known, i.e., the far-end microphone signal that generates the near-end acoustic echo. SBSS optimized via independent component analysis (ICA) leads to the system combination of the LMS algorithm with the ERN that allows for continuous and stable adaptation even during double talk. Second, we extend the system perspective to the decorrelation problem for AEC, where we show that the REE procedure can be applied effectively in a multi-channel AEC (MCAEC) setting to indirectly assist the recovery of lost AEC performance due to inter-channel correlation, known generally as the "non-uniqueness" problem. We develop a novel, computationally efficient technique of frequency-domain resampling (FDR) that effectively alleviates the non-uniqueness problem directly while introducing minimal distortion to signal quality and statistics. We also apply the system approach to the multi-delay filter (MDF) that suffers from the inter-block correlation problem. Finally, we generalize the MCAEC problem in the SBSS framework and discuss many issues related to the implementation of an SBSS system. We propose a constrained batch-online implementation of SBSS that stabilizes the convergence behavior even in the worst case scenario of a single far-end talker along with the non-uniqueness condition on the far-end mixing system. The proposed techniques are developed from a pragmatic standpoint, motivated by real-world problems in acoustic and audio signal processing. Generalization of the orthogonality principle to the system level of an AEC problem allows us to relate AEC to source separation that seeks to maximize the independence, hence implicitly the orthogonality, not only between the error signal and the far-end signal, but rather, among all signals involved. The system approach, for which the REE paradigm is just one realization, enables the encompassing of many traditional signal enhancement techniques in analytically consistent yet practically effective manner for solving the enhancement problem in a very noisy and disruptive acoustic mixing environment.PhDCommittee Chair: Biing-Hwang Juang; Committee Member: Brani Vidakovic; Committee Member: David V. Anderson; Committee Member: Jeff S. Shamma; Committee Member: Xiaoli M