Review of Face Detection Systems Based Artificial Neural Networks Algorithms

Face detection is one of the most relevant applications of image processing and biometric systems. Artificial neural networks (ANN) have been used in the field of image processing and pattern recognition. There is lack of literature surveys which give overview about the studies and researches related to the using of ANN in face detection. Therefore, this research includes a general review of face detection studies and systems which based on different ANN approaches and algorithms. The strengths and limitations of these literature studies and systems were included also.Comment: 16 pages, 12 figures, 1 table, IJMA Journa

Monte Carlo Co-Ordinate Ascent Variational Inference

In Variational Inference (VI), coordinate-ascent and gradient-based approaches are two major types of algorithms for approximating difficult-to-compute probability densities. In real-world implementations of complex models, Monte Carlo methods are widely used to estimate expectations in coordinate-ascent approaches and gradients in derivative-driven ones. We discuss a Monte Carlo Co-ordinate Ascent VI (MC-CAVI) algorithm that makes use of Markov chain Monte Carlo (MCMC) methods in the calculation of expectations required within Co-ordinate Ascent VI (CAVI). We show that, under regularity conditions, an MC-CAVI recursion will get arbitrarily close to a maximiser of the evidence lower bound (ELBO) with any given high probability. In numerical examples, the performance of MC-CAVI algorithm is compared with that of MCMC and -- as a representative of derivative-based VI methods -- of Black Box VI (BBVI). We discuss and demonstrate MC-CAVI's suitability for models with hard constraints in simulated and real examples. We compare MC-CAVI's performance with that of MCMC in an important complex model used in Nuclear Magnetic Resonance (NMR) spectroscopy data analysis -- BBVI is nearly impossible to be employed in this setting due to the hard constraints involved in the model

Feature selection using Haar wavelet power spectrum

BACKGROUND: Feature selection is an approach to overcome the 'curse of dimensionality' in complex researches like disease classification using microarrays. Statistical methods are utilized more in this domain. Most of them do not fit for a wide range of datasets. The transform oriented signal processing domains are not probed much when other fields like image and video processing utilize them well. Wavelets, one of such techniques, have the potential to be utilized in feature selection method. The aim of this paper is to assess the capability of Haar wavelet power spectrum in the problem of clustering and gene selection based on expression data in the context of disease classification and to propose a method based on Haar wavelet power spectrum. RESULTS: Haar wavelet power spectra of genes were analysed and it was observed to be different in different diagnostic categories. This difference in trend and magnitude of the spectrum may be utilized in gene selection. Most of the genes selected by earlier complex methods were selected by the very simple present method. Each earlier works proved only few genes are quite enough to approach the classification problem [1]. Hence the present method may be tried in conjunction with other classification methods. The technique was applied without removing the noise in data to validate the robustness of the method against the noise or outliers in the data. No special softwares or complex implementation is needed. The qualities of the genes selected by the present method were analysed through their gene expression data. Most of them were observed to be related to solve the classification issue since they were dominant in the diagnostic category of the dataset for which they were selected as features. CONCLUSION: In the present paper, the problem of feature selection of microarray gene expression data was considered. We analyzed the wavelet power spectrum of genes and proposed a clustering and feature selection method useful for classification based on Haar wavelet power spectrum. Application of this technique in this area is novel, simple, and faster than other methods, fit for a wide range of data types. The results are encouraging and throw light into the possibility of using this technique for problem domains like disease classification, gene network identification and personalized drug design

Machine Analysis of Facial Expressions

No abstract

Seismic Ray Impedance Inversion

This thesis investigates a prestack seismic inversion scheme implemented in the ray parameter domain. Conventionally, most prestack seismic inversion methods are performed in the incidence angle domain. However, inversion using the concept of ray impedance, as it honours ray path variation following the elastic parameter variation according to Snell’s law, shows the capacity to discriminate different lithologies if compared to conventional elastic impedance inversion. The procedure starts with data transformation into the ray-parameter domain and then implements the ray impedance inversion along constant ray-parameter profiles. With different constant-ray-parameter profiles, mixed-phase wavelets are initially estimated based on the high-order statistics of the data and further refined after a proper well-to-seismic tie. With the estimated wavelets ready, a Cauchy inversion method is used to invert for seismic reflectivity sequences, aiming at recovering seismic reflectivity sequences for blocky impedance inversion. The impedance inversion from reflectivity sequences adopts a standard generalised linear inversion scheme, whose results are utilised to identify rock properties and facilitate quantitative interpretation. It has also been demonstrated that we can further invert elastic parameters from ray impedance values, without eliminating an extra density term or introducing a Gardner’s relation to absorb this term. Ray impedance inversion is extended to P-S converted waves by introducing the definition of converted-wave ray impedance. This quantity shows some advantages in connecting prestack converted wave data with well logs, if compared with the shearwave elastic impedance derived from the Aki and Richards approximation to the Zoeppritz equations. An analysis of P-P and P-S wave data under the framework of ray impedance is conducted through a real multicomponent dataset, which can reduce the uncertainty in lithology identification.Inversion is the key method in generating those examples throughout the entire thesis as we believe it can render robust solutions to geophysical problems. Apart from the reflectivity sequence, ray impedance and elastic parameter inversion mentioned above, inversion methods are also adopted in transforming the prestack data from the offset domain to the ray-parameter domain, mixed-phase wavelet estimation, as well as the registration of P-P and P-S waves for the joint analysis. The ray impedance inversion methods are successfully applied to different types of datasets. In each individual step to achieving the ray impedance inversion, advantages, disadvantages as well as limitations of the algorithms adopted are detailed. As a conclusion, the ray impedance related analyses demonstrated in this thesis are highly competent compared with the classical elastic impedance methods and the author would like to recommend it for a wider application

Hierarchical nonlinear, multivariate, and spatially-dependent time-frequency functional methods

Notions of time and frequency are important constituents of most scientific inquiries, providing complimentary information. In an era of "big data," methodology for analyzing functional and/or image data is increasingly important. This dissertation develops methodology at the cross-section of time-frequency analysis and functional data and consists of three distinct, but related, contributions. First, we propose nonparametric methodology for nonlinear multivariate time-frequency functional data. In particular, we consider polynomial nonlinear functional data models that accommodate higher dimensional functional covariates, including time-frequency images, along with their interactions. The necessary dimension reduction for model estimation proceeds through carefully chosen basis expansions (empirical orthogonal functions) and feature-extraction stochastic search variable selection (SSVS). Properties of the methodology are examined through an extensive simulation study. Finally, we illustrate the approach through an application that attempts to characterize spawning behavior of shovelnose sturgeon in terms of high-density depth and temperature profiles. The second contribution proposes model-based time-frequency estimation through Bayesian lattice filter time-varying autoregressive models. In this context, we take a fully Bayesian approach and allow both the autoregressive coefficients and innovation variance to vary over time. Importantly, our model is estimated within the partial autocorrelation domain (i.e., through the partial autocorrelation coefficients). Additionally, all of the full conditional distributions required for our algorithm are of standard form and thus can be easily implemented using a Gibbs sampler. Further, as a by-product of the lattice filter recursions, our approach avoids undesirable matrix inversions. As such, estimation is computationally efficient and stable. We conduct a comprehensive simulation study that compares our method with other competing methods and find that, in most cases, our approach performs superior in terms of average squared error between the estimated and true time-varying spectral density. Lastly, we demonstrate our methodology through several real case studies. The final project of the dissertation develops models that accommodate spatially dependent functional responses with spatially dependent image predictors. The methodology is motivated by a soil science study that seeks to model spatially correlated water content functionals as a function of electro-conductivity images. The water content curves are measured at different locations within the study field and at various depths, whereas the electro-conductivity images are spatially referenced images of wavelength by depth. Estimation is facilitated by taking a Bayesian approach, where the necessary dimension reduction for model implementation proceeds using basis function expansions along with SSVS. Finally, the methodology is illustrated through an application to our motivating data.Includes bibliographical references (pages 122-133

Failure Diagnosis and Prognosis of Safety Critical Systems: Applications in Aerospace Industries

Many safety-critical systems such as aircraft, space crafts, and large power plants are required to operate in a reliable and efficient working condition without any performance degradation. As a result, fault diagnosis and prognosis (FDP) is a research topic of great interest in these systems. FDP systems attempt to use historical and current data of a system, which are collected from various measurements to detect faults, diagnose the types of possible failures, predict and manage failures in advance. This thesis deals with FDP of safety-critical systems. For this purpose, two critical systems including a multifunctional spoiler (MFS) and hydro-control value system are considered, and some challenging issues from the FDP are investigated. This research work consists of three general directions, i.e., monitoring, failure diagnosis, and prognosis. The proposed FDP methods are based on data-driven and model-based approaches. The main aim of the data-driven methods is to utilize measurement data from the system and forecast the remaining useful life (RUL) of the faulty components accurately and efficiently. In this regard, two dierent methods are developed. A modular FDP method based on a divide and conquer strategy is presented for the MFS system. The modular structure contains three components:1) fault diagnosis unit, 2) failure parameter estimation unit and 3) RUL unit. The fault diagnosis unit identifies types of faults based on an integration of neural network (NN) method and discrete wavelet transform (DWT) technique. Failure parameter estimation unit observes the failure parameter via a distributed neural network. Afterward, the RUL of the system is predicted by an adaptive Bayesian method. In another work, an innovative data-driven FDP method is developed for hydro-control valve systems. The idea is to use redundancy in multi-sensor data information and enhance the performance of the FDP system. Therefore, a combination of a feature selection method and support vector machine (SVM) method is applied to select proper sensors for monitoring of the hydro-valve system and isolate types of fault. Then, adaptive neuro-fuzzy inference systems (ANFIS) method is used to estimate the failure path. Similarly, an online Bayesian algorithm is implemented for forecasting RUL. Model-based methods employ high-delity physics-based model of a system for prognosis task. In this thesis, a novel model-based approach based on an integrated extended Kalman lter (EKF) and Bayesian method is introduced for the MFS system. To monitor the MFS system, a residual estimation method using EKF is performed to capture the progress of the failure. Later, a transformation is utilized to obtain a new measure to estimate the degradation path (DP). Moreover, the recursive Bayesian algorithm is invoked to predict the RUL. Finally, relative accuracy (RA) measure is utilized to assess the performance of the proposed methods

Human activity recognition based on evolving fuzzy systems

Environments equipped with intelligent sensors can be of much help if they can recognize the actions or activities of their users. If this activity recognition is done automatically, it can be very useful for different tasks such as future action prediction, remote health monitoring, or interventions. Although there are several approaches for recognizing activities, most of them do not consider the changes in how a human performs a specific activity. We present an automated approach to recognize daily activities from the sensor readings of an intelligent home environment. However, as the way to perform an activity is usually not fixed but it changes and evolves, we propose an activity recognition method based on Evolving Fuzzy SystemsThis work has been partially supported by the Spanish Government under project TRA2007-67374-C02-0

Change-point Problem and Regression: An Annotated Bibliography

The problems of identifying changes at unknown times and of estimating the location of changes in stochastic processes are referred to as the change-point problem or, in the Eastern literature, as disorder . The change-point problem, first introduced in the quality control context, has since developed into a fundamental problem in the areas of statistical control theory, stationarity of a stochastic process, estimation of the current position of a time series, testing and estimation of change in the patterns of a regression model, and most recently in the comparison and matching of DNA sequences in microarray data analysis. Numerous methodological approaches have been implemented in examining change-point models. Maximum-likelihood estimation, Bayesian estimation, isotonic regression, piecewise regression, quasi-likelihood and non-parametric regression are among the methods which have been applied to resolving challenges in change-point problems. Grid-searching approaches have also been used to examine the change-point problem. Statistical analysis of change-point problems depends on the method of data collection. If the data collection is ongoing until some random time, then the appropriate statistical procedure is called sequential. If, however, a large finite set of data is collected with the purpose of determining if at least one change-point occurred, then this may be referred to as non-sequential. Not surprisingly, both the former and the latter have a rich literature with much of the earlier work focusing on sequential methods inspired by applications in quality control for industrial processes. In the regression literature, the change-point model is also referred to as two- or multiple-phase regression, switching regression, segmented regression, two-stage least squares (Shaban, 1980), or broken-line regression. The area of the change-point problem has been the subject of intensive research in the past half-century. The subject has evolved considerably and found applications in many different areas. It seems rather impossible to summarize all of the research carried out over the past 50 years on the change-point problem. We have therefore confined ourselves to those articles on change-point problems which pertain to regression. The important branch of sequential procedures in change-point problems has been left out entirely. We refer the readers to the seminal review papers by Lai (1995, 2001). The so called structural change models, which occupy a considerable portion of the research in the area of change-point, particularly among econometricians, have not been fully considered. We refer the reader to Perron (2005) for an updated review in this area. Articles on change-point in time series are considered only if the methodologies presented in the paper pertain to regression analysis

Sensor based real-time process monitoring for ultra-precision manufacturing processes with non-linearity and non-stationarity

This research investigates methodologies for real-time process monitoring in ultra-precision manufacturing processes, specifically, chemical mechanical planarization (CMP) and ultra-precision machining (UPM), are investigated in this dissertation.The three main components of this research are as follows: (1) developing a predictive modeling approaches for early detection of process anomalies/change points, (2) devising approaches that can capture the non-Gaussian and non-stationary characteristics of CMP and UPM processes, and (3) integrating multiple sensor data to make more reliable process related decisions in real-time.In the first part, we establish a quantitative relationship between CMP process performance, such as material removal rate (MRR) and data acquired from wireless vibration sensors. Subsequently, a non-linear sequential Bayesian analysis is integrated with decision theoretic concepts for detection of CMP process end-point for blanket copper wafers. Using this approach, CMP polishing end-point was detected within a 5% error rate.Next, a non-parametric Bayesian analytical approach is utilized to capture the inherently complex, non-Gaussian, and non-stationary sensor signal patterns observed in CMP process. An evolutionary clustering analysis, called Recurrent Nested Dirichlet Process (RNDP) approach is developed for monitoring CMP process changes using MEMS vibration signals. Using this novel signal analysis approach, process drifts are detected within 20 milliseconds and is assessed to be 3-7 times faster than traditional SPC charts. This is very beneficial to the industry from an application standpoint, because, wafer yield losses will be mitigated to a great extent, if the onset of CMP process drifts can be detected timely and accurately.Lastly, a non-parametric Bayesian modeling approach, termed Dirichlet Process (DP) is combined with a multi-level hierarchical information fusion technique for monitoring of surface finish in UPM process. Using this approach, signal patterns from six different sensors (three axis vibration and force) are integrated based on information fusion theory. It was observed that using experimental UPM sensor data that process decisions based on the multiple sensor information fusion approach were 15%-30% more accurate than the decisions from individual sensors. This will enable more accurate and reliable estimation of process conditions in ultra-precision manufacturing applications