An Efficient Algorithm for Video Super-Resolution Based On a Sequential Model

In this work, we propose a novel procedure for video super-resolution, that is the recovery of a sequence of high-resolution images from its low-resolution counterpart. Our approach is based on a "sequential" model (i.e., each high-resolution frame is supposed to be a displaced version of the preceding one) and considers the use of sparsity-enforcing priors. Both the recovery of the high-resolution images and the motion fields relating them is tackled. This leads to a large-dimensional, non-convex and non-smooth problem. We propose an algorithmic framework to address the latter. Our approach relies on fast gradient evaluation methods and modern optimization techniques for non-differentiable/non-convex problems. Unlike some other previous works, we show that there exists a provably-convergent method with a complexity linear in the problem dimensions. We assess the proposed optimization method on {several video benchmarks and emphasize its good performance with respect to the state of the art.}Comment: 37 pages, SIAM Journal on Imaging Sciences, 201

Two-dimensional adaptive block Kalman filtering of SAR imagery

Includes bibliographical references.Speckle effects are commonly observed in synthetic aperture radar (SAR) imagery. In airborne SAR systems the effect of this degradation reduces the accuracy of detection substantially. Thus, the elimination of this noise is an important task in SAR imaging systems. In this paper a new method for speckle noise removal is introduced using 2-D adaptive block Kalman filtering (ABKF). The image process is represented by an autoregressive (AR) model with nonsymmetric half-plane (NSHP) region of support. New 2-D Kalman filtering equations are derived which take into account not only the effect of speckles as a multiplicative noise but also those of the additive receiver thermal noise and the blur. This method assumes local stationarity within a processing window, whereas the image can be assumed to be globally nonstationary. A recursive identification process using the stochastic Newton approach is also proposed which can be used on-line to estimate the filter parameters based upon the information within each new block of the image. Simulation results on several images are provided to indicate the effectiveness of the proposed method when used to remove the effects of speckle noise as well as that of the additive noise

Model based estimation of image depth and displacement

Passive depth and displacement map determinations have become an important part of computer vision processing. Applications that make use of this type of information include autonomous navigation, robotic assembly, image sequence compression, structure identification, and 3-D motion estimation. With the reliance of such systems on visual image characteristics, a need to overcome image degradations, such as random image-capture noise, motion, and quantization effects, is clearly necessary. Many depth and displacement estimation algorithms also introduce additional distortions due to the gradient operations performed on the noisy intensity images. These degradations can limit the accuracy and reliability of the displacement or depth information extracted from such sequences. Recognizing the previously stated conditions, a new method to model and estimate a restored depth or displacement field is presented. Once a model has been established, the field can be filtered using currently established multidimensional algorithms. In particular, the reduced order model Kalman filter (ROMKF), which has been shown to be an effective tool in the reduction of image intensity distortions, was applied to the computed displacement fields. Results of the application of this model show significant improvements on the restored field. Previous attempts at restoring the depth or displacement fields assumed homogeneous characteristics which resulted in the smoothing of discontinuities. In these situations, edges were lost. An adaptive model parameter selection method is provided that maintains sharp edge boundaries in the restored field. This has been successfully applied to images representative of robotic scenarios. In order to accommodate image sequences, the standard 2-D ROMKF model is extended into 3-D by the incorporation of a deterministic component based on previously restored fields. The inclusion of past depth and displacement fields allows a means of incorporating the temporal information into the restoration process. A summary on the conditions that indicate which type of filtering should be applied to a field is provided

A Unifying review of linear gaussian models

Factor analysis, principal component analysis, mixtures of gaussian clusters, vector quantization, Kalman filter models, and hidden Markov models can all be unified as variations of unsupervised learning under a single basic generative model. This is achieved by collecting together disparate observations and derivations made by many previous authors and introducing a new way of linking discrete and continuous state models using a simple nonlinearity. Through the use of other nonlinearities, we show how independent component analysis is also a variation of the same basic generative model.We show that factor analysis and mixtures of gaussians can be implemented in autoencoder neural networks and learned using squared error plus the same regularization term. We introduce a new model for static data, known as sensible principal component analysis, as well as a novel concept of spatially adaptive observation noise. We also review some of the literature involving global and local mixtures of the basic models and provide pseudocode for inference and learning for all the basic models

Model based fault detection for two-dimensional systems

Fault detection and isolation (FDI) are essential in ensuring safe and reliable operations in industrial systems. Extensive research has been carried out on FDI for one dimensional (1-D) systems, where variables vary only with time. The existing FDI strategies are mainly focussed on 1-D systems and can generally be classified as model based and process history data based methods. In many industrial systems, the state variables change with space and time (e.g., sheet forming, fixed bed reactors, and furnaces). These systems are termed as distributed parameter systems (DPS) or two dimensional (2-D) systems. 2-D systems have been commonly represented by the Roesser Model and the F-M model. Fault detection and isolation for 2-D systems represent a great challenge in both theoretical development and applications and only limited research results are available. In this thesis, model based fault detection strategies for 2-D systems have been investigated based on the F-M and the Roesser models. A dead-beat observer based fault detection has been available for the F-M model. In this work, an observer based fault detection strategy is investigated for systems modelled by the Roesser model. Using the 2-D polynomial matrix technique, a dead-beat observer is developed and the state estimate from the observer is then input to a residual generator to monitor occurrence of faults. An enhanced realization technique is combined to achieve efficient fault detection with reduced computations. Simulation results indicate that the proposed method is effective in detecting faults for systems without disturbances as well as those affected by unknown disturbances.The dead-beat observer based fault detection has been shown to be effective for 2-D systems but strict conditions are required in order for an observer and a residual generator to exist. These strict conditions may not be satisfied for some systems. The effect of process noises are also not considered in the observer based fault detection approaches for 2-D systems. To overcome the disadvantages, 2-D Kalman filter based fault detection algorithms are proposed in the thesis. A recursive 2-D Kalman filter is applied to obtain state estimate minimizing the estimation error variances. Based on the state estimate from the Kalman filter, a residual is generated reflecting fault information. A model is formulated for the relation of the residual with faults over a moving evaluation window. Simulations are performed on two F-M models and results indicate that faults can be detected effectively and efficiently using the Kalman filter based fault detection. In the observer based and Kalman filter based fault detection approaches, the residual signals are used to determine whether a fault occurs. For systems with complicated fault information and/or noises, it is necessary to evaluate the residual signals using statistical techniques. Fault detection of 2-D systems is proposed with the residuals evaluated using dynamic principal component analysis (DPCA). Based on historical data, the reference residuals are first generated using either the observer or the Kalman filter based approach. Based on the residual time-lagged data matrices for the reference data, the principal components are calculated and the threshold value obtained. In online applications, the T2 value of the residual signals are compared with the threshold value to determine fault occurrence. Simulation results show that applying DPCA to evaluation of 2-D residuals is effective.Doctoral These