Probabilistc and sequential computation of optical flow using temporal coherence

Caption title. "Revised version of LIDS-P-2122."Includes bibliographical references (p. 23-26).Supported by the Office on Naval Research. N00014-91-J-1004 N00014-91-J-1120 (Random Field in Oceanography ARI) Supported by the National Sceice Foundation. MIP-9195281 Supported by the Army Research Office. DAAL03-86-K-0171Toshio M. Chin, William C. Karl, Alan S. Willsky

First results of site testing program at Mt. Shatdzhatmaz in 2007 - 2009

We present the first results of the site testing performed at Mt.~Shatdzhatmaz at Northern Caucasus, where the new Sternberg astronomical institute 2.5-m telescope will be installed. An automatic site monitor instrumentation and functionality are described together with the methods of measurement of the basic astroclimate and weather parameters. The clear night sky time derived on the basis of 2006 -- 2009 data amounts to 1340 hours per year. Principle attention is given to the measurement of the optical turbulence altitude distribution which is the most important characteristic affecting optical telescopes performance. For the period from November 2007 to October 2009 more than 85\,000 turbulence profiles were collected using the combined MASS/DIMM instrument. The statistical properties of turbulent atmosphere above the summit are derived and the median values for seeing $\beta_0 = 0.93$~arcsec and free-atmosphere seeing $\beta_{free} = 0.51$~arcsec are determined. Together with the estimations of isoplanatic angle $\theta_0 = 2.07$~arcsec and time constant \tau_0 = 2.58 \mbox{ ms}, these are the first representative results obtained for Russian sites which are necessary for development of modern astronomical observation techniques like adaptive optics.Comment: Accepted for publication in MNRAS, 17 pages, 15 figure

Statistical Methods for Image Registration and Denoising

This dissertation describes research into image processing techniques that enhance military operational and support activities. The research extends existing work on image registration by introducing a novel method that exploits local correlations to improve the performance of projection-based image registration algorithms. The dissertation also extends the bounds on image registration performance for both projection-based and full-frame image registration algorithms and extends the Barankin bound from the one-dimensional case to the problem of two-dimensional image registration. It is demonstrated that in some instances, the Cramer-Rao lower bound is an overly-optimistic predictor of image registration performance and that under some conditions, the Barankin bound is a better predictor of shift estimator performance. The research also looks at the related problem of single-frame image denoising using block-based methods. The research introduces three algorithms that operate by identifying regions of interest within a noise-corrupted image and then generating noise free estimates of the regions as averages of similar regions in the image

Deep learning for anisoplanatic optical turbulence mitigation in long-range imaging

We present a deep learning approach for restoring images degraded by atmospheric optical turbulence. We consider the case of terrestrial imaging over long ranges with a wide field-of-view. This produces an anisoplanatic imaging scenario where turbulence warping and blurring vary spatially across the image. The proposed turbulence mitigation (TM) method assumes that a sequence of short-exposure images is acquired. A block matching (BM) registration algorithm is applied to the observed frames for dewarping, and the resulting images are averaged. A convolutional neural network (CNN) is then employed to perform spatially adaptive restoration. We refer to the proposed TM algorithm as the block matching and CNN (BM-CNN) method. Training the CNN is accomplished using simulated data from a fast turbulence simulation tool capable of producing a large amount of degraded imagery from declared truth images rapidly. Testing is done using independent data simulated with a different well-validated numerical wave-propagation simulator. Our proposed BM-CNN TM method is evaluated in a number of experiments using quantitative metrics. The quantitative analysis is made possible by virtue of having truth imagery from the simulations. A number of restored images are provided for subjective evaluation. We demonstrate that the BM-CNN TM method outperforms the benchmark methods in the scenarios tested

The Hierarchic treatment of marine ecological information from spatial networks of benthic platforms

Measuring biodiversity simultaneously in different locations, at different temporal scales, and over wide spatial scales is of strategic importance for the improvement of our understanding of the functioning of marine ecosystems and for the conservation of their biodiversity. Monitoring networks of cabled observatories, along with other docked autonomous systems (e.g., Remotely Operated Vehicles [ROVs], Autonomous Underwater Vehicles [AUVs], and crawlers), are being conceived and established at a spatial scale capable of tracking energy fluxes across benthic and pelagic compartments, as well as across geographic ecotones. At the same time, optoacoustic imaging is sustaining an unprecedented expansion in marine ecological monitoring, enabling the acquisition of new biological and environmental data at an appropriate spatiotemporal scale. At this stage, one of the main problems for an effective application of these technologies is the processing, storage, and treatment of the acquired complex ecological information. Here, we provide a conceptual overview on the technological developments in the multiparametric generation, storage, and automated hierarchic treatment of biological and environmental information required to capture the spatiotemporal complexity of a marine ecosystem. In doing so, we present a pipeline of ecological data acquisition and processing in different steps and prone to automation. We also give an example of population biomass, community richness and biodiversity data computation (as indicators for ecosystem functionality) with an Internet Operated Vehicle (a mobile crawler). Finally, we discuss the software requirements for that automated data processing at the level of cyber-infrastructures with sensor calibration and control, data banking, and ingestion into large data portals.Peer ReviewedPostprint (published version

A multigrid platform for real-time motion computation with discontinuity-preserving variational methods

Variational methods are among the most accurate techniques for estimating the optic flow. They yield dense flow fields and can be designed such that they preserve discontinuities, allow to deal with large displacements and perform well under noise or varying illumination. However, such adaptations render the minimisation of the underlying energy functional very expensive in terms of computational costs: Typically, one or more large linear or nonlinear systems of equations have to be solved in order to obtain the desired solution. Consequently, variational methods are considered to be too slow for real-time performance. In our paper we address this problem in two ways: (i) We present a numerical framework based on bidirectional multigrid methods for accelerating a broad class of variational optic flow methods with different constancy and smoothness assumptions. In particular, discontinuity-preserving regularisation strategies are thereby in the focus of our work. (ii) We show by the examples of classical as well as more advanced variational techniques that real-time performance is possible - even for very complex optic flow models with high accuracy. Experiments show frame rates up to 63 dense flow fields per second for real-world image sequences of size 160 x 120 on a standard PC. Compared to classical iterative methods this constitutes a speedup of two to four orders of magnitude

Accelerating Multiframe Blind Deconvolution via Deep Learning

Ground-based solar image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to apply blind deconvolution techniques. These techniques rely on the observation of many short exposure frames that are used to simultaneously infer the instantaneous state of the atmosphere and the unperturbed object. We have recently explored the use of machine learning to accelerate this process, with promising results. We build upon this previous work to propose several interesting improvements that lead to better models. As well, we propose a new method to accelerate the restoration based on algorithm unrolling. In this method, the image restoration problem is solved with a gradient descent method that is unrolled and accelerated aided by a few small neural networks. The role of the neural networks is to correct the estimation of the solution at each iterative step. The model is trained to perform the optimization in a small fixed number of steps with a curated dataset. Our findings demonstrate that both methods significantly reduce the restoration time compared to the standard optimization procedure. Furthermore, we showcase that these models can be trained in an unsupervised manner using observed images from three different instruments. Remarkably, they also exhibit robust generalization capabilities when applied to new datasets. To foster further research and collaboration, we openly provide the trained models, along with the corresponding training and evaluation code, as well as the training dataset, to the scientific community.Comment: 26 pages, 9 figures, accepted for publication in Solar Physic

Assessing stream bank condition using airborne LiDAR and high spatial resolution image data in temperate semirural areas in Victoria, Australia

Stream bank condition is an important physical form indicator for streams related to the environmental condition of riparian corridors. This research developed and applied an approach for mapping bank condition from airborne light detection and ranging (LiDAR) and high-spatial resolution optical image data in a temperate forest/woodland/urban environment. Field observations of bank condition were related to LiDAR and optical image-derived variables, including bank slope, plant projective cover, bank-full width, valley confinement, bank height, bank top crenulation, and ground vegetation cover. Image-based variables, showing correlation with the field measurements of stream bank condition, were used as input to a cumulative logistic regression model to estimate and map bank condition. The highest correlation was achieved between field-assessed bank condition and image-derived average bank slope (R2 1/4 0.60, n 1/4 41), ground vegetation cover (R2 1/4 0.43, n 1/4 41), bank width/height ratio (R2 1/4 0.41, n 1/4 41), and valley confinement (producer's accuracy 1/4 100%, n 1/4 9). Crossvalidation showed an average misclassification error of 0.95 from an ordinal scale from 0 to 4 using the developed model. This approach was developed to support the remotely sensed mapping of stream bank condition for 26,000 km of streams in Victoria, Australia, from 2010 to 2012