Multiperspective mosaics and layered representation for scene visualization

This thesis documents the efforts made to implement multiperspective mosaicking for the purpose of mosaicking undervehicle and roadside sequences. For the undervehicle sequences, it is desired to create a large, high-resolution mosaic that may used to quickly inspect the entire scene shot by a camera making a single pass underneath the vehicle. Several constraints are placed on the video data, in order to facilitate the assumption that the entire scene in the sequence exists on a single plane. Therefore, a single mosaic is used to represent a single video sequence. Phase correlation is used to perform motion analysis in this case. For roadside video sequences, it is assumed that the scene is composed of several planar layers, as opposed to a single plane. Layer extraction techniques are implemented in order to perform this decomposition. Instead of using phase correlation to perform motion analysis, the Lucas-Kanade motion tracking algorithm is used in order to create dense motion maps. Using these motion maps, spatial support for each layer is determined based on a pre-initialized layer model. By separating the pixels in the scene into motion-specific layers, it is possible to sample each element in the scene correctly while performing multiperspective mosaicking. It is also possible to fill in many gaps in the mosaics caused by occlusions, hence creating more complete representations of the objects of interest. The results are several mosaics with each mosaic representing a single planar layer of the scene

Significant achievements in the planetary geology program, 1981

Recent developments in planetology research as reported at the 1981 NASA Planetary Geology Principal Investigators meeting are summarized. The evolution of the solar system, comparative planetology, and geologic processes active on other planets are considered. Galilean satellites and small bodies, Venus, geochemistry and regoliths, volcanic and aeolian processes and landforms, fluvial and periglacial processes, and planetary impact cratering, remote sensing, and cartography are discussed

Classic Mosaics and Visual Correspondence via Graph-Cut based Energy Optimization

Computer graphics and computer vision were traditionally two distinct research fields focusing on opposite topics. Lately, they have been increasingly borrowing ideas and tools from each other. In this thesis, we investigate two problems in computer vision and graphics that rely on the same tool, namely energy optimization with graph cuts. In the area of computer graphics, we address the problem of generating artificial classic mosaics, still and animated. The main purpose of artificial mosaics is to help a user to create digital art. First we reformulate our previous static mosaic work in a more principled global optimization framework. Then, relying on our still mosaic algorithm, we develop a method for producing animated mosaics directly from real video sequences, which is the first such method, we believe. Our mosaic animation style is uniquely expressive. Our method estimates the motion of the pixels in the video, renders the frames with mosaic effect based on both the colour and motion information from the input video. This algorithm relies extensively on our novel motion segmentation approach, which is a computer vision problem. To improve the quality of our animated mosaics, we need to improve the motion segmentation algorithm. Since motion and stereo problems have a similar setup, we start with the problem of finding visual correspondence for stereo, which has the advantage of having datasets with ground truth, useful for evaluation. Most previous methods for stereo correspondence do not provide any measure of reliability in their estimates. We aim to find the regions for which correspondence can be determined reliably. Our main idea is to find corresponding regions that have a sufficiently strong texture cue on the boundary, since texture is a reliable cue for matching. Unlike the previous work, we allow the disparity range within each such region to vary smoothly, instead of being constant. This produces blob-like semi-dense visual features for which we have a high confidence in their estimated ranges of disparities

Mapping and classification of ecologically sensitive marine habitats using unmanned aerial vehicle (UAV) imagery and object-based image analysis (OBIA)

Nowadays, emerging technologies, such as long-range transmitters, increasingly miniaturized components for positioning, and enhanced imaging sensors, have led to an upsurge in the availability of new ecological applications for remote sensing based on unmanned aerial vehicles (UAVs), sometimes referred to as “drones”. In fact, structure-from-motion (SfM) photogrammetry coupled with imagery acquired by UAVs offers a rapid and inexpensive tool to produce high-resolution orthomosaics, giving ecologists a new way for responsive, timely, and cost-effective monitoring of ecological processes. Here, we adopted a lightweight quadcopter as an aerial survey tool and object-based image analysis (OBIA) workflow to demonstrate the strength of such methods in producing very high spatial resolution maps of sensitive marine habitats. Therefore, three different coastal environments were mapped using the autonomous flight capability of a lightweight UAV equipped with a fully stabilized consumer-grade RGB digital camera. In particular we investigated a Posidonia oceanica seagrass meadow, a rocky coast with nurseries for juvenile fish, and two sandy areas showing biogenic reefs of Sabelleria alveolata. We adopted, for the first time, UAV-based raster thematic maps of these key coastal habitats, produced after OBIA classification, as a new method for fine-scale, low-cost, and time saving characterization of sensitive marine environments which may lead to a more effective and efficient monitoring and management of natural resource

St. Lawrence Island polynya: Ice circulation and dense water production

Thesis (Ph.D.) University of Alaska Fairbanks, 1999The St. Lawrence Island polynya (SLIP) opens every winter off the coast of St. Lawrence Island as winds move ice away from the shore. The SLIP is an important site for production of the dense water that flows northward through the Bering Strait to help maintain the Arctic Ocean halocline. Winter 1991/1992 ERS-1 SAR, thermal infrared, and passive microwave imagery are analyzed in combination with regional climate system and analytical simulations to investigate SLIP ice circulation, heat fluxes, and dense water production. Emphasis is on the February 1992 southern SLIP event. Satellite-based measurements show this polynya extended ~165km offshore and ~100km along shore at maximum extent. ERS-1 SAR GPS-derived ice motion indicated maximum ice speeds of ~30km day -1 during polynya expansion. Ice along the polynya boundary drifted parallel to the wind at 3--4% of the wind speed during north/northeasterly winds >7m s-1 Heat fluxes associated with the SLIP varied depending on method of calculation, but indicated increasing trends during polynya development. Associated ice production rates of 4.218.9cm day-1 were computed via different models. Dense water production, derived from ice production rates and polynya size, ranged from 0.011--0.017Sv, suggesting that the SLIP could account for 19--27% of the Bering Sea's contribution and 1--2% of the total Arctic contribution to Arctic Ocean halocline maintenance. Although the regional climate system model generated the SLIP on the same time scales as observed, a larger polynya resulted. The simulated polynya's heat and moisture impact was observed to at least 800mb, reaching 50km downstream. During periods of sustained winds, ice circulation was similar to that observed. Incorporation of a "barotropic" ocean component suggested that ocean circulation may be an important ice circulation forcing mechanism at the SLIP, especially during periods of weak winds, as inclusion greatly improved the simulated ice circulation. The "barotropic" ocean also improved polynya shape and extent. If regional climate changes alter the existence of polynyas like the SLIP, changes in the Arctic Ocean halocline might occur. Additional in situ observations and better fully-coupled atmosphere-ice-ocean models are needed to further ascertain the impact of polynyas on the overall Arctic climate system

Cassini observations reveal a regime of zonostrophic macroturbulence on Jupiter

In December 2000, the Cassini fly-by near Jupiter delivered high-resolution images of Jupiter’s clouds over the entire planet in a band between 50°N and 50°S. Three daily-averaged two-dimensional velocity snapshots extracted from these images are used to perform spectral analysis of jovian atmospheric macroturbulence. A similar analysis is also performed on alternative data documented by Choi and Showman (Choi, D., Showman, A. [2011]. Icarus 216, 597–609), based on a different method of image processing. The inter-comparison of the products of both analyses ensures a better constraint of the spectral estimates. Both analyses reveal strong anisotropy of the kinetic energy spectrum. The zonal spectrum is very steep and most of the kinetic energy resides in slowly evolving, alternating zonal (west–east) jets, while the non-zonal, or residual spectrum obeys the Kolmogorov–Kraichnan law specific to two-dimensional turbulence in the range of the inverse energy cascade. The spectral data is used to estimate the inverse cascade rate ∊ and the zonostrophy index Rβ for the first time. Although both datasets yield somewhat different values of ∊, it is estimated to be in the range 0.5–1.0 × 10−5 m2 s−3. The ensuing values of Rβ ≳ 5 belong well in the range of zonostrophic turbulence whose threshold corresponds to Rβ ≃ 2.5. We infer that the large-scale circulation is maintained by an anisotropic inverse energy cascade. The removal of the Great Red Spot from both datasets has no significant effect upon either the spectra or the inverse cascade rate. The spectral data are used to compute the rate of the energy exchange, W, between the non-zonal structures and the large-scale zonal flow. It is found that instantaneous values of W may exceed ∊ by an order of magnitude. Previous numerical simulations with a barotropic model suggest that W and ∊ attain comparable values only after averaging of W over a sufficiently long time. Near-instantaneous values of W that have been routinely used to infer the rate of the kinetic energy supply to Jupiter’s zonal flow may therefore significantly overestimate ∊. This disparity between W and ∊ may resolve the long-standing conundrum of an unrealistically high rate of energy transfer to the zonal flow. The meridional diffusivity Kϕ in the regime of zonostrophic turbulence is given by an expression that depends on ∊. The value of Kϕ estimated from the spectra is compared against data from the dispersion of stratospheric gases and debris resulting from the Shoemaker-Levy 9 comet and Wesley asteroid impacts in 1994 and 2009 respectively. Not only is Kϕ found to be consistent with estimates for both impacts, but the eddy diffusivity found from observations appears to be scale-independent. This behaviour could be a consequence of the interaction between anisotropic turbulence and Rossby waves specific to the regime of zonostrophic macroturbulence

High resolution spatial variability in spring snowmelt for an Arctic shrub-tundra watershed

Arctic tundra environments are characterized by spatially heterogeneous end-of-winter snow cover because of high winds that erode, transport and deposit snow over the winter. This spatially variable end-of-winter snow cover subsequently influences the spatial and temporal variability of snowmelt and results in a patchy snowcover over the melt period. Documenting changes in both snow cover area (SCA) and snow water equivalent (SWE) during the spring melt is essential for understanding hydrological systems, but the lack of high-resolution SCA and SWE datasets that accurately capture micro-scale changes are not commonly available, and do not exist for the Canadian Arctic. This study applies high-resolution remote sensing measurements of SCA and SWE using a fixed-wing Unmanned Aerial System (UAS) to document snowcover changes over the snowmelt period for an Arctic tundra headwater catchment. Repeat measurements of SWE and SCA were obtained for four dominant land cover types (tundra, short shrub, tall shrub, and topographic drift) to provide observations of spatially distributed snowmelt patterns and basin-wide declines in SWE. High-resolution analysis of snowcover conditions over the melt reveal a strong relationship between land cover type, snow distribution, and snow ablation rates whereby shallow snowpacks found in tundra and short shrub regions feature rapid declines in SWE and SCA and became snow-free approximately 10 days earlier than deeper snowpacks. In contrast, tall shrub patches and topographic drift regions were characterized by large initial SWE values and featured a slow decline in SCA. Analysis of basin-wide declines in SCA and SWE reveal three distinct melt phases characterized by 1) low melt rates across a large area resulting in a minor change in SCA, but a very large decline in SWE with, 2) high melt rates resulting in drastic declines in both SCA and SWE, and 3) low melt rates over a small portion of the basin, resulting in little change to either SCA or SWE. The ability to capture high-resolution spatio-temporal changes to tundra snow cover furthers our understanding of the relative importance of various land cover types on the snowmelt timing and amount of runoff available to the hydrological system during the spring freshet

Artifacts and landmarks: pearls and pitfalls for in vivo reflectance confocal microscopy of the skin using the tissue-coupled device

Reflectance confocal microscopy (RCM) is a non-invasive imaging tool for cellular-level examination of skin lesions, typically from the epidermis to the superficial dermis. Clinical studies show RCM imaging is highly sensitive and specific in the diagnosis of skin diseases. RCM is disseminating from academic tertiary care centers with early adopter "experts" into diverse clinical settings, with image acquisition performed by technicians and image interpretation by physicians. In the hands of trained users, RCM serves an aid to accurately diagnose and monitor skin tumors and inflammatory processes. However, exogenous and endogenous artifacts introduced during imaging can obscure RCM images, limiting or prohibiting interpretation. Herein we review the types of artifacts that may occur and techniques for mitigating them during image acquisition, to assist technicians with qualitative image assessment and provide physicians guidance on identifying artifacts that may confound interpretation. Finally, we discuss normal skin "landmarks" and how they can (i) obscure images, (ii) be exploited for additional diagnostic information, and (iii) simulate pathological structures. A deeper understanding of the principles and methods behind RCM imaging and the varying appearance of normal skin structures in the acquired images aids technicians in capturing higher quality image sets and enables physicians to increase interpretation accuracy