Supervised learning on graphs of spatio-temporal similarity in satellite image sequences

High resolution satellite image sequences are multidimensional signals composed of spatio-temporal patterns associated to numerous and various phenomena. Bayesian methods have been previously proposed in (Heas and Datcu, 2005) to code the information contained in satellite image sequences in a graph representation using Bayesian methods. Based on such a representation, this paper further presents a supervised learning methodology of semantics associated to spatio-temporal patterns occurring in satellite image sequences. It enables the recognition and the probabilistic retrieval of similar events. Indeed, graphs are attached to statistical models for spatio-temporal processes, which at their turn describe physical changes in the observed scene. Therefore, we adjust a parametric model evaluating similarity types between graph patterns in order to represent user-specific semantics attached to spatio-temporal phenomena. The learning step is performed by the incremental definition of similarity types via user-provided spatio-temporal pattern examples attached to positive or/and negative semantics. From these examples, probabilities are inferred using a Bayesian network and a Dirichlet model. This enables to links user interest to a specific similarity model between graph patterns. According to the current state of learning, semantic posterior probabilities are updated for all possible graph patterns so that similar spatio-temporal phenomena can be recognized and retrieved from the image sequence. Few experiments performed on a multi-spectral SPOT image sequence illustrate the proposed spatio-temporal recognition method

High resolution spatial variability in spring snowmelt for an Arctic shrub-tundra watershed

Arctic tundra environments are characterized by spatially heterogeneous end-of-winter snow cover because of high winds that erode, transport and deposit snow over the winter. This spatially variable end-of-winter snow cover subsequently influences the spatial and temporal variability of snowmelt and results in a patchy snowcover over the melt period. Documenting changes in both snow cover area (SCA) and snow water equivalent (SWE) during the spring melt is essential for understanding hydrological systems, but the lack of high-resolution SCA and SWE datasets that accurately capture micro-scale changes are not commonly available, and do not exist for the Canadian Arctic. This study applies high-resolution remote sensing measurements of SCA and SWE using a fixed-wing Unmanned Aerial System (UAS) to document snowcover changes over the snowmelt period for an Arctic tundra headwater catchment. Repeat measurements of SWE and SCA were obtained for four dominant land cover types (tundra, short shrub, tall shrub, and topographic drift) to provide observations of spatially distributed snowmelt patterns and basin-wide declines in SWE. High-resolution analysis of snowcover conditions over the melt reveal a strong relationship between land cover type, snow distribution, and snow ablation rates whereby shallow snowpacks found in tundra and short shrub regions feature rapid declines in SWE and SCA and became snow-free approximately 10 days earlier than deeper snowpacks. In contrast, tall shrub patches and topographic drift regions were characterized by large initial SWE values and featured a slow decline in SCA. Analysis of basin-wide declines in SCA and SWE reveal three distinct melt phases characterized by 1) low melt rates across a large area resulting in a minor change in SCA, but a very large decline in SWE with, 2) high melt rates resulting in drastic declines in both SCA and SWE, and 3) low melt rates over a small portion of the basin, resulting in little change to either SCA or SWE. The ability to capture high-resolution spatio-temporal changes to tundra snow cover furthers our understanding of the relative importance of various land cover types on the snowmelt timing and amount of runoff available to the hydrological system during the spring freshet

Spatio-temporal influence of tundra snow properties on Ku-band (17.2 GHz) backscatter

During the 2010/11 boreal winter, a distributed set of backscatter measurements was collected using a ground-based Ku-band (17.2 GHz) scatterometer system at 26 open tundra sites. A standard snow-sampling procedure was completed after each scan to evaluate local variability in snow layering, depth, density and water equivalent (SWE) within the scatterometer field of view. The shallow depths and large basal depth hoar encountered presented an opportunity to evaluate backscatter under a set of previously untested conditions. Strong Ku-band response was found with increasing snow depth and snow water equivalent (SWE). In particular, co-polarized vertical backscatter increased by 0.82 dB for every 1 cm increase in SWE (R2 = 0.62). While the result indicated strong potential for Ku-band retrieval of shallow snow properties, it did not characterize the influence of sub-scan variability. An enhanced snow-sampling procedure was introduced to generate detailed characterizations of stratigraphy within the scatterometer field of view using near-infrared photography along the length of a 5m trench. Changes in snow properties along the trench were used to discuss variations in the collocated backscatter response. A pair of contrasting observation sites was used to highlight uncertainties in backscatter response related to short length scale spatial variability in the observed tundra environment

An Ensemble Approach to Space-Time Interpolation

There has been much excitement and activity in recent years related to the relatively sudden availability of earth-related data and the computational capabilities to visualize and analyze these data. Despite the increased ability to collect and store large volumes of data, few individual data sets exist that provide both the requisite spatial and temporal observational frequency for many urban and/or regional-scale applications. The motivating view of this paper, however, is that the relative temporal richness of one data set can be leveraged with the relative spatial richness of another to fill in the gaps. We also note that any single interpolation technique has advantages and disadvantages. Particularly when focusing on the spatial or on the temporal dimension, this means that different techniques are more appropriate than others for specific types of data. We therefore propose a space- time interpolation approach whereby two interpolation methods – one for the temporal and one for the spatial dimension – are used in tandem in order to maximize the quality of the result. We call our ensemble approach the Space-Time Interpolation Environment (STIE). The primary steps within this environment include a spatial interpolator, a time-step processor, and a calibration step that enforces phenomenon-related behavioral constraints. The specific interpolation techniques used within the STIE can be chosen on the basis of suitability for the data and application at hand. In the current paper, we describe STIE conceptually including the structure of the data inputs and output, details of the primary steps (the STIE processors), and the mechanism for coordinating the data and the 1 processors. We then describe a case study focusing on urban land cover in Phoenix Arizona. Our empirical results show that STIE was effective as a space-time interpolator for urban land cover with an accuracy of 85.2% and furthermore that it was more effective than a single technique.