A Data-Driven Reflectance Model

We present a generative model for isotropic bidirectional reflectance distribution functions (BRDFs) based on acquired reflectance data. Instead of using analytical reflectance models, we represent each BRDF as a dense set of measurements. This allows us to interpolate and extrapolate in the space of acquired BRDFs to create new BRDFs. We treat each acquired BRDF as a single high-dimensional vector taken from a space of all possible BRDFs. We apply both linear (subspace) and non-linear (manifold) dimensionality reduction tools in an effort to discover a lower-dimensional representation that characterizes our measurements. We let users define perceptually meaningful parametrization directions to navigate in the reduced-dimension BRDF space. On the low-dimensional manifold, movement along these directions produces novel but valid BRDFs.Engineering and Applied Science

Improved canopy reflectance modeling and scene inference through improved understanding of scene pattern

The Li-Strahler reflectance model, driven by LANDSAT Thematic Mapper (TM) data, provided regional estimates of tree size and density within 20 percent of sampled values in two bioclimatic zones in West Africa. This model exploits tree geometry in an inversion technique to predict average tree size and density from reflectance data using a few simple parameters measured in the field (spatial pattern, shape, and size distribution of trees) and in the imagery (spectral signatures of scene components). Trees are treated as simply shaped objects, and multispectral reflectance of a pixel is assumed to be related only to the proportions of tree crown, shadow, and understory in the pixel. These, in turn, are a direct function of the number and size of trees, the solar illumination angle, and the spectral signatures of crown, shadow and understory. Given the variance in reflectance from pixel to pixel within a homogeneous area of woodland, caused by the variation in the number and size of trees, the model can be inverted to give estimates of average tree size and density. Because the inversion is sensitive to correct determination of component signatures, predictions are not accurate for small areas

Variability in Surface BRDF at Different Spatial Scales (30 m-500 m) Over a Mixed Agricultural Landscape as Retrieved from Airborne and Satellite Spectral Measurements

Over the past decade, the role of multiangle remote sensing has been central to the development of algorithms for the retrieval of global land surface properties including models of the bidirectional reflectance distribution function (BRDF), albedo, land cover/dynamics, burned area extent, as well as other key surface biophysical quantities represented by the anisotropic reflectance characteristics of vegetation. In this study, a new retrieval strategy for fine-to-moderate resolution multiangle observations was developed, based on the operational sequence used to retrieve the Moderate Resolution Imaging Spectroradiometer (MODIS) Collection 5 reflectance and BRDF/albedo products. The algorithm makes use of a semiempirical kernel-driven bidirectional reflectance model to provide estimates of intrinsic albedo (i.e., directional-hemispherical reflectance and bihemispherical reflectance), model parameters describing the BRDF, and extensive quality assurance information. The new retrieval strategy was applied to NASA's Cloud Absorption Radiometer (CAR) data acquired during the 2007 Cloud and Land Surface Interaction Campaign (CLASIC) over the well-instrumented Atmospheric Radiation Measurement Program (ARM) Southern Great Plains (SGP) Cloud and Radiation Testbed (CART) site in Oklahoma, USA. For the case analyzed, we obtained approx.1.6 million individual surface bidirectional reflectance factor (BRF) retrievals, from nadir to 75 off-nadir, and at spatial resolutions ranging from 3 m - 500 m. This unique dataset was used to examine the interaction of the spatial and angular characteristics of a mixed agricultural landscape; and provided the basis for detailed assessments of: (1) the use of a priori knowledge in kernel-driven BRDF model inversions; (2) the interaction between surface reflectance anisotropy and instrument spatial resolution; and (3) the uncertain ties that arise when sub-pixel differences in the BRDF are aggregated to a moderate resolution satellite pixel. Results offer empirical evidence concerning the influence of scale and spatial heterogeneity in kernel-driven BRDF models; providing potential new insights into the behavior and characteristics of different surface radiative properties related to land/use cover change and vegetation structure

An Integrative Remote Sensing Application of Stacked Autoencoder for Atmospheric Correction and Cyanobacteria Estimation Using Hyperspectral Imagery

Hyperspectral image sensing can be used to effectively detect the distribution of harmful cyanobacteria. To accomplish this, physical- and/or model-based simulations have been conducted to perform an atmospheric correction (AC) and an estimation of pigments, including phycocyanin (PC) and chlorophyll-a (Chl-a), in cyanobacteria. However, such simulations were undesirable in certain cases, due to the difficulty of representing dynamically changing aerosol and water vapor in the atmosphere and the optical complexity of inland water. Thus, this study was focused on the development of a deep neural network model for AC and cyanobacteria estimation, without considering the physical formulation. The stacked autoencoder (SAE) network was adopted for the feature extraction and dimensionality reduction of hyperspectral imagery. The artificial neural network (ANN) and support vector regression (SVR) were sequentially applied to achieve AC and estimate cyanobacteria concentrations (i.e., SAE-ANN and SAE-SVR). Further, the ANN and SVR models without SAE were compared with SAE-ANN and SAE-SVR models for the performance evaluations. In terms of AC performance, both SAE-ANN and SAE-SVR displayed reasonable accuracy with the Nash???Sutcliffe efficiency (NSE) > 0.7. For PC and Chl-a estimation, the SAE-ANN model showed the best performance, by yielding NSE values > 0.79 and > 0.77, respectively. SAE, with fine tuning operators, improved the accuracy of the original ANN and SVR estimations, in terms of both AC and cyanobacteria estimation. This is primarily attributed to the high-level feature extraction of SAE, which can represent the spatial features of cyanobacteria. Therefore, this study demonstrated that the deep neural network has a strong potential to realize an integrative remote sensing application

Depth Super-Resolution Meets Uncalibrated Photometric Stereo

A novel depth super-resolution approach for RGB-D sensors is presented. It disambiguates depth super-resolution through high-resolution photometric clues and, symmetrically, it disambiguates uncalibrated photometric stereo through low-resolution depth cues. To this end, an RGB-D sequence is acquired from the same viewing angle, while illuminating the scene from various uncalibrated directions. This sequence is handled by a variational framework which fits high-resolution shape and reflectance, as well as lighting, to both the low-resolution depth measurements and the high-resolution RGB ones. The key novelty consists in a new PDE-based photometric stereo regularizer which implicitly ensures surface regularity. This allows to carry out depth super-resolution in a purely data-driven manner, without the need for any ad-hoc prior or material calibration. Real-world experiments are carried out using an out-of-the-box RGB-D sensor and a hand-held LED light source.Comment: International Conference on Computer Vision (ICCV) Workshop, 201