Fundamental remote sensing science research program. Part 1: Scene radiation and atmospheric effects characterization project

Brief articles summarizing the status of research in the scene radiation and atmospheric effect characterization (SRAEC) project are presented. Research conducted within the SRAEC program is focused on the development of empirical characterizations and mathematical process models which relate the electromagnetic energy reflected or emitted from a scene to the biophysical parameters of interest

Analysis and approximation of some Shape-from-Shading models for non-Lambertian surfaces

The reconstruction of a 3D object or a scene is a classical inverse problem in Computer Vision. In the case of a single image this is called the Shape-from-Shading (SfS) problem and it is known to be ill-posed even in a simplified version like the vertical light source case. A huge number of works deals with the orthographic SfS problem based on the Lambertian reflectance model, the most common and simplest model which leads to an eikonal type equation when the light source is on the vertical axis. In this paper we want to study non-Lambertian models since they are more realistic and suitable whenever one has to deal with different kind of surfaces, rough or specular. We will present a unified mathematical formulation of some popular orthographic non-Lambertian models, considering vertical and oblique light directions as well as different viewer positions. These models lead to more complex stationary nonlinear partial differential equations of Hamilton-Jacobi type which can be regarded as the generalization of the classical eikonal equation corresponding to the Lambertian case. However, all the equations corresponding to the models considered here (Oren-Nayar and Phong) have a similar structure so we can look for weak solutions to this class in the viscosity solution framework. Via this unified approach, we are able to develop a semi-Lagrangian approximation scheme for the Oren-Nayar and the Phong model and to prove a general convergence result. Numerical simulations on synthetic and real images will illustrate the effectiveness of this approach and the main features of the scheme, also comparing the results with previous results in the literature.Comment: Accepted version to Journal of Mathematical Imaging and Vision, 57 page

Reflectance of Polytetrafluoroethylene (PTFE) for Xenon Scintillation Light

Gaseous and liquid xenon particle detectors are being used in a number of applications including dark matter search and neutrino-less double beta decay experiments. Polytetrafluoroethylene (PTFE) is often used in these detectors both as electrical insulator and as a light reflector to improve the efficiency of detection of scintillation photons. However, xenon emits in the vacuum ultraviolet wavelength region (175 nm) where the reflecting properties of PTFE are not sufficiently known. In this work we report on measurements of PTFE reflectance, including its angular distribution, for the xenon scintillation light. Various samples of PTFE, manufactured by different processes (extruded, expanded, skived and pressed) have been studied. The data were interpreted with a physical model comprising both specular and diffuse reflections. The reflectance obtained for these samples ranges from about 47% to 66% for VUV light. Fluoropolymers, namely ETFE, FEP and PFA were also measured

Analysis and Radiometric Calibration for Backscatter Intensity of Hyperspectral LiDAR Caused by Incident Angle Effect

Hyperspectral LiDAR (HSL) is a new remote sensing detection method with high spatial and spectral information detection ability. In the process of laser scanning, the laser echo intensity is affected by many factors. Therefore, it is necessary to calibrate the backscatter intensity data of HSL. Laser incidence angle is one of the important factors that affect the backscatter intensity of the target. This paper studied the radiometric calibration method of incidence angle effect for HSL. The reflectance of natural surfaces can be simulated as a combination of specular reflection and diffuse reflection. The linear combination of the Lambertian model and Beckmann model provides a comprehensive theory that can be applied to various surface conditions, from glossy to rough surfaces. Therefore, an adaptive threshold radiometric calibration method (Lambertian-Beckmann model) is proposed to solve the problem caused by the incident angle effect. The relationship between backscatter intensity and incident angle of HSL is studied by combining theory with experiments, and the model successfully quantifies the difference between diffuse and specular reflectance coefficients. Compared with the Lambertian model, the proposed model has higher calibration accuracy, and the average improvement rate to the samples in this study was 22.67%. Compared with the results before calibration with the incidence angle of less than 70 degrees, the average improvement rate of the Lambertian-Beckmann model was 62.26%. Moreover, we also found that the green leaves have an obvious specular reflection effect near 650-720 nm, which might be related to the inner microstructure of chlorophyll. The Lambertian-Beckmann model was more helpful to the calibration of leaves in the visible wavelength range. This is a meaningful and a breakthrough exploration for HSL.Peer reviewe

A Novel Framework for Highlight Reflectance Transformation Imaging

We propose a novel pipeline and related software tools for processing the multi-light image collections (MLICs) acquired in different application contexts to obtain shape and appearance information of captured surfaces, as well as to derive compact relightable representations of them. Our pipeline extends the popular Highlight Reflectance Transformation Imaging (H-RTI) framework, which is widely used in the Cultural Heritage domain. We support, in particular, perspective camera modeling, per-pixel interpolated light direction estimation, as well as light normalization correcting vignetting and uneven non-directional illumination. Furthermore, we propose two novel easy-to-use software tools to simplify all processing steps. The tools, in addition to support easy processing and encoding of pixel data, implement a variety of visualizations, as well as multiple reflectance-model-fitting options. Experimental tests on synthetic and real-world MLICs demonstrate the usefulness of the novel algorithmic framework and the potential benefits of the proposed tools for end-user applications.Terms: "European Union (EU)" & "Horizon 2020" / Action: H2020-EU.3.6.3. - Reflective societies - cultural heritage and European identity / Acronym: Scan4Reco / Grant number: 665091DSURF project (PRIN 2015) funded by the Italian Ministry of University and ResearchSardinian Regional Authorities under projects VIGEC and Vis&VideoLa

A study on local photometric models and their application to robust tracking

International audienceSince modeling reflections in image processing is a difficult task, most com- puter vision algorithms assume that objects are Lambertian and that no lighting change occurs. Some photometric models can partly answer this issue by assuming that the lighting changes are the same at each point of a small window of interest. Through a study based on specular reflection models, we explicit the assumptions on which these models are implicitly based and the situations in which they could fail. This paper proposes two photometric models, which compensate for spec- ular highlights and lighting variations. They assume that photometric changes vary smoothly on the window of interest. Contrary to classical models, the characteristics of the object surface and the lighting changes can vary in the area being observed. First, we study the validity of these models with re- spect to the acquisition setup: relative locations between the light source, the sensor and the object as well as the roughness of the surface. Then, these models are used to improve feature points tracking by simultaneously estimating the photometric and geometric changes. The proposed methods are compared to well-known tracking methods robust to affine photometric changes. Experimental results on specular objects demonstrate the robust- ness of our approaches to specular highlights and lighting changes

Enhanced BRDF Modeling Using Directional Volume Scatter Terms

Accurate Bidirectional Reflectance Distribution Function (BRDF) models provide critical scatter behavior for computer graphics and remote sensing performance. The popular microfacet class of BRDF models is geometric-based and computationally inexpensive compared to wave-optics models. Microfacet models commonly account for surface scatter and Lambertian volume scatter, but not directional volume scatter. This work proposes directional volume scatter modeling for enhanced performance over all observation regions. Five directional volume models are incorporated into the modified Cook-Torrance microfacet model. Additionally, a semi-empirical directional volume term is presented based on the Beckmann microfacet distribution and a modified Fresnel reflection term. High fidelity, low density data from 15 datasets are fit to each hybrid model using a recursive optimization method then compared to the baseline Cook-Torrance model. By including a directional volume term, analysis shows fit quality is improved based on the square of the mean standard error (MSE2) by as much as 78% and backscatter agreement is improved by as much as 92%. Including the semi-empirical, Oren-Nayar, or Beard-Maxwell directional volume term reduced backscatter MSE2 across datasets exhibiting high volume scatter by an average of 52%, 46%, and 26% respectively. Directional volume terms showed statistically insignificant improvement for low volume scatter materials, while full model improvements were apparent across all high volume scatter visually diffuse materials. Results suggest directional volume scatter modeling can consistently improve full model fit quality with emphasized model agreement for backscatter observations. These results validate directional volume scatter significance and are expected to lead to enhanced remote sensing and scene generation

Polarized 3D: High-Quality Depth Sensing with Polarization Cues

Coarse depth maps can be enhanced by using the shape information from polarization cues. We propose a framework to combine surface normals from polarization (hereafter polarization normals) with an aligned depth map. Polarization normals have not been used for depth enhancement before. This is because polarization normals suffer from physics-based artifacts, such as azimuthal ambiguity, refractive distortion and fronto-parallel signal degradation. We propose a framework to overcome these key challenges, allowing the benefits of polarization to be used to enhance depth maps. Our results demonstrate improvement with respect to state-of-the-art 3D reconstruction techniques.Charles Stark Draper Laboratory (Doctoral Fellowship)Singapore. Ministry of Education (Academic Research Foundation MOE2013-T2-1-159)Singapore. National Research Foundation (Singapore University of Technology and Design

A graph-spectral approach to shape-from-shading

In this paper, we explore how graph-spectral methods can be used to develop a new shape-from-shading algorithm. We characterize the field of surface normals using a weight matrix whose elements are computed from the sectional curvature between different image locations and penalize large changes in surface normal direction. Modeling the blocks of the weight matrix as distinct surface patches, we use a graph seriation method to find a surface integration path that maximizes the sum of curvature-dependent weights and that can be used for the purposes of height reconstruction. To smooth the reconstructed surface, we fit quadrics to the height data for each patch. The smoothed surface normal directions are updated ensuring compliance with Lambert's law. The processes of height recovery and surface normal adjustment are interleaved and iterated until a stable surface is obtained. We provide results on synthetic and real-world imagery