On Recognizing Transparent Objects in Domestic Environments Using Fusion of Multiple Sensor Modalities

Current object recognition methods fail on object sets that include both diffuse, reflective and transparent materials, although they are very common in domestic scenarios. We show that a combination of cues from multiple sensor modalities, including specular reflectance and unavailable depth information, allows us to capture a larger subset of household objects by extending a state of the art object recognition method. This leads to a significant increase in robustness of recognition over a larger set of commonly used objects.Comment: 12 page

Recovering facial shape using a statistical model of surface normal direction

In this paper, we show how a statistical model of facial shape can be embedded within a shape-from-shading algorithm. We describe how facial shape can be captured using a statistical model of variations in surface normal direction. To construct this model, we make use of the azimuthal equidistant projection to map the distribution of surface normals from the polar representation on a unit sphere to Cartesian points on a local tangent plane. The distribution of surface normal directions is captured using the covariance matrix for the projected point positions. The eigenvectors of the covariance matrix define the modes of shape-variation in the fields of transformed surface normals. We show how this model can be trained using surface normal data acquired from range images and how to fit the model to intensity images of faces using constraints on the surface normal direction provided by Lambert's law. We demonstrate that the combination of a global statistical constraint and local irradiance constraint yields an efficient and accurate approach to facial shape recovery and is capable of recovering fine local surface details. We assess the accuracy of the technique on a variety of images with ground truth and real-world images

Linear Differential Constraints for Photo-polarimetric Height Estimation

In this paper we present a differential approach to photo-polarimetric shape estimation. We propose several alternative differential constraints based on polarisation and photometric shading information and show how to express them in a unified partial differential system. Our method uses the image ratios technique to combine shading and polarisation information in order to directly reconstruct surface height, without first computing surface normal vectors. Moreover, we are able to remove the non-linearities so that the problem reduces to solving a linear differential problem. We also introduce a new method for estimating a polarisation image from multichannel data and, finally, we show it is possible to estimate the illumination directions in a two source setup, extending the method into an uncalibrated scenario. From a numerical point of view, we use a least-squares formulation of the discrete version of the problem. To the best of our knowledge, this is the first work to consider a unified differential approach to solve photo-polarimetric shape estimation directly for height. Numerical results on synthetic and real-world data confirm the effectiveness of our proposed method.Comment: To appear at International Conference on Computer Vision (ICCV), Venice, Italy, October 22-29, 201

Another dimension from LiDAR – Obtaining foliage density from full waveform data

LiDAR tells the user where surfaces are, not what they are. In this study we investigate the potential for waveform LiDAR to provide more information on the nature of the returns over forestry. Waveform LiDAR was acquired for ten Pinus radiata plots in a New Zealand plantation, along with comprehensive leaf area sampling in 2m vertical bands. The decay rate of each waveform peak was shown to be a useful tool for estimating foliage density, and has potential for identifying regions containing ground and understorey. Leaf Area Density (LAD) is an expression of foliage density per unit height, and a relationship between waveform decay rate and LAD was developed with an R2 of 56%. Incorporating the proportion of discrete LiDAR that fell in that band (which itself has an R2 of 50%) improves this model to explain 69% of the variation in LAD. This is a good result, especially given the costs and difficulties in measuring leaf area directly. As foliage density varies dramatically on a fine scale it was not possible to differentiate the nature of every single LiDAR return – but by averaging over a small area local variation in LAD could be easily mapped. Ground returns could be distinguished as having short decays, and broad leafed understorey typically had values between those of the canopy and ground, although surface roughness and slope make it impossible to robustly identify single returns. This study produced a useful model for estimating LAD in Pinus radiata which could easily be extended to other coniferous species

Method for coregistration of optical measurements of breast tissue with histopathology : the importance of accounting for tissue deformations

For the validation of optical diagnostic technologies, experimental results need to be benchmarked against the gold standard. Currently, the gold standard for tissue characterization is assessment of hematoxylin and eosin (H&E)-stained sections by a pathologist. When processing tissue into H&E sections, the shape of the tissue deforms with respect to the initial shape when it was optically measured. We demonstrate the importance of accounting for these tissue deformations when correlating optical measurement with routinely acquired histopathology. We propose a method to register the tissue in the H&E sections to the optical measurements, which corrects for these tissue deformations. We compare the registered H&E sections to H&E sections that were registered with an algorithm that does not account for tissue deformations by evaluating both the shape and the composition of the tissue and using microcomputer tomography data as an independent measure. The proposed method, which did account for tissue deformations, was more accurate than the method that did not account for tissue deformations. These results emphasize the need for a registration method that accounts for tissue deformations, such as the method presented in this study, which can aid in validating optical techniques for clinical use. (C) The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License

The structure of red-infrared scattergrams of semivegetated landscapes

A physically based linear stochastic geometric canopy soil reflectance model is presented for characterizing spatial variability of semivegetated landscapes at subpixel and regional scales. Landscapes are conceptualized as stochastic geometric surfaces, incorporating not only the variability in geometric elements, but also the variability in vegetation and soil background reflectance which can be important in some scenes. The model is used to investigate several possible mechanisms which contribute to the often observed characteristic triangular shape of red-infrared scattergrams of semivegetated landscapes. Scattergrams of simulated and semivegetated scenes are analyzed with respect to the scales of the satellite pixel and subpixel components. Analysis of actual aerial radiometric data of a pecan orchard is presented in comparison with ground observations as preliminary confirmation of the theoretical results