INVESTIGATING 3D RECONSTRUCTION OF NON-COLLABORATIVE SURFACES THROUGH PHOTOGRAMMETRY AND PHOTOMETRIC STEREO

Abstract. 3D digital reconstruction techniques are extensively used for quality control purposes. Among them, photogrammetry and photometric stereo methods have been for a long time used with success in several application fields. However, generating highly-detailed and reliable micro-measurements of non-collaborative surfaces is still an open issue. In these cases, photogrammetry can provide accurate low-frequency 3D information, whereas it struggles to extract reliable high-frequency details. Conversely, photometric stereo can recover a very detailed surface topography, although global surface deformation is often present. In this paper, we present the preliminary results of an ongoing project aiming to combine photogrammetry and photometric stereo in a synergetic fusion of the two techniques. Particularly, hereafter, we introduce the main concept design behind an image acquisition system we developed to capture images from different positions and under different lighting conditions as required by photogrammetry and photometric stereo techniques. We show the benefit of such a combination through some experimental tests. The experiments showed that the proposed method recovers the surface topography at the same high-resolution achievable with photometric stereo while preserving the photogrammetric accuracy. Furthermore, we exploit light directionality and multiple light sources to improve the quality of dense image matching in poorly textured surfaces

In vivo measurement of skin microrelief using photometricstereo in the presence of interreflections

This paper proposes and describes an implementation of a novel photometric stereo based technique for in vivo assessment of three-dimensional (3D) skin topographyin the presence of interreflections. The proposed method illuminates skin with red, green, and blue colored lights and uses the resulting variation in surface gradients tomitigate the effects of interreflections. Experiments were carried out on Caucasian, Asian and African American subjects to demonstrate the accuracy of our methodand to validate the measurements produced by our system. Our method produced significant improvement in 3D surface reconstruction for all Caucasian, Asian and African American skin types. The results also illustrate the differences in recovered skin topography due to non-diffuse Bidirectional reflectance distribution function(BRDF) for each color illumination used, which also concur with the existing multispectral BRDF data available for skin

Average surface roughness evaluation using 3-source photometric stereo technique

Copyright © The Authors and EDP Sciences, 2016. This paper presents a technique for measuring surface roughness (Ra), using photometric stereo method. The method utilizes three or more images of the measured surface from the same viewpoint, taken sequentially under different illumination conditions. The scenes captured by the camera were reconstructed by the least square method to obtain surface normal from surface topography. Three-dimensional surface textural patterns were recovered from those surface normal. The system was validated with five standard surface roughness specimens. The Ra calculated from the recovered surface was compared with the values measured from contacting roughness measurement (stylus instrument). The best coefficient of the slant angles can also be determined through the linear regression. The experimental results indicate that the technique can be applied to well recover standard surface roughness

Analysis of wood surface waviness with a two-image photometric stereo method

This paper describes a two-image photometric stereo (PS) method for analysis of surface waviness on planed wood products. This method is based on an assumption that the wood surface is a Lambertian surface. In addition, owing to the fact that surface waviness on planed wood is mainly composed of cutter marks, which fluctuate only in one dimension, three-dimensional surface topography can reasonably be represented by a two-dimensional surface profile. Accordingly, a surface waviness profile can be extracted from two images of the surface under specifically arranged illumination. Measurement results from the two-image PS method are compared with those from a laser profilometer. Comparison indicates a high correlation between the two methods

Multidimensional imaging for skin tissue surface characterization

Human skin, the outer and largest organ covering our body, can be described in terms of both its 3D spatial topography and its 2D spectral reflectance. Such a characterization normally requires the application of separate procedures using different kinds of equipment, where spectral reflectance can only be obtained from a small patch of the skin surface. This paper investigates the integration of multiple imaging modalities to simultaneously capture both spectral and spatial information from the skin surface over a wide area. By extending the imaging spectrum from the visible to the near-infrared (NIR), we improve general recovery, obtain a more detailed skin profile, and are able to identify the distribution of various principal chromophores within the deeper dermal layers. Experiments show that new dimensions of skin characterization can be generated through the recovered geometrical and spectral information, so that an enhanced visibility of important skin physiological phenomena can be achieved. © 2013 Elsevier B.V. All rights reserved

Measurement, modeling and perception of painted surfaces : A Multi-scale analysis of the touch-up problem

Real-world surfaces typically have geometric features at a range of spatial scales. At the microscale, opaque surfaces are often characterized by bidirectional reflectance distribution functions (BRDF), which describes how a surface scatters incident light. At the mesoscale, surfaces often exhibit visible texture - stochastic or patterned arrangements of geometric features that provide visual information about surface properties such as roughness, smoothness, softness, etc. These textures also affect how light is scattered by the surface, but the effects are at a different spatial scale than those captured by the BRDF. Through this research, we investigate how microscale and mesoscale surface properties interact to contribute to overall surface appearance. This behavior is also the cause of the well-known touch-up problem in the paint industry, where two regions coated with exactly the same paint, look different in color, gloss and/or texture because of differences in application methods. At first, samples were created by applying latex paint to standard wallboard surfaces. Two application methods- spraying and rolling were used. The BRDF and texture properties of the samples were measured, which revealed differences at both the microscale and mesoscale. This data was then used as input for a physically-based image synthesis algorithm, to generate realistic images of the surfaces under different viewing conditions. In order to understand the factors that govern touch-up visibility, psychophysical tests were conducted using calibrated, digital photographs of the samples as stimuli. Images were presented in pairs and a two alternative forced choice design was used for the experiments. These judgments were then used as data for a Thurstonian scaling analysis to produce psychophysical scales of visibility, which helped determine the effect of paint formulation, application methods, and viewing and illumination conditions on the touch-up problem. The results can be used as base data towards development of a psychophysical model that relates physical differences in paint formulation and application methods to visual differences in surface appearance

Overcoming the Challenges Associated with Image-based Mapping of Small Bodies in Preparation for the OSIRIS-REx Mission to (101955) Bennu

The OSIRIS-REx Asteroid Sample Return Mission is the third mission in NASA's New Frontiers Program and is the first U.S. mission to return samples from an asteroid to Earth. The most important decision ahead of the OSIRIS-REx team is the selection of a prime sample-site on the surface of asteroid (101955) Bennu. Mission success hinges on identifying a site that is safe and has regolith that can readily be ingested by the spacecraft's sampling mechanism. To inform this mission-critical decision, the surface of Bennu is mapped using the OSIRIS-REx Camera Suite and the images are used to develop several foundational data products. Acquiring the necessary inputs to these data products requires observational strategies that are defined specifically to overcome the challenges associated with mapping a small irregular body. We present these strategies in the context of assessing candidate sample-sites at Bennu according to a framework of decisions regarding the relative safety, sampleability, and scientific value across the asteroid's surface. To create data products that aid these assessments, we describe the best practices developed by the OSIRIS-REx team for image-based mapping of irregular small bodies. We emphasize the importance of using 3D shape models and the ability to work in body-fixed rectangular coordinates when dealing with planetary surfaces that cannot be uniquely addressed by body-fixed latitude and longitude.Comment: 31 pages, 10 figures, 2 table