In-process surface profile assessment of rotary machined timber using a dynamic photometric stereo technique

Machining operations have advanced in speed and there is an increasing demand for higher quality surface finish. It is therefore necessary to develop real-time surface inspection techniques which will provide sensory information for controlling the machining processes. This paper describes a practical method for real-time analysis of planed wood using the photometric stereo technique. Earlier research has shown that the technique is very effective in assessing surface waviness on static wood samples. In this paper, the photometric stereo method is extended to real industrial applications where samples are subjected to rapid movements. Surface profiles extracted from the dynamic photometric stereo method are compared with those from the static measurements and the results show that there is a high correlation between the two methods

Single-image RGB Photometric Stereo With Spatially-varying Albedo

We present a single-shot system to recover surface geometry of objects with spatially-varying albedos, from images captured under a calibrated RGB photometric stereo setup---with three light directions multiplexed across different color channels in the observed RGB image. Since the problem is ill-posed point-wise, we assume that the albedo map can be modeled as piece-wise constant with a restricted number of distinct albedo values. We show that under ideal conditions, the shape of a non-degenerate local constant albedo surface patch can theoretically be recovered exactly. Moreover, we present a practical and efficient algorithm that uses this model to robustly recover shape from real images. Our method first reasons about shape locally in a dense set of patches in the observed image, producing shape distributions for every patch. These local distributions are then combined to produce a single consistent surface normal map. We demonstrate the efficacy of the approach through experiments on both synthetic renderings as well as real captured images.Comment: 3DV 2016. Project page at http://www.ttic.edu/chakrabarti/rgbps

A 3D machine vision method for non-invasive assessment of respiratory function

Copyright © 2015 John Wiley & Sons, Ltd. Background: Respiratory function testing is important for detecting and monitoring illness, however, it is difficult for some patients, such as the young and severely ill, to perform conventional tests that require cooperation and/or patient contact. Method: A new method was developed for non-contact breathing measurement, employing photometric stereo to capture the surface topography of the torso of an unconstrained subject. The surface is integrated to calculate time-dependent volume changes during respiration. Results: The method provides a useful means of continuously measuring volume changes during respiration with high spatial and temporal resolution. The system was tested by comparison with pneumotachometry equipment and a clear periodic signal, of a frequency corresponding to the reference data, was observed. Conclusion: The approach is unique in performing breathing monitoring (with potential diagnostic capability) for unconstrained patients in virtually any lighting conditions (including darkness during sleep) and in a non-contact, unobtrusive (i.e. using imperceptible light) fashion. Copyright © 2015 John Wiley & Sons, Ltd

In vivo measurement of skin microrelief using photometricstereo in the presence of interreflections

This paper proposes and describes an implementation of a novel photometric stereo based technique for in vivo assessment of three-dimensional (3D) skin topographyin the presence of interreflections. The proposed method illuminates skin with red, green, and blue colored lights and uses the resulting variation in surface gradients tomitigate the effects of interreflections. Experiments were carried out on Caucasian, Asian and African American subjects to demonstrate the accuracy of our methodand to validate the measurements produced by our system. Our method produced significant improvement in 3D surface reconstruction for all Caucasian, Asian and African American skin types. The results also illustrate the differences in recovered skin topography due to non-diffuse Bidirectional reflectance distribution function(BRDF) for each color illumination used, which also concur with the existing multispectral BRDF data available for skin

Variational Uncalibrated Photometric Stereo under General Lighting

Photometric stereo (PS) techniques nowadays remain constrained to an ideal laboratory setup where modeling and calibration of lighting is amenable. To eliminate such restrictions, we propose an efficient principled variational approach to uncalibrated PS under general illumination. To this end, the Lambertian reflectance model is approximated through a spherical harmonic expansion, which preserves the spatial invariance of the lighting. The joint recovery of shape, reflectance and illumination is then formulated as a single variational problem. There the shape estimation is carried out directly in terms of the underlying perspective depth map, thus implicitly ensuring integrability and bypassing the need for a subsequent normal integration. To tackle the resulting nonconvex problem numerically, we undertake a two-phase procedure to initialize a balloon-like perspective depth map, followed by a "lagged" block coordinate descent scheme. The experiments validate efficiency and robustness of this approach. Across a variety of evaluations, we are able to reduce the mean angular error consistently by a factor of 2-3 compared to the state-of-the-art.Comment: Haefner and Ye contributed equall

Photometric reconstruction of a dynamic textured surface from just one color image acquisition

http://www.opticsinfobase.org/josaa/abstract.cfm?msid=85528 This article has been selected for inclusion in the Virtual Journal for Biomedical Optics (Vol. 3, Iss. 4)International audienceTextured surface analysis is essential for many applications. We present a three-dimensional recovery approach for real textured surfaces based on photometric stereo. The aim is to be able to measure the textured surfaces with a high degree of accuracy. For this, we use a color digital sensor and principles of color photometric stereo. This method uses a single color image, instead of a sequence of gray-scale images, to recover the surface of the three dimensions. It can thus be integrated into dynamic systems where there is significant relative motion between the object and the camera. To evaluate the performances of our method, we compare it on real textured surfaces to traditional photometric stereo using three images. We show thus that it is possible to have similar results with just one color image

Modelling and real-time control of a high performance rotary wood planing machine

Rotary planing is one of the most valuable machining operations in the timber processing industry. It has been established that cutting tool inaccuracy and forced vibration during the machining process are the primary causes of surface quality degradation. The main aim of this thesis is to design a control architecture that is suitable for adaptive operation of a wood planing machining in order to improve the quality of its surface finish. In order to achieve the stated goal, thorough understanding of the effects of machine deficiencies on surface finish quality is required. Therefore, a generic simulation model for synthesising the surface profiles produced by wood planing process is first developed. The model is used to simulate the combined effects of machining parameters, vibration and cutting tool inaccuracy on the resultant surface profiles. It has been postulated that online monitoring of surface finish quality can be used to provide feedback information for a secondary control loop for the machining process, which will lead to the production of consistently high quality surface finishes. There is an existing vision-based wood surface profile measurement technique, but the application of the technique has been limited to static wood samples. This thesis extends the application of the technique to moving wood samples. It is shown experimentally that the method is suitable for in-process surface profile measurements. The current industrial wood planing machines do not have the capability of measuring and adjusting process parameters in real-time. Therefore, knowledge of the causes of surface finish degradation would enable the operators to optimise the mechanical structure of the machines offline. For this reason, two novel approaches for characterising defects on planed timber surfaces have been created in this thesis using synthetic data. The output of this work is a software tool that can assist machine operators in inferring the causes of defects based on the waviness components of the workpiece surface finish. The main achievement in this research is the design of a new active wood planing technique that combines real-time cutter path optimisation (cutting tool inaccuracy compensation) with vibration disturbance rejection. The technique is based on real-time vertical displacements of the machine spindle. Simulation and experimental results obtained from a smart wood planing machine show significant improvements in the dynamic performance of the machine and the produced surface finish quality. Potential areas for future research include application of the defects characterisation techniques to real data and full integration of the dynamic surface profile measurements with the smart wood planing machine