One shot profilometry using iterative two-step temporal phase-unwrapping

This paper reviews two techniques that have been recently published for 3D profilometry and proposes one shot profilometry using iterative two-step temporal phase-unwrapping by combining the composite fringe projection and the iterative two-step temporal phase unwrapping algorithm. In temporal phase unwrapping, many images with different frequency fringe pattern are needed to project which would take much time. In order to solve this problem, Ochoa proposed a phase unwrapping algorithm based on phase partitions using a composite fringe, which only needs projecting one composite fringe pattern with four kinds of frequency information to complete the process of 3D profilometry. However, we found that the fringe order determined through the construction of phase partitions tended to be imprecise. Recently, we proposed an iterative two-step temporal phase unwrapping algorithm, which can achieve high sensitivity and high precision shape measurement. But it needs multiple frames of fringe images which would take much time. In order to take into account both the speed and accuracy of 3D shape measurement, we get a new, and more accurate unwrapping method based on composite fringe pattern by combining these two techniques. This method not only retains the speed advantage of Ochoa's algorithm, but also greatly improves its measurement accuracy. Finally, the experimental evaluation is conducted to prove the validity of the proposed method, and the experimental results show that this method is feasible.Comment: 14 pages, 15 figure

Micro Fourier Transform Profilometry (μ\muFTP): 3D shape measurement at 10,000 frames per second

Recent advances in imaging sensors and digital light projection technology have facilitated a rapid progress in 3D optical sensing, enabling 3D surfaces of complex-shaped objects to be captured with improved resolution and accuracy. However, due to the large number of projection patterns required for phase recovery and disambiguation, the maximum fame rates of current 3D shape measurement techniques are still limited to the range of hundreds of frames per second (fps). Here, we demonstrate a new 3D dynamic imaging technique, Micro Fourier Transform Profilometry ($\mu$FTP), which can capture 3D surfaces of transient events at up to 10,000 fps based on our newly developed high-speed fringe projection system. Compared with existing techniques, $\mu$FTP has the prominent advantage of recovering an accurate, unambiguous, and dense 3D point cloud with only two projected patterns. Furthermore, the phase information is encoded within a single high-frequency fringe image, thereby allowing motion-artifact-free reconstruction of transient events with temporal resolution of 50 microseconds. To show $\mu$FTP's broad utility, we use it to reconstruct 3D videos of 4 transient scenes: vibrating cantilevers, rotating fan blades, bullet fired from a toy gun, and balloon's explosion triggered by a flying dart, which were previously difficult or even unable to be captured with conventional approaches.Comment: This manuscript was originally submitted on 30th January 1

Acquisition of 3D shapes of moving objects using fringe projection profilometry

Three-dimensional (3D) shape measurement for object surface reconstruction has potential applications in many areas, such as security, manufacturing and entertainment. As an effective non-contact technique for 3D shape measurements, fringe projection profilometry (FPP) has attracted significant research interests because of its high measurement speed, high measurement accuracy and ease to implement. Conventional FPP analysis approaches are applicable to the calculation of phase differences for static objects. However, 3D shape measurement for dynamic objects remains a challenging task, although they are highly demanded in many applications. The study of this thesis work aims to enhance the measurement accuracy of the FPP techniques for the 3D shape of objects subject to movement in the 3D space. The 3D movement of objects changes not only the position of the object but also the height information with respect to the measurement system, resulting in motion-induced errors with the use of existing FPP technology. The thesis presents the work conducted for solutions of this challenging problem

Development of a calibration pipeline for a monocular-view structured illumination 3D sensor utilizing an array projector

Commercial off-the-shelf digital projection systems are commonly used in active structured illumination photogrammetry of macro-scale surfaces due to their relatively low cost, accessibility, and ease of use. They can be described as inverse pinhole modelled. The calibration pipeline of a 3D sensor utilizing pinhole devices in a projector-camera setup configuration is already well-established. Recently, there have been advances in creating projection systems offering projection speeds greater than that available from conventional off-the-shelf digital projectors. However, they cannot be calibrated using well established techniques based on the pinole assumption. They are chip-less and without projection lens. This work is based on the utilization of unconventional projection systems known as array projectors which contain not one but multiple projection channels that project a temporal sequence of illumination patterns. None of the channels implement a digital projection chip or a projection lens. To workaround the calibration problem, previous realizations of a 3D sensor based on an array projector required a stereo-camera setup. Triangulation took place between the two pinhole modelled cameras instead. However, a monocular setup is desired as a single camera configuration results in decreased cost, weight, and form-factor. This study presents a novel calibration pipeline that realizes a single camera setup. A generalized intrinsic calibration process without model assumptions was developed that directly samples the illumination frustum of each array projection channel. An extrinsic calibration process was then created that determines the pose of the single camera through a downhill simplex optimization initialized by particle swarm. Lastly, a method to store the intrinsic calibration with the aid of an easily realizable calibration jig was developed for re-use in arbitrary measurement camera positions so that intrinsic calibration does not have to be repeated

Motion Correction Structured Light using Pattern Interleaving Technique

Phase Measuring Profilometry (PMP) is the most robust scanning technique for static 3D data acquisition. To make this technique robust to the target objects which are in motion during the scan interval a novel algorithm called ‘Pattern Interleaving’ is used to get a high density single scan image and making Phase Measuring Profilometry insensitive to ‘z’ motion and prevent motion banding which is predominant in 3D reconstruction when the object is in motion during the scan tim

Three-dimensional geometry characterization using structured light fields

Tese de doutoramento. Engenharia Mecânica. Faculdade de Engenharia. Universidade do Porto. 200

Non-contact free-form shape measurement for coordinate measuring machines

Precision measurement of manufactured parts commonly uses contact measurement methods. A Coordinate Measuring Machine (CMM) mounted probe touches the surface of the part, recording the probe’s tip position at each contact. Recently, devices have been developed that continuously scan the probe tip across the surface, allowing points to be measured more quickly. Contact measurement is accurate and fast for shapes that are easily parameterized such as a sphere or a plane, but is slow and requires considerable user input for more general objects such as those with free-form surfaces. Phase stepping fringe projection and photogrammetry are common non-contact shape measurement methods. Photogrammetry builds a 3D model of feature points from images of an object taken from multiple perspectives. In phase stepping fringe projection a series of sinusoidal patterns, with a phase shift between each, is projected towards an object. A camera records a corresponding series of images. The phase of the pattern at each imaged point is calculated and converted to a 3D representation of the object’s surface. Techniques combining phase stepping fringe projection and photogrammetry were developed and are described here. The eventual aim is to develop an optical probe for a CMM to enable non-contact measurement of objects in an industrial setting. For the CMM to accurately report its position the probe must be small, light, and robust. The methods currently used to provide a phase shift require either an accurately calibrated translation stage to move an internal component, or a programmable projector. Neither of these implementations can be practically mounted on a CMM due to size and weight limits or the delicate parts required. A CMM probe consisting of a single camera and a fringe projector was developed. The fringe projector projects a fixed fringe pattern. Phase steps are created by moving the CMM mounted probe, taking advantage of the geometry of the fringe projection system. New techniques to calculate phase from phase stepped images created by relative motion of probe and object are proposed, mathematically modelled, and tested experimentally. Novel techniques for absolute measurement of surfaces by viewing an object from different perspectives are developed. A prototype probe is used to demonstrate measurements of a variety of objects.Engineering and Physical Sciences Research Council (EPSRC) Grant No. GR/T11289/0