Micro Fourier Transform Profilometry (μ\muFTP): 3D shape measurement at 10,000 frames per second

Recent advances in imaging sensors and digital light projection technology have facilitated a rapid progress in 3D optical sensing, enabling 3D surfaces of complex-shaped objects to be captured with improved resolution and accuracy. However, due to the large number of projection patterns required for phase recovery and disambiguation, the maximum fame rates of current 3D shape measurement techniques are still limited to the range of hundreds of frames per second (fps). Here, we demonstrate a new 3D dynamic imaging technique, Micro Fourier Transform Profilometry ($\mu$FTP), which can capture 3D surfaces of transient events at up to 10,000 fps based on our newly developed high-speed fringe projection system. Compared with existing techniques, $\mu$FTP has the prominent advantage of recovering an accurate, unambiguous, and dense 3D point cloud with only two projected patterns. Furthermore, the phase information is encoded within a single high-frequency fringe image, thereby allowing motion-artifact-free reconstruction of transient events with temporal resolution of 50 microseconds. To show $\mu$FTP's broad utility, we use it to reconstruct 3D videos of 4 transient scenes: vibrating cantilevers, rotating fan blades, bullet fired from a toy gun, and balloon's explosion triggered by a flying dart, which were previously difficult or even unable to be captured with conventional approaches.Comment: This manuscript was originally submitted on 30th January 1

Progress in industrial photogrammetry by means of markerless solutions

174 p.La siguiente tesis está enfocada al desarrollo y uso avanzado de metodologías fotogramétrica sin dianas en aplicaciones industriales. La fotogrametría es una técnica de medición óptica 3D que engloba múltiples configuraciones y aproximaciones. En este estudio se han desarrollado procedimientos de medición, modelos y estrategias de procesamiento de imagen que van más allá que la fotogrametría convencional y buscan el emplear soluciones de otros campos de la visión artificial en aplicaciones industriales. Mientras que la fotogrametría industrial requiere emplear dianas artificiales para definir los puntos o elementos de interés, esta tesis contempla la reducción e incluso la eliminación de las dianas tanto pasivas como activas como alternativas prácticas. La mayoría de los sistemas de medida utilizan las dianas tanto para definir los puntos de control, relacionar las distintas perspectivas, obtener precisión, así como para automatizar las medidas. Aunque en muchas situaciones el empleo de dianas no sea restrictivo existen aplicaciones industriales donde su empleo condiciona y restringe considerablemente los procedimientos de medida empleados en la inspección. Un claro ejemplo es la verificación y control de calidad de piezas seriadas, o la medición y seguimiento de elementos prismáticos relacionados con un sistema de referencia determinado. Es en este punto donde la fotogrametría sin dianas puede combinarse o complementarse con soluciones tradicionales para tratar de mejorar las prestaciones actuales

Real-time 3D surface-shape measurement using fringe projection and system-geometry constraints

Optical three-dimensional (3D) surface-shape measurement has diverse applications in engineering, computer vision and medical science. Fringe projection profilometry (FPP), uses a camera-projector system to permit high-accuracy full-field 3D surface-shape measurement by projecting fringe patterns onto an object surface, capturing images of the deformed patterns, and computing the 3D surface geometry. A wrapped phase map can be computed from the camera images by phase analysis techniques. Phase-unwrapping can solve the phase ambiguity of the wrapped phase map and permit determination of camera-projector correspondences. The object surface geometry can then be reconstructed by stereovision techniques after system calibration. For real-time 3D measurement, geometry-constraint based methods may be a preferred technique over other phase-unwrapping methods, since geometry-constraint methods can handle surface discontinuities, which are problematic for spatial phase unwrapping, and they do not require additional patterns, which are needed in temporal phase unwrapping. However, the fringe patterns used in geometry-constraint based methods are usually designed with a low frequency in order to maximize the reliability of correspondence determination. Although using high-frequency fringe patterns have proven to be effective in increasing the measurement accuracy by suppressing the phase error, high-frequency fringe patterns may reduce the reliability and thus are not commonly used. To address the limitations of current geometry-constraint based methods, a new fringe projection method for surface-shape measurement was developed using modulation of background and amplitude intensities of the fringe patterns to permit identification of the fringe order, and thus unwrap the phase, for high-frequency fringe patterns. Another method was developed with background modulation only, using four high-frequency phase-shifted fringe patterns. The pattern frequency is determined using a new fringe-wavelength geometry-constraint model that allows only two point candidates in the measurement volume. The correct corresponding point is selected with high reliability using a binary pattern computed from the background intensity. Equations of geometry-constraint parameters permit parameter calculation prior to measurement, thus reducing computational cost during measurement. In a further development, a new real-time 3D measurement method was devised using new background-modulated modified Fourier transform profilometry (FTP) fringe patterns and geometry constraints. The new method reduced the number of fringe patterns required for 3D surface reconstruction to two. A short camera-projector baseline allows reliable corresponding-point selection, even with high-frequency fringe patterns, and a new calibration approach reduces error induced by the short baseline. Experiments demonstrated the ability of the methods to perform real-time 3D measurement for a surface with geometric discontinuity, and for spatially isolated objects. Although multi-image FPP techniques can achieve higher accuracy than single-image methods, they suffer from motion artifacts when measuring dynamic object surfaces that are either moving or deforming. To reduce the motion-induced measurement error for multi-image FPP techniques, a new method was developed to first estimate the motion-induced phase shift errors by computing the differences between phase maps over a multiple measurement sequence. Then, a phase map with reduced motion-induced error is computed using the estimated phase shift errors. This motion-induced error compensation is computed pixel-wise for non-homogeneous surface motion. Experiments demonstrated the ability of the method to reduce motion-induced error in real-time, for real-time shape measurement of surfaces with high depth variation, and moving and deforming surfaces

State-of-the-art active optical techniques for three-dimensional surface metrology: a review [Invited]

This paper reviews recent developments of non-contact three-dimensional (3D) surface metrology using an active structured optical probe. We focus primarily on those active non-contact 3D surface measurement techniques that could be applicable to the manufacturing industry. We discuss principles of each technology, and its advantageous characteristics as well as limitations. Towards the end, we discuss our perspectives on the current technological challenges in designing and implementing these methods in practical applications.Purdue Universit