Modeling the measurement precision of Fringe Projection Profilometry

Abstract Three-dimensional (3D) surface geometry provides elemental information in various sciences and precision engineering. Fringe Projection Profilometry (FPP) is one of the most powerful non-contact (thus non-destructive) and non-interferometric (thus less restrictive) 3D measurement techniques, featuring at its high precision. However, the measurement precision of FPP is currently evaluated experimentally, lacking a complete theoretical model for guidance. We propose the first complete FPP precision model chain including four stage models (camera intensity, fringe intensity, phase and 3D geometry) and two transfer models (from fringe intensity to phase and from phase to 3D geometry). The most significant contributions include the adoption of a non-Gaussian camera noise model, which, for the first time, establishes the connection between camera’s electronics parameters (known in advance from the camera manufacturer) and the phase precision, and the formulation of the phase to geometry transfer, which makes the precision of the measured geometry representable in an explicit and concise form. As a result, we not only establish the full precision model of the 3D geometry to characterize the performance of an FPP system that has already been set up, but also explore the expression of the highest possible precision limit to guide the error distribution of an FPP system that is yet to build. Our theoretical models make FPP a more designable technique to meet the challenges from various measurement demands concerning different object sizes from macro to micro and requiring different measurement precisions from a few millimeters to a few micrometers

Fringe projection profilometry method with high efficiency, precision, and convenience:theoretical analysis and development

Fringe projector profilometry (FPP) is an important three-dimensional (3D) measurement technique, especially when high precision and speed are required. Thus, theoretical interrogation is critical to provide deep understanding and possible improvement of FPP. By dividing an FPP measurement process into four steps (system calibration, phase measurement, pixel correspondence, and 3D reconstruction), we give theoretical analysis on the entire process except for the extensively studied calibration step. Our study indeed reveals a series of important system properties, to the best of our knowledge, for the first time: (i) in phase measurement, the optimal and worst fringe angles are proven perpendicular and parallel to epipolar line, respectively, and can be considered as system parameters and can be directly made available during traditional calibration, highlighting the significance of the epipolar line; (ii) in correspondence, when two sets of fringes with different fringe orientations are projected, the highest correspondence precision can be achieved with arbitrary orientations as long as these two orientations are perpendicular to each other; (iii) in reconstruction, a higher reconstruction precision is given by the 4-equation methods, while we notice that the 3-equation methods are almost dominatingly used in literature. Based on these theoretical results, we propose a novel FPP measurement method which (i) only projects one set of fringes with optimal fringe angle to explicitly work together with the epipolar line for precise pixel correspondence; (ii) for the first time, the optimal fringe angle is determined directly from the calibration parameters, instead of being measured; (iii) uses 4 equations for precise 3D reconstruction but we can remove one equation which is equivalent to an epipolar line, making it the first algorithm that can use 3-equation solution to achieve 4-equation precision. Our method is efficient (only one set of fringe patterns is required in projection and the speed is doubled in reconstruction), precise (in both pixel correspondence and 3D reconstruction), and convenient (the computable optimal fringe angle and a closed-form 3-equation solution). We also believe that our work is insightful in revealing fundamental FPP properties, provides a more reasonable measurement for practice, and thus is beneficial to further FPP studies.Ministry of Education (MOE)Published versionFunding: Ministry of Education - Singapore (MOE-T2EP20220-0008); Youth Innovation Promotion Association of the Chinese Academy of Sciences (2019221); National Natural Science Foundation of China (11903036, 1803037, 61805243, 62127901); Bureau of International Cooperation, Chinese Academy of Sciences (181722KYSB20180015); Key Research Program of Frontier Science, Chinese Academy of Sciences (QYZDJ-SSW-JSC038)

Low-dose imaging denoising with one pair of noisy images

Low-dose imaging techniques have many important applications in diverse fields, from biological engineering to materials science. Samples can be protected from phototoxicity or radiation-induced damage using low-dose illumination. However, imaging under a low-dose condition is dominated by Poisson noise and additive Gaussian noise, which seriously affects the imaging quality, such as signal-to-noise ratio, contrast, and resolution. In this work, we demonstrate a low-dose imaging denoising method that incorporates the noise statistical model into a deep neural network. One pair of noisy images is used instead of clear target labels and the parameters of the network are optimized by the noise statistical model. The proposed method is evaluated using simulation data of the optical microscope, and scanning transmission electron microscope under different low-dose illumination conditions. In order to capture two noisy measurements of the same information in a dynamic process, we built an optical microscope that is capable of capturing a pair of images with independent and identically distributed noises in one shot. A biological dynamic process under low-dose condition imaging is performed and reconstructed with the proposed method. We experimentally demonstrate that the proposed method is effective on an optical microscope, fluorescence microscope, and scanning transmission electron microscope, and show that the reconstructed images are improved in terms of signal-to-noise ratio and spatial resolution. We believe that the proposed method could be applied to a wide range of low-dose imaging systems from biological to material science.Published versionThis work was funded by National Key Research and Development Program of China (2021YFB3602604); National Natural Science Foundation of China (61975205,62075221, 62131011); Fusion Foundation of Research and Education of CAS; University of Chinese Academy of Sciences; Fundamental Research Funds for the Central Universities; Funded Project of Hebei Province Innovation Capability Improvement Plan, China (20540302D)