Novel Approaches in Structured Light Illumination

Among the various approaches to 3-D imaging, structured light illumination (SLI) is widely spread. SLI employs a pair of digital projector and digital camera such that the correspondences can be found based upon the projecting and capturing of a group of designed light patterns. As an active sensing method, SLI is known for its robustness and high accuracy. In this dissertation, I study the phase shifting method (PSM), which is one of the most employed strategy in SLI. And, three novel approaches in PSM have been proposed in this dissertation. First, by regarding the design of patterns as placing points in an N-dimensional space, I take the phase measuring profilometry (PMP) as an example and propose the edge-pattern strategy which achieves maximum signal to noise ratio (SNR) for the projected patterns. Second, I develop a novel period information embedded pattern strategy for fast, reliable 3-D data acquisition and reconstruction. The proposed period coded phase shifting strategy removes the depth ambiguity associated with traditional phase shifting patterns without reducing phase accuracy or increasing the number of projected patterns. Thus, it can be employed for high accuracy realtime 3-D system. Then, I propose a hybrid approach for high quality 3-D reconstructions with only a small number of illumination patterns by maximizing the use of correspondence information from the phase, texture, and modulation data derived from multi-view, PMP-based, SLI images, without rigorously synchronizing the cameras and projectors and calibrating the device gammas. Experimental results demonstrate the advantages of the proposed novel strategies for 3-D SLI systems

Real-time 3-D Reconstruction by Means of Structured Light Illumination

Structured light illumination (SLI) is the process of projecting a series of light striped patterns such that, when viewed at an angle, a digital camera can reconstruct a 3-D model of a target object\u27s surface. But by relying on a series of time multiplexed patterns, SLI is not typically associated with video applications. For this purpose of acquiring 3-D video, a common SLI technique is to drive the projector/camera pair at very high frame rates such that any object\u27s motion is small over the pattern set. But at these high frame rates, the speed at which the incoming video can be processed becomes an issue. So much so that many video-based SLI systems record camera frames to memory and then apply off-line processing. In order to overcome this processing bottleneck and produce 3-D point clouds in real-time, we present a lookup-table (LUT) based solution that in our experiments, using a 640 by 480 video stream, can generate intermediate phase data at 1063.8 frames per second and full 3-D coordinate point clouds at 228.3 frames per second. These achievements are 25 and 10 times faster than previously reported studies. At the same time, a novel dual-frequency pattern is developed which combines a high-frequency sinusoid component with a unit-frequency sinusoid component, where the high-frequency component is used to generate robust phase information and the unit-frequency component is used to reduce phase unwrapping ambiguities. Finally, we developed a gamma model for SLI, which can correct the non-linear distortion caused by the optical devices. For three-step phase measuring profilometry (PMP), analysis of the root mean squared error of the corrected phase showed a 60х reduction in phase error when the gamma calibration is performed versus 33х reduction without calibration

Optical MEMS

Optical microelectromechanical systems (MEMS), microoptoelectromechanical systems (MOEMS), or optical microsystems are devices or systems that interact with light through actuation or sensing at a micro- or millimeter scale. Optical MEMS have had enormous commercial success in projectors, displays, and fiberoptic communications. The best-known example is Texas Instruments’ digital micromirror devices (DMDs). The development of optical MEMS was impeded seriously by the Telecom Bubble in 2000. Fortunately, DMDs grew their market size even in that economy downturn. Meanwhile, in the last one and half decade, the optical MEMS market has been slowly but steadily recovering. During this time, the major technological change was the shift of thin-film polysilicon microstructures to single-crystal–silicon microsructures. Especially in the last few years, cloud data centers are demanding large-port optical cross connects (OXCs) and autonomous driving looks for miniature LiDAR, and virtual reality/augmented reality (VR/AR) demands tiny optical scanners. This is a new wave of opportunities for optical MEMS. Furthermore, several research institutes around the world have been developing MOEMS devices for extreme applications (very fine tailoring of light beam in terms of phase, intensity, or wavelength) and/or extreme environments (vacuum, cryogenic temperatures) for many years. Accordingly, this Special Issue seeks to showcase research papers, short communications, and review articles that focus on (1) novel design, fabrication, control, and modeling of optical MEMS devices based on all kinds of actuation/sensing mechanisms; and (2) new developments of applying optical MEMS devices of any kind in consumer electronics, optical communications, industry, biology, medicine, agriculture, physics, astronomy, space, or defense

Review of post-process optical form metrology for industrial-grade metal additive manufactured parts

The scope of this review is to investigate the main post-process optical form measurement technologies available in industry today and to determine whether they are applicable to industrial-grade metal additive manufactured parts. An in-depth review of the operation of optical three-dimensional form measurement technologies applicable to metal additive manufacturing is presented, with a focus on their fundamental limitations. Looking into the future, some alternative candidate measurement technologies potentially applicable to metal additive manufacturing will be discussed, which either provide higher accuracy than currently available techniques but lack measurement volume, or inversely, which operate in the appropriate measurement volume but are not currently accurate enough to be used for industrial measurement

Real-time 3D surface-shape measurement using fringe projection and system-geometry constraints

Optical three-dimensional (3D) surface-shape measurement has diverse applications in engineering, computer vision and medical science. Fringe projection profilometry (FPP), uses a camera-projector system to permit high-accuracy full-field 3D surface-shape measurement by projecting fringe patterns onto an object surface, capturing images of the deformed patterns, and computing the 3D surface geometry. A wrapped phase map can be computed from the camera images by phase analysis techniques. Phase-unwrapping can solve the phase ambiguity of the wrapped phase map and permit determination of camera-projector correspondences. The object surface geometry can then be reconstructed by stereovision techniques after system calibration. For real-time 3D measurement, geometry-constraint based methods may be a preferred technique over other phase-unwrapping methods, since geometry-constraint methods can handle surface discontinuities, which are problematic for spatial phase unwrapping, and they do not require additional patterns, which are needed in temporal phase unwrapping. However, the fringe patterns used in geometry-constraint based methods are usually designed with a low frequency in order to maximize the reliability of correspondence determination. Although using high-frequency fringe patterns have proven to be effective in increasing the measurement accuracy by suppressing the phase error, high-frequency fringe patterns may reduce the reliability and thus are not commonly used. To address the limitations of current geometry-constraint based methods, a new fringe projection method for surface-shape measurement was developed using modulation of background and amplitude intensities of the fringe patterns to permit identification of the fringe order, and thus unwrap the phase, for high-frequency fringe patterns. Another method was developed with background modulation only, using four high-frequency phase-shifted fringe patterns. The pattern frequency is determined using a new fringe-wavelength geometry-constraint model that allows only two point candidates in the measurement volume. The correct corresponding point is selected with high reliability using a binary pattern computed from the background intensity. Equations of geometry-constraint parameters permit parameter calculation prior to measurement, thus reducing computational cost during measurement. In a further development, a new real-time 3D measurement method was devised using new background-modulated modified Fourier transform profilometry (FTP) fringe patterns and geometry constraints. The new method reduced the number of fringe patterns required for 3D surface reconstruction to two. A short camera-projector baseline allows reliable corresponding-point selection, even with high-frequency fringe patterns, and a new calibration approach reduces error induced by the short baseline. Experiments demonstrated the ability of the methods to perform real-time 3D measurement for a surface with geometric discontinuity, and for spatially isolated objects. Although multi-image FPP techniques can achieve higher accuracy than single-image methods, they suffer from motion artifacts when measuring dynamic object surfaces that are either moving or deforming. To reduce the motion-induced measurement error for multi-image FPP techniques, a new method was developed to first estimate the motion-induced phase shift errors by computing the differences between phase maps over a multiple measurement sequence. Then, a phase map with reduced motion-induced error is computed using the estimated phase shift errors. This motion-induced error compensation is computed pixel-wise for non-homogeneous surface motion. Experiments demonstrated the ability of the method to reduce motion-induced error in real-time, for real-time shape measurement of surfaces with high depth variation, and moving and deforming surfaces

Design, characterization and testing of a thin-film microelectrode array and signal conditioning microchip for high spatial resolution surface laplacian measurement.

Cardiac mapping has become an important area of research for understanding the mechanisms responsible for cardiac arrhythmias and the associated diseases. Current technologies for measuring electrical potentials on the surface of the heart are limited due to poor spatial resolution, localization issues, signal distortion due to noise, tissue damage, etc. Therefore, the purpose of this study is to design, develop, characterize and investigate a custom-made microfabricated, polyimide-based, flexible Thin-Film MicroElectrode Array (TFMEA) that is directly interfaced to an integrated Signal Conditioning Microchip (SCM) to record cardiac surface potentials on the cellular level to obtain high spatial resolution Surface Laplacian (SL) measurement. TFMEAs consisting of five fingers (Cover area = 4 mm2 and 16 mm2), which contained five individual microelectrodes placed in orthogonal directions (25-µm in diameter, 75-µm interelectrode spacing) to one another, were fabricated within a flexible polyimide substrate and capable of recording electrical activities of the heart on the order of individual cardiomyocytes. A custom designed SCM consisting of 25 channels of preamplification stages and second order band-pass filters was interfaced directly with the TFMEA in order to improve the signal-to-noise ratio (SNR) characteristics of the high spatial resolution recording data. Metrology characterization using surface profilometry and high resolution Scanning Electron Microscope (SEM) indicated the geometry of fabricated TFMEAs closely matched the design parameters \u3c 0.4%). The DC resistances of the 25 individual micro electrodes were consistent (1.050 ± 0.026 kO). The simulation and testing results of the SCM verified the pre-amplification and filter stages met the designed gain and frequency parameters within 2.96%. The functionality of the TFMEA-SCM system was further characterized on a TX 151 conductive gel. The characterization results revealed that the system functionality was sufficient for high spatial cardiac mapping. In vivo testing results clearly demonstrated feasibility of using the TFMEA-SCM system to obtain cellular level SL measurements with significantly improved the SNRs during normal sinus rhythm and Ventricular Fibrillation (VF). Local activation times were detected via evaluating the zero crossing of the SL electro grams, which coincided with the gold standard (dV/dt)min of unipolar electro grams within ± 1%. The in vivo transmembrane current densities calculated from the high spatial resolution SLs were found to be significantly higher than the transmembrane current densities computed using electrodes with higher interelectrode spacings. In conclusion, the custom-made TFMEASCM systems demonstrated feasibility as a tool for measuring cardiac potentials and to perform high resolution cardiac mapping experiments

Hybrid Single and Dual Pattern Structured Light Illumination

Structured Light Illumination is a widely used 3D shape measurement technique in non-contact surface scanning. Multi-pattern based Structured Light Illumination methods reconstruct 3-D surface with high accuracy, but are sensitive to object motion during the pattern projection and the speed of scanning process is relatively long. To reduce this sensitivity, single pattern techniques are developed to achieve a high speed scanning process, such as Composite Pattern (CP) and Modified Composite Pattern (MCP) technique. However, most of single patter techniques have a significant banding artifact and sacrifice the accuracy. We focus on developing SLI techniques can achieve both high speed, high accuracy and have the tolerance to the relative motion. We first present a novel Two-Pattern Full Lateral Resolution (2PFLR) SLI method utilizing an MCP pattern for non-ambiguous phase followed by a single sinusoidal pattern for high accuracy. The surface phase modulates the single sinusoidal pattern which is demodulated using a Quadrature demodulation technique and then unwrapped by the MCP phase result. A single sinusoidal pattern reconstruction inherently has banding error. To effective de-band the surface, we propose Projector Space De-banding algorithm (PSDb). We use projector space because the band error is aligned with the projector coordinates allowing more accurate estimation of the banding error. 2PFLR system only allows the relative motion within the FOV of the scanner, to extend the application of the SLI, we present the research on Relative Motion 3-D scanner which utilize a single pattern technique. The pattern in RM3D system is designed based on MCP but has white space area to capture the surface texture, and a constellation correlation filter method is used to estimate the scanner\u27s trajectory and then align the 3-D surface reconstructed by each frame to a point cloud of the whole object surface

High-speed surface profilometry based on an adaptive microscope with axial chromatic encoding

An adaptive microscope with axial chromatic encoding is designed and developed, namely the AdaScope. With the ability to confocally address any locations within the measurement volume, the AdaScope provides the hardware foundation for a cascade measurement strategy to be developed, dramatically accelerating the speed of 3D confocal microscopy

DEVELOPMENT OF PHASE RETRIEVAL TECHNIQUES IN DISPLACEMENT AND DISPLACEMENT DERIVATIVES MEASUREMENT

Ph.DDOCTOR OF PHILOSOPH