Efficient completeness inspection using real-time 3D color reconstruction with a dual-laser triangulation system

In this chapter, we present the final system resulting from the European Project \u201d3DComplete\u201d aimed at creating a low-cost and flexible quality inspection system capable of capturing 2.5D color data for completeness inspection. The system uses a single color camera to capture at the same time 3D data with laser triangulation and color texture with a special projector of a narrow line of white light, which are then combined into a color 2.5D model in real-time. Many examples of completeness inspection tasks are reported which are extremely difficult to analyze with state-of-the-art 2D-based methods. Our system has been integrated into a real production environment, showing that completeness inspection incorporating 3D technology can be readily achieved in a short time at low costs

Calibration of double stripe 3D laser scanner systems using planarity and orthogonality constraints

In this study, 3D scanning systems that utilize a pair of laser stripes are studied. Three types of scanning systems are implemented to scan environments, rough surfaces of near planar objects and small 3D objects. These scanners make use of double laser stripes to minimize the undesired effect of occlusions. Calibration of these scanning systems is crucially important for the alignment of 3D points which are reconstructed from different stripes. In this paper, the main focus is on the calibration problem, following a treatment on the pre-processing of stripe projections using dynamic programming and localization of 2D image points with sub-pixel accuracy. The 3D points corresponding to laser stripes are used in an optimization procedure that imposes geometrical constraints such as coplanarities and orthogonalities. It is shown that, calibration procedure proposed here, significantly improves the alignment of 3D points scanned using two laser stripes

Fleksibilni optički digitalizacijski sustav s proizvoljnim brojem kamera

Development of the flexible multi-camera optical surface digitization system which projects non coherent coded light in two perpendicular directions is presented. By the introduction of the absolute method for stereopairs indexing the need for twofold searching through the phase images is eliminated, as well as the influence of discontinuities. Critical areas responsible for outlier generation are eliminated prior to triangulation by combining the modulation filtering of phase images and gradient filtering of the absolute phase images. Sequential triangulation process enabled triangulation of points that are not visible in all the cameras, thus providing means for digitization of partially occluded areas. Free form calibration object eliminated the need for specialized planar calibration objects, which combined with variable external camera parameters resulted in a system that can be adjusted depending on the measurement problem. In comparison to the commercial single and stereo camera systems our approach reduces the number of projections for the digitization of the complete objects.Razmatrana je problematika razvoja fleksibilnog optičkog sustava s proizvoljnim brojem slobodnih kamera koji digitalizaciju oblika površine provodi dvostrukim projiciranjem nekoherentnog kodiranog svjetla. Apsolutnom metodom određivanja stereoparova eliminirana je potreba za dvostrukim pretraživanjem faznih slika, te utjecaj diskontinuiteta. Kombinacijom amplitudnog filtriranja slike parcijalnih faza i gradijentnog filtriranja slike apsolutnih faza eliminirana su kritična područja, te smanjen broj pogrešno identificiranih stereoparova. Uvođenjem slijednog postupka triangulacije omogućeno je trianguliranje i onih točaka koje nisu istovremeno vidljive u svim kamerama, odnosno uvedena je mogućnost digitalizacije površina djelomično zasjenjenih površinskim artefaktima. Kroz kalibraciju slobodnim kalibrom eliminirana je potreba za specijalnim planarnim kalibracijskim objektima, u sprezi sa varijabilnim vanjskim parametrima kalibracije sustav postaje prilagodljiv mjernom zadatku. U odnosu na komercijalno dostupne sustave s jednom i dvije kamere novi sustav omogućava smanjenje broja potrebnih projekcija za digitalizaciju kompletnog mjernog volumena

Non-contact free-form shape measurement for coordinate measuring machines

Precision measurement of manufactured parts commonly uses contact measurement methods. A Coordinate Measuring Machine (CMM) mounted probe touches the surface of the part, recording the probe’s tip position at each contact. Recently, devices have been developed that continuously scan the probe tip across the surface, allowing points to be measured more quickly. Contact measurement is accurate and fast for shapes that are easily parameterized such as a sphere or a plane, but is slow and requires considerable user input for more general objects such as those with free-form surfaces. Phase stepping fringe projection and photogrammetry are common non-contact shape measurement methods. Photogrammetry builds a 3D model of feature points from images of an object taken from multiple perspectives. In phase stepping fringe projection a series of sinusoidal patterns, with a phase shift between each, is projected towards an object. A camera records a corresponding series of images. The phase of the pattern at each imaged point is calculated and converted to a 3D representation of the object’s surface. Techniques combining phase stepping fringe projection and photogrammetry were developed and are described here. The eventual aim is to develop an optical probe for a CMM to enable non-contact measurement of objects in an industrial setting. For the CMM to accurately report its position the probe must be small, light, and robust. The methods currently used to provide a phase shift require either an accurately calibrated translation stage to move an internal component, or a programmable projector. Neither of these implementations can be practically mounted on a CMM due to size and weight limits or the delicate parts required. A CMM probe consisting of a single camera and a fringe projector was developed. The fringe projector projects a fixed fringe pattern. Phase steps are created by moving the CMM mounted probe, taking advantage of the geometry of the fringe projection system. New techniques to calculate phase from phase stepped images created by relative motion of probe and object are proposed, mathematically modelled, and tested experimentally. Novel techniques for absolute measurement of surfaces by viewing an object from different perspectives are developed. A prototype probe is used to demonstrate measurements of a variety of objects.Engineering and Physical Sciences Research Council (EPSRC) Grant No. GR/T11289/0

Innovative Techniques for Digitizing and Restoring Deteriorated Historical Documents

Recent large-scale document digitization initiatives have created new modes of access to modern library collections with the development of new hardware and software technologies. Most commonly, these digitization projects focus on accurately scanning bound texts, some reaching an efficiency of more than one million volumes per year. While vast digital collections are changing the way users access texts, current scanning paradigms can not handle many non-standard materials. Documentation forms such as manuscripts, scrolls, codices, deteriorated film, epigraphy, and rock art all hold a wealth of human knowledge in physical forms not accessible by standard book scanning technologies. This great omission motivates the development of new technology, presented by this thesis, that is not-only effective with deteriorated bound works, damaged manuscripts, and disintegrating photonegatives but also easily utilized by non-technical staff. First, a novel point light source calibration technique is presented that can be performed by library staff. Then, a photometric correction technique which uses known illumination and surface properties to remove shading distortions in deteriorated document images can be automatically applied. To complete the restoration process, a geometric correction is applied. Also unique to this work is the development of an image-based uncalibrated document scanner that utilizes the transmissivity of document substrates. This scanner extracts intrinsic document color information from one or both sides of a document. Simultaneously, the document shape is estimated to obtain distortion information. Lastly, this thesis provides a restoration framework for damaged photographic negatives that corrects photometric and geometric distortions. Current restoration techniques for the discussed form of negatives require physical manipulation to the photograph. The novel acquisition and restoration system presented here provides the first known solution to digitize and restore deteriorated photographic negatives without damaging the original negative in any way. This thesis work develops new methods of document scanning and restoration suitable for wide-scale deployment. By creating easy to access technologies, library staff can implement their own scanning initiatives and large-scale scanning projects can expand their current document-sets