The effects of pattern screen surface deformation on deflectometric measurements - A simulation study

Phase-measuring deflectometry (PMD) is an optical inspection technique for full-field topography measurements of reflective sample surfaces. The measurement principle relies on the analysis of specific patterns, reflected at the sample surface. Evaluation algorithms often model the respective pattern screen as a planar light source. However, the 32\u27\u27 pattern screen in our inspection setup exhibits a central bulge of its surface of about 2–3 mm. This paper presents a simulation framework for PMD to evaluate the effects of a deformed screen surface. The idea is to simulate image data acquired with screen surface deformations and to examine the effects on the PMD evaluation results. The simulated setup consists of a 32\u27\u27 pattern screen with an adjustable central bulge height of 0–3 mm and two cameras with a field of view (FOV) of approximately 225 mm by 172 mm on the sample surface. A first experiment examines the reconstruction errors for a planar sample surface if the reconstruction algorithm uses perfect calibration data (i.e. the same parameters used for the simulated image acquisition). The reconstructed surfaces exhibit a tilt with a maximum height difference of 174 μm across the FOV. A second experiment repeats the reconstruction process of the same sample surface, using camera parameters determined in a simulated calibration process. The resulting surfaces possess irregular, wave-like errors with amplitudes of up to 9 μm in the FOV. The presented simulation results reveal the accuracy limits if a deformation model of the pattern screen is not explicitly included in the reconstruction process

Reconstruction of Specular Reflective Surfaces using Auto-Calibrating Deflectometry

This thesis discusses deflectometry as a reconstruction method for highly reflecting surfaces. It focuses on deflectometry alone and does not use other reconstruction techniques to supplement with additional data. It explains the measurement process and principle and provides a crash course into an efficient mathematical representation of the principles involved. Using this, it reformulates existing three-dimensional reconstructing methods, expands upon them and develops new ones

Reconstruction of Specular Reflective Surfaces using Auto-Calibrating Deflectometry

This thesis discusses deflectometry as a reconstruction method for highly reflecting surfaces. It focuses on deflectometry alone and does not use other reconstruction techniques to supplement with additional data. It explains the measurement process and principle and provides a crash course into an efficient mathematical representation of the principles involved. Using this, it reformulates existing three-dimensional reconstructing methods, expands upon them and develops new ones

Reproducibility of two calibration procedures for phase-measuring deflectometry

Phase-measuring deflectometry is an optical inspection technique for reflective surfaces. It enables absolute, quantitative surface measurements, given a calibrated measurement setup. Two general calibration approaches can be found in literature: First, the stepwise approach uses a calibration pattern and determines internal camera parameters and external geometrical parameters in separate, consecutive steps. Second, the holistic approach optimizes all parameters collectively, based on deflectometric measurements of a calibration mirror. Whereas both approaches have been compared regarding the accuracy of subsequent surface measurements, the present contribution focuses on experimental examination of their reproducibility. In experiment E1, we assess the parameter variability by repeating both calibration procedures ten times. In an additional experiment E2, we repeat all calibration measurements related to a mirror/pattern position ten times in a row before rearranging the mirror/pattern, in order to examine the purely noise-related parameter variability. Finally, we calculate the coordinate variability of a set of world points projected onto the image planes of the calibrated cameras. The measured variability is consistently higher in E1 than in E2 (average ratio: 3.2). Unexpectedly, in both experiments, the external parameter variability also turns out to be higher for the holistic approach compared to stepwise calibration (average ratio: 2.3). This is of importance, since the holistic approach is known from literature to be more accurate than the stepwise approach, regarding their respective application to surface measurements. The image coordinate variability is comparable for both calibration approaches with an average of 0.84 and 0.21 camera pixels for E1 and E2, respectively

3D inspection methods for specular or partially specular surfaces

Deflectometric techniques are a powerful tool for the automated quality control of specular or shiny surfaces. These techniques are based on using a camera to observe a reference pattern reflected on the surface under inspection, exploiting the dependence of specular reflections on surface normals to recover shape information from the acquired images. Although deflectometry is already used in industrial environments such as the quality control of lenses or car bodies, there are still some open problems. On the one hand, using quantitative deflectometry, the normal vector field and the 3D shape of a surface can be obtained, but these techniques do not yet take full advantage of their local sensitivity because the achieved global accuracies are affected by calibration errors. On the other hand, qualitative deflectometry is used to detect surface imperfections without absolute measurements, exploiting the local sensitivity of deflectometric recordings with reduced calibration requirements. However, this qualitative approach requires further processing that can involve a considerable engineering effort, particularly for aesthetic defects which are inherently subjective. The first part of this thesis aims to contribute to a better understanding of how deflectometric setups and their calibration errors affect quantitative measurements. Different error sources are considered including the camera calibration uncertainty and several non-ideal characteristics of LCD screens used to generate the light patterns. Experiments performed using real measurements and simulations show that the non-planarity of the LCD screen and the camera calibration are the dominant sources of error. The second part of the thesis investigates the use of deep learning to identify geometrical imperfections and texture defects based on deflectometric data. Two different approaches are explored to extract and combine photometric and geometric information using convolutional neural network architectures: one for automated classification of defective samples, and another one for automated segmentation of defective regions in a sample. The experimental results in a real industrial case study indicate that both architectures are able to learn relevant features from deflectometric data, enabling the classification and segmentation of defects based on a dataset of user-provided examples.Teknika deflektometrikoak tresna baliotsuak dira gainazal espekular edo distiratsuen kalitate kontrol automatikoa gauzatzeko. Teknika hauetan, kamera bat erabiltzen da ikuskatu beharreko gainazalean islatutako erreferentziazko patroi bat behatzeko, eta isladapen espekularrek gainazalen bektore normalengan duten menpekotasuna ustiatzen dute irudietatik informazio geometrikoa berreskuratzeko. Zenbait industria-aplikaziotan deflektometria jada erabiltzen bada ere –adibidez, betaurrekoen edo autoen karrozerien kalitate kontrolean-, oraindik badaude hobetu beharreko hainbat esparru. Batetik, deflektometria kuantitatiboak aukera ematen du gainazal baten bektore-eremu normala eta 3D forma lortzeko, baina gaur egun teknika hauek ez dute beren sentsibilitate lokal guztia aprobetxatzen kalibrazio-akatsek zehaztasun globalean duten eraginagatik. Bestetik, deflektometria kualitatiboa neurketa absoluturik egin gabe gainazal akatsak antzemateko erabili daiteke, kalibrazio-eskakizun murriztuekin sentsibilitate lokala ustiatuz. Hala ere, teknika horiek algoritmoen garapenean esfortzu handia ekar dezakeen prozesamendu bat eskatzen dute, bereziki bere baitan subjektiboak diren akats estetikoetarako. Hala ere, teknika horiek algoritmoen garapenean esfortzu handia ekar dezakeen prozesamendu bat eskatzen dute, bereziki bere baitan subjektiboak diren akats estetikoetarako. Tesi honen lehen zatiaren helburua adkizizio sistema osatzen duten gailuek eta horien kalibrazioek neurketa kuantitatiboei nola eragiten dieten hobeto ulertzen laguntzea da. Hainbat errore-iturri hartzen dira kontuan, besteak beste kameraren kalibrazioaren ziurgabetasuna, eta argi-patroiak sortzeko erabilitako LCD pantailen zenbait ezaugarri ez-ideal. Neurketa errealetan eta simulazioetan egindako esperimentuek erakusten dute LCD pantailaren deformazioak eta kameraren kalibrazioak eragindako erroreak direla neurketen akats eta ziurgabetasun iturri nagusiak. Tesiaren bigarren zatian, datu deflektometrikoetatik abiatuz, inperfekzio geometrikoak eta testura-akatsak identifikatzeko ikaskuntza sakoneko metodoen erabilera ikertzen da. Helburu honekin, irudietatik informazio fotometrikoa eta geometrikoa atera eta konbinatzen duten sare neuronal konboluzionaletan oinarritutako bi arkitektura proposatzen dira: bata, lagin akastunak automatikoki sailkatzeko; eta, bestea, laginetako eremu akastunak automatikoki segmentatzeko. Automobilgintza industriako kasu praktiko baten lortutako emaitzek erakusten dute erabilitako arkitekturek datu deflektometrikoetatik ezaugarri esanguratsuak ikas ditzaketela, erabiltzaileak emandako adibide multzo batean oinarrituta gainazal akatsak sailkatu eta segmentatzea ahalbidetuz.Las técnicas deflectométricas son una herramienta valiosa para automatizar el control de calidad de superficies especulares o reflectantes. Estas técnicas se basan en el uso de una cámara para observar un patrón de referencia reflejado en la superficie bajo inspección, explotando la dependencia de los reflejos especulares en la normal de la superficie para recuperar información geométrica a partir de las imágenes adquiridas. Aunque la deflectometría ya se usa en algunas aplicaciones industriales, tales como el control de calidad de lentes o carrocerías de coches, todavía hay algunos problemas abiertos. Por un lado, la deflectometría cuantitativa permite obtener el campo vectorial normal y la forma 3D de una superficie, pero a día de hoy no es capaz de aprovechar al máximo su sensibilidad local ya que la precisión global se ve afectada por errores de calibración. Por otro lado, la deflectometría cualitativa se utiliza para detectar imperfecciones de la superficie sin mediciones absolutas, explotando la sensibilidad local de la deflectometría con requisitos de calibración reducidos. Sin embargo, estos métodos requieren un procesamiento adicional que puede implicar un esfuerzo considerable en el desarrollo de algoritmos, particularmente para defectos estéticos que son inherentemente subjetivos. La primera parte de esta tesis tiene como objetivo contribuir a una mejor comprensión de cómo el sistema de adquisición y su calibración afectan a las mediciones cuantitativas. Se consideran dife-rentes fuentes de error, incluida la incertidumbre de calibración de la cámara y varias características no ideales de las pantallas LCD utilizadas para generar los patrones de luz. Los experimentos realizados con mediciones reales y simulaciones indican que los errores inducidos por la deformación de la pantalla LCD y la calibración de la cámara son las principales fuentes de error e incertidumbre. La segunda parte de la tesis investiga el uso del aprendizaje profundo para identificar imperfecciones geométricas y defectos de textura a partir de datos deflectométricos. Se adoptan dos enfoques diferentes para extraer y combinar información fotométrica y geométrica utilizando sendas arquitecturas basadas en redes neuronales convolucionales: una para la clasificación automatizada de muestras defectuosas y otra para la segmentación automatizada de regiones defectuosas en una muestra. Los resultados experimentales en un caso de estudio industrial real indican que ambas arquitecturas pueden aprender características relevantes de los datos deflectométricos, permitiendo la clasificación y segmentación de defectos en base a un conjunto de datos de ejemplos proporcionados por el usuario

Reconstruction of Specular Reflective Surfaces using Auto-Calibrating Deflectometry

This thesis discusses deflectometry as a reconstruction method for highlyreflecting surfaces. It explains the measurement process and principle and provides a crash course into an efficient mathematical representation of the principles involved. Using this, it reformulates existing three-dimensional reconstructing methods, expands upon them and develops new ones. Building on these novel techniques, an auto-calibration is introduced that is able to refine a rough extrinsic calibration

Proceedings of the 2011 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory

This book is a collection of 15 reviewed technical reports summarizing the presentations at the 2011 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory. The covered topics include image processing, optical signal processing, visual inspection, pattern recognition and classification, human-machine interaction, world and situation modeling, autonomous system localization and mapping, information fusion, and trust propagation in sensor networks

Proceedings of the 2009 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory

The joint workshop of the Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB, Karlsruhe, and the Vision and Fusion Laboratory (Institute for Anthropomatics, Karlsruhe Institute of Technology (KIT)), is organized annually since 2005 with the aim to report on the latest research and development findings of the doctoral students of both institutions. This book provides a collection of 16 technical reports on the research results presented on the 2009 workshop

Actuation of Thin Glass for Grazing Incidence X-ray Mirrors

This thesis follows on from work done by the Smart X-ray Optics (SXO) consortium, which consisted of seven UK institutions working between 2007-2011 to produce advances in active x-ray optics. Although some final optical testing of a SXO prototype is described herein, most of the work is aimed towards exploring simpler prototypes which make use of commercially available components. We explore a new, scalable and low-cost method of actuating thin sections of glass within the context of grazing incidence mirrors for x-ray telescopes. Finite element analysis is used to simulate different arrangements of actuators and mountings, then commercially available macro-fibre lead zirconate titanate (PZT) actuators are attached to the rear surface of 0.4mm glass to produce a simple new prototype with a small number of degrees of freedom. Raytracing is used to evaluate the importance of different aberrations with respect to optical performance. Deflectometry is explored as a method for measuring surface height, and singular value decomposition is used to derive orthogonal influence functions and command matrices for the new prototype. We find that, although this technique shows some promise, there are important issues which would need to be overcome if it were to be scaled up to produce a working telescope. A full-sized x-ray telescope may have thousands of mirror segments which would need to be individually calibrated. A robust methodology does not yet exist for this process, but the large amount of hysteresis and variability exhibited by PZT actuators will surely make it harder. More work needs to be done in this area, but in the meantime this technology could be useful to create low-profile mirrors for other applications

Proceedings of the 2010 Joint Workshop of Fraunhofer IOSB and Institute for Anthropomatics, Vision and Fusion Laboratory

On the annual Joint Workshop of the Fraunhofer IOSB and the Karlsruhe Institute of Technology (KIT), Vision and Fusion Laboratory, the students of both institutions present their latest research findings on image processing, visual inspection, pattern recognition, tracking, SLAM, information fusion, non-myopic planning, world modeling, security in surveillance, interoperability, and human-computer interaction. This book is a collection of 16 reviewed technical reports of the 2010 Joint Workshop