AN INTELLIGENT SYSTEM FOR THE DEFECT INSPECTION OF SPECULAR PAINTED CERAMIC TILES

Product visual inspection is still performed manually or semi automatically in most industries from simple ceramic tile grading to complicated automotive body panel paint defect and surface quality inspection. Moreover, specular surfaces present additional challenges to conventional vision systems due to specular reflections, which may mask the true location of objects and lead to incorrect measurements. Some sophisticated optical inspection methods have already been developed for high precision surface defect inspection in recent years. Unfortunately, most of them are highly computational. Systems built on those methods are either inapplicable or costly to achieve real-time inspection. This thesis describes an integrated low-cost intelligent system developed to automatically capture and extract regular defects of the ceramic tiles with uniformly colored specular coatings. The proposed system is implemented on a group of smart cameras using its on-board processing ability to achieve real-time inspection. The results of this study will be used to facilitate the design of a robust, low-cost, closed-loop inspection system for a class of products with smooth specular coatings. The experimental results on real test panels demonstrate the effectiveness and robustness of proposed system

Perceptual Modeling and Reproduction of Gloss

The reproduction of gloss on displays is generally not based on perception and as a consequence does not guarantee the best visualization of a real material. The reproduction is composed of four different steps: measurement, modeling, rendering, and display. The minimum number of measurements required to approximate a real material is unknown. The error metrics used to approximate measurements with analytical BRDF models are not based on perception, and the best visual approximation is not always obtained. Finally, the gloss perception difference between real objects and objects seen on displays has not sufficiently been studied and might be influencing the observer judgement. This thesis proposes a systematic, scalable, and perceptually based workflow to represent real materials on displays. First, the gloss perception difference between real objects and objects seen on displays was studied. Second, the perceptual performance of the error metrics currently in use was evaluated. Third, a projection into a perceptual gloss space was defined, enabling the computation of a perceptual gloss distance measure. Fourth, the uniformity of the gloss space was improved by defining a new gloss difference equation. Finally, a systematic, scalable, and perceptually based workflow was defined using cost-effective instruments

Light Fields Reconstructing Geometry and Reflectance Properties

Computer vision plays an important role in the progress of automation and digitalization of our society. One of the key challenges is the creation of accurate 3D representations of our environment. The rich information in light fields can enable highly accurate depth estimates, but requires the development of new algorithms. Especially specular reflections pose a challenge for many reconstruction algorithms. This is due to the violation of the brightness consistency assumption, which only holds for Lambertian surfaces. Most surfaces are to some extent specular and an appropriate handling is central to avoid erroneous depth maps. In this thesis we explore the potential of using specular highlights to determine the orientation of surfaces. To this end, we examine epipolar images in light field set ups. In light field data, reflectance properties can be characterized by intensity variations in the epipolar plane space. This space is analysed and compared to the expected reflectance, which is modelled using the render equation with different bidirectional reflection distribution functions. This approach allows us to infer highly accurate surface normals and depth estimates. Furthermore, it reveals material properties encoded in the reflectance by inspecting the intensity profile. Our results demonstrate the potential to increase the accuracy of the depth maps. Multiple cameras in a light field set up let us retrieve additional material properties encoded in the reflectance

Understanding the role of phase function in translucent appearance

Multiple scattering contributes critically to the characteristic translucent appearance of food, liquids, skin, and crystals; but little is known about how it is perceived by human observers. This article explores the perception of translucency by studying the image effects of variations in one factor of multiple scattering: the phase function. We consider an expanded space of phase functions created by linear combinations of Henyey-Greenstein and von Mises-Fisher lobes, and we study this physical parameter space using computational data analysis and psychophysics. Our study identifies a two-dimensional embedding of the physical scattering parameters in a perceptually meaningful appearance space. Through our analysis of this space, we find uniform parameterizations of its two axes by analytical expressions of moments of the phase function, and provide an intuitive characterization of the visual effects that can be achieved at different parts of it. We show that our expansion of the space of phase functions enlarges the range of achievable translucent appearance compared to traditional single-parameter phase function models. Our findings highlight the important role phase function can have in controlling translucent appearance, and provide tools for manipulating its effect in material design applications.National Institutes of Health (U.S.) (Award R01-EY019262-02)National Institutes of Health (U.S.) (Award R21-EY019741-02

Registration and variability of side scan sonar imagery

Submitted in partial fulfillment of the requirements for the degree of Ocean Engineer at the Massachusetts Institute of Technology and the Woods Hole Oceanographic Institution August 1988This thesis presents the results of several experiments performed on side scan sonar equipment and imagery with the aim of characterizing the acoustic variability of side scan sonar imagery and applying this information to image rectification and registration. A static test tank experiment is presented which analyzes the waveform, power spectral density, and temporal variability of the transmitted waveform. The results of a second static experiment conducted from the Woods Hole Oceanographic Institution Pier in Woods Hole, Massachusetts permit determination of the distribution and moments of intensity fluctuations of echoes from objects imaged in side scan sonograms. This experiment also characterizes temporal and spatial coherence of intensity fluctuations. A third experiment is presented in which a side scan sonar towfish images the bottom adjacent to the pier while running along an underwater track which reduces towfish instability. Imagery from this experiment is used to develop a rectification and registration algorithm for side scan sonat images. Preliminary image processing is described and examples presented, followed by favorable results for automated image rectification and registration.Massachusetts Commonwealth Centers of Excellence, Marine Imaging Systems, and The National Science Foundation for funding this researc

Activity profiling for minimally invasive surgery

Imperial Users onl

Modeling the Radar Return of Powerlines Using an Incremental Length Diffraction Coefficient Approach

A method for modeling the signal from cables and powerlines in Synthetic Aperture Radar (SAR) imagery is presented. Powerline detection using radar is an active area of research. Accurately identifing the location of powerlines in a scene can be used to aid pilots of low flying aircraft in collision avoidance, or map the electrical infrastructure of an area. The focus of this research was on the forward modeling problem of generating the powerline SAR signal from first principles. Previous work on simulating SAR imagery involved methods that ranged from efficient but insufficiently accurate, depending on the application, to more exact but computationally complex. A brief survey of the numerous ways to model the scattering of electromagnetic radiation is provided. A popular tool that uses the geometric optics approximation for modeling imagery for remote sensing applications across a wide range of modalities is the Digitial Imaging and Remote Sensing Image Generation (DIRSIG) tool. This research shows the way in which DIRSIG generates the SAR phase history is unique compared to other methods used. In particular, DIRSIG uses the geometric optics approximation for the scattering of electromagnetic radiation and builds the phase history in the time domain on a pulse-by-pulse basis. This enables an efficient generation of the phase history of complex scenes. The drawback to this method is the inability to account for diffraction. Since the characteristic diameter of many communication cables and powerlines is on the order of the wavelength of the incident radiation, diffraction is the dominant mechanism by which the radiation gets scattered for these targets. Comparison of DIRSIG imagery to field data shows good scene-wide qualitative agreement as well as Rayleigh distributed noise in the amplitude data, as expected for coherent imaging with speckle. A closer inspection of the Radar Cross Sections of canonical targets such as trihedrals and dihedrals, however, shows DIRSIG consistently underestimated the scattered return, especially away from specular observation angles. This underestimation was particularly pronounced for the dihedral targets which have a low acceptance angle in elevation, probably caused by the lack of a physical optics capability in DIRSIG. Powerlines were not apparent in the simulated data. For modeling powerlines outside of DIRSIG using a standalone approach, an Incremental Length Diffraction Coefficient (ILDC) method was used. Traditionally, this method is used to model the scattered radiation from the edge of a wedge, for example the edges on the wings of a stealth aircraft. The Physical Theory of Diffraction provides the 2D diffraction coefficient and the ILDC method performs an integral along the edge to extend this solution to three dimensions. This research takes the ILDC approach but instead of using the wedge diffraction coefficient, the exact far-field diffraction coefficient for scattering from a finite length cylinder is used. Wavenumber-diameter products are limited to less than or about 10. For typical powerline diameters, this translates to X-band frequencies and lower. The advantage of this method is it allows exact 2D solutions to be extended to powerline geometries where sag is present and it is shown to be more accurate than a pure physical optics approach for frequencies lower than millimeter wave. The Radar Cross Sections produced by this method were accurate to within the experimental uncertainty of measured RF anechoic chamber data for both X and C-band frequencies across an 80 degree arc for 5 different target types and diameters. For the X-band data, the mean error was 6.0% for data with 9.5% measurement uncertainty. For the C-band data, the mean error was 11.8% for data with 14.3% measurement uncertainty. The best results were obtained for X-band data in the HH polarization channel within a 20 degree arc about normal incidence. For this configuration, a mean error of 3.0% for data with a measurement uncertainty of 5.2% was obtained. The least accurate results were obtained for X-band data in the VV polarization channel within a 20 degree arc about normal incidence. For this configuration, a mean error of 8.9% for data with a measurement uncertainty of 5.9% was obtained. This error likely arose from making the smooth cylinder assumption, which neglects the semi-open waveguide TE contribution from the grooves in the helically wound powerline. For field data in an actual X-band circular SAR collection, a mean error of 3.3% for data with a measurement uncertainty of 3.3% was obtained in the HH channel. For the VV channel, a mean error of 9.9% was obtained for data with a measurement uncertainty of 3.4%. Future work for improving this method would likely entail adding a far-field semi-open waveguide contribution to the 2D diffraction coefficient for TE polarized radiation. Accounting for second order diffractions between closely spaced powerlines would also lead to improved accuracy for simulated field data

A Comparative Study of the Bidirectional Reflectance Distribution Function of Several Surfaces as a Mid-wave Infrared Diffuse Reflectance Standard

The Bi-Directional Reflectance Distribution Function (BRDF) has a well defined diffuse measurement standard in the ultraviolet, visible, and near infrared (NIR), Spectralon(trade name). It is predictable, stable, repeatable, and has low surface variation because it is a bulk scatterer. In the mid-wave IR (MWIR) and long-wave IR (LWIR), there is not such a well-defined standard. There are well-defined directional hemispherical reflectance (DHR) standards, but the process of integrating BRDF measurements into DHR for the purpose of calibration is problematic, at best. Direct BRDF measurement standards are needed. This study use current calibration techniques to ensure valid measurements and then systematically investigates the BRDF and its variation for eight potential MWIR diffuse BRDF standards. Diffuseness, repeatability, and reflectance are all considered as required parameters necessary for a di use MWIR BRDF standard. This document shows comparatively that Spectralon is an excellent candidate for a diffuse MWIR BRDF standard

Efficient, image-based appearance acquisition of real-world objects

Two ingredients are necessary to synthesize realistic images: an accurate rendering algorithm and, equally important, high-quality models in terms of geometry and reflection properties. In this dissertation we focus on capturing the appearance of real world objects. The acquired model must represent both the geometry and the reflection properties of the object in order to create new views of the object with novel illumination. Starting from scanned 3D geometry, we measure the reflection properties (BRDF) of the object from images taken under known viewing and lighting conditions. The BRDF measurement require only a small number of input images and is made even more efficient by a view planning algorithm. In particular, we propose algorithms for efficient image-to-geometry registration, and an image-based measurement technique to reconstruct spatially varying materials from a sparse set of images using a point light source. Moreover, we present a view planning algorithm that calculates camera and light source positions for optimal quality and efficiency of the measurement process. Relightable models of real-world objects are requested in various fields such as movie production, e-commerce, digital libraries, and virtual heritage.Zur Synthetisierung realistischer Bilder ist zweierlei nötig: ein akkurates Verfahren zur Beleuchtungsberechnung und, ebenso wichtig, qualitativ hochwertige Modelle, die Geometrie und Reflexionseigenschaften der Szene repräsentieren. Die Aufnahme des Erscheinungbildes realer Gegenstände steht im Mittelpunkt dieser Dissertation. Um beliebige Ansichten eines Gegenstandes unter neuer Beleuchtung zu berechnen, müssen die aufgenommenen Modelle sowohl die Geometrie als auch die Reflexionseigenschaften beinhalten. Ausgehend von einem eingescannten 3D-Geometriemodell, werden die Reflexionseigenschaften (BRDF) anhand von Bildern des Objekts gemessen, die unter kontrollierten Lichtverhältnissen aus verschiedenen Perspektiven aufgenommen wurden. Für die Messungen der BRDF sind nur wenige Eingabebilder erforderlich. Im Speziellen werden Methoden vorgestellt für die Registrierung von Bildern und Geometrie sowie für die bildbasierte Messung von variierenden Materialien. Zur zusätzlichen Steigerung der Effizienz der Aufnahme wie der Qualität des Modells, wurde ein Planungsalgorithmus entwickelt, der optimale Kamera- und Lichtquellenpositionen berechnet. Anwendung finden virtuelle 3D-Modelle bespielsweise in der Filmproduktion, im E-Commerce, in digitalen Bibliotheken wie auch bei der Bewahrung von kulturhistorischem Erbe