Camera based Display Image Quality Assessment

This thesis presents the outcomes of research carried out by the PhD candidate Ping Zhao during 2012 to 2015 in Gjøvik University College. The underlying research was a part of the HyPerCept project, in the program of Strategic Projects for University Colleges, which was funded by The Research Council of Norway. The research was engaged under the supervision of Professor Jon Yngve Hardeberg and co-supervision of Associate Professor Marius Pedersen, from The Norwegian Colour and Visual Computing Laboratory, in the Faculty of Computer Science and Media Technology of Gjøvik University College; as well as the co-supervision of Associate Professor Jean-Baptiste Thomas, from The Laboratoire Electronique, Informatique et Image, in the Faculty of Computer Science of Universit´e de Bourgogne. The main goal of this research was to develop a fast and an inexpensive camera based display image quality assessment framework. Due to the limited time frame, we decided to focus only on projection displays with static images displayed on them. However, the proposed methods were not limited to projection displays, and they were expected to work with other types of displays, such as desktop monitors, laptop screens, smart phone screens, etc., with limited modifications. The primary contributions from this research can be summarized as follows: 1. We proposed a camera based display image quality assessment framework, which was originally designed for projection displays but it can be used for other types of displays with limited modifications. 2. We proposed a method to calibrate the camera in order to eliminate unwanted vignetting artifact, which is mainly introduced by the camera lens. 3. We proposed a method to optimize the camera’s exposure with respect to the measured luminance of incident light, so that after the calibration all camera sensors share a common linear response region. 4. We proposed a marker-less and view-independent method to register one captured image with its original at a sub-pixel level, so that we can incorporate existing full reference image quality metrics without modifying them. 5. We identified spatial uniformity, contrast and sharpness as the most important image quality attributes for projection displays, and we used the proposed framework to evaluate the prediction performance of the state-of-the-art image quality metrics regarding these attributes. The proposed image quality assessment framework is the core contribution of this research. Comparing to conventional image quality assessment approaches, which were largely based on the measurements of colorimeter or spectroradiometer, using camera as the acquisition device has the advantages of quickly recording all displayed pixels in one shot, relatively inexpensive to purchase the instrument. Therefore, the consumption of time and resources for image quality assessment can be largely reduced. We proposed a method to calibrate the camera in order to eliminate unwanted vignetting artifact primarily introduced by the camera lens. We used a hazy sky as a closely uniform light source, and the vignetting mask was generated with respect to the median sensor responses over i only a few rotated shots of the same spot on the sky. We also proposed a method to quickly determine whether all camera sensors were sharing a common linear response region. In order to incorporate existing full reference image quality metrics without modifying them, an accurate registration of pairs of pixels between one captured image and its original is required. We proposed a marker-less and view-independent image registration method to solve this problem. The experimental results proved that the proposed method worked well in the viewing conditions with a low ambient light. We further identified spatial uniformity, contrast and sharpness as the most important image quality attributes for projection displays. Subsequently, we used the developed framework to objectively evaluate the prediction performance of the state-of-art image quality metrics regarding these attributes in a robust manner. In this process, the metrics were benchmarked with respect to the correlations between the prediction results and the perceptual ratings collected from subjective experiments. The analysis of the experimental results indicated that our proposed methods were effective and efficient. Subjective experiment is an essential component for image quality assessment; however it can be time and resource consuming, especially in the cases that additional image distortion levels are required to extend the existing subjective experimental results. For this reason, we investigated the possibility of extending subjective experiments with baseline adjustment method, and we found that the method could work well if appropriate strategies were applied. The underlying strategies referred to the best distortion levels to be included in the baseline, as well as the number of them

Contrôle automatique des conditions d'affichage d'une image par un projecteur

L'utilisation d'un projecteur dans différentes applications et environnements soulève la nécessité d'adapter et de contrôler l'image affichée en fonction des conditions d'affichage. L'image affichée par exemple dans un environnement éclairé peut apparaître avec des couleurs saturées et un contraste atténué. De même, son apparence peut être affectée par la réflectance et la géométrie de l'écran sur lequel l'image est projetée. Dans ce mémoire, nous proposons une approche pour contrôler l'apparence de l'image affichée par la modélisation des différents facteurs affectants son affichage. Cette approche est basée sur le modèle de formation de l'image perçue et la constance de couleur entre les images observées. L'approche proposée unifie la compensation des effets de la lumière ambiante et de la réflectance de l'écran. Nous argumentons que le modèle proposé est plus général que certains modèles de compensation utilisés pour la constance de couleurs. L'approche proposée estime l'illuminant de l'environnement d'affichage et l'illuminant cible, la réflectance de l'écran utilisé ainsi que la réflectance de l'écran cible. Une opération complémentaire pour la compensation de contraste est dérivée de la loi de Weber. Cette compensation permet d'adapter le contraste de l'image affichée conformément à l'intensité de la lumière ambiante. L'approche proposée est vérifiée expérimentalement dans des environnements éclairés et en utilisant des écrans non blancs. Elle permet de camoufler l'effet de l'écran utilisé dans l'affichage et de simuler les effets d'autres écrans cibles. Notre approche peut être utile dans certains domaines tels que le camouflage et la simulation pour des applications d'art visuel et performatif

New Trends in 3D Printing

A quarter century period of the 3D printing technology development affords ground for speaking about new realities or the formation of a new technological system of digital manufacture and partnership. The up-to-date 3D printing is at the top of its own overrated expectations. So the development of scalable, high-speed methods of the material 3D printing aimed to increase the productivity and operating volume of the 3D printing machines requires new original decisions. It is necessary to study the 3D printing applicability for manufacturing of the materials with multilevel hierarchical functionality on nano-, micro- and meso-scales that can find applications for medical, aerospace and/or automotive industries. Some of the above-mentioned problems and new trends are considered in this book

Realistic visualisation of cultural heritage objects

This research investigation used digital photography in a hemispherical dome, enabling a set of 64 photographic images of an object to be captured in perfect pixel register, with each image illuminated from a different direction. This representation turns out to be much richer than a single 2D image, because it contains information at each point about both the 3D shape of the surface (gradient and local curvature) and the directionality of reflectance (gloss and specularity). Thereby it enables not only interactive visualisation through viewer software, giving the illusion of 3D, but also the reconstruction of an actual 3D surface and highly realistic rendering of a wide range of materials. The following seven outcomes of the research are claimed as novel and therefore as representing contributions to knowledge in the field: A method for determining the geometry of an illumination dome; An adaptive method for finding surface normals by bounded regression; Generating 3D surfaces from photometric stereo; Relationship between surface normals and specular angles; Modelling surface specularity by a modified Lorentzian function; Determining the optimal wavelengths of colour laser scanners; Characterising colour devices by synthetic reflectance spectra

Holography

Holography - Basic Principles and Contemporary Applications is a collection of fifteen chapters, describing the basic principles of holography and some recent innovative developments in the field. The book is divided into three sections. The first, Understanding Holography, presents the principles of hologram recording illustrated with practical examples. A comprehensive review of diffraction in volume gratings and holograms is also presented. The second section, Contemporary Holographic Applications, is concerned with advanced applications of holography including sensors, holographic gratings, white-light viewable holographic stereograms. The third section of the book Digital Holography is devoted to digital hologram coding and digital holographic microscopy