Multispectral acquisition of large-sized pictorial surfaces

Multispectral acquisition of artworks has recently received considerable attention in the image processing community. Quite understandably, so far this attention has mainly focused on paintings, given their predominant role in museum collections. It is worth pointing out that the instrumentation and procedures used for acquiring regular paintings are not suited for the multispectral acquisition of large-sized painted surfaces such as frescoed halls and great paintings. Given the relevance of such artifacts, and their widespread presence in churches or historical buildings due to their social function, the problem of finding suitable techniques for their acquisition is certainly worth addressing. This paper focuses on multispectral acquisition of large-sized pictorial surfaces, systematically addressing the practical issues related to the acquisition equipment and procedure. Given the crucial role played by the illumination in this application, special attention is given to this issue. The proposed approach is supported by experimental results

Spectral imaging and archival data in analyzing the Madonna of the Rabbit painting by Manet and Titian

A concise insight into the outputs provided by the latest prototype of visible-near infrared (VIS-NIR) multispectral scanner (National Research Council-National Institute of Optics, CNR-INO, Italy) is presented. The analytical data acquired on an oil painting Madonna of the Rabbit by É. Manet are described. In this work, the VIS-NIR was complemented with X-ray fluorescence (XRF) mapping for the chemical and spatial characterization of several pigments. The spatially registered VIS-NIR data facilitated their processing by spectral correlation mapping (SCM) and artificial neural network (ANN) algorithm respectively for pigment mapping and improved visibility of pentimenti and of underdrawing style. The data provided several key elements for the comparison with a homonymous original work by Titian studied within the ARCHive LABoratory (ARCHLAB) transnational access project

Prototype software for colorant formulation using Gamblin conservation colors

When selecting pigments from a large set for restorative inpainting, it can often be challenging to create a mixture that will provide an exact match to the original artwork under a range of viewing and illumination conditions. In this research, a prototype computer program was developed that will aid the user by providing a color match and paint recipe that exhibits minimal metamerism when compared to the original artwork. The Gamblin Conservation Colors, a set of 43 colorants specially formulated for inpainting, were characterized in terms of their optical properties, absorption and scattering, according to Kubelka-Munk turbid media theory. Formulations were made using traditional spectrophotometric measurements and image-based measurements. The multispectral imaging system consisted of a trichromatic CFA camera coupled with two absorption filters; spectral reflectance data for each pixel location was estimated with a transformation based on calibration target images. Three targets were used for testing formulation accuracy: a target consisting of mixtures of Gamblin Conservation Colors, and two oil paintings. Pigment selection was reasonably successful, and good predictions resulted from both measurement techniques, but for more complex tasks such as pigment identification, a more rigorous colorant characterization approach may be needed. Predictions from image-based measurements were generally less accurate, and improvements in the camera model would likely remedy this. It is expected that this software will be of assistance to conservators by simplifying the process of selecting from a large set of available pigments, as well as reducing the possibility of damage to painted surfaces in cases where direct measurements are impractical. The open source nature of the software provides the opportunity for changes and addition of features in the future

Image segmentation and pigment mapping of cultural heritage based on spectral imaging

The goal of the work reported in this dissertation is to develop methods for image segmentation and pigment mapping of paintings based on spectral imaging. To reach this goal it is necessary to achieve sufficient spectral and colorimetric accuracies of both the spectral imaging system and pigment mapping. The output is a series of spatial distributions of pigments (or pigment maps) composing a painting. With these pigment maps, the change of the color appearance of the painting can be simulated when the optical properties of one or more pigments are altered. These pigment maps will also be beneficial for enriching the historical knowledge of the painting and aiding conservators in determining the best course for retouching damaged areas of the painting when metamerism is a factor. First, a new spectral reconstruction algorithm was developed based on Wyszecki’s hypothesis and the matrix R theory developed by Cohen and Kappauf. The method achieved both high spectral and colorimetric accuracies for a certain combination of illuminant and observer. The method was successfully tested with a practical spectral imaging system that included a traditional color-filter-array camera coupled with two optimized filters, developed in the Munsell Color Science Laboratory. The spectral imaging system was used to image test paintings, and the method was used to retrieve spectral reflectance factors for these paintings. Next, pigment mapping methods were brought forth, and these methods were based on Kubelka-Munk (K-M) turbid media theory that can predict spectral reflectance factor for a specimen from the optical properties of the specimen’s constituent pigments. The K-M theory has achieved practical success for opaque materials by reduction in mathematical complexity and elimination of controlling thickness. The use of the general K-M theory for the translucent samples was extensively studied, including determination of optical properties of pigments as functions of film thickness, and prediction of spectral reflectance factor of a specimen by selecting the right pigment combination. After that, an investigation was carried out to evaluate the impact of opacity and layer configuration of a specimen on pigment mapping. The conclusions were drawn from the comparisons of prediction accuracies of pigment mapping between opaque and translucent assumption, and between single and bi-layer assumptions. Finally, spectral imaging and pigment mapping were applied to three paintings. Large images were first partitioned into several small images, and each small image was segmented into different clusters based on either an unsupervised or supervised classification method. For each cluster, pigment mapping was done pixel-wise with a limited number of pigments, or with a limited number of pixels and then extended to other pixels based on a similarity calculation. For the masterpiece The Starry Night, these pigment maps can provide historical knowledge about the painting, aid conservators for inpainting damaged areas, and digitally rejuvenate the original color appearance of the painting (e.g. when the lead white was not noticeably darkened)

Study on Modern and Contemporary works of Art through non invasive integrated physical techniques

During my PhD I developed two parallel and complementary topics, concerning both works of art and materials. The first one, focused on non-invasive investigations on works of art (ancient and contemporary), was aimed to deepen conservative state, material composition, painting techniques and the early detection of any deterioration. This latter goal also guided the study of pictorial and restoration materials, mainly aimed at their characterization from the optical point of view. Diagnostic activities made use of different methods of investigation. Among image techniques, photography and macrophotography in diffuse, specular and raking light, ultraviolet fluorescent, image spectroscopy, wide band infrared reflectography, digital and differential K-edge radiography. To get as much information as possible, to be properly integrated with other data, punctual diagnostic techniques, such as reflectance spectrophotometry, colorimetry and X Ray fluorescence, were also used

Study on Modern and Contemporary works of Art through non invasive integrated physical techniques

During my PhD I developed two parallel and complementary topics, concerning both works of art and materials. The first one, focused on non-invasive investigations on works of art (ancient and contemporary), was aimed to deepen conservative state, material composition, painting techniques and the early detection of any deterioration. This latter goal also guided the study of pictorial and restoration materials, mainly aimed at their characterization from the optical point of view. Diagnostic activities made use of different methods of investigation. Among image techniques, photography and macrophotography in diffuse, specular and raking light, ultraviolet fluorescent, image spectroscopy, wide band infrared reflectography, digital and differential K-edge radiography. To get as much information as possible, to be properly integrated with other data, punctual diagnostic techniques, such as reflectance spectrophotometry, colorimetry and X Ray fluorescence, were also used

A compact spectral camera for VIS-NIR imaging

This paper describes the design of a spectro-photo/radio-metric camera, that can be used in both portable and in-situ applications, whose compactness is made possible by a suitable image spectral scanning scheme based on a Linearly Variable Filter (LVF). Such filter is able to operate continuously from 400 nm to 2500 nm, allowing the hyper-spectral imaging from visible to near infrared. In traditional scanners the whole apparatus is moved along a path as long as the scene, whereas in this instrument the camera body is still and the LVF it is the only moving part. This solution allows a compact design and an easily portable instrument

Hyperspectral colour imaging and spectrophotometric instrumentation

The trichromatic nature of commercial photography is strictly connected with the nature of human colour vision, although the characteristics of usual colour imaging devices are quite different from the human visual system. The increase in the number of colour channels for spectral (either multispectral or hyperspectral) imaging is an active field of research with many potential applications in different fields. Each element of the captured scene is specified in the spectral image by the spectral reflectance factor. This measurement is independent of the particular illumination of the scene and allows the colorimetric computation in a device-independent colour space for any chosen illuminant and any observer. This thesis describes the project and construction of a compact spectrophotometric camera, which can be used in both portable and in-situ applications. The compactness is made possible by a suitable image spectral scanning based on an Induced Transmission Filter (ITF). This filter is made by a set of thin-film coatings of dielectric materials with high and low refraction index, whose shape like a wedge induces a wavelength selective transmittance, continuously variable along one direction and uniform in the perpendicular direction. Such a filter, classified as Linearly Variable Filter (LVF), operates continuously from 430nm to 940nm and allows hyperspectral imaging. In traditional scanners the whole apparatus is moved along a path as long as the scene, whereas in this instrument the camera body is still and the LVF is the only moving part. The sequence of operations for wavelength and radiometric calibrations are discussed. The expected acquisition times and number of images as a function of the spectral sampling step are considered. The resulting properties make the instrument easy to use and with short acquisition times. Moreover, overviews of the historic evolution of colour vision fundamentals, colour spaces and spectral imaging technology are given for introducing the reader to the essential concepts useful for the understanding of the text

TECHNART 2017. Non-destructive and microanalytical techniques in art and cultural heritage. Book of abstracts

440 p.TECHNART2017 is the international biannual congress on the application of Analytical Techniques in Art and Cultural Heritage. The aim of this European conference is to provide a scientific forum to present and promote the use of analytical spectroscopic techniques in cultural heritage on a worldwide scale to stimulate contacts and exchange experiences, making a bridge between science and art. This conference builds on the momentum of the previous TECHNART editions of Lisbon, Athens, Berlin, Amsterdam and Catania, offering an outstanding and unique opportunity for exchanging knowledge on leading edge developments. Cultural heritage studies are interpreted in a broad sense, including pigments, stones, metal, glass, ceramics, chemometrics on artwork studies, resins, fibers, forensic applications in art, history, archaeology and conservation science. The meeting is focused in different aspects: - X-ray analysis (XRF, PIXE, XRD, SEM-EDX). - Confocal X-ray microscopy (3D Micro-XRF, 3D Micro-PIXE). - Synchrotron, ion beam and neutron based techniques/instrumentation. - FT-IR and Raman spectroscopy. - UV-Vis and NIR absorption/reflectance and fluorescence. - Laser-based analytical techniques (LIBS, etc.). - Magnetic resonance techniques. - Chromatography (GC, HPLC) and mass spectrometry. - Optical imaging and coherence techniques. - Mobile spectrometry and remote sensing

Design and Construction of a Multispectral Camera for Spectral and Colorimetric Reproduction

Multi-spectral imaging and spectral reflectance reconstruction can be used in cultural-heritage institutes to digitalize their collections for documentation purposes. It can be used to simulate artwork under any lighting condition, and to analyze colorants that were used. The basic idea of a multi-spectral imaging system is to sub-sample spectral reflectance factor, producing results similar to a spectrophotometer. The sampled data are used to reconstruct reflectance for the visible spectrum. In this thesis, a wide band multispectral camera was designed and constructed to achieve high spectral and color accuracy as well as high image quality. Noise propagation theory was introduced and tested. A seven channel band- pass filter set was modeled using Gaussian functions and optimized to yield high spectral and colorimetric reproduction accuracy as well as low colori- metric noise. Single and sandwich filters were selected from o!-the-shelf absorption filters using the Gaussian bandpass filter model. Experiments were conducted to test the spectral, color and noise performance of the novel sandwich filters and compared with interference filters. The novel sandwich fil- ters led to increased colorimetric accuracy along with a reduction colorimetric noise. This imaging system will be used as part of a recommended workflow for museum archiving, and will be an important addition to the spectral imaging capabilities at MCSL