Calibrating the elements of a multispectral imaging system

We describe a method to calibrate the elements of a multispectral system aimed at skylight imaging, which consists of a monochrome charge-coupled device (CCD) camera and a liquid-crystal tunable filter (LCTF). We demonstrate how to calibrate these two devices in order to build a multispectral camera that can obtain spectroradiometric measurements of skylight. Spectral characterizations of the tunable filter and the camera are presented together with a complete study into correcting temporal and spatial noise, which is of key importance in CCDs. We describe all the necessary steps to undertake this work and all the additional instrumentation that must be used to calibrate the radiometric devices correctly. We show how this complete study of our multispectral system allows us to use it as an accurate, high resolution spectroradiometer.This work was financed by the Spanish Red Temática “CIENCIA Y TECNOLOGÍA DEL COLOR” (FIS2005-25312-E), the Spanish Ministry of Education and Science, and the European Fund for Regional Development (FEDER) through grant FIS2007-60736. We thank our English colleague A. L. Tate for revising our English text.Peer reviewe

Spectral imaging of human portraits and image quality

This dissertation addresses the problem of capturing spectral images for human portraits and evaluating image quality of spectral images. A new spectral imaging approach is proposed in this dissertation for spectral images of human portraits. Thorough statistical analysis is performed for spectral reflectances from various races and different face parts. A spectral imaging system has been designed and calibrated for human portraits. The calibrated imaging system has the ability to represent not only the facial skin but also the spectra of lips, eyes and hair from various races as well. The generated spectral images can be applied to color-imaging system design and analysis. To evaluate the image quality of spectral imaging systems, a visual psychophysical image quality experiment has been performed in this dissertation. The spectral images were simulated based on real spectral imaging system. Meaningful image quality results have been obtained for spectral images generated from different spectral imaging systems. To bridge the gap between the physical measures and subjective visual perceptions of image quality, four image distortion factors were defined. Image quality metrics were obtained and evaluated based statistical analysis and multiple analysis. The image quality metrics have high correlation with subjective assessment for image quality. The image quality contribution of the distortion factors were evaluated. As an extension of the work other researchers in MCSL have initiated, this dissertation research will, working with other researchers in MCSL, put effort to build a publicly accessible database of spectral images, Lippmann2000

Expanding Dimensionality in Cinema Color: Impacting Observer Metamerism through Multiprimary Display

Television and cinema display are both trending towards greater ranges and saturation of reproduced colors made possible by near-monochromatic RGB illumination technologies. Through current broadcast and digital cinema standards work, system designs employing laser light sources, narrow-band LED, quantum dots and others are being actively endorsed in promotion of Wide Color Gamut (WCG). Despite artistic benefits brought to creative content producers, spectrally selective excitations of naturally different human color response functions exacerbate variability of observer experience. An exaggerated variation in color-sensing is explicitly counter to the exhaustive controls and calibrations employed in modern motion picture pipelines. Further, singular standard observer summaries of human color vision such as found in the CIE’s 1931 and 1964 color matching functions and used extensively in motion picture color management are deficient in recognizing expected human vision variability. Many researchers have confirmed the magnitude of observer metamerism in color matching in both uniform colors and imagery but few have shown explicit color management with an aim of minimized difference in observer perception variability. This research shows that not only can observer metamerism influences be quantitatively predicted and confirmed psychophysically but that intentionally engineered multiprimary displays employing more than three primaries can offer increased color gamut with drastically improved consistency of experience. To this end, a seven-channel prototype display has been constructed based on observer metamerism models and color difference indices derived from the latest color vision demographic research. This display has been further proven in forced-choice paired comparison tests to deliver superior color matching to reference stimuli versus both contemporary standard RGB cinema projection and recently ratified standard laser projection across a large population of color-normal observers

Individual Colorimetric Observers for Personalized Color Imaging

Colors are typically described by three values such as RGB, XYZ, and HSV. This is rooted to the fact that humans possess three types of photoreceptors under photopic conditions, and human color vision can be characterized by a set of three color matching functions (CMFs). CMFs integrate spectra to produce three colorimetric values that are related to visual responses. In reality, large variations in CMFs exist among color-normal populations. Thus, a pair of two spectrally different stimuli might be a match for one person but a mismatch for another person, also known as observer metamerism. Observer metamerism is a serious issue in color-critical applications such as soft proofing in graphic arts and color grading in digital cinema, where colors are compared on different displays. Due to observer metamerism, calibrated displays might not appear correctly, and one person might disagree with color adjustments made by another person. The recent advent of wide color gamut display technologies (e.g., LEDs, OLEDs, lasers, and Quantum Dots) has made observer metamerism even more serious due to their spectrally narrow primaries. The variations among normal color vision and observer metamerism have been overlooked for many years. The current typical color imaging workflow uses a single standard observer assuming all the color-normal people possess the same CMFs. This dissertation provides a possible solution for observer metamerism in color-critical applications by personalized color imaging introducing individual colorimetric observers. In this dissertation, at first, color matching data were collected to derive and validate CMFs for individual colorimetric observers. The data from 151 color-normal observers were obtained at four different locations. Second, two types of individual colorimetric observer functions were derived and validated. One is an individual colorimetric observer model, an extension of the CIE 2006 physiological observer incorporating eight physiological parameters to model individuals in addition to age and field size inputs. The other is a set of categorical observer functions providing a more convenient approach towards the personalized color imaging. Third, two workflows were proposed to characterize human color vision: one using a nomaloscope and the other using proposed spectral pseudoisochromatic images. Finally, the personalized color imaging was evaluated in a color image matching study on an LCD monitor and a laser projector and in a perceived color difference study on a SHARP Quattron display. The personalized color imaging was implemented using a newly introduced ICC profile, iccMAX

Test targets 5.0: A Collaborative effort exploring the use of scientific methods for color imaging and process control

Test Targets is about scholarship that intimately involves faculty and students in the process of writing and publishing. It is a collection if research papers that require collaborative effort over a time span of three academic quarters. Initially, students learned metrology, color management system, and the use of test targets for device optimization and process control. As time goes by, students are encouraged to identify research topics, formulate methodologies, and carry out experiments and data analyses in order to have specific findings. - p.

Characterisation of a multispectral digital camera System for quantitatively comparing complex animal Patterns in natural environments.

Animal coloration can be described by complex colour patterns including elements of varying size, shape and spectral profile which commonly reflect energy outside the spectral range visible for humans. Whilst spectrometry is currently employed for the quantitative study of animal coloration, it is limited on its ability to describe the spatial characteristics of spectral differences in patterns. Digital photography has recently been used as a tool for measuring spatial and spectral properties of patterns based on quantitative analysis of linear camera responses recovered after characterising the device. However current applications of digital imaging for studying animal coloration are limited to image recording within a laboratory environment considering controlled lighting conditions. Here a refined methodology for camera characterisation is developed permitting the recording of images under different illumination conditions typical of natural environments. The characterised camera system thus allows recording images from reflected ultraviolet and visible radiation resulting in a multispectral digital camera system. Furthermore a standardised imaging processing workflow was developed based on specific characteristics of the camera thus making possible an objective comparison from images. An application of the characterised camera system is exemplified in the study of animal colour patterns adapted for camouflage using as a model two Australian, endemic lizard species. The interaction between the spectral and spatial properties of the respective lizards produces complex patterns than cannot be interpreted by spectrophotometry alone. Data obtained from analysis of images recorded with the characterised camera system in the visible and near-ultraviolet region of the spectrum reveal significative differences between sex and species and a possible interaction between sex and species, suggesting microhabitat specialisation to different backgrounds

Diseño e implementación de un sistema multiespectral en el rango ultravioleta, visible e infrarrojo : aplicación al estudio y conservación de obras de arte

Multispectral systems have several applications and there are different possible configurations in which they can be implemented. Different characteristics make them useful, but the basic one is the access to spectral information of a scene or sample with high spatial resolution. In this thesis , the main objective has been the design and implementation of a multispectral system that covers part of the UV, the visible, and part of theIR ranges of the electromagnetic spectrum to be applied to artwork studies. The main part of the thesis is dedicated to the design, characterization and application of a multispectral system based on multiplexed illumination using light emitting diodes (LED). This system comprises two modules : Module 1 UV-Vis, with a CCD camera sensitive between 370nm and 930nm , coupled to a source of LEDs with 16 different channels, i.e. 16 wavelengths of emission; and Module 2 IR with an lnGaAs camera with sensitivity between 930nm and 1650nm coupled to an LED source with 7 emission wavelengths. Thus , the complete system covers from 370nm to 1650nm with a total of23 channels obtained with LED illumination. The system elements were characterized and simulations were performed to assess their performance in the reconstruction of spectral reflectance under ideal conditions , and also under conditions of quantization noise and additive noise. Its performance was evaluated using the formula CIEDE2000 color difference, the mean square error (RMSE) and the goodness-of-fit coefficient (GFC) . The simulation results showed a good overall system performance, but with better results for module 1 UV -Vis due to the increased amount of LED channels in its spectral range. Computer programs with their respective graphical interfaces to control the hardware and processing the information provided by the system were implemented. For the spectral reconstruction we employed the method based on direct interpolation using splines , and the methods based on training set of samples with known digital system responses and spectral reflectances: the undetermined pseudo-inverse (PSE -1) and simple pseudo-inverse (PSE). The equipment was evaluated over real samples of the Color Checker Chart CCCR and a series of frescoes patches painted with pigments used in artworks. The results of the metrics CIEDE2000, RMSE and GFC showed that the methods ofthe PSE-1 and PSE have similar performance, with slightly better results for the second one. The interpolation method presented a slightly lower performance, but it has the practical value of not needing training. The results for the PSE method were similar to those obtained through simulation, and proved again that the module 2 IR has lower performance. lt was concluded that overall system performance was good with CIEDE2000 and RMSE average values for the methods based on PSE in the order of 1 unit. The developed system was applied to artworks in the museum ofPedralbes Monastery in Barcelona, and the churches of Sant Pere in Terrassa. Different images of murals of the chapel of San Miguel in the Monastery of Pedralbes were captured. The evaluation of the system performance for this museum application showed similar performance to the reported one in laboratory. We also captured a painting of large format, oil on wood named: La Virgen de la Leche. For this artwork the modular design and easy movement of the system was used to generate a complete picture by composition from several smaller images. At the churches of Sant Pere, we explored wall paintings dating from the Visigoth (VI-VII) and Romance times (XII -XIII) to assess whether there were features in the paintings that were not evident in the visible range, but in other spectral ranges. Enhancement algorithms were implemented for this task. The results obtained in this thesis demonstrate the potential of the developed multispecral system for obtaining spectral information in the ultraviolet, visible and infrared regions.Los sistemas multiespectrales tienen la característica principal de proporcionar acceso a información espectral de una muestra con alta resolución espacial. En esta tesis, como principal objetivo, se ha diseñado e implementado un sistema multiespectral para aplicarlo al estudio de obras de arte. Este sistema comprende dos módulos: el módulo 1 UV-Vis, con una cámara CCD con sensibilidad entre 370nm y930nm, acoplada a una fuente de diodos emisores de luz (LED) con 16 canales diferentes, es decir 16 1ongitudes de onda de emisión; y el módulo 2 IR, con una cámara lnGaAs con sensibilidad entre 930nm y 1650nm, acoplada a una fuente LED con 7 longitudes de onda de emisión. Por tanto, el sistema completo abarca desde 370nm a 1650nm con un total de 23 canales. Se caracterizaron los elementos del sistema y se han realizado simulaciones para evaluar su rendimiento en la reconstrucción de reflectancias espectrales bajo condiciones ideales, condiciones de ruido de cuantificación y aditivo. Su rendimiento se evaluó empleando la fórmula de diferencia de color CIEDE2000, el error cuadrático medio (RMSE) y el coeficiente de bondad del ajuste (GFC). Los resultados de las simulaciones mostraron un buen rendimiento general del sistema, aunque con mejores resultados para el módulo 1 UV-Vis debido a la mayor cantidad de canales LED en su rango espectral. Paralelamente se implementaron los programas computacionales con sus respectivas interfaces gráficas necesarias para el control del hardware usado y para el procesamiento de la información proporcionada por el sistema. Para la reconstrucción espectral empleamos un método de interpolación directa basado en splines, y los métodos de pseudoinversa indeterminada (PSE-l) y pseudoinversa simple (PSE) que necesitan de un entrenamiento con un conjunto de muestras con respuestas digitales del sistema y reflectancias espectrales conocidas. El equipo se evaluó sobre muestras reales de la carta de colores Color Checker CCCR y sobre un conjunto de pinturas al fresco realizadas con pigmentos comúnmente presentas en obras de arte. Los resultados de las métricas CIEDE2000, RMSE y GFC mostraron que los métodos de la PSE-1 y PSE tienen desempeños similares, con resultados ligeramente mejores para el segundo método. El método de interpolación presentó un rendimiento ligeramente menor, aunque tiene el valor práctico de no necesitar entrenamiento. Los resultados reales para el método del PSE fueron similares a los obtenidos mediante simulación, y se mostró una vez más que el módulo 2 IR tiene un rendimiento inferior. Se concluyó que en general el desempeño del sistema era bueno, con valores CIEDE2000 y RMSE promedio para los métodos basados en PSE del orden de 1 unidad en ambos casos. El sistema desarrollado fue aplicado a obras de arte en el museo de Monasterio de Pedralbes, en Barcelona, y las Iglesias de Sant Pere, en Terrassa. En el Monasterio de Pedralbes se capturaron diferentes imágenes de pinturas murales de la capilla de San Miguel y se evaluó el desempeño del sistema para esta aplicación de museo, mostrando un desempeño similar al reportado en las pruebas de laboratorio. También se accedió a la obra “Virgen de la Leche” que es un óleo en tabla de gran formato. En esta obra se aprovechó el diseño modular y de fácil movimiento del sistema para generar por composición una imagen completa a partir de varias imágenes menores. En las iglesias de Sant Pere se exploraron pinturas murales que se estima datan de las épocas visigoda (siglos VI-VII) y románica (siglos XII-XIII) para evaluar si existían características en las pinturas que no fueran evidentes en el rango visible y que si lo fueran en otros rangos espectrales. Para ello se implementaron algoritmos de realce de la información. Los resultados obtenidos en esta tesis doctoral ponen de manifiesto las potencialidades del sistema multiespecral desarrollado para la obtención de información espectral en las regiones ultravioleta, visible e infrarroj