Classification of peacock feather reflectance using principal component analysis similarity factors from multispectral imaging data

This is the author accepted manuscript. The final version is available from the publisher via the DOI in this record.Iridescent structural colors in biology exhibit sophisticated spatially-varying reflectance properties that depend on both the illumination and viewing angles. The classification of such spectral and spatial information in iridescent structurally colored surfaces is important to elucidate the functional role of irregularity and to improve understanding of color pattern formation at different length scales. In this study, we propose a non-invasive method for the spectral classification of spatial reflectance patterns at the micron scale based on the multispectral imaging technique and the principal component analysis similarity factor (PCASF). We demonstrate the effectiveness of this approach and its component methods by detailing its use in the study of the angle-dependent reflectance properties of Pavo cristatus (the common peacock) feathers, a species of peafowl very well known to exhibit bright and saturated iridescent colors. We show that multispectral reflectance imaging and PCASF approaches can be used as effective tools for spectral recognition of iridescent patterns in the visible spectrum and provide meaningful information for spectral classification of the irregularity of the microstructure in iridescent plumage.This research was developed during a visiting research stay of Dr. José M. Medina in the Departamento de Óptica, Universidad de Granada, Spain. We thank to José Medina and Rosalía Ruiz who provided the peacock samples, to David Porcel and Juan de Dios Bueno from the Servicio de Microscopía, (Centro de Instrumentación Científica, Universidad de Granada) for technical assessment, and to the Color Imaging Group (Universidad de Granada) for their hardware partial support. JMM and JAD acknowledge the Departmento de Óptica, Universidad de Granada, Spain. PV acknowledges USAF funding (FA9550-10-1-0020)

Artist material BRDF database for computer graphics rendering

The primary goal of this thesis was to create a physical library of artist material samples. This collection provides necessary data for the development of a gonio-imaging system for use in museums to more accurately document their collections. A sample set was produced consisting of 25 panels and containing nearly 600 unique samples. Selected materials are representative of those commonly used by artists both past and present. These take into account the variability in visual appearance resulting from the materials and application techniques used. Five attributes of variability were identified including medium, color, substrate, application technique and overcoat. Combinations of these attributes were selected based on those commonly observed in museum collections and suggested by surveying experts in the field. For each sample material, image data is collected and used to measure an average bi-directional reflectance distribution function (BRDF). The results are available as a public-domain image and optical database of artist materials at art-si.org. Additionally, the database includes specifications for each sample along with other information useful for computer graphics rendering such as the rectified sample images and normal maps

Enhancing Mesh Deformation Realism: Dynamic Mesostructure Detailing and Procedural Microstructure Synthesis

Propomos uma solução para gerar dados de mapas de relevo dinâmicos para simular deformações em superfícies macias, com foco na pele humana. A solução incorpora a simulação de rugas ao nível mesoestrutural e utiliza texturas procedurais para adicionar detalhes de microestrutura estáticos. Oferece flexibilidade além da pele humana, permitindo a geração de padrões que imitam deformações em outros materiais macios, como couro, durante a animação. As soluções existentes para simular rugas e pistas de deformação frequentemente dependem de hardware especializado, que é dispendioso e de difícil acesso. Além disso, depender exclusivamente de dados capturados limita a direção artística e dificulta a adaptação a mudanças. Em contraste, a solução proposta permite a síntese dinâmica de texturas que se adaptam às deformações subjacentes da malha de forma fisicamente plausível. Vários métodos foram explorados para sintetizar rugas diretamente na geometria, mas sofrem de limitações como auto-interseções e maiores requisitos de armazenamento. A intervenção manual de artistas na criação de mapas de rugas e mapas de tensão permite controle, mas pode ser limitada em deformações complexas ou onde maior realismo seja necessário. O nosso trabalho destaca o potencial dos métodos procedimentais para aprimorar a geração de padrões de deformação dinâmica, incluindo rugas, com maior controle criativo e sem depender de dados capturados. A incorporação de padrões procedimentais estáticos melhora o realismo, e a abordagem pode ser estendida além da pele para outros materiais macios.We propose a solution for generating dynamic heightmap data to simulate deformations for soft surfaces, with a focus on human skin. The solution incorporates mesostructure-level wrinkles and utilizes procedural textures to add static microstructure details. It offers flexibility beyond human skin, enabling the generation of patterns mimicking deformations in other soft materials, such as leater, during animation. Existing solutions for simulating wrinkles and deformation cues often rely on specialized hardware, which is costly and not easily accessible. Moreover, relying solely on captured data limits artistic direction and hinders adaptability to changes. In contrast, our proposed solution provides dynamic texture synthesis that adapts to underlying mesh deformations. Various methods have been explored to synthesize wrinkles directly to the geometry, but they suffer from limitations such as self-intersections and increased storage requirements. Manual intervention by artists using wrinkle maps and tension maps provides control but may be limited to the physics-based simulations. Our research presents the potential of procedural methods to enhance the generation of dynamic deformation patterns, including wrinkles, with greater creative control and without reliance on captured data. Incorporating static procedural patterns improves realism, and the approach can be extended to other soft-materials beyond skin

Forest Remote Sensing in Canada and the Individual Tree Crown (ITC) Approach to Forest Inventories

After a brief description of Canada’s forest situation and the role of the federal government in forestry, some Natural Resources Canada’country-wide project will be introduced. These include the National Forest Inventories (past and present), the National Forest Information System, the EOSD programs to map land cover, monitor change and evaluate biomass, mostly from Canada-wide coverages with Landsat images. The accounting of carbon and the monitoring of deforestation at a map scale level will also be introduced. The second and most significant part of this paper will describe our Individual Tree Crown (ITC) approach to forest inventories used with high spatial resolution images (better than 1m/pixel). Techniques for individual crown delineation, species classification and regrouping into forest stands that are leading to a semi-automatic production of forest inventories will be described.A locally adaptive technique for tree counts, mostly reserved for young regenerating areas, will also be presented. The synergy of multispectral and LIDAR data (atmany levels) will be examined and, the normalization of spectral values within and among aerial images will be considered.Article信州大学農学部紀要. 46(1-2): 85-92 (2010)departmental bulletin pape

The Appearance of Platelet-Polymer Composite Coatings: Microstructural Characterization, Hybrid Modeling, and Predictive Design.

The appearance of a platelet-containing polymer composite coating is governed by the microstructure and optical properties included scattering particles and platelets. Many models attempt to predict the coating's appearance, but do not utilize the complete 3D-microstructure, reducing their predictive utility. In this thesis, laser scanning confocal microscopy was used to measure the effect of platelet orientation on angle-dependent lightness, and quantify the spacing between platelets, from which a new microstructural property, the gap factor, was determined. The gap factor is a measure of the average gap size between platelets per unit material surface length. It ranged from 0 to 2 for the systems studied in this thesis. An increase in gap factor of about 0.1, keeping the orientation similar, reduced the near-specular lightness of the physical samples by more than 20%. A 3D hybrid-simulation was created using wave-optics to simulate the bidirectional-reflection-distribution-function (BRDF) for individual platelets. This was combined with ray-tracing to quantify the scattering behavior of a platelet array. This model more accurately predicted the lightness of a silver paint sample than an orientation-based microfacet-model, and was used to study how the surface roughness of the platelets influences lightness. The lightness at 15 degrees off-specular was about 130 when the root-mean square of the amplitude of the roughness, sigma(RMS), was much less than the wavelength of light. Lightness reduced to about 80 when sigma(RMS) was about equal to the wavelength of light. This effect of sigma(RMS) on lightness was found to be more significant with decreases in the roughness correlation length. The hybrid model was also used to study how width, thickness, and volume concentration of the platelets change the near-specular and backscattered lightness. The observed reduction in near-specular lightness with gap factor was verified. However, the resultant 2nd-order exponential decay was weaker than observed. This was attributed wave-scattering by faces and edges, behavior not included in the current model, but may be added in the future. This hybrid model can be used in the future to design unique microstructures to produce new and novel visual or functional effects using manufacturing techniques such as 3D-printing.PhDMaterials Science and EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/133404/1/cseubert_1.pd

The Photometric Effect of Macroscopic Surface Roughness on Sediment Surfaces

The focus of this work was on explaining the effect of macroscopic surface roughness on the reflected light from a soil surface. These questions extend from deciding how to best describe roughness mathematically, to figuring out how to quantify its effect on the spectral reflectance from a soil’s surface. In this document, I provide a background of the fundamental literature in the fields of remote sensing and computer vision that have been instrumental in my research. I then outline the software and hardware tools that I have developed to quantify roughness. This includes a detailed outline of a custom LiDAR operating mode for the GRIT-T goniometer system that was developed and characterized over the course of this research, as well as proposed methods for using convergent images acquired by our goniometer system’s camera to derive useful structure from motion point clouds. These tools and concepts are then used in two experiments that aim to explain the relationship between soil surface roughness and spectral BRF phenomena. In the first experiment, clay sediment samples were gradually pulverized into a smooth powderized state and in steps of reduced surface roughness. Results show that variance in the continuum spectra as a function of viewing angle increased with the roughness of the sediment surface. This result suggests that inter-facet multiple scattering caused a variance in absorption band centering and depth due to an increased path length traveled through the medium. In the second experiment, we examine the performance of the Hapke photometric roughness correction for sand sediment surfaces of controlled sample density. We find that the correction factor potentially underpredicts the effect of shadowing in the forward scattering direction. The percentage difference between forward-modeled BRF measurements and empirically measured BRF measurements is constant across wavelength, suggesting that a factor can be empirically derived. Future results should also investigate the scale at which the photometric correction factor should be applied. Finally, I also outline a structure from motion processing chain aimed at deriving meaningful metrics of vegetation structure. Results show that correlations between these metrics and observed directional reflectance phenomena of chordgrass are strong for peak growing state plants. We observe good agreement between destructive LAI metrics and contact-based LAI metrics

A simulation framework for the design and evaluation of computational cameras

In the emerging field of computational imaging, rapid prototyping of new camera concepts becomes increasingly difficult since the signal processing is intertwined with the physical design of a camera. As novel computational cameras capture information other than the traditional two-dimensional information, ground truth data, which can be used to thoroughly benchmark a new system design, is also hard to acquire. We propose to bridge this gap by using simulation. In this article, we present a raytracing framework tailored for the design and evaluation of computational imaging systems. We show that, depending on the application, the image formation on a sensor and phenomena like image noise have to be simulated accurately in order to achieve meaningful results while other aspects, such as photorealistic scene modeling, can be omitted. Therefore, we focus on accurately simulating the mandatory components of computational cameras, namely apertures, lenses, spectral filters and sensors. Besides the simulation of the imaging process, the framework is capable of generating various ground truth data, which can be used to evaluate and optimize the performance of a particular imaging system. Due to its modularity, it is easy to further extend the framework to the needs of other fields of application. We make the source code of our simulation framework publicly available and encourage other researchers to use it to design and evaluate their own camera designs

Acquisition, Modeling, and Augmentation of Reflectance for Synthetic Optical Flow Reference Data

This thesis is concerned with the acquisition, modeling, and augmentation of material reflectance to simulate high-fidelity synthetic data for computer vision tasks. The topic is covered in three chapters: I commence with exploring the upper limits of reflectance acquisition. I analyze state-of-the-art BTF reflectance field renderings and show that they can be applied to optical flow performance analysis with closely matching performance to real-world images. Next, I present two methods for fitting efficient BRDF reflectance models to measured BTF data. Both methods combined retain all relevant reflectance information as well as the surface normal details on a pixel level. I further show that the resulting synthesized images are suited for optical flow performance analysis, with a virtually identical performance for all material types. Finally, I present a novel method for augmenting real-world datasets with physically plausible precipitation effects, including ground surface wetting, water droplets on the windshield, and water spray and mists. This is achieved by projecting the realworld image data onto a reconstructed virtual scene, manipulating the scene and the surface reflectance, and performing unbiased light transport simulation of the precipitation effects

HYPERSPECTRAL PROPERTIES OF DATE PALM TREES (PHOENIX DACTYLIFERA L.)

The goal of this study is to classify the Date Palm varieties based on hyperspectral signature technology since it is difficult to identify the Date Palm cultivars without fruits. It will also help to obtain the hyperspectral signature for different types of date palm trees. Moreover, it also assists to determine the wavelength fingerprint of each cultivar and to recommend the best classification protocol differentiating among different cultivars based on spectral signature. Utilizing the Hyperspectral imaging technology precisely on the leaves of different Date Palm cultivars, thus facilitating identification of date palm cultivars without the fruits and make the spatial classification. Hyperspectral benefits enable to detect mixtures of materials within same pixel, to identify specific materials with high degree of accuracy, to get some measure of relative abundance based on depth of absorption features and, to produce the quantitative (rather than qualitative) results. For the treatments, in this study, the six cultivars of Date Palm trees (Barhi, Khadrawi, Khenaizi, Khalas, Fard and Helali) were tested. Ten samples for each cultivar from tissue culture were taken and tested considering the same age and identical conditions (control). Later, the samples were analyzed by using the RGB bands. Analyzing the tissue culture samples, the overall results indicate that, each cultivar of the Date Palm tree has the different spectral signatur