Hyperspectral unmixing: a theoretical aspect and applications to CRISM data processing

Hyperspectral imaging has been deployed in earth and planetary remote sensing, and has contributed the development of new methods for monitoring the earth environment and new discoveries in planetary science. It has given scientists and engineers a new way to observe the surface of earth and planetary bodies by measuring the spectroscopic spectrum at a pixel scale. Hyperspectal images require complex processing before practical use. One of the important goals of hyperspectral imaging is to obtain the images of reflectance spectrum. A raw image obtained by hyperspectral remote sensing usually undergoes conversion to a physical quantity representing the intensity of light energy, called radiance. In order to obtain the reflectance spectrum of surface, the contribution of atmosphere needs to be addressed and then divided by a spectrum of ``white reference.\u27\u27 Furthermore, the obtained reflectance spectra of image pixels are likely to be the mixtures of multiple species due to limited spatial resolution from orbits around planets. Hyperspectral unmixing is an attempt to unmix those pixels - to identify substantial components and estimate their fractional abundances. Hyperspectral unmixing has been widely explored in the literature, but there are still many aspects yet to be studied. The majority of research focuses on the development of methods to retrieve correct substantial components and accurate fractional abundances. Their theoretical aspects are rarely investigated. Chapter 2 will pursue a theoretical aspect of sparse unmixing, one of the hyperspectral unmixing problems and derive its theoretical conditions that guarantee the correct identification of substantial components. Hyperspectral unmixing can also be used for other stages of hyperspectral data processing. Chapter 3 explores the application of hyperspectral unmixing to the processing of hyperspectral image acquired by the Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) onboard the Mars Reconnaissance Orbiter (MRO). In particular, new atmospheric correction and de-noising methods for the CRISM data that use a hyperspectral unmixing to model surface spectra, are introduced. The new methods remove most of the problematic systematic artifacts present in CRISM images and significantly improve signal quality. Chapter 4 investigates how hyperspectral images acquired from orbits can be combined with ground exploration. In the recent rush of the launch of many Martian ground rover missions, it is important to effectively integrate knowledge obtained by hyperspectral remote sensing from orbits into ground exploration for facilitating Martian exploration. In specific, this dissertation solves the problem of matching hyperspectral image pixels obtained by the CRISM with ground mega-pixel images acquired by the Mast Camera (Mastcam) installed on the Curiosity rover on Mars. A new systematic methodology to map the CRISM and Mastcam images onto high resolution surface topography is developed

Automated identification and mapping of interesting mineral spectra in CRISM images

The Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) has proven to be an invaluable tool for the mineralogical analysis of the Martian surface. It has been crucial in identifying and mapping the spatial extents of various minerals. Primarily, the identification and mapping of these mineral spectral-shapes have been performed manually. Given the size of the CRISM image dataset, manual analysis of the full dataset would be arduous/infeasible. This dissertation attempts to address this issue by describing an (machine learning based) automated processing pipeline for CRISM data that can be used to identify and map the unique mineral signatures present in a CRISM image. The pipeline leverages a highly discriminative representation learned through the use of Generative Adversarial Networks, such that in this novel representation space simple distance metrics are sufficient to discriminate between even very similar spectral shapes. The pipeline leverages this enhanced feature space to set up an open set classification problem that labels each new pixel as either a member of a known mineral class or novel spectral shape (or outliers). Following this, a segmentation technique is used on the outliers to group them, and further, reduce them to a representative set of the novel spectral shapes present in the image. These novel spectral shapes can then be labeled based on expert analysis and used to update the open-set classifier. The performance of these tools are validated over a subset of CRISM images from different parts of the Martian surface such as Jezero Crater, North East Syrtis, and Mawrth Vallis

Visible and Near Infrared imaging spectroscopy and the exploration of small scale hydrothermally altered and hydrated environments on Earth and Mars

The use of Visible and Near Infrared (VNIR) imaging spectroscopy is a cornerstone of planetary exploration. This work shall present an investigation into the limitations of scale, both spectral and spatial, in the utility of VNIR images for identifying small scale hydrothermal and potential hydrated environments on Mars, and regions of the Earth that can serve as martian analogues. Such settings represent possible habitable environments; important locations for astrobiological research. The ESA/Roscosmos ExoMars rover PanCam captures spectrally coarse but spatially high resolution VNIR images. This instrument is still in development and the first field trial of an emulator fitted with the final set of geological filters is presented here. Efficient image analysis techniques are explored and the ability to accurately characterise a hydrothermally altered region using PanCam data products is established. The CRISM orbital instrument has been returning hyperspectral VNIR images with an 18 m2 pixel resolution since 2006. The extraction of sub-pixel information from CRISM pixels using Spectral Mixture Analysis (SMA) algorithms is explored. Using synthetic datasets a full SMA pipeline consisting of publically available Matlab algorithms and optimised for investigation of mineralogically complex hydrothermal suites is developed for the first time. This is validated using data from Námafjall in Iceland, the region used to field trial the PanCam prototype. The pipeline is applied to CRISM images covering four regions on Mars identified as having potentially undergone hydrothermal alteration in their past. A second novel use of SMA to extract a unique spectral signature for the potentially hydrated Recurring Slope Lineae features on Mars is presented. The specific methodology presented shows promise and future improvements are suggested. The importance of combining different scales of data and recognising their limitations is discussed based on the results presented and ways in which to take the results presented in this thesis forward are given

Visible and Near Infrared imaging spectroscopy and the exploration of small scale hydrothermally altered and hydrated environments on Earth and Mars

The use of Visible and Near Infrared (VNIR) imaging spectroscopy is a cornerstone of planetary exploration. This work shall present an investigation into the limitations of scale, both spectral and spatial, in the utility of VNIR images for identifying small scale hydrothermal and potential hydrated environments on Mars, and regions of the Earth that can serve as martian analogues. Such settings represent possible habitable environments; important locations for astrobiological research. The ESA/Roscosmos ExoMars rover PanCam captures spectrally coarse but spatially high resolution VNIR images. This instrument is still in development and the first field trial of an emulator fitted with the final set of geological filters is presented here. Efficient image analysis techniques are explored and the ability to accurately characterise a hydrothermally altered region using PanCam data products is established. The CRISM orbital instrument has been returning hyperspectral VNIR images with an 18 m2 pixel resolution since 2006. The extraction of sub-pixel information from CRISM pixels using Spectral Mixture Analysis (SMA) algorithms is explored. Using synthetic datasets a full SMA pipeline consisting of publically available Matlab algorithms and optimised for investigation of mineralogically complex hydrothermal suites is developed for the first time. This is validated using data from Námafjall in Iceland, the region used to field trial the PanCam prototype. The pipeline is applied to CRISM images covering four regions on Mars identified as having potentially undergone hydrothermal alteration in their past. A second novel use of SMA to extract a unique spectral signature for the potentially hydrated Recurring Slope Lineae features on Mars is presented. The specific methodology presented shows promise and future improvements are suggested. The importance of combining different scales of data and recognising their limitations is discussed based on the results presented and ways in which to take the results presented in this thesis forward are given

Etude morphologique de la formation des ravines sur les dunes martiennes (approche comparative Terre/Mars.)

L histoire géologique récente de Mars reste peu étudiée, comparativement à l histoire primitive de Mars (>3,5 Ga). Cependant, l arrivée de nouvelles images haute résolution a permis d identifier la présence de ravines à la surface de terrains très récents. Dans ce travail, nous nous sommes attaché à caractériser la morphologie des ravines et les processus qui les ont générés. Ces nouvelles observations relancent la question de la présence d eau liquide actuellement à la surface de Mars que ce soit à l état pur ou sous forme de mélange (saumure, coulée de débris...). Des simulations expérimentales en chambre froide à la pression atmosphérique de Mars et de la Terre ont été menées. Elles ont notamment permis de quantifier le rôle de la teneur en eau dans la couche active du pergélisol sur le mécanisme de formation des ravines et leur mobilité. Nous avons également décrit l évolution saisonnière de petits réseaux ramifiés qui se sont développés chaque année au printemps durant la période 2007-2012.The recent geological history of Mars remains poorly studied, in comparison to theearly history of Mars (>3,5 Ga). However, the acquisition of new high-resolution imagesallowed to identified the presence of gullies on the surface of recent landforms such asdunes. In this work, we focused on characterizing the morphology of gullies and theirprocess(es) of formation. These new observations revive the issue of the presence of liquid water present on the surface of Mars than either pure or as a mixture (brine, debris flow ...). Experimental simulations in a cold room at Martian and terrestrial atmospheric pressure have been conducted. In particular, they allowed us to quantify the role of water content in the active layer of the permafrost in order to better constrain the mechanism of formation of gullies and their motion. We also described the seasonal evolution of small branched networks developed at spring during the 2007-2012 period.PARIS11-SCD-Bib. électronique (914719901) / SudocSudocFranceF

Quantitative Hyperspectral Imaging Pipeline to Recover Surface Images from CRISM Radiance Data

Hyperspectral data are important for remote applications such as mineralogy, geology, agriculture and surveillance sensing. A general pipeline converting measured hyperspectral radiance to the surface reflectance image can provide planetary scientists with clean, robust and repeatable products to work on. In this dissertation, the surface single scattering albedos (SSAs), the ratios of scattering eciency to scattering plus absorption eciences of a single particle, are selected to describe the reflectance. Moreover, the IOF, the ratio of measured spectral radiance (in the unit of watts per squared-meter and micrometer) to the solar spectral radiance (in the unit of watts per squared-meter and micrometer) at the observed time, is used to indicate the measurements. This pipeline includes two main parts: retrieving SSAs from IOF and reconstructing the SSA images from the SSA cube. The Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) on the Mars Reconnaissance Orbiter (MRO) helps scientists identify locations on Mars that may have exhibit hydrated mineral phases. This dissertation mainly focuses on developing the pipeline for CRISM data. One should notice that pipelines for other hyperspectral spectrometers can also be developed based on almost the same idea. Retrieving surface kinetic temperatures and SSA values from IOF data is challenging because the problem is under-determined and ill-posed, including modulating effects of atmospheric aerosols and gases, and surface scattering and emission properties. We introduce a general framework called STANN (Separating Temperature and Albedo using Neural Networks) to solve this kind of problem. STANN takes the hyperspectral IOF cube as inputs and outputs the retrieved temperature mapping and the corresponding SSA cube. Our STANN is derived using the Discrete Ordinates Radiative Transfer function to describe the forward model from SSA and temperature to IOF. In the STANN, we have a generator to generate more training samples based on limited library spectra and a neural network to approximate the inverse function based on enough generated training samples. This framework has been implemented for the Compact Imaging Spectrometer for Mars in a detailed manner. SSA can be computed from IOF directly by modeling the thermal and solar reflectance together, based on retrieved temperatures. Because accurate retrieved temperature directly leads to accurate SSA, we compare the accuracy of retrieved temperatures from STANN. The retrieved temperature has only 4 K error by one point validation (242 K) using the Curiosity Rover\u27s thermal radiometer data. Our STANN temperature map is compared with a temperature map generated independently from a theoretical thermal model. The theoretical thermal model describes the relationship between Lambert albedo at the wavelength 1.0 µm, thermal inertia and the surface temperature. However, because the thermal inertia has pixel size larger than 100 m/pixel, the generated temperature also has the same pixel size. Our STANN temperature is projected into the same pixel size (100 m/pixel) by the classic projection method. The two temperature maps have consistent global patterns. Retrieved from an IOF cube, a noisy hyperspectral SSA cube needs to be denoised and reconstructed onto the Mars surface. We propose a new algorithm, hypothesis-based estimation with regularization (HyBER), to reconstruct and denoise hyperspectral image data without extra statistical assumptions. The hypothesis test selects the best statistical model approximating measurements based on the data only. Gaussian and Poisson distributions are common respectively for continuous and integer random variables, due to the law of large numbers. Hyperspectral IOF data result from converting discrete photon counting data to continuous electrical signals after calibration. Thus, so far, Gaussian and Poisson are candidate distributions for our hypothesis tests. A regularized maximum log-likelihood estimation method is derived based on the selected model. A spatially dependent weighting on the regularization penalty is presented, substantially eliminating row artifacts that are due to non-uniform sampling. A new spectral weighting penalty is introduced to suppress varying detector-related noise. HyBER generates reconstructions with sharpened images and spectra in which the noise is suppressed, whereas fine-scale mineral absorptions are preserved. The performance is quantitatively analyzed for simulations with relative error 0.002%, which is better than the traditional non-statistical methods (baselines) and statistical methods with improper assumptions. When applied to the Mars Reconnaissance Orbiter\u27s Compact Reconnaissance Imaging Spectrometer for Mars data, the spatial resolution and contrast are about 2 times better as compared to map projecting data without the use of HyBER. So far, part of our results has enabled planetary scientists to identify minerals and understand the forming history of Mars craters. Some of these findings are verified by the Opportunity Rover\u27s measurements. In the future, results from this pipeline for CRISM are promising to play more and more critical roles in the planetary science

Learning the link between Albedo and reflectance: Machine learning-based prediction of hyperspectral bands from CTX images

The instruments of the Mars Reconnaissance Orbiter (MRO) provide a large quantity and variety of imagining data for investigations of the Martian surface. Among others, the hyper-spectral Compact Reconnaissance Imaging Spectrometer for Mars (CRISM) captures visible to infrared reflectance across several hundred spectral bands. However, Mars is only partially covered with targeted CRISM at full spectral and spatial resolution. In fact, less than one percent of the Martian surface is imaged in this way. In contrast, the Context Camera (CTX) onboard the MRO delivers images with a higher spatial resolution and the image data cover almost the entire Martian surface. In this work, we examine to what extent machine learning systems can learn the relation between morphology, albedo and spectral composition. To this end, a dataset of 67 CRISM-CTX image pairs is created and different deep neural networks are trained for the pixel-wise prediction of CRISM bands solely based on the albedo information of a CTX image. The trained models enable us to estimate spectral bands across large areas without existing CRISM data and to predict the spectral composition of any CTX image. The predictions are qualitatively similar to the ground-truth spectra and are also able to recover finer grained details, such as dunes or small craters

Mineral identification using data-mining in hyperspectral infrared imagery

Les applications de l’imagerie infrarouge dans le domaine de la géologie sont principalement des applications hyperspectrales. Elles permettent entre autre l’identification minérale, la cartographie, ainsi que l’estimation de la portée. Le plus souvent, ces acquisitions sont réalisées in-situ soit à l’aide de capteurs aéroportés, soit à l’aide de dispositifs portatifs. La découverte de minéraux indicateurs a permis d’améliorer grandement l’exploration minérale. Ceci est en partie dû à l’utilisation d’instruments portatifs. Dans ce contexte le développement de systèmes automatisés permettrait d’augmenter à la fois la qualité de l’exploration et la précision de la détection des indicateurs. C’est dans ce cadre que s’inscrit le travail mené dans ce doctorat. Le sujet consistait en l’utilisation de méthodes d’apprentissage automatique appliquées à l’analyse (au traitement) d’images hyperspectrales prises dans les longueurs d’onde infrarouge. L’objectif recherché étant l’identification de grains minéraux de petites tailles utilisés comme indicateurs minéral -ogiques. Une application potentielle de cette recherche serait le développement d’un outil logiciel d’assistance pour l’analyse des échantillons lors de l’exploration minérale. Les expériences ont été menées en laboratoire dans la gamme relative à l’infrarouge thermique (Long Wave InfraRed, LWIR) de 7.7m à 11.8 m. Ces essais ont permis de proposer une méthode pour calculer l’annulation du continuum. La méthode utilisée lors de ces essais utilise la factorisation matricielle non négative (NMF). En utlisant une factorisation du premier ordre on peut déduire le rayonnement de pénétration, lequel peut ensuite être comparé et analysé par rapport à d’autres méthodes plus communes. L’analyse des résultats spectraux en comparaison avec plusieurs bibliothèques existantes de données a permis de mettre en évidence la suppression du continuum. Les expérience ayant menés à ce résultat ont été conduites en utilisant une plaque Infragold ainsi qu’un objectif macro LWIR. L’identification automatique de grains de différents matériaux tels que la pyrope, l’olivine et le quartz a commencé. Lors d’une phase de comparaison entre des approches supervisées et non supervisées, cette dernière s’est montrée plus approprié en raison du comportement indépendant par rapport à l’étape d’entraînement. Afin de confirmer la qualité de ces résultats quatre expériences ont été menées. Lors d’une première expérience deux algorithmes ont été évalués pour application de regroupements en utilisant l’approche FCC (False Colour Composite). Cet essai a permis d’observer une vitesse de convergence, jusqu’a vingt fois plus rapide, ainsi qu’une efficacité significativement accrue concernant l’identification en comparaison des résultats de la littérature. Cependant des essais effectués sur des données LWIR ont montré un manque de prédiction de la surface du grain lorsque les grains étaient irréguliers avec présence d’agrégats minéraux. La seconde expérience a consisté, en une analyse quantitaive comparative entre deux bases de données de Ground Truth (GT), nommée rigid-GT et observed-GT (rigide-GT: étiquet manuel de la région, observée-GT:étiquetage manuel les pixels). La précision des résultats était 1.5 fois meilleur lorsque l’on a utlisé la base de données observed-GT que rigid-GT. Pour les deux dernières epxérience, des données venant d’un MEB (Microscope Électronique à Balayage) ainsi que d’un microscopie à fluorescence (XRF) ont été ajoutées. Ces données ont permis d’introduire des informations relatives tant aux agrégats minéraux qu’à la surface des grains. Les résultats ont été comparés par des techniques d’identification automatique des minéraux, utilisant ArcGIS. Cette dernière a montré une performance prometteuse quand à l’identification automatique et à aussi été utilisée pour la GT de validation. Dans l’ensemble, les quatre méthodes de cette thèse représentent des méthodologies bénéfiques pour l’identification des minéraux. Ces méthodes présentent l’avantage d’être non-destructives, relativement précises et d’avoir un faible coût en temps calcul ce qui pourrait les qualifier pour être utilisée dans des conditions de laboratoire ou sur le terrain.The geological applications of hyperspectral infrared imagery mainly consist in mineral identification, mapping, airborne or portable instruments, and core logging. Finding the mineral indicators offer considerable benefits in terms of mineralogy and mineral exploration which usually involves application of portable instrument and core logging. Moreover, faster and more mechanized systems development increases the precision of identifying mineral indicators and avoid any possible mis-classification. Therefore, the objective of this thesis was to create a tool to using hyperspectral infrared imagery and process the data through image analysis and machine learning methods to identify small size mineral grains used as mineral indicators. This system would be applied for different circumstances to provide an assistant for geological analysis and mineralogy exploration. The experiments were conducted in laboratory conditions in the long-wave infrared (7.7μm to 11.8μm - LWIR), with a LWIR-macro lens (to improve spatial resolution), an Infragold plate, and a heating source. The process began with a method to calculate the continuum removal. The approach is the application of Non-negative Matrix Factorization (NMF) to extract Rank-1 NMF and estimate the down-welling radiance and then compare it with other conventional methods. The results indicate successful suppression of the continuum from the spectra and enable the spectra to be compared with spectral libraries. Afterwards, to have an automated system, supervised and unsupervised approaches have been tested for identification of pyrope, olivine and quartz grains. The results indicated that the unsupervised approach was more suitable due to independent behavior against training stage. Once these results obtained, two algorithms were tested to create False Color Composites (FCC) applying a clustering approach. The results of this comparison indicate significant computational efficiency (more than 20 times faster) and promising performance for mineral identification. Finally, the reliability of the automated LWIR hyperspectral infrared mineral identification has been tested and the difficulty for identification of the irregular grain’s surface along with the mineral aggregates has been verified. The results were compared to two different Ground Truth(GT) (i.e. rigid-GT and observed-GT) for quantitative calculation. Observed-GT increased the accuracy up to 1.5 times than rigid-GT. The samples were also examined by Micro X-ray Fluorescence (XRF) and Scanning Electron Microscope (SEM) in order to retrieve information for the mineral aggregates and the grain’s surface (biotite, epidote, goethite, diopside, smithsonite, tourmaline, kyanite, scheelite, pyrope, olivine, and quartz). The results of XRF imagery compared with automatic mineral identification techniques, using ArcGIS, and represented a promising performance for automatic identification and have been used for GT validation. In overall, the four methods (i.e. 1.Continuum removal methods; 2. Classification or clustering methods for mineral identification; 3. Two algorithms for clustering of mineral spectra; 4. Reliability verification) in this thesis represent beneficial methodologies to identify minerals. These methods have the advantages to be a non-destructive, relatively accurate and have low computational complexity that might be used to identify and assess mineral grains in the laboratory conditions or in the field