Hybrid spectral unmixing : using artificial neural networks for linear/non-linear switching

Spectral unmixing is a key process in identifying spectral signature of materials and quantifying their spatial distribution over an image. The linear model is expected to provide acceptable results when two assumptions are satisfied: (1) The mixing process should occur at macroscopic level and (2) Photons must interact with single material before reaching the sensor. However, these assumptions do not always hold and more complex nonlinear models are required. This study proposes a new hybrid method for switching between linear and nonlinear spectral unmixing of hyperspectral data based on artificial neural networks. The neural networks was trained with parameters within a window of the pixel under consideration. These parameters are computed to represent the diversity of the neighboring pixels and are based on the Spectral Angular Distance, Covariance and a non linearity parameter. The endmembers were extracted using Vertex Component Analysis while the abundances were estimated using the method identified by the neural networks (Vertex Component Analysis, Fully Constraint Least Square Method, Polynomial Post Nonlinear Mixing Model or Generalized Bilinear Model). Results show that the hybrid method performs better than each of the individual techniques with high overall accuracy, while the abundance estimation error is significantly lower than that obtained using the individual methods. Experiments on both synthetic dataset and real hyperspectral images demonstrated that the proposed hybrid switch method is efficient for solving spectral unmixing of hyperspectral images as compared to individual algorithms

An evaluation of Multiple Endmember Spectral Mixture Analysis applied to Landsat 8 OLI images for mapping land cover in southern Africa\u27s Savanna.

Mapping land cover in southern Africa’s savannas using traditional pixel based remote sensing techniques can be very challenging due to the heterogeneity of its vegetation structure and the spectral difficulty in separating similar land covers across various land uses. In order to overcome these complications, a Multiple Endmember Spectral Mixture Analysis (MESMA) provides a potential remote sensing approach to quantify spectral variation in the physical environment at a subpixel level. The MESMA approach was applied in the study area of the Mayuni Conservancy, in Namibia. Results show that 32.3% of the study area is covered by photosynthetic vegetation (PV), 32.0% by non-photosynthetic vegetation (NPV), 25.2% by bare soil (B) and 10.6% by shade. Post-classification validation shows that MESMA presented a moderate performance in estimating the proportions of land cover types in the study area. However the validation process is limited to the available resources and carries great subjectivity. It is concluded that future research on the matter should include a more consistent investigation on the endmember selection methodology and expand the study area inside of the same ecosystem

Hydrocarbon quantification using neural networks and deep learning based hyperspectral unmixing

Hydrocarbon (HC) spills are a global issue, which can seriously impact human life and the environment, therefore early identification and remedial measures taken at an early stage are important. Thus, current research efforts aim at remotely quantifying incipient quantities of HC mixed with soils. The increased spectral and spatial resolution of hyperspectral sensors has opened ground-breaking perspectives in many industries including remote inspection of large areas and the environment. The use of subpixel detection algorithms, and in particular the use of the mixture models, has been identified as a future advance that needs to be incorporated in remote sensing. However, there are some challenging tasks since the spectral signatures of the targets of interest may not be immediately available. Moreover, real time processing and analysis is required to support fast decision-making. Progressing in this direction, this thesis pioneers and researches novel methodologies for HC quantification capable of exceeding the limitations of existing systems in terms of reduced cost and processing time with improved accuracy. Therefore the goal of this research is to develop, implement and test different methods for improving HC detection and quantification using spectral unmixing and machine learning. An efficient hybrid switch method employing neural networks and hyperspectral is proposed and investigated. This robust method switches between state of the art hyperspectral unmixing linear and nonlinear models, respectively. This procedure is well suited for the quantification of small quantities of substances within a pixel with high accuracy as the most appropriate model is employed. Central to the proposed approach is a novel method for extracting parameters to characterise the non-linearity of the data. These parameters are fed into a feedforward neural network which decides in a pixel by pixel fashion which model is more suitable. The quantification process is fully automated by applying further classification techniques to the acquired hyperspectral images. A deep learning neural network model is designed for the quantification of HC quantities mixed with soils. A three-term backpropagation algorithm with dropout is proposed to avoid overfitting and reduce the computational complexity of the model. The above methods have been evaluated using classical repository datasets from the literature and a laboratory controlled dataset. For that, an experimental procedure has been designed to produce a labelled dataset. The data was obtained by mixing and homogenizing different soil types with HC substances, respectively and measuring the reflectance with a hyperspectral sensor. Findings from the research study reveal that the two proposed models have high performance, they are suitable for the detection and quantification of HC mixed with soils, and surpass existing methods. Improvements in sensitivity, accuracy, computational time are achieved. Thus, the proposed approaches can be used to detect HC spills at an early stage in order to mitigate significant pollution from the spill areas

Chapter Earth Observation for Urban Climate Monitoring: Surface Cover and Land Surface Temperature

The rate at which global climate change is happening is arguably the most pressing environmental challenge of the century, and it affects our cities. Climate change exerts added stress on urban areas through increased numbers of heat waves threatening people’s well-being and, in many cases, human lives. Earth observation (EO) systems and the advances in remote sensing technology increase the opportunities for monitoring the thermal behavior of cities. The Sentinels constitute the first series of operational satellites for Copernicus, a program launched to provide data, information, services, and knowledge in support of Europe’s goals regarding sustainable development and global governance of the environment. This chapter examines the exploitation of EO data for monitoring the urban climate, with particular focus on the urban surface cover and temperature. Two example applications are analyzed: the mapping of the urban surface and its characteristics, using EO data and the estimation of urban temperatures. Approaches, like the ones described in this chapter, can become operational once adapted to Sentinels, since their long-term operation plan guarantees the future supply of satellite observations. Thus, the described methods may support planning activities related to climate change mitigation and adaptation in cities, as well as routine urban planning activities

Mapping urban surface materials using imaging spectroscopy data

Die Kartierung der städtische Oberflächenmaterialien ist aufgrund der komplexen räumlichen Muster eine Herausforderung. Daten von bildgebenden Spektrometern können hierbei durch die feine und kontinuierliche Abtastung des elektromagnetischen Spektrums detaillierte spektrale Merkmale von Oberflächenmaterialien erkennen, was mit multispektralen oder RGB-Bildern nicht mit der gleichen Genauigkeit erreicht werden kann. Bislang wurden in zahlreichen Studien zur Kartierung von städtischen Oberflächenmaterialien Daten von flugzeuggestützten abbildenden Spektrometern mit hoher räumlicher Auflösung verwendet, die ihr Potenzial unter Beweis stellen und gute Ergebnisse liefern. Im Vergleich zu diesen Sensoren haben weltraumgestützte abbildende Spektrometer eine regionale oder globale Abdeckung, eine hohe Wiederholbarkeit und vermeiden teure, zeit- und arbeitsaufwändige Flugkampagnen. Allerdings liegt die räumliche Auflösung der aktuellen weltraumgestützten abbildenden Spektroskopiedaten bei etwa 30 m, was zu einem Mischpixelproblem führt, welches mit herkömmlichen Kartierungsansätzen nur schwer zu bewältigen ist. Das Hauptziel dieser Studie ist die Kartierung städtischer Materialien mit bildgebenden Spektroskopiedaten in verschiedenen Maßstäben und die gleichzeitige Nutzung des Informationsgehalts dieser Daten, um die chemischen und physikalischen Eigenschaften von Oberflächenmaterialien zu erfassen sowie das Mischpixelproblem zu berücksichtigen. Konkret zielt diese Arbeit darauf ab, (1) photovoltaische Solarmodule mit Hilfe von luftgestützten bildgebenden Spektroskopiedaten auf der Grundlage ihrer spektralen Merkmale zu kartieren; (2) die Robustheit der Stichprobe von städtischen Materialgradienten zu untersuchen; (3) die Übertragbarkeit von städtischen Materialgradienten auf andere Gebiete zu analysieren.Mapping urban surface materials is challenging due to the complex spatial patterns. Data from imaging spectrometers can identify detailed spectral features of surface materials through the fine and continuous sampling of the electromagnetic spectrum, which cannot be achieved with the same accuracy using multispectral or RGB images. To date, numerous studies in urban surface material mapping have been using data from airborne imaging spectrometers with high spatial resolution, demonstrating the potential and providing good results. Compared to these sensors, spaceborne imaging spectrometers have regional or global coverage, high repeatability, and avoid expensive, time-consuming, and labor-intensive flight campaigns. However, the spatial resolution of current spaceborne imaging spectroscopy data (also known as hyperspectral data) is about 30 m, resulting in a mixed pixel problem that is challenging to handle with conventional mapping approaches. The main objective of this study is to perform urban surface material mapping with imaging spectroscopy data at different spatial scales, simultaneously explore the information content of these data to detect the chemical and physical properties of surface materials, and take the mixed-pixel problem into account. Specifically, this thesis aims to (1) map solar photovoltaic modules using airborne imaging spectroscopy data based on their spectral features; (2) investigate the sampling robustness of urban material gradients; (3) analyze the area transferability of urban material gradients

Multiscale Imaging of Evapotranspiration

Evapotranspiration (ET; evaporation + transpiration) is central to a wide range of biological, chemical, and physical processes in the Earth system. Accurate remote sensing of ET is challenging due to the interrelated and generally scale dependent nature of the physical factors which contribute to the process. The evaporation of water from porous media like sands and soils is an important subset of the complete ET problem. Chapter 1 presents a laboratory investigation into this question, examining the effects of grain size and composition on the evolution of drying sands. The effects of composition are found to be 2-5x greater than the effects of grain size, indicating that differences in heating caused by differences in reflectance may dominate hydrologic differences caused by grain size variation. In order to relate the results of Chapter 1 to the satellite image archive, however, the question of information loss between hyperspectral (measurements at 100s of wavelength intervals) laboratory measurements and multispectral (≤ 12 wavelength intervals) satellite images must be addressed. Chapter 2 focuses on this question as applied to substrate materials such as sediment, soil, rock, and non-photosynthetic vegetation. The results indicate that the continuum that is resolved by multispectral sensors is sufficient to resolve the gradient between sand-rich and clay-rich soils, and that this gradient is also a dominant feature in hyperspectral mixing spaces where the actual absorptions can be resolved. Multispectral measurements can be converted to biogeophysically relevant quantities using spectral mixture analysis (SMA). However, retrospective multitemporal analysis first requires cross-sensor calibration of the mixture model. Chapter 3 presents this calibration, allowing multispectral image data to be used interchangeably throughout the Landsat 4-8 archive. In addition, a theoretical explanation is advanced for the observed superior scaling properties of SMA-derived fraction images over spectral indices. The physical quantities estimated by the spectral mixture model are then compared to simultaneously imaged surface temperature, as well as to the derived parameters of ET Fraction and Moisture Availability. SMA-derived vegetation abundance is found to produce substantially more informative ET maps, and SMA-derived substrate fraction is found to yield a surprisingly strong linear relationship with surface temperature. These results provide context for agricultural applications. Chapter 5 investigates the question of mapping and monitoring rice agricultural using optical and thermal satellite image time series. Thermal image time series are found to produce more accurate maps of rice presence/absence, but optical image time series are found to produce more accurate maps of rice crop timing. Chapter 6 takes a more global approach, investigating the spatial structure of agricultural networks for a diverse set of landscapes. Surprisingly consistent scaling relations are found. These relations are assessed in the context of a network-based approach to land cover analysis, with potential implications for the scale dependence of ET estimates. In sum, this thesis present a novel approach to improving ET estimation based on a synthesis of complementary laboratory measurements, satellite image analysis, and field observations. Alone, each of these independent sources of information provides novel insights. Viewed together, these insights form the basis of a more accurate and complete geophysical understanding of the ET phenomenon

Mapping urban Surface Materials Using Imaging Spectroscopy Data

Urban environment and its processes directly affect human life. Detailed and up-to-date urban surface material maps are of great importance to modelers studying meteorology, climatology and ecology, as well as to authorities seeking to understand the urban growth dynamics and spatial evolution. However, mapping urban surface materials is challenging due to the complex spatial patterns. An established source of up-to-date information is remote sensing, as demonstrated by the widespread usage of SAR, LiDAR and optical data. Data from imaging spectrometers can identify detailed spectral features of surface materials through the fine and continuous sampling of the electromagnetic spectrum, which cannot be achieved with the same accuracy using multispectral or RGB images. To date, numerous studies in urban surface material mapping have been using data from airborne imaging spectrometers with high spatial resolution, demonstrating the potential and providing good results. Compared to these sensors, spaceborne imaging spectrometers have regional or global coverage, high repeatability, and avoid expensive, time-consuming, and labor-intensive flight campaigns. However, the spatial resolution of current spaceborne imaging spectroscopy data (also known as hyperspectral data) is about 30 m, resulting in a mixed pixel problem that is challenging to handle with conventional mapping approaches. The main objective of this study is to perform urban surface material mapping with imaging spectroscopy data at different spatial scales, simultaneously explore the information content of these data to detect the chemical and physical properties of surface materials, and take the mixed-pixel problem into account. Specifically, this thesis aims to (1) map solar photovoltaic modules using airborne imaging spectroscopy data based on their spectral features; (2) investigate the sampling robustness of urban material gradients; (3) analyze the area transferability of urban material gradients. To this end, we detected solar photovoltaics with an overall accuracy of about 80% to 90% by creating and combining spectral indices. This dissertation proved that the developed approach is suitable for accurate photovoltaic detection. We also demonstrated that the concept of urban surface material gradients is robust in sampling and transferable between similar urban areas. With these results, urban material gradients can be a generic technique for urban mapping with spaceborne imaging spectroscopy data. The methods developed invi the three parts of this dissertation improve the usefulness of imaging spectroscopy data for urban material detection from a classical method to the new concept of urban gradients, from airborne to spaceborne data, from pure pixel detection to solving the mixed pixel problem. By introducing and enhancing the gradient concept in urban mapping, the mixed pixel problem can be tackled, which is a promising approach for the analysis of imaging spectroscopy data from ongoing and upcoming spaceborne sensors. Overall, this thesis provides promising urban surface material mapping results by proposing a physical feature based approach as well as confirming and laying the foundation of the generic gradient concept in urban material studies. Further work can build on these results and could open a new field for the application of spaceborne imaging spectroscopy data

Tree Cover Variability in the District of Columbia

Urban forests are increasingly a focus of interest as urbanized populations grow and urban areas expand. Urban forests change as trees are planted, grow, die, and are removed. These processes alter a city's tree cover over time, but this inherent dynamism is poorly understood. Better understanding of how tree cover is a variable land cover component will enhance knowledge of the urban environment and provide new perspectives for management of urban resources. In this study, tree cover variability within a major urban center was observed over a 20 year period. Changes in tree cover proportion were measured in the District of Columbia between 1984-2004 utilizing highly calibrated satellite remote sensing data. Testing of alternate methodologies demonstrated that an approach utilizing support vector regression provided most consistent accuracy across land use types. Tree cover maps were validated using aerial photography imagery and data from field surveys. Between 1984-2004, the city-wide tree cover remained between 22.1(+/-2.9)% and 28.8(+/-2.9)% of total land surface area. The District of Columbia did not experience an overall increase or decrease in total tree canopy area. Spatial patterns of tree cover variability were investigated to identify local scale changes in tree cover and connections with urban land use. Within the city, greatest variability was observed in low density residential zones. Tree cover proportion in these zones declined 7.4(+/-5.4)% in the years between 1990-1996 and recovered after 1996. Changes in tree cover were observed with high resolution aerial photography to determine relative contribution from fluctuation in the number of standing trees and changes in crown sizes. Land cover conversion removed dense tree cover from 50.2 hectares of the city's land surface between 1984-2004. The results demonstrate that tree cover variability in the District of Columbia occurred primarily within low population density residential areas. Neighborhoods within these zones were analyzed to identify factors correlated with tree cover. Implications of the results include enhanced understanding of the possible impact of urban forest management, and how a focus on low density residential zones is appropriate in setting goals for expansion of urban tree cover

Finnish Remote Sensing Days 2012 : Book of abstracts

Peer reviewe