Analysis of Polarimetric Synthetic Aperture Radar and Passive Visible Light Polarimetric Imaging Data Fusion for Remote Sensing Applications

The recent launch of spaceborne (TerraSAR-X, RADARSAT-2, ALOS-PALSAR, RISAT) and airborne (SIRC, AIRSAR, UAVSAR, PISAR) polarimetric radar sensors, with capability of imaging through day and night in almost all weather conditions, has made polarimetric synthetic aperture radar (PolSAR) image interpretation and analysis an active area of research. PolSAR image classification is sensitive to object orientation and scattering properties. In recent years, significant work has been done in many areas including agriculture, forestry, oceanography, geology, terrain analysis. Visible light passive polarimetric imaging has also emerged as a powerful tool in remote sensing for enhanced information extraction. The intensity image provides information on materials in the scene while polarization measurements capture surface features, roughness, and shading, often uncorrelated with the intensity image. Advantages of visible light polarimetric imaging include high dynamic range of polarimetric signatures and being comparatively straightforward to build and calibrate. This research is about characterization and analysis of the basic scattering mechanisms for information fusion between PolSAR and passive visible light polarimetric imaging. Relationships between these two modes of imaging are established using laboratory measurements and image simulations using the Digital Image and Remote Sensing Image Generation (DIRSIG) tool. A novel low cost laboratory based S-band (2.4GHz) PolSAR instrument is developed that is capable of capturing 4 channel fully polarimetric SAR image data. Simple radar targets are formed and system calibration is performed in terms of radar cross-section. Experimental measurements are done using combination of the PolSAR instrument with visible light polarimetric imager for scenes capturing basic scattering mechanisms for phenomenology studies. The three major scattering mechanisms studied in this research include single, double and multiple bounce. Single bounce occurs from flat surfaces like lakes, rivers, bare soil, and oceans. Double bounce can be observed from two adjacent surfaces where one horizontal flat surface is near a vertical surface such as buildings and other vertical structures. Randomly oriented scatters in homogeneous media produce a multiple bounce scattering effect which occurs in forest canopies and vegetated areas. Relationships between Pauli color components from PolSAR and Degree of Linear Polarization (DOLP) from passive visible light polarimetric imaging are established using real measurements. Results show higher values of the red channel in Pauli color image (|HH-VV|) correspond to high DOLP from double bounce effect. A novel information fusion technique is applied to combine information from the two modes. In this research, it is demonstrated that the Degree of Linear Polarization (DOLP) from passive visible light polarimetric imaging can be used for separation of the classes in terms of scattering mechanisms from the PolSAR data. The separation of these three classes in terms of the scattering mechanisms has its application in the area of land cover classification and anomaly detection. The fusion of information from these particular two modes of imaging, i.e. PolSAR and passive visible light polarimetric imaging, is a largely unexplored area in remote sensing and the main challenge in this research is to identify areas and scenarios where information fusion between the two modes is advantageous for separation of the classes in terms of scattering mechanisms relative to separation achieved with only PolSAR

Crop development monitoring from Synthetic Aperture Radar (SAR) imagery

Satellite remote sensing plays a vital role in providing large-scale and timely data to stakeholders of the agricultural supply chain. This allows for informed decision-making that promotes sustainable and cost-effective crop management practices. In particular, data derived from satellite-based Synthetic Aperture Radar (SAR) systems, provide opportunities for continuous crop monitoring, taking advantage of its ability to acquire images during day or night and under almost all weather conditions. Moreover, an abundance of SAR data can be anticipated in the next 5 years with the launch of several international SAR missions. However, research on crop development monitoring with data from SAR satellites has not been as widely studied as with data derived from passive multi-spectral satellites and contributions can be made to the current state-of-the-art techniques. This thesis aims at improving the current knowledge on the use of satellite-based SAR imagery for crop development monitoring. This is approached by developing novel methodologies and detailed interpretations of multitemporal SAR and Polarimetric SAR (PolSAR) responses to crop growth in three different test sites. Chapter two presents a detailed analysis of the Sentinel-1 SAR satellite response to asparagus crop development in Peru, investigating the capabilities of the sensor to capture seasonality effects as well as providing an interpretation of the temporal backscatter signature. This is complemented with a case study where a multiple-output random forest regression algorithm is used to successfully retrieve crop growth stage from Sentinel-1 data and temperature measurements. Following the limitations identified with this approach, a methodology that builds upon ideas of Bayesian Filtering Frameworks (BFFs) for crop monitoring is proposed in chapter three. It incorporates Gaussian processes to model crop dynamics as well as to model the remote sensing response to the crop state. Using this approach, it is possible to derive daily predictions with the associated uncertainties, to combine in near-real-time data from active and passive satellites as well as to estimate past and future crop key events that are of strategic importance for different stakeholders. The final section of this thesis looks at the new developments of the SAR technology considering that future open access missions will provide Quad Polarimetric SAR data. An algorithm based on multitemporal PolSAR change detection is introduced in chapter four. It defines a Change Matrix to encode an interpretable representation of the crop dynamics as captured by the evolution of the scattering mechanisms over time. We use rice fields in Spain and multiple cereal crops in Canada to test the use of the algorithm for crop monitoring. A supervised learning-based crop type classification methodology is then proposed with the same method by using the encoded scattering mechanisms as input for a neural-network-based classifier, achieving comparable performances to state-of-the-art classifiers. The results obtained in this thesis represent novel additions to the literature that contribute to our understanding and successful use of SAR imagery for agricultural monitoring. For the first time, a detailed analysis of asparagus crops is presented. It is a key crop for agricultural exports of Peru, the largest exporter of asparagus in the world. Secondly, two key contributions to the state of the art BFFs for crop monitoring are presented: a) A better exploitation of the SAR temporal dimension and an application with freely available data and b) given that it is a learning-based approach, it overcomes current limitations of transferability among crop types and regions. Finally, the PolSAR change detection approach presented in the last thesis chapter, provides a novel and easy-to-interpret tool for both crop monitoring and crop type mapping applications

Monitoring Snow Cover and Snowmelt Dynamics and Assessing their Influences on Inland Water Resources

Snow is one of the most vital cryospheric components owing to its wide coverage as well as its unique physical characteristics. It not only affects the balance of numerous natural systems but also influences various socio-economic activities of human beings. Notably, the importance of snowmelt water to global water resources is outstanding, as millions of populations rely on snowmelt water for daily consumption and agricultural use. Nevertheless, due to the unprecedented temperature rise resulting from the deterioration of climate change, global snow cover extent (SCE) has been shrinking significantly, which endangers the sustainability and availability of inland water resources. Therefore, in order to understand cryo-hydrosphere interactions under a warming climate, (1) monitoring SCE dynamics and snowmelt conditions, (2) tracking the dynamics of snowmelt-influenced waterbodies, and (3) assessing the causal effect of snowmelt conditions on inland water resources are indispensable. However, for each point, there exist many research questions that need to be answered. Consequently, in this thesis, five objectives are proposed accordingly. Objective 1: Reviewing the characteristics of SAR and its interactions with snow, and exploring the trends, difficulties, and opportunities of existing SAR-based SCE mapping studies; Objective 2: Proposing a novel total and wet SCE mapping strategy based on freely accessible SAR imagery with all land cover classes applicability and global transferability; Objective 3: Enhancing total SCE mapping accuracy by fusing SAR- and multi-spectral sensor-based information, and providing total SCE mapping reliability map information; Objective 4: Proposing a cloud-free and illumination-independent inland waterbody dynamics tracking strategy using freely accessible datasets and services; Objective 5: Assessing the influence of snowmelt conditions on inland water resources

Polarimetric Synthetic Aperture Radar

This open access book focuses on the practical application of electromagnetic polarimetry principles in Earth remote sensing with an educational purpose. In the last decade, the operations from fully polarimetric synthetic aperture radar such as the Japanese ALOS/PalSAR, the Canadian Radarsat-2 and the German TerraSAR-X and their easy data access for scientific use have developed further the research and data applications at L,C and X band. As a consequence, the wider distribution of polarimetric data sets across the remote sensing community boosted activity and development in polarimetric SAR applications, also in view of future missions. Numerous experiments with real data from spaceborne platforms are shown, with the aim of giving an up-to-date and complete treatment of the unique benefits of fully polarimetric synthetic aperture radar data in five different domains: forest, agriculture, cryosphere, urban and oceans

Wetland mapping and monitoring using polarimetric and interferometric synthetic aperture radar (SAR) data and tools

Wetlands are home to a great variety of flora and fauna species and provide several unique environmental functions, such as controlling floods, improving water-quality, supporting wildlife habitat, and shoreline stabilization. Detailed information on spatial distribution of wetland classes is crucial for sustainable management and resource assessment. Furthermore, hydrological monitoring of wetlands is also important for maintaining and preserving the habitat of various plant and animal species. This thesis investigates the existing knowledge and technological challenges associated with wetland mapping and monitoring and evaluates the limitations of the methodologies that have been developed to date. The study also proposes new methods to improve the characterization of these productive ecosystems using advanced remote sensing (RS) tools and data. Specifically, a comprehensive literature review on wetland monitoring using Synthetic Aperture Radar (SAR) and Interferometric SAR (InSAR) techniques is provided. The application of the InSAR technique for wetland mapping provides the following advantages: (i) the high sensitivity of interferometric coherence to land cover changes is taken into account and (ii) the exploitation of interferometric coherence for wetland classification further enhances the discrimination between similar wetland classes. A statistical analysis of the interferometric coherence and SAR backscattering variation of Canadian wetlands, which are ignored in the literature, is carried out using multi-temporal, multi-frequency, and multi-polarization SAR data. The study also examines the capability of compact polarimetry (CP) SAR data, which will be collected by the upcoming RADARSAT Constellation Mission (RCM) and will constitute the main source of SAR observation in Canada, for wetland mapping. The research in this dissertation proposes a methodology for wetland classification using the synergistic use of intensity, polarimetry, and interferometry features using a novel classification framework. Finally, this work introduces a novel model based on the deep convolutional neural network (CNN) for wetland classification that can be trained in an end-to-end scheme and is specifically designed for the classification of wetland complexes using polarimetric SAR (PolSAR) imagery. The results of the proposed methods are promising and will significantly contribute to the ongoing efforts of conservation strategies for wetlands and monitoring changes. The approaches presented in this thesis serve as frameworks, progressing towards an operational methodology for mapping wetland complexes in Canada, as well as other wetlands worldwide with similar ecological characteristics

Study of the speckle noise effects over the eigen decomposition of polarimetric SAR data: a review

This paper is focused on considering the effects of speckle noise on the eigen decomposition of the co- herency matrix. Based on a perturbation analysis of the matrix, it is possible to obtain an analytical expression for the mean value of the eigenvalues and the eigenvectors, as well as for the Entropy, the Anisotroopy and the dif- ferent a angles. The analytical expressions are compared against simulated polarimetric SAR data, demonstrating the correctness of the different expressions.Peer ReviewedPostprint (published version

Advanced techniques for classification of polarimetric synthetic aperture radar data

With various remote sensing technologies to aid Earth Observation, radar-based imaging is one of them gaining major interests due to advances in its imaging techniques in form of syn-thetic aperture radar (SAR) and polarimetry. The majority of radar applications focus on mon-itoring, detecting, and classifying local or global areas of interests to support humans within their efforts of decision-making, analysis, and interpretation of Earth’s environment. This thesis focuses on improving the classification performance and process particularly concerning the application of land use and land cover over polarimetric SAR (PolSAR) data. To achieve this, three contributions are studied related to superior feature description and ad-vanced machine-learning techniques including classifiers, principles, and data exploitation. First, this thesis investigates the application of color features within PolSAR image classi-fication to provide additional discrimination on top of the conventional scattering information and texture features. The color features are extracted over the visual presentation of fully and partially polarimetric SAR data by generation of pseudo color images. Within the experiments, the obtained results demonstrated that with the addition of the considered color features, the achieved classification performances outperformed results with common PolSAR features alone as well as achieved higher classification accuracies compared to the traditional combination of PolSAR and texture features. Second, to address the large-scale learning challenge in PolSAR image classification with the utmost efficiency, this thesis introduces the application of an adaptive and data-driven supervised classification topology called Collective Network of Binary Classifiers, CNBC. This topology incorporates active learning to support human users with the analysis and interpretation of PolSAR data focusing on collections of images, where changes or updates to the existing classifier might be required frequently due to surface, terrain, and object changes as well as certain variations in capturing time and position. Evaluations demonstrated the capabilities of CNBC over an extensive set of experimental results regarding the adaptation and data-driven classification of single as well as collections of PolSAR images. The experimental results verified that the evolutionary classification topology, CNBC, did provide an efficient solution for the problems of scalability and dynamic adaptability allowing both feature space dimensions and the number of terrain classes in PolSAR image collections to vary dynamically. Third, most PolSAR classification problems are undertaken by supervised machine learn-ing, which require manually labeled ground truth data available. To reduce the manual labeling efforts, supervised and unsupervised learning approaches are combined into semi-supervised learning to utilize the huge amount of unlabeled data. The application of semi-supervised learning in this thesis is motivated by ill-posed classification tasks related to the small training size problem. Therefore, this thesis investigates how much ground truth is actually necessary for certain classification problems to achieve satisfactory results in a supervised and semi-supervised learning scenario. To address this, two semi-supervised approaches are proposed by unsupervised extension of the training data and ensemble-based self-training. The evaluations showed that significant speed-ups and improvements in classification performance are achieved. In particular, for a remote sensing application such as PolSAR image classification, it is advantageous to exploit the location-based information from the labeled training data. Each of the developed techniques provides its stand-alone contribution from different viewpoints to improve land use and land cover classification. The introduction of a new fea-ture for better discrimination is independent of the underlying classification algorithms used. The application of the CNBC topology is applicable to various classification problems no matter how the underlying data have been acquired, for example in case of remote sensing data. Moreover, the semi-supervised learning approach tackles the challenge of utilizing the unlabeled data. By combining these techniques for superior feature description and advanced machine-learning techniques exploiting classifier topologies and data, further contributions to polarimetric SAR image classification are made. According to the performance evaluations conducted including visual and numerical assessments, the proposed and investigated tech-niques showed valuable improvements and are able to aid the analysis and interpretation of PolSAR image data. Due to the generic nature of the developed techniques, their applications to other remote sensing data will require only minor adjustments

Status and trends of wetland studies in Canada using remote sensing technology with a focus on wetland classification: a bibliographic analysis

A large portion of Canada is covered by wetlands; mapping and monitoring them is of great importance for various applications. In this regard, Remote Sensing (RS) technology has been widely employed for wetland studies in Canada over the past 45 years. This study evaluates meta-data to investigate the status and trends of wetland studies in Canada using RS technology by reviewing the scientific papers published between 1976 and the end of 2020 (300 papers in total). Initially, a meta-analysis was conducted to analyze the status of RS-based wetland studies in terms of the wetland classification systems, methods, classes, RS data usage, publication details (e.g., authors, keywords, citations, and publications time), geographic information, and level of classification accuracies. The deep systematic review of 128 peer-reviewed articles illustrated the rising trend in using multi-source RS datasets along with advanced machine learning algorithms for wetland mapping in Canada. It was also observed that most of the studies were implemented over the province of Ontario. Pixel-based supervised classifiers were the most popular wetland classification algorithms. This review summarizes different RS systems and methodologies for wetland mapping in Canada to outline how RS has been utilized for the generation of wetland inventories. The results of this review paper provide the current state-of-the-art methods and datasets for wetland studies in Canada and will provide direction for future wetland mapping research.Peer ReviewedPostprint (published version