Hierarchical Metric Learning for Optical Remote Sensing Scene Categorization

We address the problem of scene classification from optical remote sensing (RS) images based on the paradigm of hierarchical metric learning. Ideally, supervised metric learning strategies learn a projection from a set of training data points so as to minimize intra-class variance while maximizing inter-class separability to the class label space. However, standard metric learning techniques do not incorporate the class interaction information in learning the transformation matrix, which is often considered to be a bottleneck while dealing with fine-grained visual categories. As a remedy, we propose to organize the classes in a hierarchical fashion by exploring their visual similarities and subsequently learn separate distance metric transformations for the classes present at the non-leaf nodes of the tree. We employ an iterative max-margin clustering strategy to obtain the hierarchical organization of the classes. Experiment results obtained on the large-scale NWPU-RESISC45 and the popular UC-Merced datasets demonstrate the efficacy of the proposed hierarchical metric learning based RS scene recognition strategy in comparison to the standard approaches.Comment: Undergoing revision in GRS

Evaluating land use and aboveground biomass dynamics in an oil palm–dominated landscape in Borneo using optical remote sensing

The focus of this study is to assess the efficacy of using optical remote sensing (RS) in evaluating disparities in forest composition and aboveground biomass (AGB). The research was carried out in the East Sabah region, Malaysia, which constitutes a disturbance gradient ranging from pristine old growth forests to forests that have experienced varying levels of disturbances. Additionally, a significant proportion of the area consists of oil palm plantations. In accordance with local laws, riparian forest (RF) zones have been retained within oil palm plantations and other forest types. The RS imagery was used to assess forest stand structure and AGB. Band reflectance, vegetation indicators, and gray-level co-occurrence matrix (GLCM) consistency features were used as predictor variables in regression analysis. Results indicate that the spectral variables were limited in their effectiveness in differentiating between forest types and in calculating biomass. However, GLCM based variables illustrated strong correlations with the forest stand structures as well as with the biomass of the various forest types in the study area. The present study provides new insights into the efficacy of texture examination methods in differentiating between various land-use types (including small, isolated forest zones such as RFs) as well as their AGB stocks

Wetland Mapping in Great Lakes Using Sentinel-1/2 Time-Series Imagery and DEM Data in Google Earth Engine

The Great Lakes (GL) wetlands support a variety of rare and endangered animal and plant species. Thus, wetlands in this region should be mapped and monitored using advanced and reliable techniques. In this study, a wetland map of the GL was produced using Sentinel-1/2 datasets within the Google Earth Engine (GEE) cloud computing platform. To this end, an object-based supervised machine learning (ML) classification workflow is proposed. The proposed method contains two main classification steps. In the first step, several non-wetland classes (e.g., Barren, Cropland, and Open Water), which are more distinguishable using radar and optical Remote Sensing (RS) observations, were identified and masked using a trained Random Forest (RF) model. In the second step, wetland classes, including Fen, Bog, Swamp, and Marsh, along with two non-wetland classes of Forest and Grassland/Shrubland were identified. Using the proposed method, the GL were classified with an overall accuracy of 93.6% and a Kappa coefficient of 0.90. Additionally, the results showed that the proposed method was able to classify the wetland classes with an overall accuracy of 87% and a Kappa coefficient of 0.91. Non-wetland classes were also identified more accurately than wetlands (overall accuracy = 96.62% and Kappa coefficient = 0.95)

Wetland Mapping in Great Lakes Using Sentinel-1/2 Time-Series Imagery and DEM Data in Google Earth Engine

The Great Lakes (GL) wetlands support a variety of rare and endangered animal and plant species. Thus, wetlands in this region should be mapped and monitored using advanced and reliable techniques. In this study, a wetland map of the GL was produced using Sentinel-1/2 datasets within the Google Earth Engine (GEE) cloud computing platform. To this end, an object-based supervised machine learning (ML) classification workflow is proposed. The proposed method contains two main classification steps. In the first step, several non-wetland classes (e.g., Barren, Cropland, and Open Water), which are more distinguishable using radar and optical Remote Sensing (RS) observations, were identified and masked using a trained Random Forest (RF) model. In the second step, wetland classes, including Fen, Bog, Swamp, and Marsh, along with two non-wetland classes of Forest and Grassland/Shrubland were identified. Using the proposed method, the GL were classified with an overall accuracy of 93.6% and a Kappa coefficient of 0.90. Additionally, the results showed that the proposed method was able to classify the wetland classes with an overall accuracy of 87% and a Kappa coefficient of 0.91. Non-wetland classes were also identified more accurately than wetlands (overall accuracy = 96.62% and Kappa coefficient = 0.95)

Efficient Curriculum based Continual Learning with Informative Subset Selection for Remote Sensing Scene Classification

We tackle the problem of class incremental learning (CIL) in the realm of landcover classification from optical remote sensing (RS) images in this paper. The paradigm of CIL has recently gained much prominence given the fact that data are generally obtained in a sequential manner for real-world phenomenon. However, CIL has not been extensively considered yet in the domain of RS irrespective of the fact that the satellites tend to discover new classes at different geographical locations temporally. With this motivation, we propose a novel CIL framework inspired by the recent success of replay-memory based approaches and tackling two of their shortcomings. In order to reduce the effect of catastrophic forgetting of the old classes when a new stream arrives, we learn a curriculum of the new classes based on their similarity with the old classes. This is found to limit the degree of forgetting substantially. Next while constructing the replay memory, instead of randomly selecting samples from the old streams, we propose a sample selection strategy which ensures the selection of highly confident samples so as to reduce the effects of noise. We observe a sharp improvement in the CIL performance with the proposed components. Experimental results on the benchmark NWPU-RESISC45, PatternNet, and EuroSAT datasets confirm that our method offers improved stability-plasticity trade-off than the literature

Evaluation of regression algorithms for estimating leaf area index and canopy water content from water stressed rice canopy reflectance

Optical remote sensing (RS) with robust algorithms is needed for accurate assessment of crop canopy features. Despite intensive studies on algorithms, their performance using RS needs to be improved. We evaluated five different algorithms (partial-least-squares regression (PLSR), support vector regression (SVR), random forest regression (RFR), locally-weighted-PLSR (PLSRLW) and PLSR with feature selection (PLSRFS)) for rapid assessment of leaf area index (LAI) and canopy water content (CWC) for rice canopies using canopy reflectance spectra over visible to short-wave infrared region. Two pooled datasets of LAI (600) and CWC (480) were collected from two replicated field experiments during 2014–15 and 2015–16 rice growing season. The performance of each algorithm was evaluated using coefficient of determination (R2). Results showed that PLSRLW performed more accurately than other algorithms with R2 values 0.77 and 0.66 for LAI and CWC, respectively. We also used a bootstrapping approach to generate a kernel density estimator of root mean squared error values for each model. The results suggested that the improvement in prediction accuracy of LAI and CWC can be achieved if a suitable algorithm is selected by assigning higher weights to calibration samples, which has similar canopy structure as the test sample. Subsetting of the canopy spectral data results large error values in test dataset, therefore the use of entire season canopy spectral data should be used for model calibration

Reviews and syntheses:Remotely sensed optical time series for monitoring vegetation productivity

International audienceAbstract. Vegetation productivity is a critical indicator of global ecosystem health and is impacted by human activities and climate change. A wide range of optical sensing platforms, from ground-based to airborne and satellite, provide spatially continuous information on terrestrial vegetation status and functioning. As optical Earth observation (EO) data are usually routinely acquired, vegetation can be monitored repeatedly over time; reflecting seasonal vegetation patterns and trends in vegetation productivity metrics. Such metrics include e.g., gross primary productivity, net primary productivity, biomass or yield. To summarize current knowledge, in this paper, we systematically reviewed time series (TS) literature for assessing state-of-the-art vegetation productivity monitoring approaches for different ecosystems based on optical remote sensing (RS) data. As the integration of solar-induced fluorescence (SIF) data in vegetation productivity processing chains has emerged as a promising source, we also include this relatively recent sensor modality. We define three methodological categories to derive productivity metrics from remotely sensed TS of vegetation indices or quantitative traits: (i) trend analysis and anomaly detection, (ii) land surface phenology, and (iii) integration and assimilation of TS-derived metrics into statistical and process-based dynamic vegetation models (DVM). Although the majority of used TS data streams originate from data acquired from satellite platforms, TS data from aircraft and unoccupied aerial vehicles have found their way into productivity monitoring studies. To facilitate processing, we provide a list of common toolboxes for inferring productivity metrics and information from TS data. We further discuss validation strategies of the RS-data derived productivity metrics: (1) using in situ measured data, such as yield, (2) sensor networks of distinct sensors, including spectroradiometers, flux towers, or phenological cameras, and (3) inter-comparison of different productivity products or modelled estimates. Finally, we address current challenges and propose a conceptual framework for productivity metrics derivation, including fully-integrated DVMs and radiative transfer models here labelled as "Digital Twin". This novel framework meets the requirements of multiple ecosystems and enables both an improved understanding of vegetation temporal dynamics in response to climate and environmental drivers and also enhances the accuracy of vegetation productivity monitoring

Semantic identification of urban green spaces: forest

Urban Green Spaces (UGSs) are recognized as crucial parts of the human-nature ecosystem in densely populated urban centers. Even though they have been intensively studied, an ultimate list of all types of UGSs in Europe still does not exist. This challenges decision making on whether an area should be considered an UGS or belong to another land-use class. Furthermore, the means of precise identification of UGSs are dependent, among others, on their type and semantics. Therefore, in this paper, we investigate forests as UGSs and automatically identify them using their distinct characteristics from Sentinel-2 images as well as descriptive properties derived from them, i.e., vegetation indices and texture metrics.We enrich these properties with forest relevant features such as minimum vegetation height and homogeneity. To assess the reliability of the proposed workflow, we test our approach in two German cities and compare the results with existing governmental land use data sets. With the implemented approach we precisely identify over 90% of the existing forests in the study areas. The main restriction of the approach is the transferability of the thresholds of predictor variables such as homogeneity and dissimilarity