Towards the use of sequential patterns for detection and characterization of natural and agricultural areas

Nowadays, a huge amount of high resolution satellite images are freely available. Such images allow researchers in environmental sciences to study the different natural habitats and farming practices in a remote way. However, satellite images content strongly depends on the season of the acquisition. Due to the periodicity of natural and agricultural dynamics throughout seasons, sequential patterns arise as a new opportunity to model the behaviour of these environments. In this paper, we describe some preliminary results obtained with a new framework for studying spatiotemporal evolutions over natural and agricultural areas using k-partite graphs and sequential patterns extracted from segmented Landsat images.Postprint (author’s final draft

Deep constrained clustering applied to satellite image time series

International audienceThe advent of satellite imagery is generating an unprecedented amount of remote sensing images. Current satellites now achieve frequent revisits and high mission availability and provide series of images of the Earth captured at different dates that can be seen as time series. Analyzing satellite image time series allows to perform continuous wide range Earth observation with applications in agricultural mapping , environmental disaster monitoring, etc. However, the lack of large quantity of labeled data generally prevents from easily applying supervised methods. On the contrary, unsupervised methods do not require expert knowledge but sometimes provide poor results. In this context, constrained clustering, which is a class of semi-supervised learning algorithms , is an alternative and offers a good trade-off of supervision. In this paper, we explore the use of constraints with deep clustering approaches to process satellite image time series. Our experimental study relies on deep embedded clustering and the deep constrained framework using pairwise constraints (must-link and cannot-link). Experiments on a real dataset composed of 11 satellite images show promising results and open many perspectives for applying deep constrained clustering to satellite image time series

Towards a set of agrosystem-specific cropland mapping methods to address the global cropland diversity

Accurate cropland information is of paramount importance for crop monitoring. This study compares five existing cropland mapping methodologies over five contrasting Joint Experiment for Crop Assessment and Monitoring (JECAM) sites of medium to large average field size using the time series of 7-day 250 m Moderate Resolution Imaging Spectroradiometer (MODIS) mean composites (red and near-infrared channels). Different strategies were devised to assess the accuracy of the classification methods: confusion matrices and derived accuracy indicators with and without equalizing class proportions, assessing the pairwise difference error rates and accounting for the spatial resolution bias. The robustness of the accuracy with respect to a reduction of the quantity of calibration data available was also assessed by a bootstrap approach in which the amount of training data was systematically reduced. Methods reached overall accuracies ranging from 85% to 95%, which demonstrates the ability of 250 m imagery to resolve fields down to 20 ha. Despite significantly different error rates, the site effect was found to persistently dominate the method effect. This was confirmed even after removing the share of the classification due to the spatial resolution of the satellite data (from 10% to 30%). This underlines the effect of other agrosystems characteristics such as cloudiness, crop diversity, and calendar on the ability to perform accurately. All methods have potential for large area cropland mapping as they provided accurate results with 20% of the calibration data, e.g. 2% of the study area in Ukraine. To better address the global cropland diversity, results advocate movement towards a set of cropland classification methods that could be applied regionally according to their respective performance in specific landscapes.Instituto de Clima y AguaFil: Waldner, François. Université catholique de Louvain. Earth and Life Institute - Environment, Croix du Sud; BelgicaFil: De Abelleyra, Diego. Instituto Nacional de Tecnología Agropecuaria (INTA). Instituto de Clima y Agua; ArgentinaFil: Veron, Santiago Ramón. Instituto Nacional de Tecnología Agropecuaria (INTA). Instituto de Clima y Agua; Argentina. Universidad de Buenos Aires. Facultad de Agronomía. Departamento de Métodos Cuantitativos y Sistemas de Información; ArgentinaFil: Zhang, Miao. Chinese Academy of Science. Institute of Remote Sensing and Digital Earth; ChinaFil: Wu, Bingfang. Chinese Academy of Science. Institute of Remote Sensing and Digital Earth; ChinaFil: Plotnikov, Dmitry. Russian Academy of Sciences. Space Research Institute. Terrestrial Ecosystems Monitoring Laboratory; RusiaFil: Bartalev, Sergey. Russian Academy of Sciences. Space Research Institute. Terrestrial Ecosystems Monitoring Laboratory; RusiaFil: Lavreniuk, Mykola. Space Research Institute NAS and SSA. Department of Space Information Technologies; UcraniaFil: Skakun, Sergii. Space Research Institute NAS and SSA. Department of Space Information Technologies; Ucrania. University of Maryland. Department of Geographical Sciences; Estados UnidosFil: Kussul, Nataliia. Space Research Institute NAS and SSA. Department of Space Information Technologies; UcraniaFil: Le Maire, Guerric. UMR Eco&Sols, CIRAD; Francia. Empresa Brasileira de Pesquisa Agropecuária. Meio Ambiante; BrasilFil: Dupuy, Stéphane. Centre de Coopération Internationale en Recherche Agronomique pour le Développement. Territoires, Environnement, Télédétection et Information Spatiale; FranciaFil: Jarvis, Ian. Agriculture and Agri-Food Canada. Science and Technology Branch. Agri-Climate, Geomatics and Earth Observation; CanadáFil: Defourny, Pierre. Université Catholique de Louvain. Earth and Life Institute - Environment, Croix du Sud; Belgic

Long term analysis of time series of satellite images

International audienceSatellite images allow the acquisition of large-scale ground vegetation. Images are available along several years with a high acquisition rate. Such data are called satellite image time series (SITS). We present a method to analyse an SITS through the characterization of the evolution of a vegetation index (NDVI) at two scales: annual and multi-annual. We evaluate our method on SITS of the Senegal from 2001 to 2008 and we compare our method to a clustering of long time series. The results show that our method better discriminates regions in the median zone of Senegal and locates fine interesting areas

Change detection in SAR time-series based on the coefficient of variation

This paper discusses change detection in SAR time-series. Firstly, several statistical properties of the coefficient of variation highlight its pertinence for change detection. Then several criteria are proposed. The coefficient of variation is suggested to detect any kind of change. Then other criteria based on ratios of coefficients of variations are proposed to detect long events such as construction test sites, or point-event such as vehicles. These detection methods are evaluated first on theoretical statistical simulations to determine the scenarios where they can deliver the best results. Then detection performance is assessed on real data for different types of scenes and sensors (Sentinel-1, UAVSAR). In particular, a quantitative evaluation is performed with a comparison of our solutions with state-of-the-art methods

Constrained Distance Based Clustering for Satellite Image Time-Series

International audienceThe advent of high-resolution instruments for time-series sampling poses added complexity for the formal definition of thematic classes in the remote sensing domain-required by supervised methods-while unsupervised methods ignore expert knowledge and intuition. Constrained clustering is becoming an increasingly popular approach in data mining because it offers a solution to these problems, however, its application in remote sensing is relatively unknown. This article addresses this divide by adapting publicly available constrained clustering implementations to use the dynamic time warping (DTW) dissimilarity measure, which is sometimes used for time-series analysis. A comparative study is presented, in which their performance is evaluated (using both DTW and Euclidean distances). It is found that adding constraints to the clustering problem results in an increase in accuracy when compared to unconstrained clustering. The output of such algorithms are homogeneous in spatially defined regions. Declarative approaches and k-Means based algorithms are simple to apply, requiring little or no choice of parameter values. Spectral methods, however, require careful tuning, which is unrealistic in a semi-supervised setting, although they offer the highest accuracy. These conclusions were drawn from two applications: crop clustering using 11 multi-spectral Landsat images non-uniformly sampled over a period of eight months in 2007; and tree-cut detection using 10 NDVI Sentinel-2 images non-uniformly sampled between 2016 and 2018

Multitemporal segmentation of Sentinel-2 images in an agricultural intensification region in Brazil.

ABSTRACT: With the recent evolution in the sensor's spatial resolution, such as the MultiSpectral Imager (MSI) of the Sentinel-2 mission, the need to use segmentation techniques in satellite images has increased. Although the advantages of image segmentation to delineate agricultural fields in images are already known, the literature shows that it is rarely used to consider temporal changes in highly managed regions with the intensification of agricultural activities. Therefore, this work aimed to evaluate a multitemporal segmentation method based on the coefficient of variation of spectral bands and vegetation indices obtained from Sentinel-2 images, considering two agricultural years (2018-2019 and 2019-2020) in an area with agricultural intensification. Images of the coefficient of variation represented the spectro-temporal dynamics within the study area. These images were also used to apply an edge detection filter (Sobel) to verify their performance. The region-based algorithm Watershed Segmentation (WS) was used in the segmentation process. Subsequently, to assess the quality of the segmentation results produced, the metrics Potential Segmentation Error (PSE), Number-of-Segments Ratio (NSR), and Euclidean Distance 2 (ED2) were calculated from manually delineated reference objects. The segmentation achieved its best performance when applied to the unfiltered coefficient of variation images of spectral bands with an ED2 equal to 7.289 and 2.529 for 2018-2019 and 2019-2020, respectively. There was a tendency for the WS algorithm to produce over-segmentation in the study area; however, its use proved to be effective in identifying objects in a dynamic area with the intensification of agricultural activities.Edition of proceedings of the 2022 edition of the XXIVth ISPRS Congress, Nice, France

Multisensor Fusion Remote Sensing Technology For Assessing Multitemporal Responses In Ecohydrological Systems

Earth ecosystems and environment have been changing rapidly due to the advanced technologies and developments of humans. Impacts caused by human activities and developments are difficult to acquire for evaluations due to the rapid changes. Remote sensing (RS) technology has been implemented for environmental managements. A new and promising trend in remote sensing for environment is widely used to measure and monitor the earth environment and its changes. RS allows large-scaled measurements over a large region within a very short period of time. Continuous and repeatable measurements are the very indispensable features of RS. Soil moisture is a critical element in the hydrological cycle especially in a semiarid or arid region. Point measurement to comprehend the soil moisture distribution contiguously in a vast watershed is difficult because the soil moisture patterns might greatly vary temporally and spatially. Space-borne radar imaging satellites have been popular because they have the capability to exhibit all weather observations. Yet the estimation methods of soil moisture based on the active or passive satellite imageries remain uncertain. This study aims at presenting a systematic soil moisture estimation method for the Choke Canyon Reservoir Watershed (CCRW), a semiarid watershed with an area of over 14,200 km2 in south Texas. With the aid of five corner reflectors, the RADARSAT-1 Synthetic Aperture Radar (SAR) imageries of the study area acquired in April and September 2004 were processed by both radiometric and geometric calibrations at first. New soil moisture estimation models derived by genetic programming (GP) technique were then developed and applied to support the soil moisture distribution analysis. The GP-based nonlinear function derived in the evolutionary process uniquely links a series of crucial topographic and geographic features. Included in this process are slope, aspect, vegetation cover, and soil permeability to compliment the well-calibrated SAR data. Research indicates that the novel application of GP proved useful for generating a highly nonlinear structure in regression regime, which exhibits very strong correlations statistically between the model estimates and the ground truth measurements (volumetric water content) on the basis of the unseen data sets. In an effort to produce the soil moisture distributions over seasons, it eventually leads to characterizing local- to regional-scale soil moisture variability and performing the possible estimation of water storages of the terrestrial hydrosphere. A new evolutionary computational, supervised classification scheme (Riparian Classification Algorithm, RICAL) was developed and used to identify the change of riparian zones in a semi-arid watershed temporally and spatially. The case study uniquely demonstrates an effort to incorporating both vegetation index and soil moisture estimates based on Landsat 5 TM and RADARSAT-1 imageries while trying to improve the riparian classification in the Choke Canyon Reservoir Watershed (CCRW), South Texas. The CCRW was selected as the study area contributing to the reservoir, which is mostly agricultural and range land in a semi-arid coastal environment. This makes the change detection of riparian buffers significant due to their interception capability of non-point source impacts within the riparian buffer zones and the maintenance of ecosystem integrity region wide. The estimation of soil moisture based on RADARSAT-1 Synthetic Aperture Radar (SAR) satellite imagery as previously developed was used. Eight commonly used vegetation indices were calculated from the reflectance obtained from Landsat 5 TM satellite images. The vegetation indices were individually used to classify vegetation cover in association with genetic programming algorithm. The soil moisture and vegetation indices were integrated into Landsat TM images based on a pre-pixel channel approach for riparian classification. Two different classification algorithms were used including genetic programming, and a combination of ISODATA and maximum likelihood supervised classification. The white box feature of genetic programming revealed the comparative advantage of all input parameters. The GP algorithm yielded more than 90% accuracy, based on unseen ground data, using vegetation index and Landsat reflectance band 1, 2, 3, and 4. The detection of changes in the buffer zone was proved to be technically feasible with high accuracy. Overall, the development of the RICAL algorithm may lead to the formulation of more effective management strategies for the handling of non-point source pollution control, bird habitat monitoring, and grazing and live stock management in the future. Soil properties, landscapes, channels, fault lines, erosion/deposition patches, and bedload transport history show geologic and geomorphologic features in a variety of watersheds. In response to these unique watershed characteristics, the hydrology of large-scale watersheds is often very complex. Precipitation, infiltration and percolation, stream flow, plant transpiration, soil moisture changes, and groundwater recharge are intimately related with each other to form water balance dynamics on the surface of these watersheds. Within this chapter, depicted is an optimal site selection technology using a grey integer programming (GIP) model to assimilate remote sensing-based geo-environmental patterns in an uncertain environment with respect to some technical and resources constraints. It enables us to retrieve the hydrological trends and pinpoint the most critical locations for the deployment of monitoring stations in a vast watershed. Geo-environmental information amassed in this study includes soil permeability, surface temperature, soil moisture, precipitation, leaf area index (LAI) and normalized difference vegetation index (NDVI). With the aid of a remote sensing-based GIP analysis, only five locations out of more than 800 candidate sites were selected by the spatial analysis, and then confirmed by a field investigation. The methodology developed in this remote sensing-based GIP analysis will significantly advance the state-of-the-art technology in optimum arrangement/distribution of water sensor platforms for maximum sensing coverage and information-extraction capacity. Effective water resources management is a critically important priority across the globe. While water scarcity limits the uses of water in many ways, floods also have caused so many damages and lives. To more efficiently use the limited amount of water or to resourcefully provide adequate time for flood warning, the results have led us to seek advanced techniques for improving streamflow forecasting. The objective of this section of research is to incorporate sea surface temperature (SST), Next Generation Radar (NEXRAD) and meteorological characteristics with historical stream data to forecast the actual streamflow using genetic programming. This study case concerns the forecasting of stream discharge of a complex-terrain, semi-arid watershed. This study elicits microclimatological factors and the resultant stream flow rate in river system given the influence of dynamic basin features such as soil moisture, soil temperature, ambient relative humidity, air temperature, sea surface temperature, and precipitation. Evaluations of the forecasting results are expressed in terms of the percentage error (PE), the root-mean-square error (RMSE), and the square of the Pearson product moment correlation coefficient (r-squared value). The developed models can predict streamflow with very good accuracy with an r-square of 0.84 and PE of 1% for a 30-day prediction

Assessing Vegetation Decline Due to Pollution from Solid Waste Management by a Multitemporal Remote Sensing Approach

Nowadays, the huge production of Municipal Solid Waste (MSW) is one of the most strongly felt environmental issues. Consequently, the European Union (EU) delivers laws and regulations for better waste management, identifying the essential requirements for waste disposal operations and the characteristics that make waste hazardous to human health and the envi-ronment. In Italy, environmental regulations define, among other things, the characteristics of sites to be classified as “potentially contaminated”. From this perspective, the Basilicata region is cur-rently one of the Italian regions with the highest number of potentially polluted sites in proportion to the number of inhabitants. This research aimed to identify the possible effects of potentially toxic element (PTE) pollution due to waste disposal activities in three “potentially contaminated” sites in southern Italy. The area was affected by a release of inorganic pollutants with values over the thresholds ruled by national/European legislation. Potential physiological efficiency variations of vegetation were analyzed through the multitemporal processing of satellite images. Landsat 5 Thematic Mapper (TM) and Landsat 8 Operational Land Imager (OLI) images were used to calcu-late the trend in the Normalized Difference Vegetation Index (NDVI) over the years. The mul-titemporal trends were analyzed using the median of the non-parametric Theil–Sen estimator. Fi-nally, the Mann–Kendall test was applied to evaluate trend significance featuring areas according to the contamination effects on investigated vegetation. The applied procedure led to the exclu-sion of significant effects on vegetation due to PTEs. Thus, waste disposal activities during previ-ous years do not seem to have significantly affected vegetation around targeted sites