Segmentation of satellite imagery of natural scenes using data mining

©1999 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.In this paper, we describe a segmentation technique that integrates traditional image processing algorithms with techniques adapted from knowledge discovery in databases (KDD) and data mining to analyze and segment unstructured satellite images of natural scenes, We have divided our segmentation task into three major steps, First, an initial segmentation is achieved using dynamic local thresholding, producing a set of regions. Then, spectral, spatial, and textural features for each region are generated from the thresholded image. Finally, gi,en these features as attributes, an unsupervised machine learning methodology called conceptual clustering is used to cluster the regions found in the image into N classes-thus, determining the number of classes in the image automatically. We have applied the technique successfully to ERS-1 synthetic aperture radar (SAR), Landsat thematic mapper (TM), and NOAA advanced very high resolution radiometer (AVHRR) data of natural scenes

Towards a multi-scale approach for an Earth observation-based assessment of natural resource exploitation in conflict regions

The exploitation of resources, if not properly managed, can lead to spoiling natural habitats as well as to threatening people’s health, livelihoods and security. The paper discusses a multi-scale Earth observation-based approach to provide independent information related to exploitation activities of natural resources for countries which are experiencing armed conflict. The analyses are based on medium to very high spatial resolution optical satellite data. Object-based image analysis is used for information extraction at these different scales. On a subnational level, conflict-related land cover changes as an indication of potential hot spots for exploitation activities are classified. The regional assessment provides information about potential activity areas of resource exploitation, whereas on a local scale, a site-specific assessment of exploitation areas is performed. The study demonstrates the potential of remote sensing for supporting the monitoring and documentation of natural resource exploitation in conflict regions

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Monitoring Oil Exploitation Infrastructure and Dirt Roads with Object-Based Image Analysis and Random Forest in the Eastern Mongolian Steppe

Information on the spatial distribution of human disturbance is important for assessing and monitoring land degradation. In the Eastern Mongolian Steppe Ecosystem, one of the major driving factors of human-induced land degradation is the expansion of road networks mainly due to intensifications of oil exploration and exploitation. So far, neither the extents of road networks nor the extent of surrounding grasslands affected by the oil industry are monitored which is generally labor consuming. This causes that no information on the changes in the area which is affected by those disturbance drivers is available. Consequently, the study aim is to provide a cost-effective methodology to classify infrastructure and oil exploitation areas from remotely sensed images using object-based classifications with Random Forest. By combining satellite data with different spatial and spectral resolutions (PlanetScope, RapidEye, and Landsat ETM+), the product delivers data since 2005. For the classification variables, segmentation, spectral characteristics, and indices were extracted from all above mentioned imagery and used as predictors. Results show that overall accuracies of land use maps ranged 73%–93% mainly depending on satellites’ spatial resolution. Since 2005, the area of grassland disturbed by dirt roads and oil exploitation infrastructure increased by 88% with its highest expansion by 47% in the period 2005–2010. Settlements and croplands remained relatively constant throughout the 13 years. Comparison of multiscale classification suggests that, although high spatial resolutions are clearly beneficial, all datasets were useful to delineate linear features such as roads. Consequently, the results of this study provide an effective evaluation for the potential of Random Forest for extracting relatively narrow linear features such as roads from multiscale satellite images and map products that are possible to use for detailed land degradation assessments

Rapid Invasion of Spartina Alterniflora in the Coastal Zone of Mainland China: Spatiotemporal Patterns and Human Prevention

Given the extensive spread and ecological consequences of exotic Spartina alterniflora (S. alterniflora) over the coast of mainland China, monitoring its spatiotemporal invasion patterns is important for the sake of coastal ecosystem management and ecological security. In this study, Landsat series images from 1990 to 2015 were used to establish multi-temporal datasets for documenting the temporal dynamics of S. alterniflora invasion. Our observations revealed that S. alterniflora had a continuous expansion with the area increasing by 50,204 ha during the considered 25 years. The largest expansion was identified in Jiangsu Province during the period of 1990-2000, and in Zhejiang Province during the periods 2000-2010 and 2010-2015. Three noticeable hotspots for S. alterniflora invasion were Yancheng of Jiangsu, Chongming of Shanghai, and Ningbo of Zhejiang, and each had a net area increase larger than 5000 ha. Moreover, an obvious shrinkage of S. alterniflora was identified in three coastal cities including the city of Cangzhou of Hebei, Dongguan, and Jiangmen of Guangdong. S. alterniflora invaded mostly into mudflats (>93%) and shrank primarily due to aquaculture (55.5%). This study sheds light on the historical spatial patterns in S. alterniflora distribution and thus is helpful for understanding its invasion mechanism and invasive species management

A Deep Learning Approach for Burned Area Segmentation with Sentinel-2 Data

Wildfires have major ecological, social and economic consequences. Information about the extent of burned areas is essential to assess these consequences and can be derived from remote sensing data. Over the last years, several methods have been developed to segment burned areas with satellite imagery. However, these methods mostly require extensive preprocessing, while deep learning techniques - which have successfully been applied to other segmentation tasks - have yet to be fully explored. In this work, we combine sensor-specific and methodological developments from the past few years and suggest an automatic processing chain, based on deep learning, for burned area segmentation using mono-temporal Sentinel-2 imagery. In particular, we created a new training and validation dataset, which is used to train a convolutional neural network based on a U-Net architecture. We performed several tests on the input data and reached optimal network performance using the spectral bands of the visual, near infrared and shortwave infrared domains. The final segmentation model achieved an overall accuracy of 0.98 and a kappa coefficient of 0.94