1,924 research outputs found
A Self-Organizing Neural System for Learning to Recognize Textured Scenes
A self-organizing ARTEX model is developed to categorize and classify textured image regions. ARTEX specializes the FACADE model of how the visual cortex sees, and the ART model of how temporal and prefrontal cortices interact with the hippocampal system to learn visual recognition categories and their names. FACADE processing generates a vector of boundary and surface properties, notably texture and brightness properties, by utilizing multi-scale filtering, competition, and diffusive filling-in. Its context-sensitive local measures of textured scenes can be used to recognize scenic properties that gradually change across space, as well a.s abrupt texture boundaries. ART incrementally learns recognition categories that classify FACADE output vectors, class names of these categories, and their probabilities. Top-down expectations within ART encode learned prototypes that pay attention to expected visual features. When novel visual information creates a poor match with the best existing category prototype, a memory search selects a new category with which classify the novel data. ARTEX is compared with psychophysical data, and is benchmarked on classification of natural textures and synthetic aperture radar images. It outperforms state-of-the-art systems that use rule-based, backpropagation, and K-nearest neighbor classifiers.Defense Advanced Research Projects Agency; Office of Naval Research (N00014-95-1-0409, N00014-95-1-0657
Classification of Polarimetric SAR Images Using Compact Convolutional Neural Networks
Classification of polarimetric synthetic aperture radar (PolSAR) images is an
active research area with a major role in environmental applications. The
traditional Machine Learning (ML) methods proposed in this domain generally
focus on utilizing highly discriminative features to improve the classification
performance, but this task is complicated by the well-known "curse of
dimensionality" phenomena. Other approaches based on deep Convolutional Neural
Networks (CNNs) have certain limitations and drawbacks, such as high
computational complexity, an unfeasibly large training set with ground-truth
labels, and special hardware requirements. In this work, to address the
limitations of traditional ML and deep CNN based methods, a novel and
systematic classification framework is proposed for the classification of
PolSAR images, based on a compact and adaptive implementation of CNNs using a
sliding-window classification approach. The proposed approach has three
advantages. First, there is no requirement for an extensive feature extraction
process. Second, it is computationally efficient due to utilized compact
configurations. In particular, the proposed compact and adaptive CNN model is
designed to achieve the maximum classification accuracy with minimum training
and computational complexity. This is of considerable importance considering
the high costs involved in labelling in PolSAR classification. Finally, the
proposed approach can perform classification using smaller window sizes than
deep CNNs. Experimental evaluations have been performed over the most
commonly-used four benchmark PolSAR images: AIRSAR L-Band and RADARSAT-2 C-Band
data of San Francisco Bay and Flevoland areas. Accordingly, the best obtained
overall accuracies range between 92.33 - 99.39% for these benchmark study
sites
Advances in Hyperspectral Image Classification: Earth monitoring with statistical learning methods
Hyperspectral images show similar statistical properties to natural grayscale
or color photographic images. However, the classification of hyperspectral
images is more challenging because of the very high dimensionality of the
pixels and the small number of labeled examples typically available for
learning. These peculiarities lead to particular signal processing problems,
mainly characterized by indetermination and complex manifolds. The framework of
statistical learning has gained popularity in the last decade. New methods have
been presented to account for the spatial homogeneity of images, to include
user's interaction via active learning, to take advantage of the manifold
structure with semisupervised learning, to extract and encode invariances, or
to adapt classifiers and image representations to unseen yet similar scenes.
This tutuorial reviews the main advances for hyperspectral remote sensing image
classification through illustrative examples.Comment: IEEE Signal Processing Magazine, 201
Investigating SAR algorithm for spaceborne interferometric oil spill detection
The environmental damages and recovery of terrestrial ecosystems from oil spills can last decades. Oil spills have been responsible for loss of aquamarine lives, organisms, trees, vegetation, birds and wildlife. Although there are several methods through which oil spills can be detected, it can be argued that remote sensing via the use of spaceborne platforms provides enormous benefits. This paper will provide more efficient means and methods that can assist in improving oil spill responses. The objective of this research is to develop a signal processing algorithm that can be used for detecting oil spills using spaceborne SAR interferometry (InSAR) data. To this end, a pendulum formation of multistatic smallSAR carrying platforms in a near equatorial orbit is described. The characteristic parameters such as the effects of incidence angles on radar backscatter, which support the detection of oil spills, will be the main drivers for determining the relative positions of the small satellites in formation. The orbit design and baseline distances between each spaceborne SAR platform will also be discussed. Furthermore, results from previous analysis on coverage assessment and revisit time shall be highlighted. Finally, an evaluation of automatic algorithm techniques for oil spill detection in SAR images will be conducted and results presented. The framework for the automatic algorithm considered consists of three major steps. The segmentation stage, where techniques that suggest the use of thresholding for dark spot segmentation within the captured InSAR image scene is conducted. The feature extraction stage involves the geometry and shape of the segmented region where elongation of the oil slick is considered an important feature and a function of the width and the length of the oil slick. For the classification stage, where the major objective is to distinguish oil spills from look-alikes, a Mahalanobis classifier will be used to estimate the probability of the extracted features being oil spills. The validation process of the algorithm will be conducted by using NASA’s UAVSAR data obtained over the Gulf of coast oil spill and RADARSAT-1 dat
Deep learning in remote sensing: a review
Standing at the paradigm shift towards data-intensive science, machine
learning techniques are becoming increasingly important. In particular, as a
major breakthrough in the field, deep learning has proven as an extremely
powerful tool in many fields. Shall we embrace deep learning as the key to all?
Or, should we resist a 'black-box' solution? There are controversial opinions
in the remote sensing community. In this article, we analyze the challenges of
using deep learning for remote sensing data analysis, review the recent
advances, and provide resources to make deep learning in remote sensing
ridiculously simple to start with. More importantly, we advocate remote sensing
scientists to bring their expertise into deep learning, and use it as an
implicit general model to tackle unprecedented large-scale influential
challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin
Domain Adaptive Transfer Attack (DATA)-based Segmentation Networks for Building Extraction from Aerial Images
Semantic segmentation models based on convolutional neural networks (CNNs)
have gained much attention in relation to remote sensing and have achieved
remarkable performance for the extraction of buildings from high-resolution
aerial images. However, the issue of limited generalization for unseen images
remains. When there is a domain gap between the training and test datasets,
CNN-based segmentation models trained by a training dataset fail to segment
buildings for the test dataset. In this paper, we propose segmentation networks
based on a domain adaptive transfer attack (DATA) scheme for building
extraction from aerial images. The proposed system combines the domain transfer
and adversarial attack concepts. Based on the DATA scheme, the distribution of
the input images can be shifted to that of the target images while turning
images into adversarial examples against a target network. Defending
adversarial examples adapted to the target domain can overcome the performance
degradation due to the domain gap and increase the robustness of the
segmentation model. Cross-dataset experiments and the ablation study are
conducted for the three different datasets: the Inria aerial image labeling
dataset, the Massachusetts building dataset, and the WHU East Asia dataset.
Compared to the performance of the segmentation network without the DATA
scheme, the proposed method shows improvements in the overall IoU. Moreover, it
is verified that the proposed method outperforms even when compared to feature
adaptation (FA) and output space adaptation (OSA).Comment: 11pages, 12 figure
A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community
In recent years, deep learning (DL), a re-branding of neural networks (NNs),
has risen to the top in numerous areas, namely computer vision (CV), speech
recognition, natural language processing, etc. Whereas remote sensing (RS)
possesses a number of unique challenges, primarily related to sensors and
applications, inevitably RS draws from many of the same theories as CV; e.g.,
statistics, fusion, and machine learning, to name a few. This means that the RS
community should be aware of, if not at the leading edge of, of advancements
like DL. Herein, we provide the most comprehensive survey of state-of-the-art
RS DL research. We also review recent new developments in the DL field that can
be used in DL for RS. Namely, we focus on theories, tools and challenges for
the RS community. Specifically, we focus on unsolved challenges and
opportunities as it relates to (i) inadequate data sets, (ii)
human-understandable solutions for modelling physical phenomena, (iii) Big
Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and
learning algorithms for spectral, spatial and temporal data, (vi) transfer
learning, (vii) an improved theoretical understanding of DL systems, (viii)
high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote
Sensin
Integration of geographic information system and RADARSAT synthetic aperture radar data using a self-organizing map network as compensation for realtime ground data in automatic image classification
The paper presents results of using advanced techniques such as Self-Organizing feature Map (SOM) to incorporate a GIS data layer to compensate for the limited amount of
real-time ground-truth data available for land-use and land-cover mapping in wet-season conditions in Bangladesh based on multi-temporal RADARSAT-1 SAR images. The experimental results were compared with those of traditional statistical classifiers such as Maximum Likelihood, Mahalanobis Distance, and Minimum Distance, which are not suitable for incorporating low-level GIS data in the image classification process. The performances of the classifiers were evaluated in terms of the classification accuracy with respect to the collected real-time ground truth data. The SOM neural network provided the highest overall accuracy when a GIS layer of land type classification with respect to the depth and duration of regular flooding was used in the network. Using this method, the overall accuracy was around 15% higher than the previously mentioned traditional classifiers at 79.6% where the training data covered only 0.53% of the total image. It also achieved higher accuracies for more classes in comparison to the other classifiers
- …