Ship Detection and Segmentation using Image Correlation

There have been intensive research interests in ship detection and segmentation due to high demands on a wide range of civil applications in the last two decades. However, existing approaches, which are mainly based on statistical properties of images, fail to detect smaller ships and boats. Specifically, known techniques are not robust enough in view of inevitable small geometric and photometric changes in images consisting of ships. In this paper a novel approach for ship detection is proposed based on correlation of maritime images. The idea comes from the observation that a fine pattern of the sea surface changes considerably from time to time whereas the ship appearance basically keeps unchanged. We want to examine whether the images have a common unaltered part, a ship in this case. To this end, we developed a method - Focused Correlation (FC) to achieve robustness to geometric distortions of the image content. Various experiments have been conducted to evaluate the effectiveness of the proposed approach.Comment: 8 pages, to be published in proc. of conference IEEE SMC 201

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Selection of the key earth observation sensors and platforms focusing on applications for Polar Regions in the scope of Copernicus system 2020-2030

An optimal payload selection conducted in the frame of the H2020 ONION project (id 687490) is presented based on the ability to cover the observation needs of the Copernicus system in the time period 2020–2030. Payload selection is constrained by the variables that can be measured, the power consumption, and weight of the instrument, and the required accuracy and spatial resolution (horizontal or vertical). It involved 20 measurements with observation gaps according to the user requirements that were detected in the top 10 use cases in the scope of Copernicus space infrastructure, 9 potential applied technologies, and 39 available commercial platforms. Additional Earth Observation (EO) infrastructures are proposed to reduce measurements gaps, based on a weighting system that assigned high relevance for measurements associated to Marine for Weather Forecast over Polar Regions. This study concludes with a rank and mapping of the potential technologies and the suitable commercial platforms to cover most of the requirements of the top ten use cases, analyzing the Marine for Weather Forecast, Sea Ice Monitoring, Fishing Pressure, and Agriculture and Forestry: Hydric stress as the priority use cases.Peer ReviewedPostprint (published version

Sea target detection using spaceborne GNSS-R delay-doppler maps: theory and experimental proof of concept using TDS-1 data

© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.This study addresses a novel application of global navigation satellite system-reflectometry (GNSS-R) delay-Doppler maps (DDMs), namely sea target detection. In contrast with other competing remote sensing technologies, such as synthetic aperture radar and optical systems, typically exploited in the field of sea target detection, GNSS-R systems could be employed as satellite constellations, so as to fulfill the temporal requirements for near real-time ships and sea ice sheets monitoring. In this study, the revisit time offered by GNSS-R systems is quantitatively evaluated by means of a simulation analysis, in which three different realistic GNSS-R missions are simulated and analyzed. Then, a sea target detection algorithm from spaceborne GNSS-R DDMs is described and assessed. The algorithm is based on a sea clutter compensation step and uses an adaptive threshold to take into account spatial variations in the sea background and/or noise statistics. Finally, the sea target detector algorithm is tested and validated for the first time ever using experimental GNSS-R data from the U.K. TechDemoSat-1 dataset. Performance is assessed by providing the receiver operating characteristic curves, and some preliminary experimental results are presented.Peer ReviewedPostprint (published version

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

Artificial Neural Networks and Evolutionary Computation in Remote Sensing

Artificial neural networks (ANNs) and evolutionary computation methods have been successfully applied in remote sensing applications since they offer unique advantages for the analysis of remotely-sensed images. ANNs are effective in finding underlying relationships and structures within multidimensional datasets. Thanks to new sensors, we have images with more spectral bands at higher spatial resolutions, which clearly recall big data problems. For this purpose, evolutionary algorithms become the best solution for analysis. This book includes eleven high-quality papers, selected after a careful reviewing process, addressing current remote sensing problems. In the chapters of the book, superstructural optimization was suggested for the optimal design of feedforward neural networks, CNN networks were deployed for a nanosatellite payload to select images eligible for transmission to ground, a new weight feature value convolutional neural network (WFCNN) was applied for fine remote sensing image segmentation and extracting improved land-use information, mask regional-convolutional neural networks (Mask R-CNN) was employed for extracting valley fill faces, state-of-the-art convolutional neural network (CNN)-based object detection models were applied to automatically detect airplanes and ships in VHR satellite images, a coarse-to-fine detection strategy was employed to detect ships at different sizes, and a deep quadruplet network (DQN) was proposed for hyperspectral image classification