Automatic vessel monitoring with single and multidimensional SAR images in the wavelet domain

Spaceborne Synthetic Aperture Radar (SAR) techniques constitute an extremely promising alternative compared to traditional surveillance methods thanks to the all-weather and day-and-night capabilities of Radar linked with the large coverage of SAR images. Nowadays, the capabilities of satellite based SAR systems are confirmed by a wide amount of applications and experiments all over the world. Nevertheless, specific data exploitation methods are still to be developed to provide an efficient automatic interpretation of SAR data. The aim of this paper is to present an approach based on multiscale time–frequency analysis for the automatic detection of spots in a noisy background which is a critical matter in a number of SAR applications. The technique has been applied to automatic ship detection in single and multidimensional SAR imagery and it has proven to be a rapid, robust and reliable tool, able to manage complicated heterogeneous scenes where classical approaches may fail.Peer Reviewe

A False-alarm-controllable Modified AdaBoost Wake Detection Method Using SAR Images

A false-alarm-controllable modified AdaBoost-based method is proposed for detecting ship wake from sea clutter in synthetic aperture radar (SAR) images. It reformulates the wake detection problem as a binary classification task in the multifeature space. The update strategy of the sample weights in the original AdaBoost is modified for wake detection. First, a detection result confidence factor is designed to deal with class imbalance between sea clutter and ship wake; then, the AdaBoost is further modified as a false alarm rate (FAR) controllable detector by introducing penalty parameters to adjust weights update strategies for the sea clutter. Meanwhile, the multifeature space is spanned by a novel frequency peak height ratio (FPHA) feature and four salient features. FPHA is proposed to enhance the separation between the wake and sea clutter, which is computed from the amplitude spectrum peak of the image after the Fourier transform. Experimental results show that the proposed detector can tackle the imbalanced data problem and flexibly control FAR by adjusting penalty parameters. Moreover, improved detection probability is also achieved compared with existing methods

Automatic target recognition in sonar imagery using a cascade of boosted classifiers

This thesis is concerned with the problem of automating the interpretation of data representing the underwater environment retrieved from sensors. This is an important task which potentially allows underwater robots to become completely autonomous, keeping humans out of harm’s way and reducing the operational time and cost of many underwater applications. Typical applications include unexploded ordnance clearance, ship/plane wreck hunting (e.g. Malaysia Airlines flight MH370), and oilfield inspection (e.g. Deepwater Horizon disaster). Two attributes of the processing are crucial if automated interpretation is to be successful. First, computational efficiency is required to allow real-time analysis to be performed on-board robots with limited resources. Second, detection accuracy comparable to human experts is required in order to replace them. Approaches in the open literature do not appear capable of achieving these requirements and this therefore has become the objective of this thesis. This thesis proposes a novel approach capable of recognizing targets in sonar data extremely rapidly with a low number of false alarms. The approach was originally developed for face detection in video, and it is applied to sonar data here for the first time. Aside from the application, the main contribution of this thesis, therefore, is in the way this approach is extended to reduce its training time and improve its detection accuracy. Results obtained on large sets of real sonar data on a variety of challenging terrains are presented to show the discriminative power of the proposed approach. In real field trials, the proposed approach was capable of processing sonar data real-time on-board underwater robots. In direct comparison with human experts, the proposed approach offers 40% reduction in the number of false alarms

Ship detection in SAR images based on Maxtree representation and graph signal processing

© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.This paper discusses an image processing architecture and tools to address the problem of ship detection in synthetic-aperture radar images. The detection strategy relies on a tree-based representation of images, here a Maxtree, and graph signal processing tools. Radiometric as well as geometric attributes are evaluated and associated with the Maxtree nodes. They form graph attribute signals which are processed with graph filters. The goal of this filtering step is to exploit the correlation existing between attribute values on neighboring tree nodes. Considering that trees are specific graphs where the connectivity toward ancestors and descendants may have a different meaning, we analyze several linear, nonlinear, and morphological filtering strategies. Beside graph filters, two new filtering notions emerge from this analysis: tree and branch filters. Finally, we discuss a ship detection architecture that involves graph signal filters and machine learning tools. This architecture demonstrates the interest of applying graph signal processing tools on the tree-based representation of images and of going beyond classical graph filters. The resulting approach significantly outperforms state-of-the-art algorithms. Finally, a MATLAB toolbox allowing users to experiment with the tools discussed in this paper on Maxtree or Mintree has been created and made public.Peer ReviewedPostprint (author's final draft

Advanced Ground-Based Real and Synthetic Aperture Radar

Ground-based/terrestrial radar interferometry (GBRI) is a scientific topic of increasing interest in recent years. The GBRI is used in several field as remote sensing technique for monitoring natural environment (landslides, glacier, and mines) or infrastructures (bridges, towers). These sensors provide the displacement of targets by measuring the phase difference between sending and receiving radar signal. If the acquisition rate is enough the GBRI can provide the natural frequency, e.g. by calculating the Fourier transform of displacement. The research activity, presented in this work, concerns design and development of some advanced GBRI systems. These systems are related to the following issue: detection of displacement vector, Multiple Input Multiple Output (MIMO) and radars with 3D capability

Solar radiation pressure enabled femtosatellite based Earth remote sensing

Recent developments in electronics have pushed miniaturised satellites to the femto-scale, with masses between 10 and 100 g. Although femtosatellites have been proven as a feasible concept, most designs are limited in mission capacity and lifetime due to the lack of environmental protection and onboard propellant. In this paper, a novel concept for femtosatellites for Earth remote sensing is proposed. In particular, a swarm of femtosatellites are used as elements of a sparse array in orbit to receive radar echoes. They also feature active orbit control enabled by solar radiation pressure to extend their lifetime. A simple active orbit control algorithm has been demonstrated. A mission concept based on a Sun-synchronous circular orbit is proposed to maximise the benefit for both Earth remote sensing and active orbit control. A synthetic aperture radar mission has been used to characterise their performance

Sea-Surface Object Detection Based on Electro-Optical Sensors: A Review

Sea-surface object detection is critical for navigation safety of autonomous ships. Electrooptical (EO) sensors, such as video cameras, complement radar on board in detecting small obstacle sea-surface objects. Traditionally, researchers have used horizon detection, background subtraction, and foreground segmentation techniques to detect sea-surface objects. Recently, deep learning-based object detection technologies have been gradually applied to sea-surface object detection. This article demonstrates a comprehensive overview of sea-surface object-detection approaches where the advantages and drawbacks of each technique are compared, covering four essential aspects: EO sensors and image types, traditional object-detection methods, deep learning methods, and maritime datasets collection. In particular, sea-surface object detections based on deep learning methods are thoroughly analyzed and compared with highly influential public datasets introduced as benchmarks to verify the effectiveness of these approaches. The arti

Sonar image interpretation for sub-sea operations

Mine Counter-Measure (MCM) missions are conducted to neutralise underwater explosives. Automatic Target Recognition (ATR) assists operators by increasing the speed and accuracy of data review. ATR embedded on vehicles enables adaptive missions which increase the speed of data acquisition. This thesis addresses three challenges; the speed of data processing, robustness of ATR to environmental conditions and the large quantities of data required to train an algorithm. The main contribution of this thesis is a novel ATR algorithm. The algorithm uses features derived from the projection of 3D boxes to produce a set of 2D templates. The template responses are independent of grazing angle, range and target orientation. Integer skewed integral images, are derived to accelerate the calculation of the template responses. The algorithm is compared to the Haar cascade algorithm. For a single model of sonar and cylindrical targets the algorithm reduces the Probability of False Alarm (PFA) by 80% at a Probability of Detection (PD) of 85%. The algorithm is trained on target data from another model of sonar. The PD is only 6% lower even though no representative target data was used for training. The second major contribution is an adaptive ATR algorithm that uses local sea-floor characteristics to address the problem of ATR robustness with respect to the local environment. A dual-tree wavelet decomposition of the sea-floor and an Markov Random Field (MRF) based graph-cut algorithm is used to segment the terrain. A Neural Network (NN) is then trained to filter ATR results based on the local sea-floor context. It is shown, for the Haar Cascade algorithm, that the PFA can be reduced by 70% at a PD of 85%. Speed of data processing is addressed using novel pre-processing techniques. The standard three class MRF, for sonar image segmentation, is formulated using graph-cuts. Consequently, a 1.2 million pixel image is segmented in 1.2 seconds. Additionally, local estimation of class models is introduced to remove range dependent segmentation quality. Finally, an A* graph search is developed to remove the surface return, a line of saturated pixels often detected as false alarms by ATR. The A* search identifies the surface return in 199 of 220 images tested with a runtime of 2.1 seconds. The algorithm is robust to the presence of ripples and rocks

Diffusion Models for Interferometric Satellite Aperture Radar

Probabilistic Diffusion Models (PDMs) have recently emerged as a very promising class of generative models, achieving high performance in natural image generation. However, their performance relative to non-natural images, like radar-based satellite data, remains largely unknown. Generating large amounts of synthetic (and especially labelled) satellite data is crucial to implement deep-learning approaches for the processing and analysis of (interferometric) satellite aperture radar data. Here, we leverage PDMs to generate several radar-based satellite image datasets. We show that PDMs succeed in generating images with complex and realistic structures, but that sampling time remains an issue. Indeed, accelerated sampling strategies, which work well on simple image datasets like MNIST, fail on our radar datasets. We provide a simple and versatile open-source https://github.com/thomaskerdreux/PDM_SAR_InSAR_generation to train, sample and evaluate PDMs using any dataset on a single GPU