Research on Target Detection Algorithm of Radar and Visible Image Fusion Based on Wavelet Transform

The target detection rate of unmanned surface vehicle is low because of waves, fog, background clutter and other environmental factors on the interference. Therefore, the paper studies the target detection algorithm of radar and visible image fusion based on wavelet transform. The visible image is preprocessed to ensure the detection effect. The multi-scale fractal model is used to extract the target features, and the difference between the fractal features of the target and the background is used to detect the target. The radar image is denoised by a combination of median filtering and wavelet transform. The processed visible light and radar image are fused with wavelet transform strategy. The coefficients of the low frequency sub-band are processed by the average fusion strategy. The coefficients of the high frequency sub-band are processed using a strategy with a higher absolute value. The standard deviation, the spatial frequency and the contrast resolution of the image fusion result are compared. The simulation results show that the processed image is better than the unprocessed image after the fusion

A ship detector applying Principal Component Analysis to the polarimetric Notch Filter

Ship detection using polarimetric synthetic aperture radar (PolSAR) data has attracted a lot of attention in recent years. Polarimetry can provide information regarding the scattering mechanisms of targets, which helps discriminate between ships and sea clutter. This enhancement is particularly valuable when we aim at detecting smaller vessels in rough sea states. This work exploits a ship detector called the Geometrical Perturbation-Polarimetric Notch Filter (GP-PNF), and it is aimed at improving its performance especially when less polarimetric images are available (e.g., dual-polarimetric data). The idea is to design a new polarimetric feature vector containing more features that are renowned to allow separation between ships and sea clutter. Then, a Principal Component Analysis (PCA) is further used to reduce the dimensionality of the new feature space. Experiments on four real Sentinel-1 datasets are carried out to demonstrate the validity of the proposed method and compare it against other ship detectors. Analyses of the experimental results show that the proposed algorithm can not only reduce the false alarms significantly, but also enhance the target-to-clutter ratio (TCR) so that it can more effectively detect weaker ships

A framework based on Gaussian mixture models and Kalman filters for the segmentation and tracking of anomalous events in shipboard video

Anomalous indications in monitoring equipment on board U.S. Navy vessels must be handled in a timely manner to prevent catastrophic system failure. The development of sensor data analysis techniques to assist a ship\u27s crew in monitoring machinery and summon required ship-to-shore assistance is of considerable benefit to the Navy. In addition, the Navy has a large interest in the development of distance support technology in its ongoing efforts to reduce manning on ships. In this thesis, algorithms have been developed for the detection of anomalous events that can be identified from the analysis of monochromatic stationary ship surveillance video streams. The specific anomalies that we have focused on are the presence and growth of smoke and fire events inside the frames of the video stream. The algorithm consists of the following steps. First, a foreground segmentation algorithm based on adaptive Gaussian mixture models is employed to detect the presence of motion in a scene. The algorithm is adapted to emphasize gray-level characteristics related to smoke and fire events in the frame. Next, shape discriminant features in the foreground are enhanced using morphological operations. Following this step, the anomalous indication is tracked between frames using Kalman filtering. Finally, gray level shape and motion features corresponding to the anomaly are subjected to principal component analysis and classified using a multilayer perceptron neural network. The algorithm is exercised on 68 video streams that include the presence of anomalous events (such as fire and smoke) and benign/nuisance events (such as humans walking the field of view). Initial results show that the algorithm is successful in detecting anomalies in video streams, and is suitable for application in shipboard environments

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Détection de bateaux dans les images de radar à ouverture synthétique

Le but principal de cette thèse est de développer des algorithmes efficaces et de concevoir un système pour la détection de bateaux dans les images Radar à Ouverture Synthetique (ROS.) Dans notre cas, la détection de bateaux implique en premier lieu la détection de cibles de points dans les images ROS. Ensuite, la détection d'un bateau proprement dit dépend des propriétés physiques du bateau lui-même, tel que sa taille, sa forme, sa structure, son orientation relative a la direction de regard du radar et les conditions générales de l'état de la mer. Notre stratégie est de détecter toutes les cibles de bateaux possibles dans les images de ROS, et ensuite de chercher autour de chaque candidat des évidences telle que les sillons. Les objectifs de notre recherche sont (1) d'améliorer 1'estimation des paramètres dans Ie modèle de distribution-K et de déterminer les conditions dans lesquelles un modèle alternatif (Ie Gamma, par exemple) devrait être utilise plutôt; (2) d'explorer Ie modèle PNN (Probabilistic Neural Network) comme une alternative aux modèles paramétriques actuellement utilises; (3) de concevoir un modèle de regroupement flou (FC : Fuzzy Clustering) capable de détecter les petites et grandes cibles de bateaux dans les images a un seul canal ou les images a multi-canaux; (4) de combiner la détection de sillons avec la détection de cibles de bateaux; (5) de concevoir un modèle de détection qui peut être utilisé aussi pour la détection des cibles de bateaux en zones costières.Abstract: The main purpose of this thesis is to develop efficient algorithms and design a system for ship detection from Synthetic Aperture Radar (SAR) imagery. Ship detection usually involves through detection of point targets on a radar clutter background.The detection of a ship depends on the physical properties of the ship itself, such as size, shape, and structure; its orientation relative to the radar look-direction; and the general condition of the sea state. Our strategy is to detect all possible ship targets in SAR images, and then search around each candidate for the wake as further evidence.The objectives of our research are (1) to improve estimation of the parameters in the K-distribution model and to determine the conditions in which an alternative model (Gamma, for example) should be used instead; (2) to explore a PNN (Probabilistic Neural Networks) model as an alternative to the commonly used parameteric models; (3) to design a FC (Fuzzy Clustering) model capable of detecting both small and large ship targets from single-channel images or multi-channel images; (4) to combine wake detection with ship target detection; (5) to design a detection model that can also be used to detect ship targets in coastal areas. We have developed algorithms for each of these objectives and integrated them into a system comprising six models.The system has been tested on a number of SAR images (SEASAT, ERS and RADARSAT-1, for example) and its performance has been assessed

Artificial Neural Networks and Evolutionary Computation in Remote Sensing

Artificial neural networks (ANNs) and evolutionary computation methods have been successfully applied in remote sensing applications since they offer unique advantages for the analysis of remotely-sensed images. ANNs are effective in finding underlying relationships and structures within multidimensional datasets. Thanks to new sensors, we have images with more spectral bands at higher spatial resolutions, which clearly recall big data problems. For this purpose, evolutionary algorithms become the best solution for analysis. This book includes eleven high-quality papers, selected after a careful reviewing process, addressing current remote sensing problems. In the chapters of the book, superstructural optimization was suggested for the optimal design of feedforward neural networks, CNN networks were deployed for a nanosatellite payload to select images eligible for transmission to ground, a new weight feature value convolutional neural network (WFCNN) was applied for fine remote sensing image segmentation and extracting improved land-use information, mask regional-convolutional neural networks (Mask R-CNN) was employed for extracting valley fill faces, state-of-the-art convolutional neural network (CNN)-based object detection models were applied to automatically detect airplanes and ships in VHR satellite images, a coarse-to-fine detection strategy was employed to detect ships at different sizes, and a deep quadruplet network (DQN) was proposed for hyperspectral image classification

A False-alarm-controllable Modified AdaBoost Wake Detection Method Using SAR Images

A false-alarm-controllable modified AdaBoost-based method is proposed for detecting ship wake from sea clutter in synthetic aperture radar (SAR) images. It reformulates the wake detection problem as a binary classification task in the multifeature space. The update strategy of the sample weights in the original AdaBoost is modified for wake detection. First, a detection result confidence factor is designed to deal with class imbalance between sea clutter and ship wake; then, the AdaBoost is further modified as a false alarm rate (FAR) controllable detector by introducing penalty parameters to adjust weights update strategies for the sea clutter. Meanwhile, the multifeature space is spanned by a novel frequency peak height ratio (FPHA) feature and four salient features. FPHA is proposed to enhance the separation between the wake and sea clutter, which is computed from the amplitude spectrum peak of the image after the Fourier transform. Experimental results show that the proposed detector can tackle the imbalanced data problem and flexibly control FAR by adjusting penalty parameters. Moreover, improved detection probability is also achieved compared with existing methods

Use and assessment of remote sensing for the safety of maritime shipping

Αντικείμενο της εργασίας είναι η εφαρμογή της δορυφορικής τηλεπισκόπησης για τον υπολογισμό και την εκτίμηση φυσικών παραμέτρων συνδεόμενων με κινδύνους για τη ναυτιλία. Ειδικότερα, μέσω της χρήσης δορυφορικών εικόνων σε διάφορες φασματικές περιοχές, θα εξαχθούν οι κατάλληλες παράμετροι, ώστε να μελετηθεί η κίνηση των θαλασσίων ρευμάτων, η μεταβλητότητα στην παγοκάλυψη σε διαύλους ναυσιπλοΐας, ο εντοπισμός πετρελαιοκηλίδων και η παρουσία επικίνδυνων φορτίων. Στο πλαίσιο της εργασίας, θα διαμορφωθεί η εργαλειοθήκη που θα συμβάλει στην ασφάλεια της ναυσιπλοΐας και θα αξιολογηθεί η εφαρμοστικότητά της και η δυνατότητα επιχειρησιακής χρήσης, βάσει των διαθέσιμων δεδομένων και μελλοντικών δορυφορικών αποστολών.The scope of this work is the implementation of satellite remote sensing for the calculation and estimation of physical parameters associated with risk for maritime shipping. In particular, through the use of satellite imagery in different spectral regions and the exploitation of the advantages of passive and active remote sensing, the appropriate parameters will be extracted, in order to study the wind speed and direction, the variability of sea ice coverage in marine channels, oil spillages and the presence of dangerous cargoes. As part of the work, Sentinel Application Platform (SNAP) and QGIS will be configured, which based on satellites observations, will contribute to marine navigation. Finally, the thesis will evaluate the applicability of the toolbox to business function depending on the available satellite data and the future satellite missions

Sea-Surface Object Detection Based on Electro-Optical Sensors: A Review

Sea-surface object detection is critical for navigation safety of autonomous ships. Electrooptical (EO) sensors, such as video cameras, complement radar on board in detecting small obstacle sea-surface objects. Traditionally, researchers have used horizon detection, background subtraction, and foreground segmentation techniques to detect sea-surface objects. Recently, deep learning-based object detection technologies have been gradually applied to sea-surface object detection. This article demonstrates a comprehensive overview of sea-surface object-detection approaches where the advantages and drawbacks of each technique are compared, covering four essential aspects: EO sensors and image types, traditional object-detection methods, deep learning methods, and maritime datasets collection. In particular, sea-surface object detections based on deep learning methods are thoroughly analyzed and compared with highly influential public datasets introduced as benchmarks to verify the effectiveness of these approaches. The arti