A comparative study of operational vessel detectors for maritime surveillance using satellite-borne synthetic aperture radar

This paper presents a comparative study among four operational detectors that work by automatically post-processing synthetic aperture radar (SAR) images acquired from the satellite platforms RADARSAT-2 and COSMO-SkyMed. Challenging maritime scenarios have been chosen to assess the detectors' performance against features such as ambiguities, significant sea clutter, or irregular shorelines. The SAR images which form the test data are complemented with ground truth to define the reference detection configuration, which permits quantifying the probability of detection, the false alarm rate, and the accuracy of estimating ship dimensions. Although the results show that all the detectors perform well, there is no perfect detector, and a better detection system could be developed that combines the best elements from each of the single detectors. In addition to the comparison exercise, the study has facilitated the improvement of the detectors by highlighting weaknesses and providing means for fixing them.Peer ReviewedPostprint (published version

Maritime vessel classification to monitor fisheries with SAR: demonstration in the North Sea

Integration of methods based on satellite remote sensing into current maritime monitoring strategies could help tackle the problem of global overfishing. Operational software is now available to perform vessel detection on satellite imagery, but research on vessel classification has mainly focused on bulk carriers, container ships, and oil tankers, using high-resolution commercial Synthetic Aperture Radar (SAR) imagery. Here, we present a method based on Random Forest (RF) to distinguish fishing and non-fishing vessels, and apply it to an area in the North Sea. The RF classifier takes as input the vessel’s length, longitude, and latitude, its distance to the nearest shore, and the time of the measurement (am or pm). The classifier is trained and tested on data from the Automatic Identification System (AIS). The overall classification accuracy is 91%, but the precision for the fishing class is only 58% because of specific regions in the study area where activities of fishing and non-fishing vessels overlap. We then apply the classifier to a collection of vessel detections obtained by applying the Search for Unidentified Maritime Objects (SUMO) vessel detector to the 2017 Sentinel-1 SAR images of the North Sea. The trend in our monthly fishing-vessel count agrees with data from Global Fishing Watch on fishing-vessel presence. These initial results suggest that our approach could help monitor intensification or reduction of fishing activity, which is critical in the context of the global overfishing problem

Computational Techniques of Oil Spill Detection in Synthetic Aperture Radar Data: Review Cases

In this chapter, a major role of environmental assessment is an oil spill identifies or detected from the coastal region surfaces or marine surroundings. Normally, the oil spills on the coastal regions impact their characteristics of environmental activities. However, these activities are monitoring through several radar satellites and sensor. For those achievable activities detecting or identifying, many researchers developed several approaches. Particularly, this chapter discusses about the detection of oil spill current operational effects on coastal region surfaces. In addition, the current research operations of oil spill characterizations and quality of its impacts, effects of current environmental bio-systems, their control measurement strategies, and its surveillance operations are discussed. Finally, the oil spill detection is done through the SAR image region classification based on its feature extraction. This could be monitored from the image dark region selection through remote sensing techniques

Advanced techniques for classification of polarimetric synthetic aperture radar data

With various remote sensing technologies to aid Earth Observation, radar-based imaging is one of them gaining major interests due to advances in its imaging techniques in form of syn-thetic aperture radar (SAR) and polarimetry. The majority of radar applications focus on mon-itoring, detecting, and classifying local or global areas of interests to support humans within their efforts of decision-making, analysis, and interpretation of Earth’s environment. This thesis focuses on improving the classification performance and process particularly concerning the application of land use and land cover over polarimetric SAR (PolSAR) data. To achieve this, three contributions are studied related to superior feature description and ad-vanced machine-learning techniques including classifiers, principles, and data exploitation. First, this thesis investigates the application of color features within PolSAR image classi-fication to provide additional discrimination on top of the conventional scattering information and texture features. The color features are extracted over the visual presentation of fully and partially polarimetric SAR data by generation of pseudo color images. Within the experiments, the obtained results demonstrated that with the addition of the considered color features, the achieved classification performances outperformed results with common PolSAR features alone as well as achieved higher classification accuracies compared to the traditional combination of PolSAR and texture features. Second, to address the large-scale learning challenge in PolSAR image classification with the utmost efficiency, this thesis introduces the application of an adaptive and data-driven supervised classification topology called Collective Network of Binary Classifiers, CNBC. This topology incorporates active learning to support human users with the analysis and interpretation of PolSAR data focusing on collections of images, where changes or updates to the existing classifier might be required frequently due to surface, terrain, and object changes as well as certain variations in capturing time and position. Evaluations demonstrated the capabilities of CNBC over an extensive set of experimental results regarding the adaptation and data-driven classification of single as well as collections of PolSAR images. The experimental results verified that the evolutionary classification topology, CNBC, did provide an efficient solution for the problems of scalability and dynamic adaptability allowing both feature space dimensions and the number of terrain classes in PolSAR image collections to vary dynamically. Third, most PolSAR classification problems are undertaken by supervised machine learn-ing, which require manually labeled ground truth data available. To reduce the manual labeling efforts, supervised and unsupervised learning approaches are combined into semi-supervised learning to utilize the huge amount of unlabeled data. The application of semi-supervised learning in this thesis is motivated by ill-posed classification tasks related to the small training size problem. Therefore, this thesis investigates how much ground truth is actually necessary for certain classification problems to achieve satisfactory results in a supervised and semi-supervised learning scenario. To address this, two semi-supervised approaches are proposed by unsupervised extension of the training data and ensemble-based self-training. The evaluations showed that significant speed-ups and improvements in classification performance are achieved. In particular, for a remote sensing application such as PolSAR image classification, it is advantageous to exploit the location-based information from the labeled training data. Each of the developed techniques provides its stand-alone contribution from different viewpoints to improve land use and land cover classification. The introduction of a new fea-ture for better discrimination is independent of the underlying classification algorithms used. The application of the CNBC topology is applicable to various classification problems no matter how the underlying data have been acquired, for example in case of remote sensing data. Moreover, the semi-supervised learning approach tackles the challenge of utilizing the unlabeled data. By combining these techniques for superior feature description and advanced machine-learning techniques exploiting classifier topologies and data, further contributions to polarimetric SAR image classification are made. According to the performance evaluations conducted including visual and numerical assessments, the proposed and investigated tech-niques showed valuable improvements and are able to aid the analysis and interpretation of PolSAR image data. Due to the generic nature of the developed techniques, their applications to other remote sensing data will require only minor adjustments

SAR Ship Target Recognition via Selective Feature Discrimination and Multifeature Center Classifier

Maritime surveillance is not only necessary for every country, such as in maritime safeguarding and fishing controls, but also plays an essential role in international fields, such as in rescue support and illegal immigration control. Most of the existing automatic target recognition (ATR) methods directly send the extracted whole features of SAR ships into one classifier. The classifiers of most methods only assign one feature center to each class. However, the characteristics of SAR ship images, large inner-class variance, and small interclass difference lead to the whole features containing useless partial features and a single feature center for each class in the classifier failing with large inner-class variance. We proposes a SAR ship target recognition method via selective feature discrimination and multifeature center classifier. The selective feature discrimination automatically finds the similar partial features from the most similar interclass image pairs and the dissimilar partial features from the most dissimilar inner-class image pairs. It then provides a loss to enhance these partial features with more interclass separability. Motivated by divide and conquer, the multifeature center classifier assigns multiple learnable feature centers for each ship class. In this way, the multifeature centers divide the large inner-class variance into several smaller variances and conquered by combining all feature centers of one ship class. Finally, the probability distribution over all feature centers is considered comprehensively to achieve an accurate recognition of SAR ship images. The ablation experiments and experimental results on OpenSARShip and FUSAR-Ship datasets show that our method has achieved superior recognition performance under decreasing training SAR ship samples

A Human-Centered Framework for the Understanding of Synthetic Aperture Radar Images

The limited usage of SAR data in the end-user community and in applicative contexts testified the failure of the recent literature, in which the research privileged the automatic extraction of information at the expense of users' experience with data. The development of new products and processing frameworks providing user-friendly representations and extraction of the physical information is a necessary condition for the full exploitation of SAR sensors. In this Book, the necessity to restore users’ centrality in remote sensing data analysis is analyzed and achieved through the introduction of two new classes of RGB SAR products obtained via multitemporal processing, whose principal characteristics are the ease of interpretation and the possibility to be processed with simple, end-user-oriented technique. These proposed approach aims to definitely fill the gap between the academy and the applications. The rationale is to provide ready-to-use images, in which the technical expertise with electromagnetic models, SAR imaging and image processing has been absorbed in the products formation phase. In such way, the idea that SAR images are too complicated to be interpreted and processed without a high technical expertise in order to extract physical information is overcame

Earth Observation in the EMMENA Region: Scoping Review of Current Applications and Knowledge Gaps

Earth observation (EO) techniques have significantly evolved over time, covering a wide range of applications in different domains. The scope of this study is to review the research conducted on EO in the Eastern Mediterranean, Middle East, and North Africa (EMMENA) region and to identify the main knowledge gaps. We searched through the Web of Science database for papers published between 2018 and 2022 for EO studies in the EMMENA. We categorized the papers in the following thematic areas: atmosphere, water, agriculture, land, disaster risk reduction (DRR), cultural heritage, energy, marine safety and security (MSS), and big Earth data (BED); 6647 papers were found with the highest number of publications in the thematic areas of BED (27%) and land (22%). Most of the EMMENA countries are surrounded by sea, yet there was a very small number of studies on MSS (0.9% of total number of papers). This study detected a gap in fundamental research in the BED thematic area. Other future needs identified by this study are the limited availability of very high-resolution and near-real-time remote sensing data, the lack of harmonized methodologies and the need for further development of models, algorithms, early warning systems, and services