Automatic target recognition in sonar imagery using a cascade of boosted classifiers

This thesis is concerned with the problem of automating the interpretation of data representing the underwater environment retrieved from sensors. This is an important task which potentially allows underwater robots to become completely autonomous, keeping humans out of harm’s way and reducing the operational time and cost of many underwater applications. Typical applications include unexploded ordnance clearance, ship/plane wreck hunting (e.g. Malaysia Airlines flight MH370), and oilfield inspection (e.g. Deepwater Horizon disaster). Two attributes of the processing are crucial if automated interpretation is to be successful. First, computational efficiency is required to allow real-time analysis to be performed on-board robots with limited resources. Second, detection accuracy comparable to human experts is required in order to replace them. Approaches in the open literature do not appear capable of achieving these requirements and this therefore has become the objective of this thesis. This thesis proposes a novel approach capable of recognizing targets in sonar data extremely rapidly with a low number of false alarms. The approach was originally developed for face detection in video, and it is applied to sonar data here for the first time. Aside from the application, the main contribution of this thesis, therefore, is in the way this approach is extended to reduce its training time and improve its detection accuracy. Results obtained on large sets of real sonar data on a variety of challenging terrains are presented to show the discriminative power of the proposed approach. In real field trials, the proposed approach was capable of processing sonar data real-time on-board underwater robots. In direct comparison with human experts, the proposed approach offers 40% reduction in the number of false alarms

From Statistical Detection to Decision Fusion: Detection of Underwater Mines in High Resolution SAS Images

ISBN 978-3-902613-48-6Many approaches have been proposed in underwater mine detection and classification using sonar images. The goal is to evaluate a confidence that a pixel belongs to a sought object or to the seabed. In the following, considering the object characteristics (size, reflectivity), we will always assume that the detected objects are actual mines. We propose a detection method structured as a data fusion system. This type of architecture is a smart and adaptive structure: the addition or removal of parameters is easily taken into account, without any modification of the global structure. The inputs of the proposed system are the parameters extracted from an SAS image (statistical in our case). The outputs of the system are the areas detected as potentially including an object

Survey on deep learning based computer vision for sonar imagery

Research on the automatic analysis of sonar images has focused on classical, i.e. non deep learning based, approaches for a long time. Over the past 15 years, however, the application of deep learning in this research field has constantly grown. This paper gives a broad overview of past and current research involving deep learning for feature extraction, classification, detection and segmentation of sidescan and synthetic aperture sonar imagery. Most research in this field has been directed towards the investigation of convolutional neural networks (CNN) for feature extraction and classification tasks, with the result that even small CNNs with up to four layers outperform conventional methods. The purpose of this work is twofold. On one hand, due to the quick development of deep learning it serves as an introduction for researchers, either just starting their work in this specific field or working on classical methods for the past years, and helps them to learn about the recent achievements. On the other hand, our main goal is to guide further research in this field by identifying main research gaps to bridge. We propose to leverage the research in this field by combining available data into an open source dataset as well as carrying out comparative studies on developed deep learning methods.Article number 10515711

Experimental evaluation of segmentation algorithms for corner detection in sonar images

The development of AUVs represents one of the latest great achievements of engineering and science for the exploration and monitoring of the underwater world. The use of these vehicles facilitates the collection of data and monitoring of these environments, allowing us to perform previously impossible operations. Autonomous navigation continues to present many challenges. The question of total autonomy is yet to be solved. Currently, AUVs are not able to navigate without some outside assistance for long periods.When underwater, due to the high attenuation suffered by the GPS and radio-frequency signals, the use of acoustic communications and sensors offers better results.Imaging sonars have been one of the most appealing technologies for acquiring information in underwater environments because they can yield acoustic images of the surroundings and have a set of particular characteristics that are well suited for obstacle detection and characterization tasks.Corners usually appear very distinct from the rest of the scene in sonar images, generally characterized by sharp intensities in a vertical direction. The detection of corners is particularly useful in human-structured environments such as tanks because the knowledge on their position provides a way to compute the vehicle position inside it. The combination of some basic operations typically used for image segmentation can be applied to the raw sonar image to detect and localize these spots.This dissertation proposes and evaluates with experimental data a set of image segmentation algorithms for corner detection in sonar scans. A detailed description of the necessary steps to accomplish this is provided as well as a critical analysis of the results following a few relevant metrics for autonomous navigation

Algorithms and Data Structures for Automated Change Detection and Classification of Sidescan Sonar Imagery

During Mine Warfare (MIW) operations, MIW analysts perform change detection by visually comparing historical sidescan sonar imagery (SSI) collected by a sidescan sonar with recently collected SSI in an attempt to identify objects (which might be explosive mines) placed at sea since the last time the area was surveyed. This dissertation presents a data structure and three algorithms, developed by the author, that are part of an automated change detection and classification (ACDC) system. MIW analysts at the Naval Oceanographic Office, to reduce the amount of time to perform change detection, are currently using ACDC. The dissertation introductory chapter gives background information on change detection, ACDC, and describes how SSI is produced from raw sonar data. Chapter 2 presents the author\u27s Geospatial Bitmap (GB) data structure, which is capable of storing information geographically and is utilized by the three algorithms. This chapter shows that a GB data structure used in a polygon-smoothing algorithm ran between 1.3 – 48.4x faster than a sparse matrix data structure. Chapter 3 describes the GB clustering algorithm, which is the author\u27s repeatable, order-independent method for clustering. Results from tests performed in this chapter show that the time to cluster a set of points is not affected by the distribution or the order of the points. In Chapter 4, the author presents his real-time computer-aided detection (CAD) algorithm that automatically detects mine-like objects on the seafloor in SSI. The author ran his GB-based CAD algorithm on real SSI data, and results of these tests indicate that his real-time CAD algorithm performs comparably to or better than other non-real-time CAD algorithms. The author presents his computer-aided search (CAS) algorithm in Chapter 5. CAS helps MIW analysts locate mine-like features that are geospatially close to previously detected features. A comparison between the CAS and a great circle distance algorithm shows that the CAS performs geospatial searching 1.75x faster on large data sets. Finally, the concluding chapter of this dissertation gives important details on how the completed ACDC system will function, and discusses the author\u27s future research to develop additional algorithms and data structures for ACDC