902 research outputs found
Multiple Autonomous Systems in Underwater Mine Countermeasures Mission Using Various Information Fusion as Navigation Aid
Autonomous bottom mine neutralization systems have a challenging task of mine reacquisition and navigation in the demanding underwater environment. Even after mine reacquisition, the neutralization payload has to be autonomously deployed near the mine, and before any action the verification (classification) of the existence of a mine has to be determined. The mine intervention vehicle can be an expendable (self-destroyed during the mine neutralization) or a vehicle that deploys the neutralization payload and it is retrieved at the end of the mission. Currently the systems developed by the research community are capable of remotely navigating a mine intervention underwater vehicle in the vicinity of the mine by using remote sonar aided navigation from a master vehicle. However, the task of successfully navigating the vehicle that carries the neutralization payload near the bottom and around the mine remains a challenge due to sea bottom clutter and the target signature interfering with the sonar detection. We seek a solution by introducing navigation via visual processing near the mine location. Using an onboard camera the relative distance to the mine-like object can be estimated. This will improve the overall vehicle navigation and rate of successful payload delivery close to the mine. The paper will present the current navigation system of the mine intervention underwater vehicle and the newly developed visual processing for relative position estimation
Underwater localization using imaging sonars in 3D environments
This work proposes a localization method using a mechanically scanned imaging sonar (MSIS), which stands out by its low cost and weight. The proposed method implements a Particle Filter, a Bayesian Estimator, and introduces a measurement model based on sonar simulation theory. To the best of author’s knowledge, there is no similar approach in the literature, as sonar simulation current methods target in syntethic data generation, mostly for object recognition . This stands as the major contribution of the thesis as allows the introduction of the computation of intensity values provided by imaging sonars, while maitaining compability with the already used methods, such as range extraction. Simulations shows the efficiency of the method as well its viability to the utilization of imaging sonar in underwater localization. The new approach make possible, under certain constraints, the extraction of 3D information from a sensor considered, in the literature, as 2D and also in situations where there is no reference at the same horizontal plane of the sensor transducer scanning axis. The localization in complex 3D environment is also an advantage provided by the proposed method.Este trabalho propõe um método de localização utilizando um sonar do tipo MSIS (Mechanically Scanned Imaging Sonar ), o qual se destaca por seu baixo custo e peso. O método implementa um filtro de partículas, um estimador Bayesiano, e introduz um modelo de medição baseado na teoria de simulação de sonares. No conhecimento do autor não há uma abordagem similar na literatura, uma vez que os métodos atuais de simulação de sonar visam a geração de dados sintéticos para o reconhecimento de objetos. Esta é a maior contribuição da tese pois permite a a computação dos valores de intensidade fornecidos pelos sonares do tipo imaging e ao mesmo tempo é compatível com os métodos já utilizados, como extração de distância. Simulações mostram o bom desempenho do método, assim como sua viabilidade para o uso de imaging sonars na localização submarina. A nova abordagem tornou possível, sob certas restrições, a extração de informações 3D de um sensor considerado, na literatura, como somente 2D e também em situações em que não há nehnuma referência no mesmo plano horizontal do eixo de escaneamento do transdutor. A localização em ambientes 3D complexos é também uma vantagem proporcionada pelo método proposto
SENSOR PERFORMANCE ANALYSIS FOR MINE DETECTION WITH UNMANNED VEHICLES IN VERY SHALLOW WATER AND SURF ZONES
The very shallow water and surf zones present extraordinary challenges for classifying submerged objects such as mines or shoals. Accessing these areas with traditional unmanned underwater vehicles is difficult, and remotely operated vehicles often require putting operators in harm’s way. This research explores the potential to perform object classification using only forward-looking sonar in the desired operating zones. Experiments were conducted in a controlled environment for two different target objects, a glass sphere and a rectangular cinder block. Next, forward-looking sonar images were analyzed to determine how the intensity and distribution of target returns changed as a function of distance and angle from the sonar. The ability to correlate experimentally measured intensity profiles with a target’s physical size and shape is examined. Finally, recommendations for future research are proposed to further develop this approach for potential naval applications like mine countermeasures.NECC, Virginia Beach, VA, 23459Lieutenant, United States NavyApproved for public release. Distribution is unlimited
I-AUV Docking and Panel Intervention at Sea
The use of commercially available autonomous underwater vehicles (AUVs) has increased during the last fifteen years. While they are mainly used for routine survey missions, there is a set of applications that nowadays can be only addressed by manned submersibles or work-class remotely operated vehicles (ROVs) equipped with teleoperated arms: the intervention applications. To allow these heavy vehicles controlled by human operators to perform intervention tasks, underwater structures like observatory facilities, subsea panels or oil-well Christmas trees have been adapted, making them more robust and easier to operate. The TRITON Spanish founded project proposes the use of a light-weight intervention AUV (I-AUV) to carry out intervention applications simplifying the adaptation of these underwater structures and drastically reducing the operational cost. To prove this concept, the Girona 500 I-AUV is used to autonomously dock into an adapted subsea panel and once docked perform an intervention composed of turning a valve and plugging in/unplugging a connector. The techniques used for the autonomous docking and manipulation as well as the design of an adapted subsea panel with a funnel-based docking system are presented in this article together with the results achieved in a water tank and at sea.This work was supported by the Spanish project DPI2014-57746-C3 (MERBOTS Project) and
by Generalitat Valenciana under Grant GVA-PROMETEO/2016/066. The University of Girona wants to thank the
SARTI group for their collaboration with the TRITON project
3D reconstruction and motion estimation using forward looking sonar
Autonomous Underwater Vehicles (AUVs) are increasingly used in different domains
including archaeology, oil and gas industry, coral reef monitoring, harbour’s security,
and mine countermeasure missions. As electromagnetic signals do not penetrate
underwater environment, GPS signals cannot be used for AUV navigation, and optical
cameras have very short range underwater which limits their use in most underwater
environments.
Motion estimation for AUVs is a critical requirement for successful vehicle recovery
and meaningful data collection. Classical inertial sensors, usually used for AUV motion
estimation, suffer from large drift error. On the other hand, accurate inertial sensors are
very expensive which limits their deployment to costly AUVs. Furthermore, acoustic
positioning systems (APS) used for AUV navigation require costly installation and
calibration. Moreover, they have poor performance in terms of the inferred resolution.
Underwater 3D imaging is another challenge in AUV industry as 3D information is
increasingly demanded to accomplish different AUV missions. Different systems have
been proposed for underwater 3D imaging, such as planar-array sonar and T-configured
3D sonar. While the former features good resolution in general, it is very expensive and
requires huge computational power, the later is cheaper implementation but requires
long time for full 3D scan even in short ranges.
In this thesis, we aim to tackle AUV motion estimation and underwater 3D imaging by
proposing relatively affordable methodologies and study different parameters affecting
their performance. We introduce a new motion estimation framework for AUVs which
relies on the successive acoustic images to infer AUV ego-motion. Also, we propose an
Acoustic Stereo Imaging (ASI) system for underwater 3D reconstruction based on
forward looking sonars; the proposed system features cheaper implementation than
planar array sonars and solves the delay problem in T configured 3D sonars
Sonar image interpretation for sub-sea operations
Mine Counter-Measure (MCM) missions are conducted to neutralise underwater
explosives. Automatic Target Recognition (ATR) assists operators by
increasing the speed and accuracy of data review. ATR embedded on vehicles
enables adaptive missions which increase the speed of data acquisition. This
thesis addresses three challenges; the speed of data processing, robustness of
ATR to environmental conditions and the large quantities of data required to
train an algorithm.
The main contribution of this thesis is a novel ATR algorithm. The algorithm
uses features derived from the projection of 3D boxes to produce a set of 2D
templates. The template responses are independent of grazing angle, range
and target orientation. Integer skewed integral images, are derived to accelerate
the calculation of the template responses. The algorithm is compared
to the Haar cascade algorithm. For a single model of sonar and cylindrical
targets the algorithm reduces the Probability of False Alarm (PFA) by 80%
at a Probability of Detection (PD) of 85%. The algorithm is trained on target
data from another model of sonar. The PD is only 6% lower even though no
representative target data was used for training.
The second major contribution is an adaptive ATR algorithm that uses local
sea-floor characteristics to address the problem of ATR robustness with
respect to the local environment. A dual-tree wavelet decomposition of the
sea-floor and an Markov Random Field (MRF) based graph-cut algorithm is
used to segment the terrain. A Neural Network (NN) is then trained to filter
ATR results based on the local sea-floor context. It is shown, for the Haar
Cascade algorithm, that the PFA can be reduced by 70% at a PD of 85%.
Speed of data processing is addressed using novel pre-processing techniques.
The standard three class MRF, for sonar image segmentation, is formulated
using graph-cuts. Consequently, a 1.2 million pixel image is segmented in
1.2 seconds. Additionally, local estimation of class models is introduced to
remove range dependent segmentation quality. Finally, an A* graph search
is developed to remove the surface return, a line of saturated pixels often
detected as false alarms by ATR. The A* search identifies the surface return
in 199 of 220 images tested with a runtime of 2.1 seconds. The algorithm is
robust to the presence of ripples and rocks
Underwater mapping using a SONAR
Este estudo explora a capacidade física do raio de um sonar mecânico para construir um mapa do ambiente envolvente e encontrar a localização do veículo nesse mesmo mapa. Os dados do sonar alimentam um extrator de pontos de interesse e um algoritmo SLAM. Esse algoritmo é composto por uma implementação de Octomaps, junto com um filtro de partículas. Vários testes foram executados dentro de um ambiente estruturado e os resultados desses testes são demonstrados neste estudo.This study explores the physical capabilities of the beam of a mechanical scanning imaging sonar to build a map of the surrounding environment and to find the location of the vehicle within the map. The data from the sonar feed into a feature extractor and a SLAM algorithm. The SLAM algorithm is composed of an Octomaps implementation together with a particle filter. Several tests were ran within a structured environment and the map of the structured environment as well as the location of the vehicle are presented
Pre-trained Models for Sonar Images
Machine learning and neural networks are now ubiquitous in sonar perception, but it lags behind the computer vision field due to the lack of data and pre-trained models specifically for sonar images. In this paper we present the Marine Debris Turntable dataset and produce pre-trained neural networks trained on this dataset, meant to fill the gap of missing pre-trained models for sonar images. We train Resnet 20, MobileNets, DenseNet121, SqueezeNet, MiniXception, and an Autoencoder, over several input image sizes, from 32 x 32 to 96 x 96, on the Marine Debris turntable dataset. We evaluate these models using transfer learning for low-shot classification in the Marine Debris Watertank and another dataset captured using a Gemini 720i sonar. Our results show that in both datasets the pre-trained models produce good features that allow good classification accuracy with low samples (10-30 samples per class). The Gemini dataset validates that the features transfer to other kinds of sonar sensors. We expect that the community benefits from the public release of our pre-trained models and the turntable dataset
Automatic target recognition in sonar imagery using a cascade of boosted classifiers
This thesis is concerned with the problem of automating the interpretation of data representing
the underwater environment retrieved from sensors. This is an important task
which potentially allows underwater robots to become completely autonomous, keeping
humans out of harm’s way and reducing the operational time and cost of many
underwater applications. Typical applications include unexploded ordnance clearance,
ship/plane wreck hunting (e.g. Malaysia Airlines flight MH370), and oilfield inspection
(e.g. Deepwater Horizon disaster).
Two attributes of the processing are crucial if automated interpretation is to be successful.
First, computational efficiency is required to allow real-time analysis to be
performed on-board robots with limited resources. Second, detection accuracy comparable
to human experts is required in order to replace them. Approaches in the open
literature do not appear capable of achieving these requirements and this therefore has
become the objective of this thesis.
This thesis proposes a novel approach capable of recognizing targets in sonar data
extremely rapidly with a low number of false alarms. The approach was originally
developed for face detection in video, and it is applied to sonar data here for the first
time. Aside from the application, the main contribution of this thesis, therefore, is in
the way this approach is extended to reduce its training time and improve its detection
accuracy.
Results obtained on large sets of real sonar data on a variety of challenging terrains
are presented to show the discriminative power of the proposed approach. In real field
trials, the proposed approach was capable of processing sonar data real-time on-board
underwater robots. In direct comparison with human experts, the proposed approach
offers 40% reduction in the number of false alarms
A COLLISION AVOIDANCE SYSTEM FOR AUTONOMOUS UNDERWATER VEHICLES
The work in this thesis is concerned with the development of a novel and practical collision
avoidance system for autonomous underwater vehicles (AUVs). Synergistically,
advanced stochastic motion planning methods, dynamics quantisation approaches,
multivariable tracking controller designs, sonar data processing and workspace representation,
are combined to enhance significantly the survivability of modern AUVs.
The recent proliferation of autonomous AUV deployments for various missions such
as seafloor surveying, scientific data gathering and mine hunting has demanded a substantial
increase in vehicle autonomy. One matching requirement of such missions is
to allow all the AUV to navigate safely in a dynamic and unstructured environment.
Therefore, it is vital that a robust and effective collision avoidance system should be
forthcoming in order to preserve the structural integrity of the vehicle whilst simultaneously
increasing its autonomy.
This thesis not only provides a holistic framework but also an arsenal of computational
techniques in the design of a collision avoidance system for AUVs. The
design of an obstacle avoidance system is first addressed. The core paradigm is the
application of the Rapidly-exploring Random Tree (RRT) algorithm and the newly
developed version for use as a motion planning tool. Later, this technique is merged
with the Manoeuvre Automaton (MA) representation to address the inherent disadvantages
of the RRT. A novel multi-node version which can also address time varying
final state is suggested. Clearly, the reference trajectory generated by the aforementioned
embedded planner must be tracked. Hence, the feasibility of employing the
linear quadratic regulator (LQG) and the nonlinear kinematic based state-dependent
Ricatti equation (SDRE) controller as trajectory trackers are explored.
The obstacle detection module, which comprises of sonar processing and workspace
representation submodules, is developed and tested on actual sonar data acquired
in a sea-trial via a prototype forward looking sonar (AT500). The sonar processing
techniques applied are fundamentally derived from the image processing perspective.
Likewise, a novel occupancy grid using nonlinear function is proposed for the
workspace representation of the AUV. Results are presented that demonstrate the
ability of an AUV to navigate a complex environment.
To the author's knowledge, it is the first time the above newly developed methodologies
have been applied to an A UV collision avoidance system, and, therefore, it is
considered that the work constitutes a contribution of knowledge in this area of work.J&S MARINE LT
- …