A Novel Localization System for Experimental Autonomous Underwater Vehicles

Localization is a classic and complex problem in the field of mobile robotics. It becomes particularly challenging in an aqueous environment because currents within the water can move the robot. A novel localization module and corresponding localization algorithm for experimental autonomous underwater vehicles is presented. Unlike other available positioning systems which require fixed hardware beacons, this custom built module relies only on information available from sensors on-board the vehicle and knowledge of its bounded domain. This allows the user to save valuable time which would otherwise be devoted to the setup and calibration of a beacon or sensor network. The module uses three orthogonal ultrasonic transducers to measure distances to the tank boundaries. Using the measured tri-axial orientation of the vehicle, the algorithm analytically determines the robot\u27s position within the domain in absolute coordinates. Certain vehicle states do not allow the position to be completely resolved by the algorithm alone. In this case, state estimation is used to estimate the robot position until its state is no longer indeterminate. The modular design of this system makes it ideal for application on underwater vehicles which operate in a bounded environment for research purposes. An experimental version of the module was constructed and tested in the WPI swimming pool and showed successful localization under normal conditions

Development of a fusion adaptive algorithm for marine debris detection within the post-Sandy restoration framework

Recognition of marine debris represent a difficult task due to the extreme variability of the marine environment, the possible targets, and the variable skill levels of human operators. The range of potential targets is much wider than similar fields of research such as mine hunting, localization of unexploded ordnance or pipeline detection. In order to address this additional complexity, an adaptive algorithm is being developing that appropriately responds to changes in the environment, and context. The preliminary step is to properly geometrically and radiometrically correct the collected data. Then, the core engine manages the fusion of a set of statistically- and physically-based algorithms, working at different levels (swath, beam, snippet, and pixel) and using both predictive modeling (that is, a high-frequency acoustic backscatter model) and phenomenological (e.g., digital image processing techniques) approaches. The expected outcome is the reduction of inter-algorithmic cross-correlation and, thus, the probability of false alarm. At this early stage, we provide a proof of concept showing outcomes from algorithms that dynamically adapt themselves to the depth and average backscatter level met in the surveyed environment, targeting marine debris (modeled as objects of about 1-m size). The project relies on a modular software library, called Matador (Marine Target Detection and Object Recognition)

Autonomous Lionfish Harvester

The Lionfish Major Qualifying Project Team has developed a harvesting mechanism for the purpose of hunting lionfish, with the intent of attaching it to an autonomous submarine robot. The harvester functions as an independent mechanism capable of sensing lionfish, determining their location, and harvesting them

Object classification in semi structured enviroment using forward-looking sonar

La exploración submarina utilizando robots ha ido en aumento en los últimos años. La automatización de tareas tales como monitoreo, inspección y mantenimiento bajo el agua requiere la comprensión del entorno del robot. El reconocimiento de objetos en la escena se está convirtiendo en un problema crítico para estos sistemas. En este trabajo, se estudia una tubería de clasificación de objetos bajo el agua aplicada en imágenes acústicas adquiridas por Forward-Looking Sonar (FLS). La segmentación de objetos combina el umbral, la búsqueda de píxeles conectados y las técnicas de análisis de picos de intensidad. El descriptor del objeto extrae la intensidad y las características geométricas de los objetos detectados. Se presenta una comparación entre los clasificadores Máquina de vectores de soporte, Vecinos más cercanos a K y Árboles aleatorios. Se desarrolló una herramienta de código abierto para anotar y clasificar los objetos y evaluar su rendimiento de clasificación. El método propuesto segmenta y clasifica eficientemente las estructuras en la escena utilizando un conjunto de datos real adquirido por un vehículo submarino en un área de puerto. Los resultados experimentales demuestran la solidez y precisión del método descrito en este documento.The submarine exploration using robots has been increasing in recent years. The automation of tasks such as monitoring, inspection, and underwater maintenance requires the understanding of the robot’s environment. The object recognition in the scene is becoming a critical issue for these systems. On this work, an underwater object classification pipeline applied in acoustic images acquired by Forward-Looking Sonar (FLS) are studied. The object segmentation combines thresholding, connected pixels searching and peak of intensity analyzing techniques. The object descriptor extract intensity and geometric features of the detected objects. A comparison between the Support Vector Machine, K-Nearest Neighbors, and Random Trees classifiers are presented. An open-source tool was developed to annotate and classify the objects and evaluate their classification performance. The proposed method efficiently segments and classifies the structures in the scene using a real dataset acquired by an underwater vehicle in a harbor area. Experimental results demonstrate the robustness and accuracy of the method described in this paper.• National Institute of Science and Technology - Integrated Oceanography and Multiple Uses of the Continental Shelf and Adjacent Ocean - Integrated Oceanography Center INCT-Mar COI funded by CNPq. Beca 610012/2011-8 • BS-NAVLOC (CAPES no 321/15, DGPU 7523 / 14-9, proyecto MEC PHBP14 / 00083)peerReviewe

Distributed Deep Learning in the Cloud and Energy-efficient Real-time Image Processing at the Edge for Fish Segmentation in Underwater Videos Segmentation in Underwater Videos

Using big marine data to train deep learning models is not efficient, or sometimes even possible, on local computers. In this paper, we show how distributed learning in the cloud can help more efficiently process big data and train more accurate deep learning models. In addition, marine big data is usually communicated over wired networks, which if possible to deploy in the first place, are costly to maintain. Therefore, wireless communications dominantly conducted by acoustic waves in underwater sensor networks, may be considered. However, wireless communication is not feasible for big marine data due to the narrow frequency bandwidth of acoustic waves and the ambient noise. To address this problem, we propose an optimized deep learning design for low-energy and real-time image processing at the underwater edge. This leads to trading the need to transmit the large image data, for transmitting only the low-volume results that can be sent over wireless sensor networks. To demonstrate the benefits of our approaches in a real-world application, we perform fish segmentation in underwater videos and draw comparisons against conventional techniques. We show that, when underwater captured images are processed at the collection edge, 4 times speedup can be achieved compared to using a landside server. Furthermore, we demonstrate that deploying a compressed DNN at the edge can save 60% of power compared to a full DNN model. These results promise improved applications of affordable deep learning in underwater exploration, monitoring, navigation, tracking, disaster prevention, and scientific data collection projects

Autonomous temporal pseudo-labeling for fish detection

The first major step in training an object detection model to different classes from the available datasets is the gathering of meaningful and properly annotated data. This recurring task will determine the length of any project, and, more importantly, the quality of the resulting models. This obstacle is amplified when the data available for the new classes are scarce or incompatible, as in the case of fish detection in the open sea. This issue was tackled using a mixed and reversed approach: a network is initiated with a noisy dataset of the same species as our classes (fish), although in different scenarios and conditions (fish from Australian marine fauna), and we gathered the target footage (fish from Portuguese marine fauna; Atlantic Ocean) for the application without annotations. Using the temporal information of the detected objects and augmented techniques during later training, it was possible to generate highly accurate labels from our targeted footage. Furthermore, the data selection method retained the samples of each unique situation, filtering repetitive data, which would bias the training process. The obtained results validate the proposed method of automating the labeling processing, resorting directly to the final application as the source of training data. The presented method achieved a mean average precision of 93.11% on our own data, and 73.61% on unseen data, an increase of 24.65% and 25.53% over the baseline of the noisy dataset, respectively.info:eu-repo/semantics/publishedVersio

Ecosystem Monitoring and Port Surveillance Systems

International audienceIn this project, we should build up a novel system able to perform a sustainable and long term monitoring coastal marine ecosystems and enhance port surveillance capability. The outcomes will be based on the analysis, classification and the fusion of a variety of heterogeneous data collected using different sensors (hydrophones, sonars, various camera types, etc). This manuscript introduces the identified approaches and the system structure. In addition, it focuses on developed techniques and concepts to deal with several problems related to our project. The new system will address the shortcomings of traditional approaches based on measuring environmental parameters which are expensive and fail to provide adequate large-scale monitoring. More efficient monitoring will also enable improved analysis of climate change, and provide knowledge informing the civil authority's economic relationship with its coastal marine ecosystems