Tracking the Fine Scale Movements of Fish using Autonomous Maritime Robotics: A Systematic State of the Art Review

This paper provides a systematic state of the art review on tracking the fine scale movements of fish with the use of autonomous maritime robotics. Knowledge of migration patterns and the localization of specific species of fish at a given time is vital to many aspects of conservation. This paper reviews these technologies and provides insight into what systems are being used and why. The review results show that a larger amount of complex systems that use a deep learning techniques are used over more simplistic approaches to the design. Most results found in the study involve Autonomous Underwater Vehicles, which generally require the most complex array of sensors. The results also provide insight into future research such as methods involving swarm intelligence, which has seen an increase in use in recent years. This synthesis of current and future research will be helpful to research teams working to create an autonomous vehicle with intentions to track, navigate or survey

Targeted sampling by autonomous underwater vehicles

© The Author(s), 2019. This article is distributed under the terms of the Creative Commons Attribution License. The definitive version was published in Zhang, Y., Ryan, J. P., Kieft, B., Hobson, B. W., McEwen, R. S., Godin, M. A., Harvey, J. B., Barone, B., Bellingham, J. G., Birch, J. M., Scholin, C. A., & Chavez, F. P. Targeted sampling by autonomous underwater vehicles. Frontiers in Marine Science, 6 (2019): 415, doi:10.3389/fmars.2019.00415.In the vast ocean, many ecologically important phenomena are temporally episodic, localized in space, and move according to local currents. To effectively study these complex and evolving phenomena, methods that enable autonomous platforms to detect and respond to targeted phenomena are required. Such capabilities allow for directed sensing and water sample acquisition in the most relevant and informative locations, as compared against static grid surveys. To meet this need, we have designed algorithms for autonomous underwater vehicles that detect oceanic features in real time and direct vehicle and sampling behaviors as dictated by research objectives. These methods have successfully been applied in a series of field programs to study a range of phenomena such as harmful algal blooms, coastal upwelling fronts, and microbial processes in open-ocean eddies. In this review we highlight these applications and discuss future directions.This work was supported by the David and Lucile Packard Foundation. The 2015 experiment in Monterey Bay was partially supported by NOAA Ecology and Oceanography of Harmful Algal Blooms (ECOHAB) Grant NA11NOS4780030. The 2018 SCOPE Hawaiian Eddy Experiment was partially supported by the National Science Foundation (OCE-0962032 and OCE-1337601), Simons Foundation Grant #329108, the Gordon and Betty Moore Foundation (Grant #3777, #3794, and #2728), and the Schmidt Ocean Institute for R/V Falkor Cruise FK180310. Publication of this paper was funded by the Schmidt Ocean Institute

Adaptive sampling in autonomous marine sensor networks

Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at the Massachusetts Institute of Technology and the Woods Hole Oceanographic Institution June 2006In this thesis, an innovative architecture for real-time adaptive and cooperative control of autonomous sensor platforms in a marine sensor network is described in the context of the autonomous oceanographic network scenario. This architecture has three major components, an intelligent, logical sensor that provides high-level environmental state information to a behavior-based autonomous vehicle control system, a new approach to behavior-based control of autonomous vehicles using multiple objective functions that allows reactive control in complex environments with multiple constraints, and an approach to cooperative robotics that is a hybrid between the swarm cooperation and intentional cooperation approaches. The mobility of the sensor platforms is a key advantage of this strategy, allowing dynamic optimization of the sensor locations with respect to the classification or localization of a process of interest including processes which can be time varying, not spatially isotropic and for which action is required in real-time. Experimental results are presented for a 2-D target tracking application in which fully autonomous surface craft using simulated bearing sensors acquire and track a moving target in open water. In the first example, a single sensor vehicle adaptively tracks a target while simultaneously relaying the estimated track to a second vehicle acting as a classification platform. In the second example, two spatially distributed sensor vehicles adaptively track a moving target by fusing their sensor information to form a single target track estimate. In both cases the goal is to adapt the platform motion to minimize the uncertainty of the target track parameter estimates. The link between the sensor platform motion and the target track estimate uncertainty is fully derived and this information is used to develop the behaviors for the sensor platform control system. The experimental results clearly illustrate the significant processing gain that spatially distributed sensors can achieve over a single sensor when observing a dynamic phenomenon as well as the viability of behavior-based control for dealing with uncertainty in complex situations in marine sensor networks.Supported by the Office of Naval Research, with a 3-year National Defense Science and Engineering Grant Fellowship and research assistantships through the Generic Ocean Array Technology Sonar (GOATS) project, contract N00014-97-1-0202 and contract N00014-05-G-0106 Delivery Order 008, PLUSNET: Persistent Littoral Undersea Surveillance Network

Algorithms for propagation-aware underwater ranging and localization

Mención Internacional en el título de doctorWhile oceans occupy most of our planet, their exploration and conservation are one of the crucial research problems of modern time. Underwater localization stands among the key issues on the way to the proper inspection and monitoring of this significant part of our world. In this thesis, we investigate and tackle different challenges related to underwater ranging and localization. In particular, we focus on algorithms that consider underwater acoustic channel properties. This group of algorithms utilizes additional information about the environment and its impact on acoustic signal propagation, in order to improve the accuracy of location estimates, or to achieve a reduced complexity, or a reduced amount of resources (e.g., anchor nodes) compared to traditional algorithms. First, we tackle the problem of passive range estimation using the differences in the times of arrival of multipath replicas of a transmitted acoustic signal. This is a costand energy- effective algorithm that can be used for the localization of autonomous underwater vehicles (AUVs), and utilizes information about signal propagation. We study the accuracy of this method in the simplified case of constant sound speed profile (SSP) and compare it to a more realistic case with various non-constant SSP. We also propose an auxiliary quantity called effective sound speed. This quantity, when modeling acoustic propagation via ray models, takes into account the difference between rectilinear and non-rectilinear sound ray paths. According to our evaluation, this offers improved range estimation results with respect to standard algorithms that consider the actual value of the speed of sound. We then propose an algorithm suitable for the non-invasive tracking of AUVs or vocalizing marine animals, using only a single receiver. This algorithm evaluates the underwater acoustic channel impulse response differences induced by a diverse sea bottom profile, and proposes a computationally- and energy-efficient solution for passive localization. Finally, we propose another algorithm to solve the issue of 3D acoustic localization and tracking of marine fauna. To reach the expected degree of accuracy, more sensors are often required than are available in typical commercial off-the-shelf (COTS) phased arrays found, e.g., in ultra short baseline (USBL) systems. Direct combination of multiple COTS arrays may be constrained by array body elements, and lead to breaking the optimal array element spacing, or the desired array layout. Thus, the application of state-of-the-art direction of arrival (DoA) estimation algorithms may not be possible. We propose a solution for passive 3D localization and tracking using a wideband acoustic array of arbitrary shape, and validate the algorithm in multiple experiments, involving both active and passive targets.Part of the research in this thesis has been supported by the EU H2020 program under project SYMBIOSIS (G.A. no. 773753).This work has been supported by IMDEA Networks InstitutePrograma de Doctorado en Ingeniería Telemática por la Universidad Carlos III de MadridPresidente: Paul Daniel Mitchell.- Secretario: Antonio Fernández Anta.- Vocal: Santiago Zazo Bell

Information-Centric Design and Implementation for Underwater Acoustic Networks

Over the past decade, Underwater Acoustic Networks (UANs) have received extensive attention due to their vast benefits in academia and industry alike. However, due to the overall magnitude and harsh characteristics of underwater environments, standard wireless network techniques will fail because current technology and energy restrictions limit underwater devices due to delayed acoustic communications. To help manage these limitations we utilize Information-Centric Networking (ICN). More importantly, we look at ICN\u27s paradigm shift from traditional TCP/IP architecture to improve data handling and enhance network efficiency. By utilizing some of ICN\u27s techniques, such as data naming hierarchy, we can reevaluate each component of the network\u27s protocol stack given current underwater limitations to study the vast solutions and perspectives Information-Centric architectures can provide to UANs. First, we propose a routing strategy used to manage and route large data files in a network prone to high mobility. Therefore, due to UANs limited transmitting capability, we passively store sensed data and adaptively find the best path. Furthermore, we introduce adapted Named Data Networking (NDN) components to improve upon routing robustness and adaptiveness. Beyond naming data, we use tracers to assist in tracking stored data locations without using other excess means such as flooding. By collaborating tracer consistency with routing path awareness our protocol can adaptively manage faulty or high mobility nodes. Through this incorporation of varied NDN techniques, we are able to see notable improvements in routing efficiency. Second, we analyze the effects of Denial of Service (DoS) attacks on upper layer protocols. Since UANs are typically resource restrained, malicious users can advantageously create fake traffic to burden the already constrained network. While ICN techniques only provide basic DoS restriction we must expand our detection and restriction technique to meet the unique demands of UANs. To provide enhanced security against DoS we construct an algorithm to detect and restrict against these types of attacks while adapting to meet acoustic characteristics. To better extend this work we incorporate three node behavior techniques using probabilistic, adaptive, and predictive approaches for detecting malicious traits. Thirdly, to depict and test protocols in UANs, simulators are commonly used due to their accessibility and controlled testing aspects. For this section, we review Aqua-Sim, a discrete event-driven open-source underwater simulator. To enhance the core aspect of this simulator we first rewrite the current architecture and transition Aqua-Sim to the newest core simulator, NS-3. Following this, we clean up redundant features spread out between the various underwater layers. Additionally, we fully integrate the diverse NS-3 API within our simulator. By revamping previous code layout we are able to improve architecture modularity and child class expandability. New features are also introduced including localization and synchronization support, busy terminal problem support, multi-channel support, transmission range uncertainty modules, external noise generators, channel trace-driven support, security module, and an adapted NDN module. Additionally, we provide extended documentation to assist in user development. Simulation testing shows improved memory management and continuous validity in comparison to other underwater simulators and past iterations of Aqua-Sim

Multisensor acoustic tracking of fish and seabird behavior around tidal turbine structures in Scotland

Despite rapid development of marine renewable energy, relatively little is known of the immediate and future impacts on the surrounding ecosystems. Quantifying the behavior and distribution of animals around marine renewable energy devices is crucial for understanding, predicting, and potentially mitigating any threats posed by these installations. The Flow and Benthic Ecology 4D (FLOWBEC) autonomous seabed platform integrated an Imagenex multibeam echosounder and a Simrad EK60 multi-frequency echosounder to monitor marine life in a 120◦ sector over ranges up to 50 m, seven to eight times per second. Established target detection algorithms fail within MRE sites, due to high levels of backscatter generated by the turbulent physical dynamics, limiting and biasing analysis to only periods of low current speed. This study presents novel algorithms to extract diving seabirds, fish, and fish schools from the intense backscatter caused by turbulent dynamics in flows of 4ms−1. Filtering, detection, and tracking using a modified nearest neighbor algorithm provide robust tracking of animal behavior using the multibeam echosounder. Independent multifrequency target detection is demonstrated using the EK60 with optimally calculated thresholds, scale-sensitive filters, morphological exclusion, and frequency-response characteristics. This provides sensitive and reliable detection throughout the entire water column and at all flow speeds. Dive profiles, depth preferences, predator–prey interactions, and fish schooling behavior can be analyzed, in conjunction with the hydrodynamic impacts of marine renewable energy devices. Coregistration of targets between the acoustic instruments increases the information available, providing quantitative measures including frequency response from the EK60, and target morphology and behavioral interactions from the multibeam echosounder. The analyses draw on deployments at a tidal energy site in Scotland to compare the presence and absence of renewable energy structures across a range of physical and trophic levels over complete spring-neap tidal cycles. These results can be used to inform how animals forage in these sites and whether individuals face collision risks. This quantitative information can de-risk the licensing process and, with a greater mechanistic understanding at demonstration scales, its predictive power could reduce the monitoring required at future arrays

Acoustic underwater target tracking methods using autonomous vehicles

Marine ecological research related to the increasing importance which the fisheries sector has reached so far, new methods and tools to study the biological components of our oceans are needed. The capacity to measure different population and environmental parameters of marine species allows a greater knowledge of the human impact, improving exploitation strategies of these resources. For example, the displacement capacity and mobility patterns are crucial to obtain the required knowledge for a sustainable management of fisheries. However, underwater localisation is one of the main problems which must be addressed in subsea exploration, where no Global Positioning System (GPS) is available. In addition to the traditional underwater localisation systems, such as Long BaseLine (LBL) or Ultra-Short BaseLine (USBL), new methods have been developed to increase navigation performance, flexibility, and to reduce deployment costs. For example, the Range-Only and Single-Beacon (ROSB) is based on an autonomous vehicle which localises and tracks different underwater targets using slant range measurements conducted by acoustic modems. In a moving target tracking scenario, the ROSB target tracking method can be seen as a Hidden Markov Model (HMM) problem. Using Bayes' rule, the probability distribution function of the HMM states can be solved by using different filtering methods. Accordingly, this thesis presents different strategies to improve the ROSB localisation and tracking methods for static and moving targets. Determining the optimal parameters to minimize acoustic energy use and search time, and to maximize the localisation accuracy and precision, is therefore one of the discussed aspects of ROSB. Thus, we present and compare different methods under different scenarios, both evaluated in simulations and field tests. The main mathematical notation and performance of each algorithm are presented, where the best practice has been derived. From a methodology point of view, this work advances the understanding of accuracy that can be achieved by using ROSB target tracking methods with autonomous vehicles. Moreover, whereas most of the work conducted during the last years has been focused on target tracking using acoustic modems, here we also present a novel method called the Area-Only Target Tracking (AOTT). This method works with commercially available acoustic tags, thereby reducing the costs and complexity over other tracking systems. These tags do not have bidirectional communication capabilities, and therefore, the ROSB techniques are not applicable. However, this method can be used to track small targets such as jellyfish due to the reduced tag's size. The methodology behind the area-only technique is shown, and results from the first field tests conducted in Monterey Bay area, California, are also presented.La biologia marina junt amb la importància que ha adquirit el sector pesquer, fa que es requereixin noves eines per a l’estudi dels nostres oceans. La capacitat de mesurar diferents poblacions i paràmetres ambientals d’espècies marines permet millorar el coneixement de l’impacte que l’ésser humà té sobre elles, millorant-ne els mètodes d’explotació. Per exemple, la capacitat de desplaçament i els patrons de moviment són crucials per obtenir el coneixement necessari per a una explotació sostenible de les pescaries involucrades. No obstant, la localització submarina és un dels principals problemes que s’ha de resoldre en l’explotació dels recursos submarins, on el sistema de posició global (GPS) no es pot utilitzar. A part dels mètodes tradicionals de posicionament submarí, com per exemple el Long Base-Line (LBL) o el Ultra-Short Base-Line (USBL), nous mètodes han estat desenvolupats per tal de millorar la navegació, la flexibilitat, i per reduir els costos de desplegament. Per exemple, el Range-Only and Single-Beacon (ROSB) utilitza un vehicle autònom per a localitzar i seguir diferents objectius submarins mitjançant mesures de rang realitzades a partir de mòdems acústics. En un escenari on l’objectiu a seguir és mòbil, el mètode ROSB de seguiment pot ser vist com a un problema de Hidden Markov Model (HMM). Aleshores, utilitzant la regla de Bayes, la funció de distribució de probabilitat dels estats del HMM pot ser solucionat utilitzant diferents mètodes de filtratge. Per tant, s’estudien diferents estratègies per millorar el sistema de localització i seguiment basat en ROSB, tant per objectius estàtics com mòbils. En aquesta tesis, presentem i comparem diferents mètodes utilitzant diferents escenaris, els quals s’han avaluat tant en simulacions com en proves de camp reals. A més, es presenten les principals notacions matemàtiques de cada algoritme i les millors pràctiques a utilitzar. Per tant, des d’un punt de vista metodològic, aquest treball fa un pas endavant en el coneixement de l’exactitud que es pot assolir utilitzant els mètodes de localització i seguiment d’espècies mitjançant algoritmes ROSB i vehicles autònoms. A més a més, mentre molts dels treballs realitzant durant els últims anys es centren en l’ús de mòdems acústics per al seguiment d’objectius submarins, en aquesta tesis es presenta un innovador mètode anomenat Area-Only Target Tracking (AOTT). Aquest sistema utilitza petites etiquetes acústiques comercials (tag), la qual cosa, redueix el cost i la complexitat en comparació amb els altres mètodes. Addicionalment, gràcies a l’ús d’aquests tags de dimensions reduïdes, aquest sistema permet seguir espècies marines com les meduses. La metodologia utilitzada per el mètode AOTT es mostra en aquesta tesis, on també es presenten els primers experiments realitzats a la badia de Monterey a Califòrnia

Advances in Sonar Technology

The demand to explore the largest and also one of the richest parts of our planet, the advances in signal processing promoted by an exponential growth in computation power and a thorough study of sound propagation in the underwater realm, have lead to remarkable advances in sonar technology in the last years.The work on hand is a sum of knowledge of several authors who contributed in various aspects of sonar technology. This book intends to give a broad overview of the advances in sonar technology of the last years that resulted from the research effort of the authors in both sonar systems and their applications. It is intended for scientist and engineers from a variety of backgrounds and even those that never had contact with sonar technology before will find an easy introduction with the topics and principles exposed here

Automated tracking of the Florida manatee (Trichechus manatus)

The electronic, physical, biological and environmental factors involved in the automated remote tracking of the Florida manatee (Trichechus manatus) are identified. The current status of the manatee as an endangered species is provided. Brief descriptions of existing tracking and position locating systems are presented to identify the state of the art in these fields. An analysis of energy media is conducted to identify those with the highest probability of success for this application. Logistic questions such as the means of attachment and position of any equipment to be placed on the manatee are also investigated. Power sources and manateeborne electronics encapsulation techniques are studied and the results of a compter generated DF network analysis are summarized