Advances in Simultaneous Localization and Mapping in Confined Underwater Environments Using Sonar and Optical Imaging.

This thesis reports on the incorporation of surface information into a probabilistic simultaneous localization and mapping (SLAM) framework used on an autonomous underwater vehicle (AUV) designed for underwater inspection. AUVs operating in cluttered underwater environments, such as ship hulls or dams, are commonly equipped with Doppler-based sensors, which---in addition to navigation---provide a sparse representation of the environment in the form of a three-dimensional (3D) point cloud. The goal of this thesis is to develop perceptual algorithms that take full advantage of these sparse observations for correcting navigational drift and building a model of the environment. In particular, we focus on three objectives. First, we introduce a novel representation of this 3D point cloud as collections of planar features arranged in a factor graph. This factor graph representation probabalistically infers the spatial arrangement of each planar segment and can effectively model smooth surfaces (such as a ship hull). Second, we show how this technique can produce 3D models that serve as input to our pipeline that produces the first-ever 3D photomosaics using a two-dimensional (2D) imaging sonar. Finally, we propose a model-assisted bundle adjustment (BA) framework that allows for robust registration between surfaces observed from a Doppler sensor and visual features detected from optical images. Throughout this thesis, we show methods that produce 3D photomosaics using a combination of triangular meshes (derived from our SLAM framework or given a-priori), optical images, and sonar images. Overall, the contributions of this thesis greatly increase the accuracy, reliability, and utility of in-water ship hull inspection with AUVs despite the challenges they face in underwater environments. We provide results using the Hovering Autonomous Underwater Vehicle (HAUV) for autonomous ship hull inspection, which serves as the primary testbed for the algorithms presented in this thesis. The sensor payload of the HAUV consists primarily of: a Doppler velocity log (DVL) for underwater navigation and ranging, monocular and stereo cameras, and---for some applications---an imaging sonar.PhDElectrical Engineering: SystemsUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/120750/1/paulozog_1.pd

Semantic Segmentation for Fully Automated Macrofouling Analysis on Coatings after Field Exposure

Biofouling is a major challenge for sustainable shipping, filter membranes, heat exchangers, and medical devices. The development of fouling-resistant coatings requires the evaluation of their effectiveness. Such an evaluation is usually based on the assessment of fouling progression after different exposure times to the target medium (e.g., salt water). The manual assessment of macrofouling requires expert knowledge about local fouling communities due to high variances in phenotypical appearance, has single-image sampling inaccuracies for certain species, and lacks spatial information. Here we present an approach for automatic image-based macrofouling analysis. We created a dataset with dense labels prepared from field panel images and propose a convolutional network (adapted U-Net) for the semantic segmentation of different macrofouling classes. The establishment of macrofouling localization allows for the generation of a successional model which enables the determination of direct surface attachment and in-depth epibiotic studies.Comment: 33 pages, 10 figure

Data-driven Ship Performance Models - - Emphasis on Energy Efficiency and Fatigue Safety

Due to digitalization in the maritime industry, a huge amount of ship operation-related data has been collected. The main objective of this thesis is to exploit machine learning/big data analytics to build data-driven ship performance models, focusing on speed-power relationship modeling, and fatigue accumulation assessment during a ship’s operation at sea.The speed-power performance models are established in three different ways: 1) semi-empirical white-box models, 2) machine learning black-box methods, and 3) physics-informed grey-box models. The white-box models include improved semi-empirical formulas for ship added resistance due to head waves, and further developed formulas in arbitrary wave headings. Validation studies using three case study ships show good agreement between the speed predictions by the white-box models and the long-term averages of full-scale measurements. Different supervised machine learning methods’ capabilities have been compared for black-box modeling. The XGBoost algorithm is found to have the most reliable predictive ability, with the highest efficiency suitable for onboard devices. The novel grey-box models are proposed by considering the physical principles in model tests and big data information from real sailing. It has been demonstrated that the proposed grey-box models can improve prediction accuracy by approximately 30% for ship speed estimation and provides 50% less cumulative error of sailing time than the black-box methods.The impact of voyage optimization-aided operations on the encountered wave conditions and ship fatigue damage is investigated in this thesis. By recommending appropriate routes, voyage optimization can greatly extend the fatigue life of a ship by at least 50%. The machine learning techniques are also applied to a ship’s fatigue assessment. The results indicate that the proposed data-driven fatigue assessment model could increase accuracy by approximately 70% for the case study vessel compared to other prominent spectral methods

Multivariate data mining for estimating the rate of discolouration material accumulation in drinking water distribution systems

Particulate material accumulates over time as cohesive layers on internal pipeline surfaces in water distribution systems (WDS). When mobilised, this material can cause discolouration. This paper explores factors expected to be involved in this accumulation process. Two complementary machine learning methodologies are applied to significant amounts of real world field data from both a qualitative and a quantitative perspective. First, Kohonen self-organising maps were used for integrative and interpretative multivariate data mining of potential factors affecting accumulation. Second, evolutionary polynomial regression (EPR), a hybrid data-driven technique, was applied that combines genetic algorithms with numerical regression for developing easily interpretable mathematical model expressions. EPR was used to explore producing novel simple expressions to highlight important accumulation factors. Three case studies are presented: UK national and two Dutch local studies. The results highlight bulk water iron concentration, pipe material and looped network areas as key descriptive parameters for the UK study. At the local level, a significantly increased third data set allowed K-fold cross validation. The mean cross validation coefficient of determination was 0.945 for training data and 0.930 for testing data for an equation utilising amount of material mobilised and soil temperature for estimating daily regeneration rate. The approach shows promise for developing transferable expressions usable for pro-active WDS management

Data-Driven and Hybrid Methods for Naval Applications

The goal of this PhD thesis is to study, design and develop data analysis methods for naval applications. Data analysis is improving our ways to understand complex phenomena by profitably taking advantage of the information laying behind a collection of data. In fact, by adopting algorithms coming from the world of statistics and machine learning it is possible to extract valuable information, without requiring specific domain knowledge of the system generating the data. The application of such methods to marine contexts opens new research scenarios, since typical naval problems can now be solved with higher accuracy rates with respect to more classical techniques, based on the physical equations governing the naval system. During this study, some major naval problems have been addressed adopting state-of-the-art and novel data analysis techniques: condition-based maintenance, consisting in assets monitoring, maintenance planning, and real-time anomaly detection; energy and consumption monitoring, in order to reduce vessel consumption and gas emissions; system safety for maneuvering control and collision avoidance; components design, in order to detect possible defects at design stage. A review of the state-of-the-art of data analysis and machine learning techniques together with the preliminary results of the application of such methods to the aforementioned problems show a growing interest in these research topics and that effective data-driven solutions can be applied to the naval context. Moreover, for some applications, data-driven models have been used in conjunction with domain-dependent methods, modelling physical phenomena, in order to exploit both mechanistic knowledge of the system and available measurements. These hybrid methods are proved to provide more accurate and interpretable results with respect to both the pure physical or data-driven approaches taken singularly, thus showing that in the naval context it is possible to offer new valuable methodologies by either providing novel statistical methods or improving the state-of-the-art ones

Modeling for the performance of navigation, control and data post-processing of underwater gliders

Underwater gliders allow efficient monitoring in oceanography. In contrast to buoys, which log oceanographic data at individual depths at only one location, gliders can log data over a period of up to one year by following predetermined routes. In addition to the logged data from the available sensors, usually a conductivity-temperature-depth (CTD) sensor, the depth-average velocity can also be estimated using the horizontal glider velocity and the GPS update in a dead-reckoning algorithm. The horizontal velocity is also used for navigation or planning a long-term glider mission. This paper presents an investigation to determine the horizontal glider velocity as accurately as possible. For this, Slocum glider flight models used in practice will be presented and compared. A glider model for a steady-state gliding motion based on this analysis is described in detail. The approach for estimating the individual model parameters using nonlinear regression will be presented. In this context, a robust method to accurately detect the angle of attack is presented and the requirements of the logged vehicle data for statistically verified model parameters are discussed. The approaches are verified using logged data from glider missions in the Indian Ocean from 2016 to 2018. It is shown that a good match between the logged and the modeled data requires a time-varying model, where the model parameters change with respect to time. A reason for the changes is biofouling, where organisms settle and grow on the glider. The proposed method for deciphering an accurate horizontal glider velocity could serve to improve the dead-reckoning algorithm used by the glider for calculating depth-average velocity and for understanding its errors. The depth-average velocity is used to compare ocean current models from CMEMS and HYCOM with the glider logged data

A Review on Applications of Machine Learning in Shipping Sustainability

The shipping industry faces a significant challenge as it needs to significantly lower the amounts of Green House Gas emissions at the same time as it is expected to meet the rising demand. Traditionally, optimising the fuel consumption for ships is done during the ship design stage and through operating it in a better way, for example, with more energy-efficient machinery, optimising the speed or route. During the last decade, the area of machine learning has evolved significantly, and these methods are applicable in many more fields than before. The field of ship efficiency improvement by using Machine Learning methods is significantly progressing due to the available volumes of data from online measuring, experiments and computations. This amount of data has made machine learning a powerful tool that has been successfully used to extract information and intricate patterns that can be translated into attractive ship energy savings. This article presents an overview of machine learning, current developments, and emerging opportunities for ship efficiency. This article covers the fundamentals of Machine Learning and discusses the methodologies available for ship efficiency optimisation. Besides, this article reveals the potentials of this promising technology and future challenges