Offshore marine visualization

In 85 B.C. a Greek philosopher called Posidonius set sail to answer an age-old question: how deep is the ocean? By lowering a large rock tied to a very long length of rope he determined that the ocean was 2km deep. These line and sinker methods were used until the 1920s when oceanographers developed the first echo sounders that could measure the water's depth by reflecting sound waves off the seafloor. The subsequent increase in sonar depth soundings resulted in oceanologists finally being able to view the alien underwater landscape. Paper printouts and records dominated the industry for decades until the mid 1980s when new digital sonar systems enabled computers to process and render the captured data streams.In the last five years, the offshore industry has been particularly slow to take advantage of the significant advancements made in computer and graphics technologies. Contemporary marine visualization systems still use outdated 2D representations of vessels positioned on digital charts and the potential for using 3D computer graphics for interacting with multidimensional marine data has not been fully investigated.This thesis is concerned with the issues surrounding the visualization of offshore activities and data using interactive 3D computer graphics. It describes the development of a novel 3D marine visualization system and subsequent study of marine visualization techniques through a number of offshore case studies that typify the marine industry. The results of this research demonstrate that presenting the offshore engineer or office based manager with a more intuitive and natural 3D computer generated viewing environment enables complex offshore tasks, activities and procedures to be more readily monitored and understood. The marine visualizations presented in this thesis take advantage of recent advancements in computer graphics technology and our extraordinary ability to interpret 3D data. These visual enhancements have improved offshore staffs' spatial and temporal understanding of marine data resulting in improved planning, decision making and real-time situation awareness of complex offshore data and activities

Diagnosing Robotic Swarms 2 (Dr. Swarm2)

Robots are envisioned to work alongside humans. However, humans struggle to interpret the state and goals of a robot. The use of multiple robots further exacerbates this issue. To solve this problem, we propose Dr. Swarm 2, an augmented reality (AR) application built on the Magic Leap. The overlay provides concise information in a manner unachievable with existing methods

Context-Enabled Visualization Strategies for Automation Enabled Human-in-the-loop Inspection Systems to Enhance the Situation Awareness of Windstorm Risk Engineers

Insurance loss prevention survey, specifically windstorm risk inspection survey is the process of investigating potential damages associated with a building or structure in the event of an extreme weather condition such as a hurricane or tornado. Traditionally, the risk inspection process is highly subjective and depends on the skills of the engineer performing it. This dissertation investigates the sensemaking process of risk engineers while performing risk inspection with special focus on various factors influencing it. This research then investigates how context-based visualizations strategies enhance the situation awareness and performance of windstorm risk engineers. An initial study investigated the sensemaking process and situation awareness requirements of the windstorm risk engineers. The data frame theory of sensemaking was used as the framework to carry out this study. Ten windstorm risk engineers were interviewed, and the data collected were analyzed following an inductive thematic approach. The themes emerged from the data explained the sensemaking process of risk engineers, the process of making sense of contradicting information, importance of their experience level, internal and external biases influencing the inspection process, difficulty developing mental models, and potential technology interventions. More recently human in the loop systems such as drones have been used to improve the efficiency of windstorm risk inspection. This study provides recommendations to guide the design of such systems to support the sensemaking process and situation awareness of windstorm visual risk inspection. The second study investigated the effect of context-based visualization strategies to enhance the situation awareness of the windstorm risk engineers. More specifically, the study investigated how different types of information contribute towards the three levels of situation awareness. Following a between subjects study design 65 civil/construction engineering students completed this study. A checklist based and predictive display based decision aids were tested and found to be effective in supporting the situation awareness requirements as well as performance of windstorm risk engineers. However, the predictive display only helped with certain tasks like understanding the interaction among different components on the rooftop. For remaining tasks, checklist alone was sufficient. Moreover, the decision aids did not place any additional cognitive demand on the participants. This study helped us understand the advantages and disadvantages of the decision aids tested. The final study evaluated the transfer of training effect of the checklist and predictive display based decision aids. After one week of the previous study, participants completed a follow-up study without any decision aids. The performance and situation awareness of participants in the checklist and predictive display group did not change significantly from first trial to second trial. However, the performance and situation awareness of participants in the control condition improved significantly in the second trial. They attributed this to their exposure to SAGAT questionnaire in the first study. They knew what issues to look for and what tasks need to be completed in the simulation. The confounding effect of SAGAT questionnaires needs to be studied in future research efforts

Making the invisible visible:Underwater Malta—a virtual museum for submerged cultural heritage

The seabed can be considered as the world’s largest museum, and underwater sites ex‐ plored and studied so far provide priceless information on human interaction with the sea. In recog‐ nition of the importance of this cultural resource, UNESCO, in its 2001 Convention on the Protection of the Underwater Cultural Heritage, determined that objects/sites should be preserved in situ, whilst also advocating for public access and sharing. The implementation of these principles is not without difficulties. Some states have opened up underwater sites to the public—mainly through diving, yet the vast majority of the world’s population does not dive. In Malta, 7000 years of human occupation is reflected in and on the landscape, and recent offshore surveys show that the islands’ long and complex history has also left an indelible mark on the seabed. Besides difficulties related to their protection and management, these sites also present a challenge with regard to sharing and communicating. Recent advances in underwater imaging and processing software have accelerated the development of 3D photogrammetry of submerged sites and the idea for a virtual museum was born. The virtual museum, UnderwaterMalta, was created out of a need to share the plethora of underwater sites located on the seabed of the Maltese Islands. A multitude of digital tools are used to share and communicate these sites, offering visitors a dry dive into submerged sites that would otherwise remain invisible to the vast majority of the public. This paper discusses the basic principle of the sharing of underwater cultural heritage and the difficulties that beset the implementation of such a principle. A detailed explanation and evaluation of the methods used to gather the raw data needed is set in the context of the particular and unique working conditions related to deep water sites. The workings of this paper are based on first‐hand experiences garnered through the record‐ ing of numerous wrecks over the years and the creation and launch of The Virtual Museum‐Under‐ water Malta—a comprehensive virtual museum specifically built for “displaying” underwater ar‐ chaeological sites that are otherwise invisible to the general public.peer-reviewe

Analyzing high resolution topography for advancing the understanding of mass and energy transfer through landscapes: A review

International audienceThe study of mass and energy transfer across landscapes has recently evolved to comprehensive considerations acknowledging the role of biota and humans as geomorphic agents, as well as the importance of small-scale landscape features. A contributing and supporting factor to this evolution is the emergence over the last two decades of technologies able to acquire high resolution topography (HRT) (meter and sub-meter resolution) data. Landscape features can now be captured at an appropriately fine spatial resolution at which surface processes operate; this has revolutionized the way we study Earth-surface processes. The wealth of information contained in HRT also presents considerable challenges. For example, selection of the most appropriate type of HRT data for a given application is not trivial. No definitive approach exists for identifying and filtering erroneous or unwanted data, yet inappropriate filtering can create artifacts or eliminate/distort critical features. Estimates of errors and uncertainty are often poorly defined and typically fail to represent the spatial heterogeneity of the dataset, which may introduce bias or error for many analyses. For ease of use, gridded products are typically preferred rather than the more information-rich point cloud representations. Thus many users take advantage of only a fraction of the available data, which has furthermore been subjected to a series of operations often not known or investigated by the user. Lastly, standard HRT analysis work-flows are yet to be established for many popular HRT operations, which has contributed to the limited use of point cloud data.In this review, we identify key research questions relevant to the Earth-surface processes community within the theme of mass and energy transfer across landscapes and offer guidance on how to identify the most appropriate topographic data type for the analysis of interest. We describe the operations commonly performed from raw data to raster products and we identify key considerations and suggest appropriate work-flows for each, pointing to useful resources and available tools. Future research directions should stimulate further development of tools that take advantage of the wealth of information contained in the HRT data and address the present and upcoming research needs such as the ability to filter out unwanted data, compute spatially variable estimates of uncertainty and perform multi-scale analyses. While we focus primarily on HRT applications for mass and energy transfer, we envision this review to be relevant beyond the Earth-surface processes community for a much broader range of applications involving the analysis of HRT

Bathymetric Survey of the St. Anthony Channel (Croatia) Using Multibeam Echosounders (MBES)—A New Methodological Semi-Automatic Approach of Point Cloud Post-Processing

Multibeam echosounders (MBES) have become a valuable tool for underwater floor mapping. However, MBES data are often loaded with different measurement errors. This study presents a new user-friendly and methodological semi-automatic approach of point cloud post-processing error removal. The St. Anthony Channel (Croatia) was selected as the research area because it is regarded as one of the most demanding sea or river passages in the world and it is protected as a significant landscape by the Šibenik-Knin County. The two main objectives of this study, conducted within the Interreg Italy–Croatia PEPSEA project, were to: (a) propose a methodological framework that would enable the easier and user-friendly identification and removal of the errors in MBES data; (b) create a high-resolution integral model (MBES and UAV data) of the St. Anthony Channel for maritime safety and tourism promotion purposes. A hydrographic survey of the channel was carried out using WASSP S3 MBES while UAV photogrammetry was performed using Matrice 210 RTK V2. The proposed semi-automatic post-processing of the MBES acquired point cloud was completed in the Open Source CloudCompare software following five steps in which various point filtering methods were used. The reduction percentage in points after the denoising process was 14.11%. Our results provided: (a) a new user-friendly methodological framework for MBES point filtering; (b) a detailed bathymetric map of the St. Anthony Channel with a spatial resolution of 50 cm; and (c) the first integral (MBES and UAV) high-resolution model of the St. Anthony Channel. The generated models can primarily be used for maritime safety and tourism promotion purposes. In future research, ground-truthing methods (e.g., ROVs) will be used to validate the generated models

3D Recording and Interpretation for Maritime Archaeology

This open access peer-reviewed volume was inspired by the UNESCO UNITWIN Network for Underwater Archaeology International Workshop held at Flinders University, Adelaide, Australia in November 2016. Content is based on, but not limited to, the work presented at the workshop which was dedicated to 3D recording and interpretation for maritime archaeology. The volume consists of contributions from leading international experts as well as up-and-coming early career researchers from around the globe. The content of the book includes recording and analysis of maritime archaeology through emerging technologies, including both practical and theoretical contributions. Topics include photogrammetric recording, laser scanning, marine geophysical 3D survey techniques, virtual reality, 3D modelling and reconstruction, data integration and Geographic Information Systems. The principal incentive for this publication is the ongoing rapid shift in the methodologies of maritime archaeology within recent years and a marked increase in the use of 3D and digital approaches. This convergence of digital technologies such as underwater photography and photogrammetry, 3D sonar, 3D virtual reality, and 3D printing has highlighted a pressing need for these new methodologies to be considered together, both in terms of defining the state-of-the-art and for consideration of future directions. As a scholarly publication, the audience for the book includes students and researchers, as well as professionals working in various aspects of archaeology, heritage management, education, museums, and public policy. It will be of special interest to those working in the field of coastal cultural resource management and underwater archaeology but will also be of broader interest to anyone interested in archaeology and to those in other disciplines who are now engaging with 3D recording and visualization

B.O.G.G.L.E.S.: Boundary Optical GeoGraphic Lidar Environment System

The purpose of this paper is to describe a pseudo X-ray vision system that pairs a Lidar scanner with a visualization device. The system as a whole is referred to as B.O.G.G.L.E.S. There are several key factors that went into the development of this system and the background information and design approach are thoroughly described. B.O.G.G.L.E.S functionality is depicted through the use of design constraints and the analysis of test results. Additionally, many possible developments for B.O.G.G.L.E.S are proposed in the paper. This indicates that there are various avenues of improvement for this project that could be implemented in the future