Web-based Geographical Visualization of Container Itineraries

Around 90% of the world cargo is transported in maritime containers, but only around 2% are physically inspected. This opens the possibility for illicit activities. A viable solution is to control containerized cargo through information-based risk analysis. Container route-based analysis has been considered a key factor in identifying potentially suspicious consignments. Essential part of itinerary analysis is the geographical visualization of the itinerary. In the present paper, we present initial work of a web-based system’s realization for interactive geographical visualization of container itinerary.JRC.G.4-Maritime affair

Detection of Abnormal Vessel Behaviours Based on AIS Data Features Using HDBSCAN+

 Achieving maritime security is challenging due to the vastness and complexity of the domain. Monitoring all Achieving maritime security is challenging due to the vastness and complexity of the domain. Monitoringall vessels that use this medium is humanly impossible but is needed for law enforcement. This paper proposes amachine learning solution based on HDBSCAN+ to classify the movements of vessels into ‘normal’ or ‘abnormal’.This classification reduces the number of vessels that have to be monitored by law enforcement agencies to amanageable size. To date, AIS is the primary source of information that can represent vessel movements andenable the detection of maritime anomalies. The proposed model uses latitude, longitude, type of vessel, courseand speed as features of the AIS data for analysis. The performance of the proposed model is validated against the marine incidents reported by Information Fusion Centre-Indian Ocean Region (IFC-IOR). The proposed model has successfully detected the incidents reported by IFC-IOR

Machine Learning for Enhanced Maritime Situation Awareness: Leveraging Historical AIS Data for Ship Trajectory Prediction

In this thesis, methods to support high level situation awareness in ship navigators through appropriate automation are investigated. Situation awareness relates to the perception of the environment (level 1), comprehension of the situation (level 2), and projection of future dynamics (level 3). Ship navigators likely conduct mental simulations of future ship traffic (level 3 projections), that facilitate proactive collision avoidance actions. Such actions may include minor speed and/or heading alterations that can prevent future close-encounter situations from arising, enhancing the overall safety of maritime operations. Currently, there is limited automation support for level 3 projections, where the most common approaches utilize linear predictions based on constant speed and course values. Such approaches, however, are not capable of predicting more complex ship behavior. Ship navigators likely facilitate such predictions by developing models for level 3 situation awareness through experience. It is, therefore, suggested in this thesis to develop methods that emulate the development of high level human situation awareness. This is facilitated by leveraging machine learning, where navigational experience is artificially represented by historical AIS data. First, methods are developed to emulate human situation awareness by developing categorization functions. In this manner, historical ship behavior is categorized to reflect distinct patterns. To facilitate this, machine learning is leveraged to generate meaningful representations of historical AIS trajectories, and discover clusters of specific behavior. Second, methods are developed to facilitate pattern matching of an observed trajectory segment to clusters of historical ship behavior. Finally, the research in this thesis presents methods to predict future ship behavior with respect to a given cluster. Such predictions are, furthermore, on a scale intended to support proactive collision avoidance actions. Two main approaches are used to facilitate these functions. The first utilizes eigendecomposition-based approaches via locally extracted AIS trajectory segments. Anomaly detection is also facilitated via this approach in support of the outlined functions. The second utilizes deep learning-based approaches applied to regionally extracted trajectories. Both approaches are found to be successful in discovering clusters of specific ship behavior in relevant data sets, classifying a trajectory segment to a given cluster or clusters, as well as predicting the future behavior. Furthermore, the local ship behavior techniques can be trained to facilitate live predictions. The deep learning-based techniques, however, require significantly more training time. These models will, therefore, need to be pre-trained. Once trained, however, the deep learning models will facilitate almost instantaneous predictions

A maritime decision support system to assess risk in the presence of environmental uncertainties: the REP10 experiment

The aim of this work is to report on an activity carried out during the 2010 Recognized Environmental Picture experiment, held in the Ligurian Sea during summer 2010. The activity was the first at-sea test of the recently developed decision support system (DSS) for operation planning, which had previously been tested in an artificial experiment. The DSS assesses the impact of both environmental conditions (meteorological and oceanographic) and non-environmental conditions (such as traffic density maps) on people and assets involved in the operation and helps in deciding a course of action that allows safer operation. More precisely, the environmental variables (such as wind speed, current speed and significant wave height) taken as input by the DSS are the ones forecasted by a super-ensemble model, which fuses the forecasts provided by multiple forecasting centres. The uncertainties associated with the DSS's inputs (generally due to disagreement between forecasts) are propagated through the DSS's output by using the unscented transform. In this way, the system is not only able to provide a traffic light map (run/not run the operation), but also to specify the confidence level associated with each action. This feature was tested on a particular type of operation with underwater gliders: the glider surfacing for data transmission. It is also shown how the availability of a glider path prediction tool provides surfacing options along the predicted path. The applicability to different operations is demonstrated by applying the same system to support diver operations

Spatio-Temporal Deep Learning Approaches for Addressing Track Association Problem using Automatic Identification System (AIS) Data

In the realm of marine surveillance, track association constitutes a pivotal yet challenging task, involving the identification and tracking of unlabelled vessel trajectories. The need for accurate data association algorithms stems from the urge to spot unusual vessel movements or threat detection. These algorithms link sequential observations containing location and motion information to specific moving objects, helping to build their real-time trajectories. These threat detection algorithms will be useful when a vessel attempts to conceal its identity. The algorithm can then identify and track the specific vessel from its incoming signal. The data for this study is sourced from the Automatic Identification System, which serves as a communication medium between neighboring ships and the control center. While traditional methods have relied on sequential tracking and physics-based models, the emergence of deep learning has significantly transformed techniques typically used in trajectory prediction, clustering, and anomaly detection. This transformation is largely attributed to the deep learning algorithm’s capability to model complex nonlinear relationships while capturing both the spatial and temporal dynamics of ship movement. Capitalizing on this computational advantage, our study focuses on evaluating different deep learning architectures such as Multi Model Long Short-Term Memory (LSTM), 1D Convolutional-LSTM, and Temporal-Graph Convolutional Neural Networks— in addressing the problem of track association. The performance of these proposed models are compared against different deep learning algorithms specialized in track association tasks using several real-life AIS datasets

A Practical Approach to the Development of Ontology-Based Information Fusion Systems

Proceedings of: NATO Advanced Study Institute (ASI) on Prediction and Recognition of Piracy Efforts Using Collaborative Human-Centric Information Systems, Salamanca, 19-30 September, 2011Ontology-based representations are gaining momentum among other alternatives to implement the knowledge model of high-level fusion applications. In this paper, we provide an introduction to the theoretical foundations of ontology-based knowledge representation and reasoning, with a particular focus on the issues that appear in maritime security –where heterogeneous regulations, information sources, users, and systems are involved. We also present some current approaches and existing technologies for high-level fusion based on ontological representations. Unfortunately, current tools for the practical implementation of ontology-based systems are not fully standardized, or even prepared to work together in medium-scale systems. Accordingly, we discuss different alternatives to face problems such as spatial and temporal knowledge representation or uncertainty management. To illustrate the conclusions drawn from this research, an ontology-based semantic tracking system is briefly presented. Results and latent capabilities of this framework are shown at the end of the paper, where we also envision future opportunities for this kind of applications.This research activity is supported in part by Projects CICYT TIN2008-06742-C02-02/TSI, CICYT TEC2008-06732-C02-02/TEC, CAM CONTEXTS (S2009/TIC-1485) and DPS 2008-07029-C02-02.Publicad

A unified model for context-based behavioural modelling and classification

A unified Bayesian model that simultaneously performs behavioural modelling, information fusion and classification is presented. The model is expressed in the form of a dynamic Bayesian network (DBN). Behavioural modelling is performed by tracking the continuous dynamics of a entity and incorporating various contextual elements that influence behaviour. The entity is classified according to its behaviour. Classification is expressed as a conditional probability of the entity class given its tracked trajectory and the contextual elements. Inference in the DBN is performed using a derived Gaussian sum filter. The model is applied to classify vessels, according to their behaviour, in a maritime piracy situation. The novel aspects of this work include the unified approach to behaviour modelling and classification, the way in which contextual information is fused, the unique approach to classification according to behaviour and the associated derived Gaussian sum filter inference algorithm.South African National Research Foundation (NRF) and the the Advanced Sensors and Electronics Defence (ASED) Centre of KACST through the Council for Scientific and Industrial Research (CSIR).http://www.elsevier.com/locate/eswa2016-11-30hb201

Context Exploitation in Data Fusion

Complex and dynamic environments constitute a challenge for existing tracking algorithms. For this reason, modern solutions are trying to utilize any available information which could help to constrain, improve or explain the measurements. So called Context Information (CI) is understood as information that surrounds an element of interest, whose knowledge may help understanding the (estimated) situation and also in reacting to that situation. However, context discovery and exploitation are still largely unexplored research topics. Until now, the context has been extensively exploited as a parameter in system and measurement models which led to the development of numerous approaches for the linear or non-linear constrained estimation and target tracking. More specifically, the spatial or static context is the most common source of the ambient information, i.e. features, utilized for recursive enhancement of the state variables either in the prediction or the measurement update of the filters. In the case of multiple model estimators, context can not only be related to the state but also to a certain mode of the filter. Common practice for multiple model scenarios is to represent states and context as a joint distribution of Gaussian mixtures. These approaches are commonly referred as the join tracking and classification. Alternatively, the usefulness of context was also demonstrated in aiding the measurement data association. Process of formulating a hypothesis, which assigns a particular measurement to the track, is traditionally governed by the empirical knowledge of the noise characteristics of sensors and operating environment, i.e. probability of detection, false alarm, clutter noise, which can be further enhanced by conditioning on context. We believe that interactions between the environment and the object could be classified into actions, activities and intents, and formed into structured graphs with contextual links translated into arcs. By learning the environment model we will be able to make prediction on the target\u2019s future actions based on its past observation. Probability of target future action could be utilized in the fusion process to adjust tracker confidence on measurements. By incorporating contextual knowledge of the environment, in the form of a likelihood function, in the filter measurement update step, we have been able to reduce uncertainties of the tracking solution and improve the consistency of the track. The promising results demonstrate that the fusion of CI brings a significant performance improvement in comparison to the regular tracking approaches