365 research outputs found
Challenges in video based object detection in maritime scenario using computer vision
This paper discusses the technical challenges in maritime image processing
and machine vision problems for video streams generated by cameras. Even well
documented problems of horizon detection and registration of frames in a video
are very challenging in maritime scenarios. More advanced problems of
background subtraction and object detection in video streams are very
challenging. Challenges arising from the dynamic nature of the background,
unavailability of static cues, presence of small objects at distant
backgrounds, illumination effects, all contribute to the challenges as
discussed here
Enhancing automatic maritime surveillance systems with visual information
Automatic surveillance systems for the maritime
domain are becoming more and more important due to a constant
increase of naval traffic and to the simultaneous reduction of
crews on decks. However, available technology still provides only
a limited support to this kind of applications. In this paper,
a modular system for intelligent maritime surveillance, capable
of fusing information from heterogeneous sources, is described.
The system is designed to enhance the functions of the existing
Vessel Traffic Services systems and to be deployable in populated
areas, where radar-based systems cannot be used due to the high
electromagnetic radiation emissions. A quantitative evaluation
of the proposed approach has been carried out on a large
and publicly available data set of images and videos, collected
from multiple real sites, with different light, weather, and traffic
conditions
Are object detection assessment criteria ready for maritime computer vision?
Maritime vessels equipped with visible and infrared cameras can complement
other conventional sensors for object detection. However, application of
computer vision techniques in maritime domain received attention only recently.
The maritime environment offers its own unique requirements and challenges.
Assessment of the quality of detections is a fundamental need in computer
vision. However, the conventional assessment metrics suitable for usual object
detection are deficient in the maritime setting. Thus, a large body of related
work in computer vision appears inapplicable to the maritime setting at the
first sight. We discuss the problem of defining assessment metrics suitable for
maritime computer vision. We consider new bottom edge proximity metrics as
assessment metrics for maritime computer vision. These metrics indicate that
existing computer vision approaches are indeed promising for maritime computer
vision and can play a foundational role in the emerging field of maritime
computer vision
Sea-Surface Object Detection Based on Electro-Optical Sensors: A Review
Sea-surface object detection is critical for navigation safety of autonomous ships. Electrooptical (EO) sensors, such as video cameras, complement radar on board in detecting small obstacle
sea-surface objects. Traditionally, researchers have used horizon detection, background subtraction, and
foreground segmentation techniques to detect sea-surface objects. Recently, deep learning-based object
detection technologies have been gradually applied to sea-surface object detection. This article demonstrates a comprehensive overview of sea-surface object-detection approaches where the advantages
and drawbacks of each technique are compared, covering four essential aspects: EO sensors and image
types, traditional object-detection methods, deep learning methods, and maritime datasets collection. In
particular, sea-surface object detections based on deep learning methods are thoroughly analyzed and
compared with highly influential public datasets introduced as benchmarks to verify the effectiveness of
these approaches. The arti
Pohang Canal Dataset: A Multimodal Maritime Dataset for Autonomous Navigation in Restricted Waters
This paper presents a multimodal maritime dataset and the data collection
procedure used to gather it, which aims to facilitate autonomous navigation in
restricted water environments. The dataset comprises measurements obtained
using various perception and navigation sensors, including a stereo camera, an
infrared camera, an omnidirectional camera, three LiDARs, a marine radar, a
global positioning system, and an attitude heading reference system. The data
were collected along a 7.5-km-long route that includes a narrow canal, inner
and outer ports, and near-coastal areas in Pohang, South Korea. The collection
was conducted under diverse weather and visual conditions. The dataset and its
detailed description are available for free download at
https://sites.google.com/view/pohang-canal-dataset.Comment: Submitted to IJRR as a data paper for revie
Unsupervised maritime target detection
The unsupervised detection of maritime targets in grey scale video is a difficult problem in maritime video surveillance. Most approaches assume that the camera is static and employ pixel-wise background modelling techniques for foreground detection; other methods rely on colour or thermal information to detect targets. These methods fail in real-world situations when the static camera assumption is violated, and colour or thermal data is unavailable. In defence and security applications, prior information and training samples of targets may be unavailable for training a classifier; the learning of a one class classifier for the background may be impossible as well. Thus, an unsupervised online approach that attempts to learn from the scene data is highly desirable. In this thesis, the characteristics of the maritime scene and the ocean texture are exploited for foreground detection. Two fast and effective methods are investigated for target detection. Firstly, online regionbased background texture models are explored for describing the appearance of the ocean. This approach avoids the need for frame registration because the model is built spatially rather than temporally. The texture appearance of the ocean is described using Local Binary Pattern (LBP) descriptors. Two models are proposed: one model is a Gaussian Mixture (GMM) and the other, referred to as a Sparse Texture Model (STM), is a set of histogram texture distributions. The foreground detections are optimized using a Graph Cut (GC) that enforces spatial coherence. Secondly, feature tracking is investigated as a means of detecting stable features in an image frame that typically correspond to maritime targets; unstable features are background regions. This approach is a Track-Before-Detect (TBD) concept and it is implemented using a hierarchical scheme for motion estimation, and matching of Scale- Invariant Feature Transform (SIFT) appearance features. The experimental results show that these approaches are feasible for foreground detection in maritime video when the camera is either static or moving. Receiver Operating Characteristic (ROC) curves were generated for five test sequences and the Area Under the ROC Curve (AUC) was analyzed for the performance of the proposed methods. The texture models, without GC optimization, achieved an AUC of 0.85 or greater on four out of the five test videos. At 50% True Positive Rate (TPR), these four test scenarios had a False Positive Rate (FPR) of less than 2%. With the GC optimization, an AUC of greater than 0.8 was achieved for all the test cases and the FPR was reduced in all cases when compared to the results without the GC. In comparison to the state of the art in background modelling for maritime scenes, our texture model methods achieved the best performance or comparable performance. The two texture models executed at a reasonable processing frame rate. The experimental results for TBD show that one may detect target features using a simple track score based on the track length. At 50% TPR a FPR of less than 4% is achieved for four out of the five test scenarios. These results are very promising for maritime target detection
Detection and Classification of Obstacles for Autonomous Vessels Using Machine Learning
Desenvolvimento de um sistema capaz de realizar a deteção e classificação de obstáculos de vários tipos que possam ser sujeitos de colisões e resultar em danos para a embarcação ou até na destruição total do mesmo. O sistema é também capaz da deteção da linha do horizonte para estimar a distância relativa dos objetos detetados à posição atual da embarcação. As deteções são conseguidas recorrendo a técnicas de Deep Learning, nomeadamente usando CNNs, para a deteção dos obstaculos e linha do horizonte.Development of a system capable of obstacle detection and classification of various types that may be subject of collisions and result in damages to the ship or even its own total loss. The system is also capable of detection the horizon line, to estimate the relative distance of the detected objects to the vehicle current position. This is achieved throught Deep Learning techniques, namely by the use of Convolutional Neural Networks
- …