Space-based Global Maritime Surveillance. Part I: Satellite Technologies

Maritime surveillance (MS) is crucial for search and rescue operations, fishery monitoring, pollution control, law enforcement, migration monitoring, and national security policies. Since the early days of seafaring, MS has been a critical task for providing security in human coexistence. Several generations of sensors providing detailed maritime information have become available for large offshore areas in real time: maritime radar sensors in the 1950s and the automatic identification system (AIS) in the 1990s among them. However, ground-based maritime radars and AIS data do not always provide a comprehensive and seamless coverage of the entire maritime space. Therefore, the exploitation of space-based sensor technologies installed on satellites orbiting around the Earth, such as satellite AIS data, synthetic aperture radar, optical sensors, and global navigation satellite systems reflectometry, becomes crucial for MS and to complement the existing terrestrial technologies. In the first part of this work, we provide an overview of the main available space-based sensors technologies and present the advantages and limitations of each technology in the scope of MS. The second part, related to artificial intelligence, signal processing and data fusion techniques, is provided in a companion paper, titled: "Space-based Global Maritime Surveillance. Part II: Artificial Intelligence and Data Fusion Techniques" [1].Comment: This paper has been submitted to IEEE Aerospace and Electronic Systems Magazin

JRC - Alenia Aeronautica Coupled UAS and Spaceborne SAR Campaign in Italy

The European maritime area is one of Europe’s most important assets with regard to resources, security and ultimately prosperity of the Member States. A significant part of Europe’s economy relies directly or indirectly on it. It is not just the shipping or fisheries industries and their related activities. It is also shipbuilding and ports, marine equipment and offshore energy, maritime and coastal tourism, aquaculture, submarine telecommunications, blue biotech and the protection of the marine environment. The European maritime area faces several risks and threats posed by unlawful activities, such as drugs trafficking, smuggling, illegal immigration, organised crime and terrorism. Piracy in international waters also constitutes a threat to Europe since it can disrupt the maritime transport chain. These risks and threats can endanger human lives, marine resources and the environment, as well as significantly disrupt the transport chain and global and local security. It is anticipated that these risks and threats will endure in the mid and long run. In order to keep Europe as a world leader in the global maritime economy, an effective integrated/interoperable, sustainable maritime surveillance system and situational awareness are needed. A significant number of unlawful maritime activities, such as illegal immigration, drugs trafficking, smuggling, piracy and terrorism involve mainly small boats, because small boats are faster and more difficult to detect using conventional means. Hence, it is very important to find out the feasibility of using Unmanned Aerial Systems (UAS) for small boat detection, tracking, classification and identification, as well as to study the potential of UAS for maritime surveillance. Since 2010 the EC-JRC has carried out a number of UAS maritime surveillance campaigns to study the potential of UAS for maritime surveillance, in particular for small boat detection. This report presents the results and conclusions of the JRC - Alenia Aeronautica Coupled UAS and Spaceborne SAR campaign carried out in Oct. 2010 in Porto Corallo, Sardinia, Italy.JRC.G.4-Maritime affair

Naval Target Classification by Fusion of Multiple Imaging Sensors Based on the Confusion Matrix

This paper presents an algorithm for the classification of targets based on the fusion of the class information provided by different imaging sensors. The outputs of the different sensors are combined to obtain an accurate estimate of the target class. The performance of each imaging sensor is modelled by means of its confusion matrix (CM), whose elements are the conditional error probabilities in the classification and the conditional correct classification probabilities. These probabilities are used by each sensor to make a decision on the target class. Then, a final decision on the class is made using a suitable fusion rule in order to combine the local decisions provided by the sensors. The overall performance of the classification process is evaluated by means of the "fused" confusion matrix, i.e. the CM pertinent to the final decision on the target class. Two fusion rules are considered: a majority voting (MV) rule and a maximum likelihood (ML) rule. A case study is then presented, where the developed algorithm is applied to three imaging sensors located on a generic air platform: a video camera, an infrared camera (IR), and a spotlight Synthetic Aperture Radar (SAR)

DESIRE Simulation tool to demonstrate data products for security applications

International audienceThe Simulation Tool to demonstrate Data Products for Security Applications (DESIRE) is a simulation tool aimed at demonstrating the added value of including a thermal infrared (TIR) imager within different space-borne architecture options comprising different capabilities i.e. SAR and optical. The simulator has been developed considering as end users system designers that need to assess the added value of infrared data when they are combined with other data. The DESIRE Tool development has been based on mission scenarios that address the priority areas identified in the GMES services for security e.g. Border security, Maritime Surveillance and Support to EU External Action. Particular relevant scenarios taken into account for the simulator user requirements analysis have been Oil Spill Detection, Maritime Ship Surveillance, Industrial Site Monitoring and Urban Heat Islands.The simulator is composed of an external interface capable of ingesting different input products at different processing levels (from L0 to L2, depending of the data type), a processing chain for each data type to bring the products up to L3, a co-registration module, different data combination and data fusion techniques (in order to generate merged maps or maps with information extracted from different products), and a set of modules to customize and validate the data-fusion products depending on the scenario under investigation.DESIRE has been implemented as a flexible, configurable and modular simulation tool, to be used for existing and firmly planned in-orbit capability and to combine these with real or synthetic TIR data products. DESIRE is based on the simulation framework OpenSF.The modular design of DESIRE allows the future extension of the simulator functionality with additional processing modules in order to deal with a wider range of scenarios and in-orbit architectures

Spaceborne SAR Small Boat Detection Campaign in Portugal and Spain

The European maritime area is one of Europe’s most important assets with regard to resources, security and ultimately prosperity of the Member States. A significant part of Europe’s economy relies directly or indirectly on it. It is not just the shipping or fisheries industries and their related activities. It is also shipbuilding and ports, marine equipment and offshore energy, maritime and coastal tourism, aquaculture, submarine telecommunications, blue biotech and the protection of the marine environment. The European maritime area faces several risks and threats posed by unlawful activities, such as drugs trafficking, smuggling, illegal immigration, organised crime and terrorism. Piracy in international waters also constitutes a threat to Europe since it can disrupt the maritime transport chain. These risks and threats can endanger human lives, marine resources and the environment, as well as significantly disrupt the transport chain and global and local security. It is anticipated that these risks and threats will endure in the mid and long run. In order to keep Europe as a world leader in the global maritime economy, an effective integrated/interoperable, sustainable maritime surveillance system and situational awareness are needed. A significant number of unlawful maritime activities, such as illegal immigration, drugs trafficking, smuggling, piracy and terrorism involve mainly small boats, because small boats are faster and more difficult to detect using conventional means. Hence, it is very important to find out the feasibility of using SAR Satellite images for small boat detection. Since 2008 the EC-JRC has carried out a number of SAR Small Boat detection experiments to assess the feasibility of using Spaceborne SAR for Small Boat detection. This report presents the results and conclusions of the Spaceborne SAR Small Boat detection campaign in inland sea waters and in coastal waters carried out by the EC-JRC in the South of Spain (Sancti Petri-La Barossa, El Rompido, Punta Umbria, Cadiz and Isla Cristina) and in Portugal (Sagres and Cascais) in December 2010. The results of the experiment show that under suitable conditions of sea state, wind speed and incidence angle it is possible to detect small boats in spaceborne SAR imagery in inland waters, Coastal waters and open sea. Further research is needed to study possible correlations between the empirical probability of detection of small boats in spaceborne SAR and the main parameters involved, such as sea state, wind speed, incidence angle, among others.JRC.G.4-Maritime affair

A New Orbiting Deployable System for Small Satellite Observations for Ecology and Earth Observation

In this paper, we present several study cases focused on marine, oceanographic, and atmospheric environments, which would greatly benefit from the use of a deployable system for small satellite observations. As opposed to the large standard ones, small satellites have become an effective and affordable alternative access to space, owing to their lower costs, innovative design and technology, and higher revisiting times, when launched in a constellation configuration. One of the biggest challenges is created by the small satellite instrumentation working in the visible (VIS), infrared (IR), and microwave (MW) spectral ranges, for which the resolution of the acquired data depends on the physical dimension of the telescope and the antenna collecting the signal. In this respect, a deployable payload, fitting the limited size and mass imposed by the small satellite architecture, once unfolded in space, can reach performances similar to those of larger satellites. In this study, we show how ecology and Earth Observations can benefit from data acquired by small satellites, and how they can be further improved thanks to deployable payloads. We focus on DORA—Deployable Optics for Remote sensing Applications—in the VIS to TIR spectral range, and on a planned application in the MW spectral range, and we carry out a radiometric analysis to verify its performances for Earth Observation studies

Deep learning-based vessel detection from very high and medium resolution optical satellite images as component of maritime surveillance systems

This thesis presents an end-to-end multiclass vessel detection method from optical satellite images. The proposed workflow covers the complete processing chain and involves rapid image enhancement techniques, the fusion with automatic identification system (AIS) data, and the detection algorithm based on convolutional neural networks (CNN). The algorithms presented are implemented in the form of independent software processors and integrated in an automated processing chain as part of the Earth Observation Maritime Surveillance System (EO-MARISS).In der vorliegenden Arbeit wird eine Methode zur Detektion von Schiffen unterschiedlicher Klassen in optischen Satellitenbildern vorgestellt. Diese gliedert sich in drei aufeinanderfolgende Funktionen: i) die Bildbearbeitung zur Verbesserung der Bildeigenschaften, ii) die Datenfusion mit den Daten des Automatischen Identifikation Systems (AIS) und iii) dem auf „Convolutional Neural Network“ (CNN) basierenden Detektionsalgorithmus. Die vorgestellten Algorithmen wurden in Form eigenständiger Softwareprozessoren implementiert und als Teil des maritimen Erdbeobachtungssystems integriert

JRC – Elbit Systems Coupled UAS and Spaceborne SAR Campaign in Israel

The European maritime area is one of Europe’s most important assets with regard to resources, security and ultimately prosperity of the Member States. A significant part of Europe’s economy relies directly or indirectly on it. It is not just the shipping or fisheries industries and their related activities. It is also shipbuilding and ports, marine equipment and offshore energy, maritime and coastal tourism, aquaculture, submarine telecommunications, blue biotech and the protection of the marine environment. The European maritime area faces several risks and threats posed by unlawful activities, such as drugs trafficking, smuggling, illegal immigration, organised crime and terrorism. Piracy in international waters also constitutes a threat to Europe since it can disrupt the maritime transport chain. These risks and threats can endanger human lives, marine resources and the environment, as well as significantly disrupt the transport chain and global and local security. It is anticipated that these risks and threats will endure in the mid and long run. In order to keep Europe as a world leader in the global maritime economy, an effective integrated/interoperable, sustainable maritime surveillance system and situational awareness are needed. A significant number of unlawful maritime activities, such as illegal immigration, drugs trafficking, smuggling, piracy and terrorism involve mainly small boats, because small boats are faster and more difficult to detect using conventional means. Hence, it is very important to find out the feasibility of using Unmanned Aerial Systems (UAS) for small boat detection, tracking, classification and identification, as well as to study the potential of UAS for maritime surveillance. Since 2010 the EC-JRC has carried out a number of UAS maritime surveillance campaigns to study the potential of UAS for maritime surveillance, in particular for small boat detection. This report presents the results and conclusions of the JRC – Elbit Systems Coupled UAS and Spaceborne SAR campaign carried out in Dec. 2010 in Haifa, Israel.JRC.G.4-Maritime affair

From Orbit to Ocean—Fixing Southeast Asia’s Remote-Sensing Blind Spots

Improving maritime domain awareness (MDA) in Southeast Asia is critical not only for regional states but for the national-security interests of the United States. MDA in the coming decades will be dominated by cheaper, more-efficient remote-sensing tools, and the United States and other outside parties should shift toward introducing partners to the booming private-sector offerings in remote sensing