Proceedings of MARESEC 2023

The 3rd European Workshop on Maritime Systems Resilience and Security (MARESEC) was dedicated to the research on Resilience, Security, Technology and related Ethical, Legal, and Social Aspects (ELSA) in the context of Maritime Systems, including but not restricted to Offshore/Onshore Infrastructures, Navigation and Shipping and Autonomous Systems. The event, organized by the Institute for the Protection of Maritime Infrastructures of the German Aerospace Center (DLR), took place virtually on June 27th , 2023, with over 60 participants. Out of all submitted extended abstracts, 13 were selected for oral presentations, and 2 keynotes were delivered on Maritime Surveillance and Networked Autonomous Underwater Robots. Additionally, 2 student presentations were held. The contributions to the conference came from institutions in 22 countries. The final schedule can be found in the appendix

Improving YOLOv8 with Scattering Transform and Attention for Maritime Awareness

Ship recognition and georeferencing using monitoring cameras are crucial to many applications in maritime situational awareness. Although deep learning algorithms are available for ship recognition tasks, there is a need for innovative approaches that attain higher precision rates irrespective of ship sizes, types, or physical hardware limitations. Furthermore, their deployment in maritime environments requires embedded systems capable of image processing, with balanced accuracy, reduced latency and low energy consumption. To achieve that, we build upon the foundations of the standard YOLOv8 and present a novel architecture that improves the segmentation and georeferencing of ships in the context of maritime awareness using a real-world dataset (ShipSG). Our architecture synergizes global and local features in the image for improved ship segmentation and georeferencing. The 2D scattering-transform enhances the YOLOv8 backbone by extracting global structural features from the image. The addition of convolutional block attention module (CBAM) in the head allows focusing on relevant spatial and channel-wise regions. We achieve mAP of 75.46%, comparable to larger YOLOv8 models at a much faster inference speed, 59.3 milliseconds per image, when deployed on the NVIDIA Jetson Xavier AGX as target embedded system. We applied the modified network to georeference the segmented ship masks, with a georeferencing distance error of 18 meters, which implies comparable georeferencing performance to non-embedded approaches

Look ATME: The Discriminator Mean Entropy Needs Attention

Generative adversarial networks (GANs) are successfully used for image synthesis but are known to face instability during training. In contrast, probabilistic diffusion models (DMs) are stable and generate high-quality images, at the cost of an expensive sampling procedure. In this paper, we introduce a simple method to allow GANs to stably converge to their theoretical optimum, while bringing in the denoising machinery from DMs. These models are combined into a simpler model (ATME) that only requires a forward pass during inference, making predictions cheaper and more accurate than DMs and popular GANs. ATME breaks an information asymmetry existing in most GAN models in which the discriminator has spatial knowledge of where the generator is failing. To restore the information symmetry, the generator is endowed with knowledge of the entropic state of the discriminator, which is leveraged to allow the adversarial game to converge towards equilibrium. We demonstrate the power of our method in several image-to-image translation tasks, showing superior performance than state-of-the-art methods at a lesser cost. Code is available at https://github.com/DLR-MI/atme

Real-time embedded reconstruction of dynamic objects for a 3D maritime situational awareness picture

Monitoring maritime infrastructures is an important part of maritime safety and security. To best assess the security status of these facilities, detailed information should be made available to stakeholders, such as port authorities, law enforcement agencies and emergency services in a concise and easily understandable format. In this work, we propose a novel real-time 3D reconstruction framework for enhancing maritime situational awareness. We introduce and verify a pipeline prototype for dynamic 3D reconstruction of maritime objects using a static observer and stereoscopic cameras on an GPU-accelerated embedded device. Our pipeline runs with approx. 6Hz on a Nvidia Jetson Xavier AGX embedded system and is verified using a simulated dataset of a harbor basin

A Prospective, Multicenter, Real-World Registry of Coronary Lithotripsy in Calcified Coronary Arteries

BACKGROUND Intravascular lithotripsy (IVL) has demonstrated effectiveness in the treatment of calcified lesions in selected patients with stable coronary disease. OBJECTIVES The authors sought to assess the performance of coronary IVL in calcified coronary lesions in a real-life, all comers, setting. METHODS The REPLICA-EPIC18 study prospectively enrolled consecutive patients treated with IVL in 26 centers in Spain. An independent core laboratory performed the angiographic analysis and event adjudication. The primary effectiveness endpoint assessed procedural success (successful IVL delivery, final diameter stenosis <20%, and absence of in- hospital major adverse cardiovascular events [MACE]). The primary safety endpoint measured freedom from MACE at 30 days. A predefined substudy compared outcomes between acute coronary syndrome (ACS) and chronic coronary syndrome (CCS) patients. RESULTS A total of 426 patients (456 lesions) were included, 63% of the patients presenting with ACS. IVL delivery was successful in 99% of cases. Before IVL, 49% of lesions were considered undilatable. The primary effectiveness endpoint was achieved in 66% of patients, with similar rates among CCS patients (68%) and ACS patients (65%). Likewise, there were no significant differences in angiographic success after IVL between CCS and ACS patients. The rate of MACE at 30 days (primary safety endpoint) was 3% (1% in CCS and 5% in ACS patients [P = 0.073]). CONCLUSIONS Coronary IVL proved to be a feasible and safe procedure in a real-life setting, effectively facilitating stent implantation in severely calcified lesions. Patients with ACS on admission showed similar angiographic success rates but showed a trend toward higher 30-day MACE compared with patients with CCS. (REPLICA-EPIC18 study [Registry of Coronary Lithotripsy in Spain]; NCT04298307) (c) 2024 The Authors. Published by Elsevier on behalf of the American College of Cardiology Foundation. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/)

Detection and Geovisualization of Abnormal Vessel Behavior from Video

Intelligent maritime situational awareness pursues an effective understanding of the majority of the activities related to the maritime domain (impacting the safety, security, economy, or environment), with the aid of artificial intelligence systems. Such an understanding requires the development of automated processes capable of not only detecting abnormal behavior but also of visually-representing and interpreting it. Although much progress has been made in anomaly detection and visualization using vessel self-reporting positioning data, there have been no corresponding advances using video data, despite the increasing use of cameras for maritime surveillance. In this work, we introduce a framework which goes beyond vessel tracking for anomaly detection in video, and is therefore applicable to scenes with a high density of vessels. The proposed framework detects abnormal behavior using a Generative Adversarial Network (GAN) and interprets this knowledge using metrics derived from clustering the positions and courses provided by an independent vessel/motion detector. These detections are geovisualized using an advanced displaying tool where detected abnormal behavior may be localized on the globe, providing an infrastructure for intelligent maritime situational awareness

Object detection in dehazed Optical and Infrared Images

Images captured in the presence of smoke and fog will often suffer from bad visibility. In such scenario, the limited perception poses a massive problem for monitoring infrastructures. In the event of a disaster, or even an attack, smoke and fog might hinder emergency services such as fire-services. The Institutes for the Protection of Terrestrial and Maritime Infrastructures, subscribed to the German Aerospace Center (DLR), are dedicated to develop concepts and technologies to help to improve the safety and security of critical maritime and terrestrial infrastructures. In this poster, first the concept of efficient image dehazing will be exploited. Second, it will be shown how state-of-the-art algorithms in object detection improve their performance by using dehazed images when smoke and fog are present. Finally, this two-stage approach has been applied to optical and infrared images, showing the robustness and possible application of dehazing in this field

2nd Workshop on Maritime Computer Vision (MaCVi) 2024: Challenge Results

The 2nd Workshop on Maritime Computer Vision (MaCVi) 2024 addresses maritime computer vision for Unmanned Aerial Vehicles (UAV) and Unmanned Surface Vehicles (USV). Three challenges categories are considered: (i) UAV-based Maritime Object Tracking with Re-Identification, (ii) USV-based Maritime Obstacle Segmentation and Detection, (iii) USV-based Maritime Boat Tracking. The USV-based Maritime Obstacle Segmentation and Detection features three sub-challenges, including a new embedded challenge addressing efficient inference on real-world embedded devices. This report offers a comprehensive overview of the findings from the challenges. We provide both statistical and qualitative analyses, evaluating trends from over 195 submissions. All datasets, evaluation code, and the leaderboard are available to the public at https://macvi.org/workshop/macvi2

Weaning from mechanical ventilation in intensive care units across 50 countries (WEAN SAFE): a multicentre, prospective, observational cohort study

Background Current management practices and outcomes in weaning from invasive mechanical ventilation are poorly understood. We aimed to describe the epidemiology, management, timings, risk for failure, and outcomes of weaning in patients requiring at least 2 days of invasive mechanical ventilation. Methods WEAN SAFE was an international, multicentre, prospective, observational cohort study done in 481 intensive care units in 50 countries. Eligible participants were older than 16 years, admitted to a participating intensive care unit, and receiving mechanical ventilation for 2 calendar days or longer. We defined weaning initiation as the first attempt to separate a patient from the ventilator, successful weaning as no reintubation or death within 7 days of extubation, and weaning eligibility criteria based on positive end-expiratory pressure, fractional concentration of oxygen in inspired air, and vasopressors. The primary outcome was the proportion of patients successfully weaned at 90 days. Key secondary outcomes included weaning duration, timing of weaning events, factors associated with weaning delay and weaning failure, and hospital outcomes. This study is registered with ClinicalTrials.gov, NCT03255109. Findings Between Oct 4, 2017, and June 25, 2018, 10 232 patients were screened for eligibility, of whom 5869 were enrolled. 4523 (77·1%) patients underwent at least one separation attempt and 3817 (65·0%) patients were successfully weaned from ventilation at day 90. 237 (4·0%) patients were transferred before any separation attempt, 153 (2·6%) were transferred after at least one separation attempt and not successfully weaned, and 1662 (28·3%) died while invasively ventilated. The median time from fulfilling weaning eligibility criteria to first separation attempt was 1 day (IQR 0–4), and 1013 (22·4%) patients had a delay in initiating first separation of 5 or more days. Of the 4523 (77·1%) patients with separation attempts, 2927 (64·7%) had a short wean (≤1 day), 457 (10·1%) had intermediate weaning (2–6 days), 433 (9·6%) required prolonged weaning (≥7 days), and 706 (15·6%) had weaning failure. Higher sedation scores were independently associated with delayed initiation of weaning. Delayed initiation of weaning and higher sedation scores were independently associated with weaning failure. 1742 (31·8%) of 5479 patients died in the intensive care unit and 2095 (38·3%) of 5465 patients died in hospital. Interpretation In critically ill patients receiving at least 2 days of invasive mechanical ventilation, only 65% were weaned at 90 days. A better understanding of factors that delay the weaning process, such as delays in weaning initiation or excessive sedation levels, might improve weaning success rates

Weaning from mechanical ventilation in intensive care units across 50 countries (WEAN SAFE): a multicentre, prospective, observational cohort study

Background: Current management practices and outcomes in weaning from invasive mechanical ventilation are poorly understood. We aimed to describe the epidemiology, management, timings, risk for failure, and outcomes of weaning in patients requiring at least 2 days of invasive mechanical ventilation. Methods: WEAN SAFE was an international, multicentre, prospective, observational cohort study done in 481 intensive care units in 50 countries. Eligible participants were older than 16 years, admitted to a participating intensive care unit, and receiving mechanical ventilation for 2 calendar days or longer. We defined weaning initiation as the first attempt to separate a patient from the ventilator, successful weaning as no reintubation or death within 7 days of extubation, and weaning eligibility criteria based on positive end-expiratory pressure, fractional concentration of oxygen in inspired air, and vasopressors. The primary outcome was the proportion of patients successfully weaned at 90 days. Key secondary outcomes included weaning duration, timing of weaning events, factors associated with weaning delay and weaning failure, and hospital outcomes. This study is registered with ClinicalTrials.gov, NCT03255109. Findings: Between Oct 4, 2017, and June 25, 2018, 10 232 patients were screened for eligibility, of whom 5869 were enrolled. 4523 (77·1%) patients underwent at least one separation attempt and 3817 (65·0%) patients were successfully weaned from ventilation at day 90. 237 (4·0%) patients were transferred before any separation attempt, 153 (2·6%) were transferred after at least one separation attempt and not successfully weaned, and 1662 (28·3%) died while invasively ventilated. The median time from fulfilling weaning eligibility criteria to first separation attempt was 1 day (IQR 0-4), and 1013 (22·4%) patients had a delay in initiating first separation of 5 or more days. Of the 4523 (77·1%) patients with separation attempts, 2927 (64·7%) had a short wean (≤1 day), 457 (10·1%) had intermediate weaning (2-6 days), 433 (9·6%) required prolonged weaning (≥7 days), and 706 (15·6%) had weaning failure. Higher sedation scores were independently associated with delayed initiation of weaning. Delayed initiation of weaning and higher sedation scores were independently associated with weaning failure. 1742 (31·8%) of 5479 patients died in the intensive care unit and 2095 (38·3%) of 5465 patients died in hospital. Interpretation: In critically ill patients receiving at least 2 days of invasive mechanical ventilation, only 65% were weaned at 90 days. A better understanding of factors that delay the weaning process, such as delays in weaning initiation or excessive sedation levels, might improve weaning success rates. Funding: European Society of Intensive Care Medicine, European Respiratory Society