Synthetic Aperture Radar (SAR) Meets Deep Learning

This reprint focuses on the application of the combination of synthetic aperture radars and depth learning technology. It aims to further promote the development of SAR image intelligent interpretation technology. A synthetic aperture radar (SAR) is an important active microwave imaging sensor, whose all-day and all-weather working capacity give it an important place in the remote sensing community. Since the United States launched the first SAR satellite, SAR has received much attention in the remote sensing community, e.g., in geological exploration, topographic mapping, disaster forecast, and traffic monitoring. It is valuable and meaningful, therefore, to study SAR-based remote sensing applications. In recent years, deep learning represented by convolution neural networks has promoted significant progress in the computer vision community, e.g., in face recognition, the driverless field and Internet of things (IoT). Deep learning can enable computational models with multiple processing layers to learn data representations with multiple-level abstractions. This can greatly improve the performance of various applications. This reprint provides a platform for researchers to handle the above significant challenges and present their innovative and cutting-edge research results when applying deep learning to SAR in various manuscript types, e.g., articles, letters, reviews and technical reports

Global Dynamics of the Offshore Wind Energy Sector Derived from Earth Observation Data - Deep Learning Based Object Detection Optimised with Synthetic Training Data for Offshore Wind Energy Infrastructure Extraction from Sentinel-1 Imagery

The expansion of renewable energies is being driven by the gradual phaseout of fossil fuels in order to reduce greenhouse gas emissions, the steadily increasing demand for energy and, more recently, by geopolitical events. The offshore wind energy sector is on the verge of a massive expansion in Europe, the United Kingdom, China, but also in the USA, South Korea and Vietnam. Accordingly, the largest marine infrastructure projects to date will be carried out in the upcoming decades, with thousands of offshore wind turbines being installed. In order to accompany this process globally and to provide a database for research, development and monitoring, this dissertation presents a deep learning-based approach for object detection that enables the derivation of spatiotemporal developments of offshore wind energy infrastructures from satellite-based radar data of the Sentinel-1 mission. For training the deep learning models for offshore wind energy infrastructure detection, an approach is presented that makes it possible to synthetically generate remote sensing data and the necessary annotation for the supervised deep learning process. In this synthetic data generation process, expert knowledge about image content and sensor acquisition techniques is made machine-readable. Finally, extensive and highly variable training data sets are generated from this knowledge representation, with which deep learning models can learn to detect objects in real-world satellite data. The method for the synthetic generation of training data based on expert knowledge offers great potential for deep learning in Earth observation. Applications of deep learning based methods can be developed and tested faster with this procedure. Furthermore, the synthetically generated and thus controllable training data offer the possibility to interpret the learning process of the optimised deep learning models. The method developed in this dissertation to create synthetic remote sensing training data was finally used to optimise deep learning models for the global detection of offshore wind energy infrastructure. For this purpose, images of the entire global coastline from ESA's Sentinel-1 radar mission were evaluated. The derived data set includes over 9,941 objects, which distinguish offshore wind turbines, transformer stations and offshore wind energy infrastructures under construction from each other. In addition to this spatial detection, a quarterly time series from July 2016 to June 2021 was derived for all objects. This time series reveals the start of construction, the construction phase and the time of completion with subsequent operation for each object. The derived offshore wind energy infrastructure data set provides the basis for an analysis of the development of the offshore wind energy sector from July 2016 to June 2021. For this analysis, further attributes of the detected offshore wind turbines were derived. The most important of these are the height and installed capacity of a turbine. The turbine height was calculated by a radargrammetric analysis of the previously detected Sentinel-1 signal and then used to statistically model the installed capacity. The results show that in June 2021, 8,885 offshore wind turbines with a total capacity of 40.6~GW were installed worldwide. The largest installed capacities are in the EU (15.2~GW), China (14.1~GW) and the United Kingdom (10.7~GW). From July 2016 to June 2021, China has expanded 13~GW of offshore wind energy infrastructure. The EU has installed 8~GW and the UK 5.8~GW of offshore wind energy infrastructure in the same period. This temporal analysis shows that China was the main driver of the expansion of the offshore wind energy sector in the period under investigation. The derived data set for the description of the offshore wind energy sector was made publicly available. It is thus freely accessible to all decision-makers and stakeholders involved in the development of offshore wind energy projects. Especially in the scientific context, it serves as a database that enables a wide range of investigations. Research questions regarding offshore wind turbines themselves as well as the influence of the expansion in the coming decades can be investigated. This supports the imminent and urgently needed expansion of offshore wind energy in order to promote sustainable expansion in addition to the expansion targets that have been set

Integrated Applications of Geo-Information in Environmental Monitoring

This book focuses on fundamental and applied research on geo-information technology, notably optical and radar remote sensing and algorithm improvements, and their applications in environmental monitoring. This Special Issue presents ten high-quality research papers covering up-to-date research in land cover change and desertification analyses, geo-disaster risk and damage evaluation, mining area restoration assessments, the improvement and development of algorithms, and coastal environmental monitoring and object targeting. The purpose of this Special Issue is to promote exchanges, communications and share the research outcomes of scientists worldwide and to bridge the gap between scientific research and its applications for advancing and improving society

Optical remote sensing of water quality parameters retrieval in the Barents Sea

This thesis addresses various aspects of monitoring water quality indicators (WQIs) using optical remote sensing technologies. The dynamic nature of aquatic systems necessitate frequent monitoring at high spatial resolution. Machine learning (ML)-based algorithms are becoming increasingly common for these applications. ML algorithms are required to be trained by a significant amount of training data, and their accuracy depends on the performance of the atmospheric correction (AC) algorithm being used for correcting atmospheric effects. AC over open oceanic waters generally performs reasonably well; however, limitations still exist over inland and coastal waters. AC becomes more challenging in the high north waters, such as the Barents Sea, due to the unique in-water optical properties at high latitudes, long ray pathways, as well as the scattering of light from neighboring sea ice into the sensors’ field of view adjacent to ice-infested waters. To address these challenges, we evaluated the performances of state-of-the-art AC algorithms applied to the high-resolution satellite sensors Landsat-8 Operational Land Imager (OLI) and Sentinel-2 Multispectral Instrument (MSI), both for high-north (Paper II) and for global inland and coastal waters (Paper III). Using atmospherically corrected remote sensing reflectance (Rrs ) products, estimated after applying the top performing AC algorithm, we present a new bandpass adjustment (BA) method for spectral harmonization of Rrs products from OLI and MSI. This harmonization will enable an increased number of ocean color (OC) observations and, hence, a larger amount of training data. The BA model is based on neural networks (NNs), which perform a pixel-by-pixel transformation of MSI-derived Rrs to that of OLI equivalent for their common bands. In addition, to accurately retrieve concentrations of Chlorophyll-a (Chl-a) and Color Dissolved Organic Matter (CDOM) from remotely sensed data, we propose in the thesis (Paper 1) an NN-based WQI retrieval model dubbed Ocean Color Net (OCN). Our results indicate that Rrs retrieved via the Acolite Dark Spectrum Fitting (DSF) method is in best agreement with in-situ Rrs observations in the Barents Sea compared to the other methods. The median absolute percentage difference (MAPD) in the blue-green bands ranges from 9% to 25%. In the case of inland and coastal waters (globally), we found that OC-SMART is the top performer, with MAPD Rrs products for varying optical regimes than previously presented methods. Additionally, to improve the analysis of remote sensing spectral data, we introduce a new spatial window-based match-up data set creation method which increases the training data set and allows for better tuning of regression models. Based on comparisons with in-water measured Chl-a profiles in the Barents Sea, our analysis indicates that the MSI-derived Rrs products are more sensitive to the depth-integrated Chl-a contents than near-surface Chl-a values (Paper I). In the case of inland and coastal waters, our study shows that using combined OLI and BA MSI-derived Rrs match-ups results in considerable improvement in the retrieval of WQIs (Paper III). The obtained results for the datasets used in this thesis illustrates that the proposed OCN algorithm shows better performance in retrieving WQIs than other semi-empirical algorithms such as the band ratio-based algorithm, the ML-based Gaussian Process Regression (GPR), as well as the globally trained Case-2 Regional/Coast Colour (C2RCC) processing chain model C2RCC-networks, and OC-SMART. The work in this thesis contributes to ongoing research in developing new methods for merging data products from multiple OC missions for increased coverage and the number of optical observations. The developed algorithms are validated in various environmental and aquatic conditions and have the potential to contribute to accurate and consistent retrievals of in-water constituents from high-resolution satellite sensors

Ocean Remote Sensing with Synthetic Aperture Radar

The ocean covers approximately 71% of the Earth’s surface, 90% of the biosphere and contains 97% of Earth’s water. The Synthetic Aperture Radar (SAR) can image the ocean surface in all weather conditions and day or night. SAR remote sensing on ocean and coastal monitoring has become a research hotspot in geoscience and remote sensing. This book—Progress in SAR Oceanography—provides an update of the current state of the science on ocean remote sensing with SAR. Overall, the book presents a variety of marine applications, such as, oceanic surface and internal waves, wind, bathymetry, oil spill, coastline and intertidal zone classification, ship and other man-made objects’ detection, as well as remotely sensed data assimilation. The book is aimed at a wide audience, ranging from graduate students, university teachers and working scientists to policy makers and managers. Efforts have been made to highlight general principles as well as the state-of-the-art technologies in the field of SAR Oceanography

Remote Sensing of the Aquatic Environments

The book highlights recent research efforts in the monitoring of aquatic districts with remote sensing observations and proximal sensing technology integrated with laboratory measurements. Optical satellite imagery gathered at spatial resolutions down to few meters has been used for quantitative estimations of harmful algal bloom extent and Chl-a mapping, as well as winds and currents from SAR acquisitions. The knowledge and understanding gained from this book can be used for the sustainable management of bodies of water across our planet

Deep Learning Detected Nutrient Deficiency in Chili Plant

Chili is a staple commodity that also affects the Indonesian economy due to high market demand. Proven in June 2019, chili is a contributor to Indonesia's inflation of 0.20% from 0.55%. One factor is crop failure due to malnutrition. In this study, the aim is to explore Deep Learning Technology in agriculture to help farmers be able to diagnose their plants, so that their plants are not malnourished. Using the RCNN algorithm as the architecture of this system. Use 270 datasets in 4 categories. The dataset used is primary data with chili samples in Boyolali Regency, Indonesia. The chili we use are curly chili. The results of this study are computers that can recognize nutrient deficiencies in chili plants based on image input received with the greatest testing accuracy of 82.61% and has the best mAP value of 15.57%