Rapid post-disaster infrastructure damage characterisation enabled by remote sensing and deep learning technologies -- a tiered approach

Critical infrastructure, such as transport networks and bridges, are systematically targeted during wars and suffer damage during extensive natural disasters because it is vital for enabling connectivity and transportation of people and goods, and hence, underpins national and international economic growth. Mass destruction of transport assets, in conjunction with minimal or no accessibility in the wake of natural and anthropogenic disasters, prevents us from delivering rapid recovery and adaptation. As a result, systemic operability is drastically reduced, leading to low levels of resilience. Thus, there is a need for rapid assessment of its condition to allow for informed decision-making for restoration prioritisation. A solution to this challenge is to use technology that enables stand-off observations. Nevertheless, no methods exist for automated characterisation of damage at multiple scales, i.e. regional (e.g., network), asset (e.g., bridges), and structural (e.g., road pavement) scales. We propose a methodology based on an integrated, multi-scale tiered approach to fill this capability gap. In doing so, we demonstrate how automated damage characterisation can be enabled by fit-for-purpose digital technologies. Next, the methodology is applied and validated to a case study in Ukraine that includes 17 bridges, damaged by human targeted interventions. From regional to component scale, we deploy technology to integrate assessments using Sentinel-1 SAR images, crowdsourced information, and high-resolution images for deep learning to facilitate automatic damage detection and characterisation. For the first time, the interferometric coherence difference and semantic segmentation of images were deployed in a tiered multi-scale approach to improve the reliability of damage characterisations at different scales

Deep learning methods applied to digital elevation models: state of the art

Deep Learning (DL) has a wide variety of applications in various thematic domains, including spatial information. Although with limitations, it is also starting to be considered in operations related to Digital Elevation Models (DEMs). This study aims to review the methods of DL applied in the field of altimetric spatial information in general, and DEMs in particular. Void Filling (VF), Super-Resolution (SR), landform classification and hydrography extraction are just some of the operations where traditional methods are being replaced by DL methods. Our review concludes that although these methods have great potential, there are aspects that need to be improved. More appropriate terrain information or algorithm parameterisation are some of the challenges that this methodology still needs to face.Functional Quality of Digital Elevation Models in Engineering’ of the State Agency Research of SpainPID2019-106195RB- I00/AEI/10.13039/50110001103

Site Characterization Using Integrated Imaging Analysis Methods on Satellite Data of the Islamabad, Pakistan, Region

We develop an integrated digital imaging analysis approach to produce a first-approximation site characterization map for Islamabad, Pakistan, based on remote-sensing data. We apply both pixel-based and object-oriented digital imaging analysis methods to characterize detailed (1:50,000) geomorphology and geology from Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) satellite imagery. We use stereo-correlated relative digital elevation models (rDEMs) derived from ASTER data, as well as spectra in the visible near-infrared (VNIR) to thermal infrared (TIR) domains. The resulting geomorphic units in the study area are classified as mountain (including the Margala Hills and the Khairi Murat Ridge), piedmont, and basin terrain units. The local geologic units are classified as limestone in the Margala Hills and the Khairi Murat Ridge and sandstone rock types for the piedmonts and basins. Shear-wave velocities for these units are assigned in ranges based on established correlations in California. These ranges include Vs30-values to be greater than 500 m/sec for mountain units, 200–600 m/sec for piedmont units, and less than 300 m/sec for basin units. While the resulting map provides the basis for incorporating site response in an assessment of seismic hazard for Islamabad, it also demonstrates the potential use of remote-sensing data for site characterization in regions where only limited conventional mapping has been done

Large-scale 3D environmental modelling and visualisation for flood hazard warning.

3D environment reconstruction has received great interest in recent years in areas such as city planning, virtual tourism and flood hazard warning. With the rapid development of computer technologies, it has become possible and necessary to develop new methodologies and techniques for real time simulation for virtual environments applications. This thesis proposes a novel dynamic simulation scheme for flood hazard warning. The work consists of three main parts: digital terrain modelling; 3D environmental reconstruction and system development; flood simulation models. The digital terrain model is constructed using real world measurement data of GIS, in terms of digital elevation data and satellite image data. An NTSP algorithm is proposed for very large data assessing, terrain modelling and visualisation. A pyramidal data arrangement structure is used for dealing with the requirements of terrain details with different resolutions. The 3D environmental reconstruction system is made up of environmental image segmentation for object identification, a new shape match method and an intelligent reconstruction system. The active contours-based multi-resolution vector-valued framework and the multi-seed region growing method are both used for extracting necessary objects from images. The shape match method is used with a template in the spatial domain for a 3D detailed small scale urban environment reconstruction. The intelligent reconstruction system is designed to recreate the whole model based on specific features of objects for large scale environment reconstruction. This study then proposes a new flood simulation scheme which is an important application of the 3D environmental reconstruction system. Two new flooding models have been developed. The first one is flood spreading model which is useful for large scale flood simulation. It consists of flooding image spatial segmentation, a water level calculation process, a standard gradient descent method for energy minimization, a flood region search and a merge process. The finite volume hydrodynamic model is built from shallow water equations which is useful for urban area flood simulation. The proposed 3D urban environment reconstruction system was tested on our simulation platform. The experiment results indicate that this method is capable of dealing with complicated and high resolution region reconstruction which is useful for many applications. When testing the 3D flood simulation system, the simulation results are very close to the real flood situation, and this method has faster speed and greater accuracy of simulating the inundation area in comparison to the conventional flood simulation model

Integrating Remote Sensing Techniques into Forest Monitoring: Selected Topics with a Focus on Thermal Remote Sensing

A sustainable management of natural resources, in particular of forests, is of great importance to preserve the ecological, environmental and economic benefits of forests for future generations. An enhanced understanding of the current situation and ongoing trends of forests, e.g. through policy interventions, is crucial to managing the forest wisely. In this context, forest monitoring is essential for collecting the base data required and for observing trends. Despite the wide range of approved methods and techniques for both close-range and satellite-based remote sensing monitoring, ongoing forest monitoring research is still grappling with specific and unresolved questions: The data acquired must be more reliable, in particular over a long-term period; costs need to be reduced through advancements in both methods and technology that offer easier and more feasible ways of interpreting data. This thesis comprises a number of focused studies, each with their individual and specific research questions, and aims to explore the benefits of innovative methods and technologies. The main emphasis of the studies presented is the integration of close-range and satellite-based remote sensing for enhancing the efficiency of forest monitoring. Manuscript I discusses thermal canopy photography, a new field of application. This approach takes advantage of the large differences in temperature between sky and non-sky pixels and overcomes the inconsistencies of finding an optimal threshold. For an unambiguously separation of “sky” and “non-sky” pixels, a global threshold of 0 °C was defined. Currently, optical or hemispherical canopy photography is the most widely used method to extract crown-related variables. However, a number of aspects, such as exposure, illumination conditions, and threshold definition present a challenge in optical canopy photography and dramatically influence the result; consequently, a comparison of the results from optical canopy photography at a different point in time derived is not advisable. For forest monitoring, where repeated measurements of the canopy cover on the same plots were undertaken, it is therefore of utmost importance to devise a standard protocol to estimate changes in and compare the canopy covers. This paper offers such a protocol by introducing thermal canopy photography. A feasible and accurate method that examines the strong correlation (R2 = 0.96) of canopy closure values derived from thermal and optical image pairs. Thermal photography, as a close-range remote sensing technique, also aids data collection and analysis in other contexts, for instance to expand our knowledge about bamboo tree species: Information about the maturity of bamboo culms is of utmost importance for managing bamboo stands because only then the process of lignification is finished and the culm is technically stronger and more resistant to insect and fungi attacks. The findings of a study (Manuscript III) conducted in Pereira, Colombia, show small differences in culm surface temperature between culms of different ages for the bamboo species Guadua angustifolia K., which may be a sign of maturity. The surface temperature of 12 culms was measured after sunrise using the thermal camera system FLIR 60Ebx. This study shows an innovative close-range remote sensing technique which may support researchers’ determination of the maturity of bamboo culms. This research is in its inception phase and our results are the first of this kind. In the context of analyzing, in particular of thermal imagery time-series data, Manuscript (IV) offers a new methodology using advanced statistical methods. Otsu Thresholding, an automatic segmentation technique is used in a first processing step. O’Sullivan penalized splines estimated the temperature profile extracted from the canopy leaf temperature. A final comparison of the different profiles is done by constructing simultaneous confidence bands. The result shows an approximately significant difference in canopy leaf temperature. For this study, we successfully cooperated with the Center for Statistics at Göttingen University (Prof. Kneib). The second close-range remote sensing technology employed in this thesis is terrestrial laser scanning which is used here to enhance our understanding about buttressed trees. Big trees with an irregular non-convex shape are important contributors to aboveground biomass in tropical forests, but an accurate estimation of their biomass is still a challenge and often remains biased. Allometric equations including tree diameter and height as predictors are currently used in tropical forests, but they are often not calibrated for such large and irregular trees where measuring the diameter is quite difficult. Against this background, Manuscript II shows the result of the 3D-analysis of 12 buttressed trees. This study was conducted in the Botanical Garden of Bogor, Indonesia, using a state-of-the-art terrestrial laser scanner. The findings allow for new insights into the irregular geometry of buttressed trees and the methodological approach employed in this paper will help to improve volume and biomass models for this kind of tree. The results suggest a strong relationship (R² = 0.87) between cross-sectional areas at diameter above buttress (DAB) height and the actual tree basal area measured at 1.3 m height. The accuracy of field biomass estimates is crucial if the data are used to calibrate models to predict the forest biomass on landscape level using remote sensing imagery. The linkage between technology and methodology in the context of forest monitoring remote sensing enhance our knowledge in extracting more reliable information on tree cover estimation. The pre-processing of satellite images plays a crucial role in the processing workflow and particularly the illumination correction has a direct effect on the estimated tree cover. Manuscript IV evaluates four DEMs (Pleiades DSM, SRTM30, SRTM V4.1 and SRTM-X) that are available for the area of Shitai County (Anhui Province, Southeast China) for the purpose of an optimized illumination correction and tree cover estimation from optical RapidEye satellite images. The findings presented in this study suggest that the change in tree cover is contingent on the respective digital elevation models used for pre-processing the data. Imagery corrected with the freely available SRTM30 DEM with 30 m resolution leads to a higher accuracy in the estimation of tree cover based on the high-resolution and cost intensive Pleaides DEM. These manuscripts eventually seek to resolve some of the issues and provide answers to some of the detailed questions that still persist at different steps of the forest monitoring process. In future, these new and innovate methods and technologies will maybe integrate into forest monitoring programs

ELULC-10, a 10 m European land use and land cover map using Sentinel and landsat data in Google Earth Engine

Land Use/Land Cover (LULC) maps can be effectively produced by cost-effective and frequent satellite observations. Powerful cloud computing platforms are emerging as a growing trend in the high utilization of freely accessible remotely sensed data for LULC mapping over large-scale regions using big geodata. This study proposes a workflow to generate a 10 m LULC map of Europe with nine classes, ELULC-10, using European Sentinel-1/-2 and Landsat-8 images, as well as the LUCAS reference samples. More than 200 K and 300 K of in situ surveys and images, respectively, were employed as inputs in the Google Earth Engine (GEE) cloud computing platform to perform classification by an object-based segmentation algorithm and an Artificial Neural Network (ANN). A novel ANN-based data preparation was also presented to remove noisy reference samples from the LUCAS dataset. Additionally, the map was improved using several rule-based post-processing steps. The overall accuracy and kappa coefficient of 2021 ELULC-10 were 95.38% and 0.94, respectively. A detailed report of the classification accuracies was also provided, demonstrating an accurate classification of different classes, such as Woodland and Cropland. Furthermore, rule-based post processing improved LULC class identifications when compared with current studies. The workflow could also supply seasonal, yearly, and change maps considering the proposed integration of complex machine learning algorithms and large satellite and survey data.Peer ReviewedPostprint (published version

Information Extraction and Modeling from Remote Sensing Images: Application to the Enhancement of Digital Elevation Models

To deal with high complexity data such as remote sensing images presenting metric resolution over large areas, an innovative, fast and robust image processing system is presented. The modeling of increasing level of information is used to extract, represent and link image features to semantic content. The potential of the proposed techniques is demonstrated with an application to enhance and regularize digital elevation models based on information collected from RS images

Remote Sensing for International Stability and Security - Integrating GMOSS Achievements in GMES

The Joint Research Centre of the European Commission hosted a two-day workshop "Remote sensing for international stability and security: integrating GMOSS achievements in GMES". Its aim was to disseminate the scientific and technical achievements of the Global Monitoring for Security and Stability (GMOSS) network of excellence to partners of ongoing and future GMES projects such as RESPOND, LIMES, RISK-EOS,PREVIEW, BOSS4GMES, SAFER, G-MOSAIC. The objectives of this workshop were: ¿ To bring together scientific and technical people from the GMOSS NoE and from thematically related GMES projects. ¿ To discuss and compare alternative technical solutions (e.g. final experimental understanding from GMOSS, operational procedures applied in projects such as RESPOND, pre-operational application procedures foreseen from LIMES, etc.) ¿ To draft a list of technical and scientific challenges relevant in the next future. ¿ To open GMOSS to a wider forum in the JRC This report contains abstracts of the fifteen contributions presented by European researchers. The different presentations addressed pre-processing, feature recognition, change detection and applications which represents also the structure of the report. The second part includes poster abstracts presented during a separate poster session.JRC.G.2-Global security and crisis managemen