OBJECT-BASED CLASSIFICATION OF EARTHQUAKE DAMAGE FROM HIGH-RESOLUTION OPTICAL IMAGERY USING MACHINE LEARNING

Object-based approaches to the segmentation and supervised classification of remotely-sensed images yield more promising results compared to traditional pixel-based approaches. However, the development of an object-based approach presents challenges in terms of algorithm selection and parameter tuning. Subjective methods and trial and error are often used, but time consuming and yield less than optimal results. Objective methods are warranted, especially for rapid deployment in time sensitive applications such as earthquake induced damage assessment. Our research takes a systematic approach to evaluating object-based image segmentation and machine learning algorithms for the classification of earthquake damage in remotely-sensed imagery using Trimble’s eCognition software. We tested a variety of algorithms and parameters on post-event aerial imagery of the 2011 earthquake in Christchurch, New Zealand. Parameters and methods are adjusted and results compared against manually selected test cases representing different classifications used. In doing so, we can evaluate the effectiveness of the segmentation and classification of buildings, earthquake damage, vegetation, vehicles and paved areas, and compare different levels of multi-step image segmentations. Specific methods and parameters explored include classification hierarchies, object selection strategies, and multilevel segmentation strategies. This systematic approach to object-based image classification is used to develop a classifier that is then compared against current pixel-based classification methods for post-event imagery of earthquake damage. Our results show a measurable improvement against established pixel-based methods as well as object-based methods for classifying earthquake damage in high resolution, post-event imagery

Assessing Building Vulnerability to Tsunami Hazard Using Integrative Remote Sensing and GIS Approaches

Risk and vulnerability assessment for natural hazards is of high interest. Various methods focusing on building vulnerability assessment have been developed ranging from simple approaches to sophisticated ones depending on the objectives of the study, the availability of data and technology. In-situ assessment methods have been widely used to measure building vulnerability to various types of hazards while remote sensing methods, specifically developed for assessing building vulnerability to tsunami hazard, are still very limited. The combination of remote sensing approaches with in-situ methods offers unique opportunities to overcome limitations of in-situ assessments. The main objective of this research is to develop remote sensing techniques in assessing building vulnerability to tsunami hazard as one of the key elements of risk assessment. The research work has been performed in the framework of the GITEWS (German-Indonesian Tsunami Early Warning System) project. This research contributes to two major components of tsunami risk assessment: (1) the provision of infrastructure vulnerability information as an important element in the exposure assessment; (2) tsunami evacuation modelling which is a critical element for assessing immediate response and capability to evacuate as part of the coping capacity analysis. The newly developed methodology is based on the combination of in-situ measurements and remote sensing techniques in a so-called “bottom-up remote sensing approach”. Within this approach, basic information was acquired by in-situ data collection (bottom level), which was then used as input for further analysis in the remote sensing approach (upper level). The results of this research show that a combined in-situ measurement and remote sensing approach can be successfully employed to assess and classify buildings into 4 classes based on their level of vulnerability to tsunami hazard with an accuracy of more than 80 percent. Statistical analysis successfully revealed key spatial parameters which were regarded to link parameters between in-situ and remote sensing approach such as size, height, shape, regularity, orientation, and accessibility. The key spatial parameters and their specified threshold values were implemented in a decision tree algorithm for developing a remote sensing rule-set of building vulnerability classification. A big number of buildings in the study area (Cilacap city, Indonesia) were successfully classified into the building vulnerability classes. The categorization ranges from high to low vulnerable buildings (A to C) and includes also a category of buildings which are potentially suitable for tsunami vertical evacuation (VE). A multi-criteria analysis was developed that incorporates three main components for vulnerability assessment: stability, tsunami resistance and accessibility. All the defined components were configured in a decision tree algorithm by applying weighting, scoring and threshold definition based on the building sample data. Stability components consist of structure parameters, which are closely related to the building stability against earthquake energy. Building stability needs to be analyzed because most of tsunami events in Indonesia are preceded by major earthquakes. Stability components analysis was applied in the first step of the newly developed decision tree algorithm to evaluate the building stability when earthquake strikes. Buildings with total scores below the defined threshold of stability were classified as the most vulnerable class A. Such the buildings have a high probability of being damaged after earthquake events. The remaining buildings with total scores above the defined threshold of stability were further analyzed using tsunami components and accessibility components to classify them into the vulnerability classes B, C and VE respectively. This research is based on very high spatial resolution satellite images (QuickBird) and object-based image analysis. Object-based image analysis is was chosen, because it allows the formulation of rule-sets based on image objects instead of pixels, which has significant advantages especially for the analysis of very high resolution satellite images. In the pre-processing stage, three image processing steps were performed: geometric correction, pan-sharpening and filtering. Adaptive Local Sigma and Morphological Opening filter techniques were applied as basis for the subsequent building edge detection. The data pre-processing significantly increased the accuracy of the following steps of image classification. In the next step image segmentation was developed to extract adequate image objects to be used for further classification. Image classification was carried out by grouping resulting objects into desired classes based on the derived object features. A single object was assigned by its feature characteristics calculated in the segmentation process. The characteristic features of an object - which were grouped into spectral signature, shape, size, texture, and neighbouring relations - were analysed, selected and semantically modelled to classify objects into object classes. Fuzzy logic algorithm and object feature separation analysis was performed to set the member¬ship values of objects that were grouped into particular classes. Finally this approach successfully detected and mapped building objects in the study area with their spatial attributes which provide base information for building vulnerability classification. A building vulnerability classification rule-set has been developed in this research and successfully applied to categorize building vulnerability classes. The developed approach was applied for Cilacap city, Indonesia. In order to analyze the transferability of this newly developed approach, the algorithm was also applied to Padang City, Indonesia. The results showed that the developed methodology is in general transferable. However, it requires some adaptations (e.g. thresholds) to provide accurate results. The results of this research show that Cilacap City is very vulnerable to tsunami hazard. Class A (very vulnerable) buildings cover the biggest portion of area in Cilacap City (63%), followed by class C (28%), class VE (6%) and class B (3%). Preventive measures should be carried out for the purpose of disaster risk reduction, especially for people living in such the most vulnerable buildings. Finally, the results were applied for tsunami evacuation modeling. The buildings, which were categorized as potential candidates for vertical evacuation, were selected and a GIS approach was applied to model evacuation time and evacuation routes. The results of this analysis provide important inputs to the disaster management authorities for future evacuation planning and disaster mitigation

REMOTE SENSING DATA ANALYSIS FOR ENVIRONMENTAL AND HUMANITARIAN PURPOSES. The automation of information extraction from free satellite data.

This work is aimed at investigating technical possibilities to provide information on environmental parameters that can be used for risk management. The World food Program (WFP) is the United Nations Agency which is involved in risk management for fighting hunger in least-developed and low-income countries, where victims of natural and manmade disasters, refugees, displaced people and the hungry poor suffer from severe food shortages. Risk management includes three different phases (pre-disaster, response and post disaster) to be managed through different activities and actions. Pre disaster activities are meant to develop and deliver risk assessment, establish prevention actions and prepare the operative structures for managing an eventual emergency or disaster. In response and post disaster phase actions planned in the pre-disaster phase are executed focusing on saving lives and secondly, on social economic recovery. In order to optimally manage its operations in the response and post disaster phases, WFP needs to know, in order to estimate the impact an event will have on future food security as soon as possible, the areas affected by the natural disaster, the number of affected people, and the effects that the event can cause to vegetation. For this, providing easy-to-consult thematic maps about the affected areas and population, with adequate spatial resolution, time frequency and regular updating can result determining. Satellite remote sensed data have increasingly been used in the last decades in order to provide updated information about land surface with an acceptable time frequency. Furthermore, satellite images can be managed by automatic procedures in order to extract synthetic information about the ground condition in a very short time and can be easily shared in the web. The work of thesis, focused on the analysis and processing of satellite data, was carried out in cooperation with the association ITHACA (Information Technology for Humanitarian Assistance, Cooperation and Action), a center of research which works in cooperation with the WFP in order to provide IT products and tools for the management of food emergencies caused by natural disasters. These products should be able to facilitate the forecasting of the effects of catastrophic events, the estimation of the extension and location of the areas hit by the event, of the affected population and thereby the planning of interventions on the area that could be affected by food insecurity. The requested features of the instruments are: • Regular updating • Spatial resolution suitable for a synoptic analysis • Low cost • Easy consultation Ithaca is developing different activities to provide georeferenced thematic data to WFP users, such a spatial data infrastructure for storing, querying and manipulating large amounts of global geographic information, and for sharing it between a large and differentiated community; a system of early warning for floods, a drought monitoring tool, procedures for rapid mapping in the response phase in a case of natural disaster, web GIS tools to distribute and share georeferenced information, that can be consulted only by means of a web browser. The work of thesis is aimed at providing applications for the automatic production of base georeferenced thematic data, by using free global satellite data, which have characteristics suitable for analysis at a regional scale. In particular the main themes of the applications are water bodies and vegetation phenology. The first application aims at providing procedures for the automatic extraction of water bodies and will lead to the creation and update of an historical archive, which can be analyzed in order to catch the seasonality of water bodies and delineate scenarios of historical flooded areas. The automatic extraction of phenological parameters from satellite data will allow to integrate the existing drought monitoring system with information on vegetation seasonality and to provide further information for the evaluation of food insecurity in the post disaster phase. In the thesis are described the activities carried on for the development of procedures for the automatic processing of free satellite data in order to produce customized layers according to the exigencies in format and distribution of the final users. The main activities, which focused on the development of an automated procedure for the extraction of flooded areas, include the research of an algorithm for the classification of water bodies from satellite data, an important theme in the field of management of the emergencies due to flood events. Two main technologies are generally used: active sensors (radar) and passive sensors (optical data). Advantages for active sensors include the ability to obtain measurements anytime, regardless of the time of day or season, while passive sensors can only be used in the daytime cloud free conditions. Even if with radar technologies is possible to get information on the ground in all weather conditions, it is not possible to use radar data to obtain a continuous archive of flooded areas, because of the lack of a predetermined frequency in the acquisition of the images. For this reason the choice of the dataset went in favor of MODIS (Moderate Resolution Imaging Spectroradiometer), optical data with a daily frequency, a spatial resolution of 250 meters and an historical archive of 10 years. The presence of cloud coverage prevents from the acquisition of the earth surface, and the shadows due to clouds can be wrongly classified as water bodies because of the spectral response very similar to the one of water. After an analysis of the state of the art of the algorithms of automated classification of water bodies in images derived from optical sensors, the author developed an algorithm that allows to classify the data of reflectivity and to temporally composite them in order to obtain flooded areas scenarios for each event. This procedure was tested in the Bangladesh areas, providing encouraging classification accuracies. For the vegetation theme, the main activities performed, here described, include the review of the existing methodologies for phenological studies and the automation of the data flow between inputs and outputs with the use of different global free satellite datasets. In literature, many studies demonstrated the utility of the NDVI (Normalized Difference Vegetation Index) indices for the monitoring of vegetation dynamics, in the study of cultivations, and for the survey of the vegetation water stress. The author developed a procedure for creating layers of phenological parameters which integrates the TIMESAT software, produced by Lars Eklundh and Per Jönsson, for processing NDVI indices derived from different satellite sensors: MODIS (Moderate Resolution Imaging Spectroradiometer), AVHRR (Advanced Very High Resolution Radiometer) AND SPOT (Système Pour l'Observation de la Terre) VEGETATION. The automated procedure starts from data downloading, calls in a batch mode the software and provides customized layers of phenological parameters such as the starting of the season or length of the season and many others

Multisource and Multitemporal Data Fusion in Remote Sensing

The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve the performance of the processing approaches with respect to the application at hand. Multisource data fusion has, therefore, received enormous attention from researchers worldwide for a wide variety of applications. Moreover, thanks to the revisit capability of several spaceborne sensors, the integration of the temporal information with the spatial and/or spectral/backscattering information of the remotely sensed data is possible and helps to move from a representation of 2D/3D data to 4D data structures, where the time variable adds new information as well as challenges for the information extraction algorithms. There are a huge number of research works dedicated to multisource and multitemporal data fusion, but the methods for the fusion of different modalities have expanded in different paths according to each research community. This paper brings together the advances of multisource and multitemporal data fusion approaches with respect to different research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references

Generative adversarial networks review in earthquake-related engineering fields

Within seismology, geology, civil and structural engineering, deep learning (DL), especially via generative adversarial networks (GANs), represents an innovative, engaging, and advantageous way to generate reliable synthetic data that represent actual samples' characteristics, providing a handy data augmentation tool. Indeed, in many practical applications, obtaining a significant number of high-quality information is demanding. Data augmentation is generally based on artificial intelligence (AI) and machine learning data-driven models. The DL GAN-based data augmentation approach for generating synthetic seismic signals revolutionized the current data augmentation paradigm. This study delivers a critical state-of-art review, explaining recent research into AI-based GAN synthetic generation of ground motion signals or seismic events, and also with a comprehensive insight into seismic-related geophysical studies. This study may be relevant, especially for the earth and planetary science, geology and seismology, oil and gas exploration, and on the other hand for assessing the seismic response of buildings and infrastructures, seismic detection tasks, and general structural and civil engineering applications. Furthermore, highlighting the strengths and limitations of the current studies on adversarial learning applied to seismology may help to guide research efforts in the next future toward the most promising directions

Towards Automated Analysis of Urban Infrastructure after Natural Disasters using Remote Sensing

Natural disasters, such as earthquakes and hurricanes, are an unpreventable component of the complex and changing environment we live in. Continued research and advancement in disaster mitigation through prediction of and preparation for impacts have undoubtedly saved many lives and prevented significant amounts of damage, but it is inevitable that some events will cause destruction and loss of life due to their sheer magnitude and proximity to built-up areas. Consequently, development of effective and efficient disaster response methodologies is a research topic of great interest. A successful emergency response is dependent on a comprehensive understanding of the scenario at hand. It is crucial to assess the state of the infrastructure and transportation network, so that resources can be allocated efficiently. Obstructions to the roadways are one of the biggest inhibitors to effective emergency response. To this end, airborne and satellite remote sensing platforms have been used extensively to collect overhead imagery and other types of data in the event of a natural disaster. The ability of these platforms to rapidly probe large areas is ideal in a situation where a timely response could result in saving lives. Typically, imagery is delivered to emergency management officials who then visually inspect it to determine where roads are obstructed and buildings have collapsed. Manual interpretation of imagery is a slow process and is limited by the quality of the imagery and what the human eye can perceive. In order to overcome the time and resource limitations of manual interpretation, this dissertation inves- tigated the feasibility of performing fully automated post-disaster analysis of roadways and buildings using airborne remote sensing data. First, a novel algorithm for detecting roadway debris piles from airborne light detection and ranging (lidar) point clouds and estimating their volumes is presented. Next, a method for detecting roadway flooding in aerial imagery and estimating the depth of the water using digital elevation models (DEMs) is introduced. Finally, a technique for assessing building damage from airborne lidar point clouds is presented. All three methods are demonstrated using remotely sensed data that were collected in the wake of recent natural disasters. The research presented in this dissertation builds a case for the use of automatic, algorithmic analysis of road networks and buildings after a disaster. By reducing the latency between the disaster and the delivery of damage maps needed to make executive decisions about resource allocation and performing search and rescue missions, significant loss reductions could be achieved