A Review

Structural disaster damage detection and characterization is one of the oldest remote sensing challenges, and the utility of virtually every type of active and passive sensor deployed on various air- and spaceborne platforms has been assessed. The proliferation and growing sophistication of unmanned aerial vehicles (UAVs) in recent years has opened up many new opportunities for damage mapping, due to the high spatial resolution, the resulting stereo images and derivatives, and the flexibility of the platform. This study provides a comprehensive review of how UAV-based damage mapping has evolved from providing simple descriptive overviews of a disaster science, to more sophisticated texture and segmentation-based approaches, and finally to studies using advanced deep learning approaches, as well as multi-temporal and multi-perspective imagery to provide comprehensive damage descriptions. The paper further reviews studies on the utility of the developed mapping strategies and image processing pipelines for first responders, focusing especially on outcomes of two recent European research projects, RECONASS (Reconstruction and Recovery Planning: Rapid and Continuously Updated Construction Damage, and Related Needs Assessment) and INACHUS (Technological and Methodological Solutions for Integrated Wide Area Situation Awareness and Survivor Localization to Support Search and Rescue Teams). Finally, recent and emerging developments are reviewed, such as recent improvements in machine learning, increasing mapping autonomy, damage mapping in interior, GPS-denied environments, the utility of UAVs for infrastructure mapping and maintenance, as well as the emergence of UAVs with robotic abilities. Document type: Articl

Pathways and challenges of the application of artificial intelligence to geohazards modelling

© 2020 International Association for Gondwana Research The application of artificial intelligence (AI) and machine learning in geohazard modelling has been rapidly growing in recent years, a trend that is observed in several research and application areas thanks to recent advances in AI. As a result, the increasing dependence on data driven studies has made its practical applications towards geohazards (landslides, debris flows, earthquakes, droughts, floods, glacier studies) an interesting prospect. These aforementioned geohazards were responsible for roughly 80% of the economic loss in the past two decades caused by all natural hazards. The present study analyses the various domains of geohazards which have benefited from classical machine learning approaches and highlights the future course of direction in this field. The emergence of deep learning has fulfilled several gaps in: i) classification; ii) seasonal forecasting as well as forecasting at longer lead times; iii) temporal based change detection. Apart from the usual challenges of dataset availability, climate change and anthropogenic activities, this review paper emphasizes that the future studies should focus on consecutive events along with integration of physical models. The recent catastrophe in Japan and Australia makes a compelling argument to focus towards consecutive events. The availability of higher temporal resolution and multi-hazard dataset will prove to be essential, but the key would be to integrate it with physical models which would improve our understanding of the mechanism involved both in single and consecutive hazard scenario. Geohazards would eventually be a data problem, like geosciences, and therefore it is essential to develop models that would be capable of handling large voluminous data. The future works should also revolve towards interpretable models with the hope of providing a reasonable explanation of the results, thereby achieving the ultimate goal of Explainable AI

An innovative structural health assessment tool for existing precast concrete buildings using deep learning methods and thermal infrared satellite imagery

Currently, there is a limited number of tools that can be used to assess progressive damage of buildings in large-scale study areas. The effectiveness of such tools is also constrained by a lack of sufficient and reliable data from the buildings and the area itself. This research article presents an innovative framework for damage detection and classification of precast concrete (PC) buildings based on satellite infrared (IR) imagery. The framework uses heat leakage changes over time to assess the progressive damage of buildings. Multispectral satellite images are used for a spatial scanning and large-scale assessment of a study area. A deep learning object detection algorithm coupled with two pixel intensities classification approaches are utilized in the framework. The proposed framework is demonstrated on two case study areas (parts of Karaganda and Almaty cities) in Kazakhstan using a set of multitemporal satellite images. Overall, the proposed framework, in combination with a YOLOv3 algorithm, successfully detects 85% of the PC buildings in the study areas. The use of a peak heat leakage classification approach (in comparison to mean heat leakage classification) over the 4 years showed a good agreement with the proposed framework. On-site visual inspections confirmed that PC buildings that were classified as having “High damage probability” have indeed evident signs of deterioration, as well as a more heat leakage than the rest of the buildings in the study areas. Whilst the framework has some limitations such as its applicability to extreme continental climate and its low sensitivity to detect minor damage, the proposed innovative framework showed very promising results at detecting progressive damage in PC buildings. This article contributes towards developing more efficient long-term damage assessment tools for existing buildings in large urban areas

Integrated Applications of Geo-Information in Environmental Monitoring

This book focuses on fundamental and applied research on geo-information technology, notably optical and radar remote sensing and algorithm improvements, and their applications in environmental monitoring. This Special Issue presents ten high-quality research papers covering up-to-date research in land cover change and desertification analyses, geo-disaster risk and damage evaluation, mining area restoration assessments, the improvement and development of algorithms, and coastal environmental monitoring and object targeting. The purpose of this Special Issue is to promote exchanges, communications and share the research outcomes of scientists worldwide and to bridge the gap between scientific research and its applications for advancing and improving society

Computational socioeconomics

Uncovering the structure of socioeconomic systems and timely estimation of socioeconomic status are significant for economic development. The understanding of socioeconomic processes provides foundations to quantify global economic development, to map regional industrial structure, and to infer individual socioeconomic status. In this review, we will make a brief manifesto about a new interdisciplinary research field named Computational Socioeconomics, followed by detailed introduction about data resources, computational tools, data-driven methods, theoretical models and novel applications at multiple resolutions, including the quantification of global economic inequality and complexity, the map of regional industrial structure and urban perception, the estimation of individual socioeconomic status and demographic, and the real-time monitoring of emergent events. This review, together with pioneering works we have highlighted, will draw increasing interdisciplinary attentions and induce a methodological shift in future socioeconomic studies

Remote Sensing of Natural Hazards

Each year, natural hazards such as earthquakes, cyclones, flooding, landslides, wildfires, avalanches, volcanic eruption, extreme temperatures, storm surges, drought, etc., result in widespread loss of life, livelihood, and critical infrastructure globally. With the unprecedented growth of the human population, largescale development activities, and changes to the natural environment, the frequency and intensity of extreme natural events and consequent impacts are expected to increase in the future.Technological interventions provide essential provisions for the prevention and mitigation of natural hazards. The data obtained through remote sensing systems with varied spatial, spectral, and temporal resolutions particularly provide prospects for furthering knowledge on spatiotemporal patterns and forecasting of natural hazards. The collection of data using earth observation systems has been valuable for alleviating the adverse effects of natural hazards, especially with their near real-time capabilities for tracking extreme natural events. Remote sensing systems from different platforms also serve as an important decision-support tool for devising response strategies, coordinating rescue operations, and making damage and loss estimations.With these in mind, this book seeks original contributions to the advanced applications of remote sensing and geographic information systems (GIS) techniques in understanding various dimensions of natural hazards through new theory, data products, and robust approaches

Social media crowdsourcing for rapid damage assessment following sudden-onset earthquakes

Rapid appraisal of damages related to hazard events is important to first responders, government agencies, insurance industries, and other private and public organizations. While satellite monitoring, ground-based sensor systems, inspections, and other technologies provide data to inform post-disaster response, crowdsourcing through social media is an additional and novel data source. In this study, the use of social media data, principally Twitter postings, is investigated to make approximate but rapid early assessments of damages following earthquake disasters. The goal is to explore the potential utility of using social media data for rapid damage assessment after sudden-onset hazard events and to identify insights related to potential challenges. This study defines a text-based damage assessment scale for earthquake damages and then develops a text classification model for rapid damage assessment. The 2019 Ridgecrest, California earthquake sequence is mainly investigated as the case study. Results reveal that Twitter users rapidly responded to this sudden-onset event, and the damage estimation shows temporal and spatial characteristics. The generalization ability of the model is validated through the investigation of damage assessment for another five earthquake events. Although the accuracy remains a challenge compared to ground-based instrumental readings and inspections, the proposed damage assessment model features rapidity with large amounts of data at spatial densities that exceed those of conventional sensor networks

Multiscale image representation in deep learning

Deep learning is a very popular field of research which can input a variety of data types [1, 16, 30]. It is a subfield of machine learning consisting of mostly neural networks. A challenge which is very commonly met in the training of neural networks, especially when working with images is the vast amount of data required. Because of this various data augmentation techniques have been proposed to create more data at low cost while keeping the labelling of the data accurate [65]. When a model is trained on images these augmentations include rotating, flipping and cropping the images [21]. An added advantage of data augmentation is that it makes the model more robust to rotation and transformation of an object in an image [65]. In this mini-dissertation we investigate the use of the Discrete Pulse Transform [54, 2] decomposition algorithm and its Discrete Pulse Vectors (DPV) [17] as data augmentation for image classification in deep learning. The DPVs is used to extract features from the image. A convolutional neural network is trained on the original and augmented images and a comparison made to a convolutional neural network only trained on the unaugmented images. The purpose of the models implemented is to correctly classify an image as either a cat or dog. The training and testing accuracy of the two approaches are similar. The loss of the model using the proposed data augmentation is improved. When making use of probabilities predicted by the model and determining a custom cut off to classify an image into one of the two classes, the model trained on using the proposed augmentation outperforms the model trained without the proposed data augmentation.Mini Dissertation (MSc (Advanced Data Analytics))--University of Pretoria, 2020.The financial assistance of the National Research Foundation (NRF) towards this research is hereby acknowledged. Opinions expressed and conclusions arrived at, are those of the author and are not necessarily to be attributed to the NRF.StatisticsMSc (Advanced Data Analytics)Unrestricte