A machine learning-guided data integration framework to measure multidimensional poverty

As developing nations like South Africa chart a path of socio-economic development, the spatialisation of progress, opportunity, and neglect is a critical antecedent to policy-making and regional interventionism. Efforts to capture meaningful data using household surveys and censuses face a diluted accuracy due to sampling, surveying, and quantification errors. The reliability and regularity of these traditional methods is also constrained since the processes are costly and time consuming. Recent investigations in the field of machine learning and satellite imaging have presented a viable proof-of-concept technique to exploit specific economic indicators to demonstrate economic development patterns across regional areas. The current study adopts several interrelated approaches encompassed within the field of remote sensing in order to evaluate and model poverty in the South African landscape. By adopting publicly accessible information for classification to indicate the intensity of poverty, this study proposed an inexpensive solution to poverty estimation. Concretely, the solution combined satellite imagery and geospatial data with regional poverty data exploiting an ensemble approach to poverty diagnosis. The solution is based upon multidimensional indicators and multi-layered insights that can be extrapolated from overlapping models to bolster them and help with socio-economic well-being estimations. Through machine learning techniques and object-oriented training of a convolutional neural network, this study revealed that a naïve combination of distinct data sources shows patterns of socio-economic well-being in South Africa by achieving an R2 of 0.56 wealth estimation compared to 0.54 from satellite imagery. This outlined variability and incongruity within landscapes that not only reflect the persistent subdivisions of apartheid-era enclavisation, but indicate critical gaps in domestic social services, infrastructure, and developmental pathways. This study is applicable to policy makers in low- and middle-income countries that lack accurate and timely data on economic development as an important precursor to public support, policy making, and planned expenditures.School of ComputingM. Tech. (Information Technology

A Proof-of-Concept of Integrating Machine Learning, Remote Sensing, and Survey Data in Evaluations: The Measurement of Disaster Resilience in the Philippines

Disaster resilience is a topic of increasing importance for policy makers in the context of climate change. However, measuring disaster resilience remains a challenge as it requires information on both the physical environment and socio-economic dimensions. In this study we developed and tested a method to use remote sensing (RS) data to construct proxy indicators of socio-economic change. We employed machine-learning algorithms to generate land-cover and land-use classifications from very high-resolution satellite imagery to appraise disaster damage and recovery processes in the Philippines following the devastation of typhoon Haiyan in November 2013. We constructed RS-based proxy indicators for N=20 barangays (villages) in the region surrounding Tacloban City in the central east of the Philippines. We then combined the RS-based proxy indicators with detailed socio-economic information collected during a rigorous-impact evaluation by DEval in 2016. Results from a statistical analysis demonstrated that fastest post-disaster recovery occurred in urban barangays that received sufficient government support (subsidies), and which had no prior disaster experience. In general, socio-demographic factors had stronger effects on the early recovery phase (0-2 years) compared to the late recovery phase (2-3 years). German development support was related to recovery performance only to some extent. Rather than providing an in-depth statistical analysis, this study is intended as a proof-of-concept. We have been able to demonstrate that high-resolution RS data and machine-learning techniques can be used within a mixed-methods design as an effective tool to evaluate disaster impacts and recovery processes. While RS data have distinct limitations (e.g., cost, labour intensity), they offer unique opportunities to objectively measure physical, and by extension socio-economic, changes over large areas and long time-scales.Zunehmende Wetterextreme und Naturkatastrophen sind Folgen des Klimawandels. Aufgrund dieser steigenden Risiken rückt die Resilienz der Bevölkerung im Katastrophenfall als zentrales Thema in den Vordergrund und hat zunehmende Bedeutung für politische Entscheidungstragende. Dennoch bleibt die Messung des mehrdimensionalen Konzepts der Katastrophenresilienz eine Herausforderung, da sie Informationen sowohl über die physische Umgebung als auch sozioökonomische Faktoren erfordert. In dieser Studie wird eine Methode entwickelt, um aus Fernerkundungsdaten (RS-Daten) Indikatoren zu entwickeln, die Aspekte des sozioökonomischen Wandels approximieren und somit messbar machen (Proxy-Indikatoren). Zu diesem Zweck wurden Algorithmen des maschinellen Lernens eingesetzt. Mit Hilfe dieser Algorithmen wurden aus hochauflösenden Satellitenbildern Klassifizierungen für Landstruktur und Landnutzung konstruiert, um Katastrophenschäden und iederaufbauprozesse auf den Philippinen nach der Zerstörung durch den Taifun Haiyan im November 2013 zu messen. Aus den RS-Daten wurden die Indikatoren für N=20 Barangays (Dörfer) in der Region um die Stadt Tacloban im zentralen Osten der Philippinen berechnet. Diese auf RS-Daten basierenden Indikatoren wurden mit detaillierten sozioökonomischen Informationen kombiniert, die für eine DEval-Evaluierung im Jahr 2016 erhoben wurden. Die Ergebnisse der statistischen Analyse zeigen, dass der schnellste Wiederaufbau nach der Katastrophe in städtischen Barangays zu beobachten war, die ausreichend staatliche Unterstützung (Subventionen) erhielten und über keine Katastrophenerfahrung verfügten. Im Vergleich hatten soziodemografische Faktoren allgemein stärkere Auswirkungen auf die frühe (0-2 Jahre) als auf die spätere (2-3 Jahre) Wiederaufbauphase. Es konnte nur ein bedingter Bezug zwischen der deutschen Entwicklungszusammenarbeit und den Wiederaufbauerfolgen festgestellt werden. Diese Studie versteht sich als Nachweis der Machbarkeit, weniger als detaillierte statistische Analyse. Sie belegt, dass hochauflösende RS-Daten und Techniken des maschinellen Lernens innerhalb eines integrierten Methodendesigns als effektives Werkzeug zur Bewertung von Katastrophenauswirkungen und Wiederherstellungsprozessen eingesetzt werden können. Trotz spezifischer Einschränkungen (hohe Kosten, Arbeitsintensität etc.) bieten RS-Daten einzigartige Möglichkeiten sowohl Umweltbedingungen als auch sozioökonomische Veränderungen über große Gebiete und lange Zeiträume hinweg objektiv messen zu können

Deep Learning for Time-Series Analysis of Optical Satellite Imagery

In this cumulative thesis, I cover four papers on time-series analysis of optical satellite imagery. The contribution is split into two parts. The first one introduces DENETHOR and DynamicEarthNet, two landmark datasets with high-quality ground truth data for agricultural monitoring and change detection. Second, I introduce SiROC and SemiSiROC, two methodological contributions to label-efficient change detection

Proceedings of the Academic Track at State of the Map 2020

Proceedings of the Academic Track at State of the Map 202

Predicting Building Functions by Fusing Social Media and Remote Sensing Data

Die Funktionen von Gebäuden lassen sich nicht direkt messen, sondern erfordern die Interpretation von Daten. In dieser Arbeit werden drei neue Methoden zur Vorhersage von Gebäudefunktionen vorgestellt, die auf Daten aus sozialen Medien und Fernerkundungsdaten beruhen. Die Methoden basieren auf Ansätzen des maschinellen Lernens und wurden auf kulturell diversifizierten Datensätzen entwickelt und getestet. Die Vorhersage lässt sich durch die Kombination mehrerer Modelle um bis zu 6,9% erhöhen

Application of Artificial Intelligence Approaches in the Flood Management Process for Assessing Blockage at Cross-Drainage Hydraulic Structures

Floods are the most recurrent, widespread and damaging natural disasters, and are ex-pected to become further devastating because of global warming. Blockage of cross-drainage hydraulic structures (e.g., culverts, bridges) by flood-borne debris is an influen-tial factor which usually results in reducing hydraulic capacity, diverting the flows, dam-aging structures and downstream scouring. Australia is among the countries adversely impacted by blockage issues (e.g., 1998 floods in Wollongong, 2007 floods in Newcas-tle). In this context, Wollongong City Council (WCC), under the Australian Rainfall and Runoff (ARR), investigated the impact of blockage on floods and proposed guidelines to consider blockage in the design process for the first time. However, existing WCC guide-lines are based on various assumptions (i.e., visual inspections as representative of hy-draulic behaviour, post-flood blockage as representative of peak floods, blockage remains constant during the whole flooding event), that are not supported by scientific research while also being criticised by hydraulic design engineers. This suggests the need to per-form detailed investigations of blockage from both visual and hydraulic perspectives, in order to develop quantifiable relationships and incorporate blockage into design guide-lines of hydraulic structures. However, because of the complex nature of blockage as a process and the lack of blockage-related data from actual floods, conventional numerical modelling-based approaches have not achieved much success. The research in this thesis applies artificial intelligence (AI) approaches to assess the blockage at cross-drainage hydraulic structures, motivated by recent success achieved by AI in addressing complex real-world problems (e.g., scour depth estimation and flood inundation monitoring). The research has been carried out in three phases: (a) litera-ture review, (b) hydraulic blockage assessment, and (c) visual blockage assessment. The first phase investigates the use of computer vision in the flood management domain and provides context for blockage. The second phase investigates hydraulic blockage using lab scale experiments and the implementation of multiple machine learning approaches on datasets collected from lab experiments (i.e., Hydraulics-Lab Dataset (HD), Visual Hydraulics-Lab Dataset (VHD)). The artificial neural network (ANN) and end-to-end deep learning approaches reported top performers among the implemented approaches and demonstrated the potential of learning-based approaches in addressing blockage is-sues. The third phase assesses visual blockage at culverts using deep learning classifi-cation, detection and segmentation approaches for two types of visual assessments (i.e., blockage status classification, percentage visual blockage estimation). Firstly, a range of existing convolutional neural network (CNN) image classification models are imple-mented and compared using visual datasets (i.e., Images of Culvert Openings and Block-age (ICOB), VHD, Synthetic Images of Culverts (SIC)), with the aim to automate the process of manual visual blockage classification of culverts. The Neural Architecture Search Network (NASNet) model achieved best classification results among those im-plemented. Furthermore, the study identified background noise and simplified labelling criteria as two contributing factors in degraded performance of existing CNN models for blockage classification. To address the background clutter issue, a detection-classification pipeline is proposed and achieved improved visual blockage classification performance. The proposed pipeline has been deployed using edge computing hardware for blockage monitoring of actual culverts. The role of synthetic data (i.e., SIC) on the performance of culvert opening detection is also investigated. Secondly, an automated segmentation-classification deep learning pipeline is proposed to estimate the percentage of visual blockage at circular culverts to better prioritise culvert maintenance. The AI solutions proposed in this thesis are integrated into a blockage assessment framework, designed to be deployed through edge computing to monitor, record and assess blockage at cross-drainage hydraulic structures

Proceedings of the Academic Track at the State of the Map 2020

Proceedings of the Academic Track at the State of the Map 2020 - Online (originally planned in Cape Town, South Africa) July 4-6, 2020

Earth Observation Open Science and Innovation

geospatial analytics; social observatory; big earth data; open data; citizen science; open innovation; earth system science; crowdsourced geospatial data; citizen science; science in society; data scienc