Unsupervised Image Regression for Heterogeneous Change Detection

Change detection (CD) in heterogeneous multitemporal satellite images is an emerging and challenging topic in remote sensing. In particular, one of the main challenges is to tackle the problem in an unsupervised manner. In this paper, we propose an unsupervised framework for bitemporal heterogeneous CD based on the comparison of affinity matrices and image regression. First, our method quantifies the similarity of affinity matrices computed from colocated image patches in the two images. This is done to automatically identify pixels that are likely to be unchanged. With the identified pixels as pseudotraining data, we learn a transformation to map the first image to the domain of the other image and vice versa. Four regression methods are selected to carry out the transformation: Gaussian process regression, support vector regression, random forest regression (RFR), and a recently proposed kernel regression method called homogeneous pixel transformation. To evaluate the potentials and limitations of our framework and also the benefits and disadvantages of each regression method, we perform experiments on two real data sets. The results indicate that the comparison of the affinity matrices can already be considered a CD method by itself. However, image regression is shown to improve the results obtained by the previous step alone and produces accurate CD maps despite of the heterogeneity of the multitemporal input data. Notably, the RFR approach excels by achieving similar accuracy as the other methods, but with a significantly lower computational cost and with fast and robust tuning of hyperparameters

Inferring Complex Activities for Context-aware Systems within Smart Environments

The rising ageing population worldwide and the prevalence of age-related conditions such as physical fragility, mental impairments and chronic diseases have significantly impacted the quality of life and caused a shortage of health and care services. Over-stretched healthcare providers are leading to a paradigm shift in public healthcare provisioning. Thus, Ambient Assisted Living (AAL) using Smart Homes (SH) technologies has been rigorously investigated to help address the aforementioned problems. Human Activity Recognition (HAR) is a critical component in AAL systems which enables applications such as just-in-time assistance, behaviour analysis, anomalies detection and emergency notifications. This thesis is aimed at investigating challenges faced in accurately recognising Activities of Daily Living (ADLs) performed by single or multiple inhabitants within smart environments. Specifically, this thesis explores five complementary research challenges in HAR. The first study contributes to knowledge by developing a semantic-enabled data segmentation approach with user-preferences. The second study takes the segmented set of sensor data to investigate and recognise human ADLs at multi-granular action level; coarse- and fine-grained action level. At the coarse-grained actions level, semantic relationships between the sensor, object and ADLs are deduced, whereas, at fine-grained action level, object usage at the satisfactory threshold with the evidence fused from multimodal sensor data is leveraged to verify the intended actions. Moreover, due to imprecise/vague interpretations of multimodal sensors and data fusion challenges, fuzzy set theory and fuzzy web ontology language (fuzzy-OWL) are leveraged. The third study focuses on incorporating uncertainties caused in HAR due to factors such as technological failure, object malfunction, and human errors. Hence, existing studies uncertainty theories and approaches are analysed and based on the findings, probabilistic ontology (PR-OWL) based HAR approach is proposed. The fourth study extends the first three studies to distinguish activities conducted by more than one inhabitant in a shared smart environment with the use of discriminative sensor-based techniques and time-series pattern analysis. The final study investigates in a suitable system architecture with a real-time smart environment tailored to AAL system and proposes microservices architecture with sensor-based off-the-shelf and bespoke sensing methods. The initial semantic-enabled data segmentation study was evaluated with 100% and 97.8% accuracy to segment sensor events under single and mixed activities scenarios. However, the average classification time taken to segment each sensor events have suffered from 3971ms and 62183ms for single and mixed activities scenarios, respectively. The second study to detect fine-grained-level user actions was evaluated with 30 and 153 fuzzy rules to detect two fine-grained movements with a pre-collected dataset from the real-time smart environment. The result of the second study indicate good average accuracy of 83.33% and 100% but with the high average duration of 24648ms and 105318ms, and posing further challenges for the scalability of fusion rule creations. The third study was evaluated by incorporating PR-OWL ontology with ADL ontologies and Semantic-Sensor-Network (SSN) ontology to define four types of uncertainties presented in the kitchen-based activity. The fourth study illustrated a case study to extended single-user AR to multi-user AR by combining RFID tags and fingerprint sensors discriminative sensors to identify and associate user actions with the aid of time-series analysis. The last study responds to the computations and performance requirements for the four studies by analysing and proposing microservices-based system architecture for AAL system. A future research investigation towards adopting fog/edge computing paradigms from cloud computing is discussed for higher availability, reduced network traffic/energy, cost, and creating a decentralised system. As a result of the five studies, this thesis develops a knowledge-driven framework to estimate and recognise multi-user activities at fine-grained level user actions. This framework integrates three complementary ontologies to conceptualise factual, fuzzy and uncertainties in the environment/ADLs, time-series analysis and discriminative sensing environment. Moreover, a distributed software architecture, multimodal sensor-based hardware prototypes, and other supportive utility tools such as simulator and synthetic ADL data generator for the experimentation were developed to support the evaluation of the proposed approaches. The distributed system is platform-independent and currently supported by an Android mobile application and web-browser based client interfaces for retrieving information such as live sensor events and HAR results

A machine learning-guided data integration framework to measure multidimensional poverty

As developing nations like South Africa chart a path of socio-economic development, the spatialisation of progress, opportunity, and neglect is a critical antecedent to policy-making and regional interventionism. Efforts to capture meaningful data using household surveys and censuses face a diluted accuracy due to sampling, surveying, and quantification errors. The reliability and regularity of these traditional methods is also constrained since the processes are costly and time consuming. Recent investigations in the field of machine learning and satellite imaging have presented a viable proof-of-concept technique to exploit specific economic indicators to demonstrate economic development patterns across regional areas. The current study adopts several interrelated approaches encompassed within the field of remote sensing in order to evaluate and model poverty in the South African landscape. By adopting publicly accessible information for classification to indicate the intensity of poverty, this study proposed an inexpensive solution to poverty estimation. Concretely, the solution combined satellite imagery and geospatial data with regional poverty data exploiting an ensemble approach to poverty diagnosis. The solution is based upon multidimensional indicators and multi-layered insights that can be extrapolated from overlapping models to bolster them and help with socio-economic well-being estimations. Through machine learning techniques and object-oriented training of a convolutional neural network, this study revealed that a naïve combination of distinct data sources shows patterns of socio-economic well-being in South Africa by achieving an R2 of 0.56 wealth estimation compared to 0.54 from satellite imagery. This outlined variability and incongruity within landscapes that not only reflect the persistent subdivisions of apartheid-era enclavisation, but indicate critical gaps in domestic social services, infrastructure, and developmental pathways. This study is applicable to policy makers in low- and middle-income countries that lack accurate and timely data on economic development as an important precursor to public support, policy making, and planned expenditures.School of ComputingM. Tech. (Information Technology

Automatic verification of road databases using multiple road models

[no abstract

Development of an unsupervised remote sensing methodology of detect surface leakage from terrestrial CO2 storage sites

Imperial Users onl

An evidential reasoning geospatial approach to transport corridor susceptibility zonation

PhD ThesisGiven the increased hazards faced by transport corridors such as climate induced extreme weather, it is essential that local spatial hot-spots of potential landslide susceptibility can be recognised. Traditionally, geotechnical survey and monitoring approaches have been used to recognise spatially landslide susceptibility zones. The increased availability of affordable very high resolution remotely-sensed datasets, such as airborne laser scanning (ALS) and multispectral aerial imagery, along with improved geospatial digital map data-sets, potentially allows the automated recognition of vulnerable earthwork slopes. However, the challenge remains to develop the analytical framework that allows such data to be integrated in an objective manner to recognise slopes potentially susceptible to failure. In this research, an evidential reasoning multi-source geospatial integration approach for the broad-scale recognition and prediction of landslide susceptibility in transport corridors has been developed. Airborne laser scanning and Ordnance Survey DTM data is used to derive slope stability parameters (slope gradient, aspect, terrain wetness index (TWI), stream power index (SPI) and curvature), while Compact Airborne Spectrographic Imager (CASI) imagery, and existing national scale digital map data-sets are used to characterise the spatial variability of land cover, land use and soil type. A novel approach to characterisation of soil moisture distribution within transport corridors is developed that incorporates the effects of the catchment contribution to local zones of moisture concentration in earthworks. In this approach, the land cover and soil type of the wider catchment are used to estimate the spatial contribution of precipitation contributing to surface runoff, which in turn is used to parameterise a weighted terrain accumulation flow model. The derived topographic and land use properties of the transport corridor are integrated within the evidential reasoning approach to characterise numeric measures of belief, disbelief and uncertainty regarding slope instability spatially within the transport corridor. Evidential reasoning was employed as it offers the ability to derive an objective weighting of the relative importance of each derived property to the final estimation of landslide susceptibility, whilst allowing the uncertainty of the properties to be taken into account. The developed framework was applied to railway transport earthworks located near Haltwhistle in northern England, UK. This section of the Carlisle-Newcastle rail line has a ii history of instability with the occurrence of numerous minor landslides in recent years. Results on spatial distribution of soil moisture indicate considerable contribution of the surrounding wider catchment topography to the localised zones of moisture accumulation. The degrees of belief and disbelief indicated the importance of slope with gradients between 250 to 350 and concave curvature. Permeable soils with variable intercalations accounted for over 80% of slope instability with 5.1% of the earthwork cuttings identified as relatively unstable in contrast to 47.5% for the earthwork embankment. The developed approach was found to have a goodness of fit of 88.5% with respect to the failed slopes used to parametrise the evidential reasoning model and an overall predictive capability of 77.75% based on independent validation dataset.TETFUND Nigeria, Nasarawa State University and my family members for their financial support towards the completion of the PhD programme

Assessing, monitoring and mapping forest resources in the Blue Nile Region of Sudan using an object-based image analysis approach

Following the hierarchical nature of forest resource management, the present work focuses on the natural forest cover at various abstraction levels of details, i.e. categorical land use/land cover (LU/LC) level and a continuous empirical estimation of local operational level. As no single sensor presently covers absolutely all the requirements of the entire levels of forest resource assessment, multisource imagery (i.e. RapidEye, TERRA ASTER and LANDSAT TM), in addition to other data and knowledge have been examined. To deal with this structure, an object-based image analysis (OBIA) approach has been assessed in the destabilized Blue Nile region of Sudan as a potential solution to gather the required information for future forest planning and decision making. Moreover, the spatial heterogeneity as well as the rapid changes observed in the region motivates the inspection for more efficient, flexible and accurate methods to update the desired information. An OBIA approach has been proposed as an alternative analysis framework that can mitigate the deficiency associated with the pixel-based approach. In this sense, the study examines the most popular pixel-based maximum likelihood classifier, as an example of the behavior of spectral classifier toward respective data and regional specifics. In contrast, the OBIA approach analyzes remotely sensed data by incorporating expert analyst knowledge and complimentary ancillary data in a way that somehow simulates human intelligence for image interpretation based on the real-world representation of the features. As the segment is the basic processing unit, various combinations of segmentation criteria were tested to separate similar spectral values into groups of relatively homogeneous pixels. At the categorical subtraction level, rules were developed and optimum features were extracted for each particular class. Two methods were allocated (i.e. Rule Based (RB) and Nearest Neighbour (NN) Classifier) to assign segmented objects to their corresponding classes. Moreover, the study attempts to answer the questions whether OBIA is inherently more precise at fine spatial resolution than at coarser resolution, and how both pixel-based and OBIA approaches can be compared regarding relative accuracy in function of spatial resolution. As anticipated, this work emphasizes that the OBIA approach is can be proposed as an advanced solution particulary for high resolution imagery, since the accuracies were improved at the different scales applied compare with those of pixel-based approach. Meanwhile, the results achieved by the two approaches are consistently high at a finer RapidEye spatial resolution, and much significantly enhanced with OBIA. Since the change in LU/LC is rapid and the region is heterogeneous as well as the data vary regarding the date of acquisition and data source, this motivated the implementation of post-classification change detection rather than radiometric transformation methods. Based on thematic LU/LC maps, series of optimized algorithms have been developed to depict the dynamics in LU/LC entities. Therefore, detailed change “from-to” information classes as well as changes statistics were produced. Furthermore, the produced change maps were assessed, which reveals that the accuracy of the change maps is consistently high. Aggregated to the community-level, social survey of household data provides a comprehensive perspective additionally to EO data. The predetermined hot spots of degraded and successfully recovered areas were investigated. Thus, the study utilized a well-designed questionnaire to address the factors affecting land-cover dynamics and the possible solutions based on local community's perception. At the operational structural forest stand level, the rationale for incorporating these analyses are to offer a semi-automatic OBIA metrics estimates from which forest attribute is acquired through automated segmentation algorithms at the level of delineated tree crowns or clusters of crowns. Correlation and regression analyses were applied to identify the relations between a wide range of spectral and textural metrics and the field derived forest attributes. The acquired results from the OBIA framework reveal strong relationships and precise estimates. Furthermore, the best fitted models were cross-validated with an independent set of field samples, which revealed a high degree of precision. An important question is how the spatial resolution and spectral range used affect the quality of the developed model this was also discussed based on the different sensors examined. To conclude, the study reveals that the OBIA has proven capability as an efficient and accurate approach for gaining knowledge about the land features, whether at the operational forest structural attributes or categorical LU/LC level. Moreover, the methodological framework exhibits a potential solution to attain precise facts and figures about the change dynamics and its driving forces.Da das Waldressourcenmanagement hierarchisch strukturiert ist, beschäftigt sich die vorliegende Arbeit mit der natürlichen Waldbedeckung auf verschiedenen Abstraktionsebenen, das heißt insbesondere mit der Ebene der kategorischen Landnutzung / Landbedeckung (LU/LC) sowie mit der kontinuierlichen empirischen Abschätzung auf lokaler operativer Ebene. Da zurzeit kein Sensor die Anforderungen aller Ebenen der Bewertung von Waldressourcen und von Multisource-Bildmaterialien (d.h. RapidEye, TERRA ASTER und LANDSAT TM) erfüllen kann, wurden zusätzlich andere Formen von Daten und Wissen untersucht und in die Arbeit mit eingebracht. Es wurde eine objekt-basierte Bildanalyse (OBIA) in einer destabilisierten Region des Blauen Nils im Sudan eingesetzt, um nach möglichen Lösungen zu suchen, erforderliche Informationen für die zukünftigen Waldplanung und die Entscheidungsfindung zu sammeln. Außerdem wurden die räumliche Heterogenität, sowie die sehr schnellen Änderungen in der Region untersucht. Dies motiviert nach effizienteren, flexibleren und genaueren Methoden zu suchen, um die gewünschten aktuellen Informationen zu erhalten. Das Konzept von OBIA wurde als Substitution-Analyse-Rahmen vorgeschlagen, um die Mängel vom früheren pixel-basierten Konzept abzumildern. In diesem Sinne untersucht die Studie die beliebtesten Maximum-Likelihood-Klassifikatoren des pixel-basierten Konzeptes als Beispiel für das Verhalten der spektralen Klassifikatoren in dem jeweiligen Datenbereich und der Region. Im Gegensatz dazu analysiert OBIA Fernerkundungsdaten durch den Einbau von Wissen des Analytikers sowie kostenlose Zusatzdaten in einer Art und Weise, die menschliche Intelligenz für die Bildinterpretation als eine reale Darstellung der Funktion simuliert. Als ein Segment einer Basisverarbeitungseinheit wurden verschiedene Kombinationen von Segmentierungskriterien getestet um ähnliche spektrale Werte in Gruppen von relativ homogenen Pixeln zu trennen. An der kategorische Subtraktionsebene wurden Regeln entwickelt und optimale Eigenschaften für jede besondere Klasse extrahiert. Zwei Verfahren (Rule Based (RB) und Nearest Neighbour (NN) Classifier) wurden zugeteilt um die segmentierten Objekte der entsprechenden Klasse zuzuweisen. Außerdem versucht die Studie die Fragen zu beantworten, ob OBIA in feiner räumlicher Auflösung grundsätzlich genauer ist als eine gröbere Auflösung, und wie beide, das pixel-basierte und das OBIA Konzept sich in einer relativen Genauigkeit als eine Funktion der räumlichen Auflösung vergleichen lassen. Diese Arbeit zeigt insbesondere, dass das OBIA Konzept eine fortschrittliche Lösung für die Bildanalyse ist, da die Genauigkeiten - an den verschiedenen Skalen angewandt - im Vergleich mit denen der Pixel-basierten Konzept verbessert wurden. Unterdessen waren die berichteten Ergebnisse der feineren räumlichen Auflösung nicht nur für die beiden Ansätze konsequent hoch, sondern durch das OBIA Konzept deutlich verbessert. Die schnellen Veränderungen und die Heterogenität der Region sowie die unterschiedliche Datenherkunft haben dazu geführt, dass die Umsetzung von Post-Klassifizierungs- Änderungserkennung besser geeignet ist als radiometrische Transformationsmethoden. Basierend auf thematische LU/LC Karten wurden Serien von optimierten Algorithmen entwickelt, um die Dynamik in LU/LC Einheiten darzustellen. Deshalb wurden für Detailänderung "von-bis"-Informationsklassen sowie Veränderungsstatistiken erstellt. Ferner wurden die erzeugten Änderungskarten bewertet, was zeigte, dass die Genauigkeit der Änderungskarten konstant hoch ist. Aggregiert auf die Gemeinde-Ebene bieten Sozialerhebungen der Haushaltsdaten eine umfassende zusätzliche Sichtweise auf die Fernerkundungsdaten. Die vorher festgelegten degradierten und erfolgreich wiederhergestellten Hot Spots wurden untersucht. Die Studie verwendet einen gut gestalteten Fragebogen um Faktoren die die Dynamik der Änderung der Landbedeckung und mögliche Lösungen, die auf der Wahrnehmung der Gemeinden basieren, anzusprechen. Auf der Ebene des operativen strukturellen Waldbestandes wird die Begründung für die Einbeziehung dieser Analysen angegeben um semi-automatische OBIA Metriken zu schätzen, die aus dem Wald-Attribut durch automatisierte Segmentierungsalgorithmen in den Baumkronen abgegrenzt oder Cluster von Kronen Ebenen erworben wird. Korrelations- und Regressionsanalysen wurden angewandt, um die Beziehungen zwischen einer Vielzahl von spektralen und strukturellen Metriken und den aus den Untersuchungsgebieten abgeleiteten Waldattributen zu identifizieren. Die Ergebnisse des OBIA Rahmens zeigen starke Beziehungen und präzise Schätzungen. Die besten Modelle waren mit einem unabhängigen Satz von kreuz-validierten Feldproben ausgestattet, welche hohe Genauigkeiten ergaben. Eine wichtige Frage ist, wie die räumliche Auflösung und die verwendete Bandbreite die Qualität der entwickelten Modelle auch auf der Grundlage der verschiedenen untersuchten Sensoren beeinflussen. Schließlich zeigt die Studie, dass OBIA in der Lage ist, als ein effizienter und genauer Ansatz Kenntnisse über die Landfunktionen zu erlangen, sei es bei operativen Attributen der Waldstruktur oder auch auf der kategorischen LU/LC Ebene. Außerdem zeigt der methodischen Rahmen eine mögliche Lösung um präzise Fakten und Zahlen über die Veränderungsdynamik und ihre Antriebskräfte zu ermitteln