Urban building detection from optical and insar features exploiting context

We investigate the potential of combined features of aerial images and high-resolution interferometric SAR (InSAR) data for building detection in urban areas. It is shown that completeness and correctness may be increased if we integrate both InSAR double-bounce lines and 3D lines of stereo data in addition to building hints of a single optical orthophoto. In order to exploit context information, which is crucial for object detection in urban areas, we use a Conditional Random Field approach. It proves to be a valuable method for context-based building detection with multi-sensor features

Detection and height estimation of buildings from SAR and optical images using conditional random fields

[no abstract

Automatic near real-time flood detection in high resolution X-band synthetic aperture radar satellite data using context-based classification on irregular graphs

This thesis is an outcome of the project “Flood and damage assessment using very high resolution SAR data” (SAR-HQ), which is embedded in the interdisciplinary oriented RIMAX (Risk Management of Extreme Flood Events) programme, funded by the Federal Ministry of Education and Research (BMBF). It comprises the results of three scientific papers on automatic near real-time flood detection in high resolution X-band synthetic aperture radar (SAR) satellite data for operational rapid mapping activities in terms of disaster and crisis-management support. Flood situations seem to become more frequent and destructive in many regions of the world. A rising awareness of the availability of satellite based cartographic information has led to an increase in requests to corresponding mapping services to support civil-protection and relief organizations with disaster-related mapping and analysis activities. Due to the rising number of satellite systems with high revisit frequencies, a strengthened pool of SAR data is available during operational flood mapping activities. This offers the possibility to observe the whole extent of even large-scale flood events and their spatio-temporal evolution, but also calls for computationally efficient and automatic flood detection methods, which should drastically reduce the user input required by an active image interpreter. This thesis provides solutions for the near real-time derivation of detailed flood parameters such as flood extent, flood-related backscatter changes as well as flood classification probabilities from the new generation of high resolution X-band SAR satellite imagery in a completely unsupervised way. These data are, in comparison to images from conventional medium-resolution SAR sensors, characterized by an increased intra-class and decreased inter-class variability due to the reduced mixed pixel phenomenon. This problem is addressed by utilizing multi-contextual models on irregular hierarchical graphs, which consider that semantic image information is less represented in single pixels but in homogeneous image objects and their mutual relation. A hybrid Markov random field (MRF) model is developed, which integrates scale-dependent as well as spatio-temporal contextual information into the classification process by combining hierarchical causal Markov image modeling on automatically generated irregular hierarchical graphs with noncausal Markov modeling related to planar MRFs. This model is initialized in an unsupervised manner by an automatic tile-based thresholding approach, which solves the flood detection problem in large-size SAR data with small a priori class probabilities by statistical parameterization of local bi-modal class-conditional density functions in a time efficient manner. Experiments performed on TerraSAR-X StripMap data of Southwest England and ScanSAR data of north-eastern Namibia during large-scale flooding show the effectiveness of the proposed methods in terms of classification accuracy, computational performance, and transferability. It is further demonstrated that hierarchical causal Markov models such as hierarchical maximum a posteriori (HMAP) and hierarchical marginal posterior mode (HMPM) estimation can be effectively used for modeling the inter-spatial context of X-band SAR data in terms of flood and change detection purposes. Although the HMPM estimator is computationally more demanding than the HMAP estimator, it is found to be more suitable in terms of classification accuracy. Further, it offers the possibility to compute marginal posterior entropy-based confidence maps, which are used for the generation of flood possibility maps that express that the uncertainty in labeling of each image element. The supplementary integration of intra-spatial and, optionally, temporal contextual information into the Markov model results in a reduction of classification errors. It is observed that the application of the hybrid multi-contextual Markov model on irregular graphs is able to enhance classification results in comparison to modeling on regular structures of quadtrees, which is the hierarchical representation of images usually used in MRF-based image analysis. X-band SAR systems are generally not suited for detecting flooding under dense vegetation canopies such as forests due to the low capability of the X-band signal to penetrate into media. Within this thesis a method is proposed for the automatic derivation of flood areas beneath shrubs and grasses from TerraSAR-X data. Furthermore, an approach is developed, which combines high resolution topographic information with multi-scale image segmentation to enhance the mapping accuracy in areas consisting of flooded vegetation and anthropogenic objects as well as to remove non-water look-alike areas

Merging digital surface models sourced from multi-satellite imagery and their consequent application in automating 3D building modelling

Recently, especially within the last two decades, the demand for DSMs (Digital Surface Models) and 3D city models has increased dramatically. This has arisen due to the emergence of new applications beyond construction or analysis and consequently to a focus on accuracy and the cost. This thesis addresses two linked subjects: first improving the quality of the DSM by merging different source DSMs using a Bayesian approach; and second, extracting building footprints using approaches, including Bayesian approaches, and producing 3D models. Regarding the first topic, a probabilistic model has been generated based on the Bayesian approach in order to merge different source DSMs from different sensors. The Bayesian approach is specified to be ideal in the case when the data is limited and this can consequently be compensated by introducing the a priori. The implemented prior is based on the hypothesis that the building roof outlines are specified to be smooth, for that reason local entropy has been implemented in order to infer the a priori data. In addition to the a priori estimation, the quality of the DSMs is obtained by using field checkpoints from differential GNSS. The validation results have shown that the model was successfully able to improve the quality of the DSMs and improving some characteristics such as the roof surfaces, which consequently led to better representations. In addition to that, the developed model has been compared with the Maximum Likelihood model which showed similar quantitative statistical results and better qualitative results. Perhaps it is worth mentioning that, although the DSMs used in the merging have been produced using satellite images, the model can be applied on any type of DSM. The second topic is building footprint extraction based on using satellite imagery. An efficient flow-line for automatic building footprint extraction and 3D model construction, from both stereo panchromatic and multispectral satellite imagery was developed. This flow-line has been applied in an area of different building types, with both hipped and sloped roofs. The flow line consisted of multi stages. First, data preparation, digital orthoimagery and DSMs are created from WorldView-1. Pleiades imagery is used to create a vegetation mask. The orthoimagery then undergoes binary classification into ‘foreground’ (including buildings, shadows, open-water, roads and trees) and ‘background’ (including grass, bare soil, and clay). From the foreground class, shadows and open water are removed after creating a shadow mask by thresholding the same orthoimagery. Likewise roads have been removed, for the time being, after interactively creating a mask using the orthoimagery. NDVI processing of the Pleiades imagery has been used to create a mask for removing the trees. An ‘edge map’ is produced using Canny edge detection to define the exact building boundary outlines, from enhanced orthoimagery. A normalised digital surface model (nDSM) is produced from the original DSM using smoothing and subtracting techniques. Second, start Building Detection and Extraction. Buildings can be detected, in part, in the nDSM as isolated relatively elevated ‘blobs’. These nDSM ‘blobs’ are uniquely labelled to identify rudimentary buildings. Each ‘blob’ is paired with its corresponding ‘foreground’ area from the orthoimagery. Each ‘foreground’ area is used as an initial building boundary, which is then vectorised and simplified. Some unnecessary details in the ‘edge map’, particularly on the roofs of the buildings can be removed using mathematical morphology. Some building edges are not detected in the ‘edge map’ due to low contrast in some parts of the orthoimagery. The ‘edge map’ is subsequently further improved also using mathematical morphology, leading to the ‘modified edge map’. Finally, A Bayesian approach is used to find the most probable coordinates of the building footprints, based on the ‘modified edge map’. The proposal that is made for the footprint a priori data is based on the creating a PDF which assumes that the probable footprint angle at the corner is 90o and along the edge is 180o, with a less probable value given to the other angles such as 45o and 135o. The 3D model is constructed by extracting the elevation of the buildings from the DSM and combining it with the regularized building boundary. Validation, both quantitatively and qualitatively has shown that the developed process and associated algorithms have successfully been able to extract building footprints and create 3D models

Mapping the surface water storage variation in densely impounded semi-arid NE Brazil with satellite remote sensing approach

Surface water bodies provide vital support to the society and fundamentally affect ecosystems in various manners. Precise knowledge of the spatial extent of surface water bodies (e.g. reservoirs) as well as of the quantity of water they store is necessary for efficient water deployment and understanding of the local hydrology. Remote sensing provides broad opportunities for surface water mapping. The main objectives of this thesis are: 1) delineating surface water area of partly vegetated water bodies only from remote sensing data without field data input; 2) obtaining the surface water storage, and 3) analyzing its spatio-temporal variations for northeastern (NE) Brazil as a representative for a densely dammed semi-arid region. At first, I investigated the potential of digital elevation models (DEMs) generated from TanDEM-X data, which were acquired during the low water level stage, for reservoirs’ bathymetry derivation. I found that the accuracy of such DEMs can reach one meter, both in the absolute and relative respects. It has shown that DEMs derived from TanDEM-X data have great potentials for representing the reservoirs’ bathymetry of temporally dried-out reservoirs. Subsequently, I targeted at developing a method for mapping the water surface beneath canopy independent of field data for further delineation of the effective water surface. Instead of the commonly used backscattering coefficients, I investigated the capability of the Gray-Level Co-Occurrence Matrix (GLCM) texture index to distinguish different types of Radar backscattering taking place in (partly) vegetated reservoirs. This experiment demonstrated that different types of backscattering at the vegetated water surface show distinct statistical characteristics on GLCM variance derived from TerraSAR-X satellite time series data. Furthermore, with the threshold established based on the statistics of the sub-populations dominated by different types of backscattering, the vegetated water surfaces were effectively mapped, and the effective water surface areas were further delineated with an accuracy of 77% to 95%. ii Based on the investigation of the DEMs generated from TanDEM-X data, I derived the formerly unknown bathymetry for 2 105 reservoirs of various sizes in four representative regions of an overall area of 10 000 km2. The spatial distributions of surface water storage capacities in the four regions were subsequently extracted from the combination of the reservoir bathymetry and the water surface extents provided by RapidEye satellite time series. Furthermore, the spatio-temporal variations of surface water storage were derived for the four representative regions on an annual basis in the period of 2009-2017. This study showed that 1) The density of reservoirs in NE Brazil amounts to 0.04-0.23 reservoirs per km2, the corresponding water surface and surface water storage are 1.18-4.13 ha/km2 and 0.01-0.04 hm3 m/km², respectively; 2) On the spatial unit of 5×5 km2, the surface water storage in the region constantly decreased due to a prolonged drought with a rate of 105 m3/year from 2009 to 2017, with a slight increase from 2016 to 2017 in a few reservoirs; 3) Local precipitation deficit controls the variation of the overall surface water storage in the region. In this thesis I demonstrated the great potential of the great potential of SAR and optical satellite time series data for hydrological applications. The method I developed for delineating the effective water extent from the vegetated reservoirs has shown high potential transferability for other similar regions. The data gaps of bathymetry and surface waters storage capacity were filled for 2 105 reservoirs in NE Brazil. The results of the spatio-temporal variations of surface water storage in four representative regions from 2009-2016 can support future water management and improve hydrological prediction in NE Brazil