A Framework for SAR-Optical Stereogrammetry over Urban Areas

Currently, numerous remote sensing satellites provide a huge volume of diverse earth observation data. As these data show different features regarding resolution, accuracy, coverage, and spectral imaging ability, fusion techniques are required to integrate the different properties of each sensor and produce useful information. For example, synthetic aperture radar (SAR) data can be fused with optical imagery to produce 3D information using stereogrammetric methods. The main focus of this study is to investigate the possibility of applying a stereogrammetry pipeline to very-high-resolution (VHR) SAR-optical image pairs. For this purpose, the applicability of semi-global matching is investigated in this unconventional multi-sensor setting. To support the image matching by reducing the search space and accelerating the identification of correct, reliable matches, the possibility of establishing an epipolarity constraint for VHR SAR-optical image pairs is investigated as well. In addition, it is shown that the absolute geolocation accuracy of VHR optical imagery with respect to VHR SAR imagery such as provided by TerraSAR-X can be improved by a multi-sensor block adjustment formulation based on rational polynomial coefficients. Finally, the feasibility of generating point clouds with a median accuracy of about 2m is demonstrated and confirms the potential of 3D reconstruction from SAR-optical image pairs over urban areas.Comment: This is the pre-acceptance version, to read the final version, please go to ISPRS Journal of Photogrammetry and Remote Sensing on ScienceDirec

Enhancment of dense urban digital surface models from VHR optical satellite stereo data by pre-segmentation and object detection

The generation of digital surface models (DSM) of urban areas from very high resolution (VHR) stereo satellite imagery requires advanced methods. In the classical approach of DSM generation from stereo satellite imagery, interest points are extracted and correlated between the stereo mates using an area based matching followed by a least-squares sub-pixel refinement step. After a region growing the 3D point list is triangulated to the resulting DSM. In urban areas this approach fails due to the size of the correlation window, which smoothes out the usual steep edges of buildings. Also missing correlations as for partly – in one or both of the images – occluded areas will simply be interpolated in the triangulation step. So an urban DSM generated with the classical approach results in a very smooth DSM with missing steep walls, narrow streets and courtyards. To overcome these problems algorithms from computer vision are introduced and adopted to satellite imagery. These algorithms do not work using local optimisation like the area-based matching but try to optimize a (semi-)global cost function. Analysis shows that dynamic programming approaches based on epipolar images like dynamic line warping or semiglobal matching yield the best results according to accuracy and processing time. These algorithms can also detect occlusions – areas not visible in one or both of the stereo images. Beside these also the time and memory consuming step of handling and triangulating large point lists can be omitted due to the direct operation on epipolar images and direct generation of a so called disparity image fitting exactly on the first of the stereo images. This disparity image – representing already a sort of a dense DSM – contains the distances measured in pixels in the epipolar direction (or a no-data value for a detected occlusion) for each pixel in the image. Despite the global optimization of the cost function many outliers, mismatches and erroneously detected occlusions remain, especially if only one stereo pair is available. To enhance these dense DSM – the disparity image – a pre-segmentation approach is presented in this paper. Since the disparity image is fitting exactly on the first of the two stereo partners (beforehand transformed to epipolar geometry) a direct correlation between image pixels and derived heights (the disparities) exist. This feature of the disparity image is exploited to integrate additional knowledge from the image into the DSM. This is done by segmenting the stereo image, transferring the segmentation information to the DSM and performing a statistical analysis on each of the created DSM segments. Based on this analysis and spectral information a coarse object detection and classification can be performed and in turn the DSM can be enhanced. After the description of the proposed method some results are shown and discussed

Features of Point Clouds Synthesized from Multi-View ALOS/PRISM Data and Comparisons with LiDAR Data in Forested Areas

LiDAR waveform data from airborne LiDAR scanners (ALS) e.g. the Land Vegetation and Ice Sensor (LVIS) havebeen successfully used for estimation of forest height and biomass at local scales and have become the preferredremote sensing dataset. However, regional and global applications are limited by the cost of the airborne LiDARdata acquisition and there are no available spaceborne LiDAR systems. Some researchers have demonstrated thepotential for mapping forest height using aerial or spaceborne stereo imagery with very high spatial resolutions.For stereo imageswith global coverage but coarse resolution newanalysis methods need to be used. Unlike mostresearch based on digital surface models, this study concentrated on analyzing the features of point cloud datagenerated from stereo imagery. The synthesizing of point cloud data from multi-view stereo imagery increasedthe point density of the data. The point cloud data over forested areas were analyzed and compared to small footprintLiDAR data and large-footprint LiDAR waveform data. The results showed that the synthesized point clouddata from ALOSPRISM triplets produce vertical distributions similar to LiDAR data and detected the verticalstructure of sparse and non-closed forests at 30mresolution. For dense forest canopies, the canopy could be capturedbut the ground surface could not be seen, so surface elevations from other sourceswould be needed to calculatethe height of the canopy. A canopy height map with 30 m pixels was produced by subtracting nationalelevation dataset (NED) fromthe averaged elevation of synthesized point clouds,which exhibited spatial featuresof roads, forest edges and patches. The linear regression showed that the canopy height map had a good correlationwith RH50 of LVIS data with a slope of 1.04 and R2 of 0.74 indicating that the canopy height derived fromPRISM triplets can be used to estimate forest biomass at 30 m resolution

HIRIS (High-Resolution Imaging Spectrometer: Science opportunities for the 1990s. Earth observing system. Volume 2C: Instrument panel report

The high-resolution imaging spectrometer (HIRIS) is an Earth Observing System (EOS) sensor developed for high spatial and spectral resolution. It can acquire more information in the 0.4 to 2.5 micrometer spectral region than any other sensor yet envisioned. Its capability for critical sampling at high spatial resolution makes it an ideal complement to the MODIS (moderate-resolution imaging spectrometer) and HMMR (high-resolution multifrequency microwave radiometer), lower resolution sensors designed for repetitive coverage. With HIRIS it is possible to observe transient processes in a multistage remote sensing strategy for Earth observations on a global scale. The objectives, science requirements, and current sensor design of the HIRIS are discussed along with the synergism of the sensor with other EOS instruments and data handling and processing requirements

High-resolution debris cover mapping using UAV-derived thermal imagery: limits and opportunities

Debris-covered glaciers are widespread in high mountain ranges on Earth. However, the dynamic evolution of debris-covered glacier surfaces is not well understood, in part due to difficulties of mapping debris cover thickness in high spatiotemporal resolution. In this study we present land surface temperatures (LST) and its diurnal variability measured from an unpiloted aerial vehicle (UAV) at high spatial resolution. We test two common approaches to derive debris thickness maps by (1) solving a surface energy balance model (SEBM) in conjunction with meteorological reanalysis data and (2) least squares regression of a rational curve using debris thickness field measurements. In addition, we take advantage of the measured diurnal temperature cycle and estimate the rate of change of heat storage within the debris cover. Both approaches resulted in debris thickness estimates with a RMSE of 6 to 8 cm between observed and modelled debris thicknesses, depending on the time of the day. The diurnal variability of the LST controls the relationship between LST and debris thickness and the non-linearity increases with increasing LST. During the warming phase of the debris cover, the LST depends strongly on the terrain aspect, rendering clear-sky morning flights that do not account for aspect-effects problematic. Our sensitivity analysis of various parameters in the SEBM highlights the relevance of the effective thermal conductivity when LST is high. Residual and variable bias of UAV-derived LSTs during a flight require calibration, which we achieve with bare ice surfaces. The model performance would benefit from more accurate LST measurements, which are difficult to achieve with uncooled sensors.</p

Onboard utilization of ground control points for image correction. Volume 1: Executive summary

Operation of a navigation system, centered around image correction, was simulated and the system performance was analyzed. Onboard utilization of ground control points for image correction is summarized. Simulation results, and recommendations for future mission requirements are presented

Satellite based synthetic aperture radar and optical spatial-temporal information as aid for operational and environmental mine monitoring

A sustainable society is a society that satisfies its resource requirements without endangering the sustainability of these resources. The mineral endowment on the African continent is estimated to be the first or second largest of world reserves. Therefore, it is recognised that the African continent still heavily depends on mineral exports as a key contributor to the gross domestic product (GDP) of various countries. These mining activities, however, do introduce primary and secondary environmental degradation factors. They attract communities to these mining areas, light and heavy industrial establishments occur, giving rise to artisanal activities. This study focussed on satellite RS products as an aid to a mine’s operations and the monitoring of its environment. Effective operational mine management and control ensures a more sustainable and profitable lifecycle for mines. Satellite based RS holds the potential to observe the mine and its surrounding areas at high temporal intervals, different spectral wavelengths and spatial resolutions. The combination of SAR and optical information creates a spatial platform to observe and measure the mine’s operations and the behaviour of specific land cover and land use classes over time and contributes to a better understanding of the mining activities and their influence on the environment within a specific geographical area. This study will introduce an integrated methodology to collect, process and analyse spatial information over a specific targeted mine. This methodology utilises a medium resolution land cover base map, derived from Landsat 8, to understand the predominant land cover types of the surrounding area. Using very high resolution mono- and stereoscopic satellite imagery provides a finer scale analysis and identifies changes in features at a smaller scale. Combining these technologies with the synthetic aperture radar (SAR) applications for precise measurement of surface subsidence or upliftment becomes a spatial toolbox for mine management. This study examines a combination of satellite remote sensing products guided by a systematic workflow methodology to integrate spatial results as an aid for mining operations and environmental monitoring. Some of the results that can be highlighted is the successful land cover classification using the Landsat 8 satellite. The land cover that dominated the Kolomela mine area was the “SHRUBLAND/GRASS” class with a 94% coverage and “MINE” class of 2.6%. Sishen mine had a similar dominated land cover characteristic with a “SHRUBLAND/GRASS” class of 90% and “MINE” class of 4.8%. The Pléiades time-series classification analysis was done using three scenes each acquired at a different time interval. The Sishen and Kolomela mine showed especially changes from the bare soil class to the asphalt or mine class. The Pléiades stereoscopic analysis provided volumetric change detection over small, medium, large and recessed areas. Both the Sishen and Kolomela mines demonstrated height profile changes in each selected category. The last category of results focused on the SAR technology to measure within millimetre accuracy the subsidence and upliftment behaviour of surface areas over time. The Royal Bafokeng Platinum tailings pond area was measured using 74 TerraSAR-X scenes. The tailings wall area was confirmed as stable with natural subsidence that occurred in its surrounding area due to seasonal changes of the soil during rainy and dry periods. The Chuquicamata mine as a large open pit copper mine area was analysed using 52 TerraSAR-X scenes. The analysis demonstrated significant vertical surface movement over some of the dumping sites. It is the wish of the researcher that this dissertation and future research scholars will continue to contribute in this scientific field. These contributions can only assist the mining sector to continuously improve its mining operations as well as its monitoring of the primary as well as the secondary environmental impacts to ensure improved sustainability for the next generation.Environmental SciencesM. Sc. (Environmental Science

Detection of Marine Plastic Debris in the North Pacific Ocean using Optical Satellite Imagery

Plastic pollution is ubiquitous across marine environments, yet detection of anthropogenic debris in the global oceans is in its infancy. Here, we exploit high-resolution multispectral satellite imagery over the North Pacific Ocean and information from GPS-tracked floating plastic conglomerates to explore the potential for detecting marine plastic debris via spaceborne remote sensing platforms. Through an innovative method of estimating material abundance in mixed pixels, combined with an inverse spectral unmixing calculation, a spectral signature of aggregated plastic litter was derived from an 8-band WorldView-2 image. By leveraging the spectral characteristics of marine plastic debris in a real environment, plastic detectability was demonstrated and evaluated utilising a Spectral Angle Mapper (SAM) classification, Mixture Tuned Matched Filtering (MTMF), the Reed-Xiaoli Detector (RXD) algorithm, and spectral indices in a three-variable feature space. Results indicate that floating aggregations are detectable on sub-pixel scales, but as reliable ground truth information was restricted to a single confirmed target, detections were only validated by means of their respective spectral responses. Effects of atmospheric correction algorithms were evaluated using ACOLITE, ACOMP, and FLAASH, in which derived unbiased percentage differences ranged from 1% to 81% following a pairwise comparison. Building first steps towards an integrated marine monitoring system, the strengths and limitations of current remote sensing technology are identified and adopted to make suggestions for future improvements

Automated Building Information Extraction and Evaluation from High-resolution Remotely Sensed Data

The two-dimensional (2D) footprints and three-dimensional (3D) structures of buildings are of great importance to city planning, natural disaster management, and virtual environmental simulation. As traditional manual methodologies for collecting 2D and 3D building information are often both time consuming and costly, automated methods are required for efficient large area mapping. It is challenging to extract building information from remotely sensed data, considering the complex nature of urban environments and their associated intricate building structures. Most 2D evaluation methods are focused on classification accuracy, while other dimensions of extraction accuracy are ignored. To assess 2D building extraction methods, a multi-criteria evaluation system has been designed. The proposed system consists of matched rate, shape similarity, and positional accuracy. Experimentation with four methods demonstrates that the proposed multi-criteria system is more comprehensive and effective, in comparison with traditional accuracy assessment metrics. Building height is critical for building 3D structure extraction. As data sources for height estimation, digital surface models (DSMs) that are derived from stereo images using existing software typically provide low accuracy results in terms of rooftop elevations. Therefore, a new image matching method is proposed by adding building footprint maps as constraints. Validation demonstrates that the proposed matching method can estimate building rooftop elevation with one third of the error encountered when using current commercial software. With an ideal input DSM, building height can be estimated by the elevation contrast inside and outside a building footprint. However, occlusions and shadows cause indistinct building edges in the DSMs generated from stereo images. Therefore, a “building-ground elevation difference model” (EDM) has been designed, which describes the trend of the elevation difference between a building and its neighbours, in order to find elevation values at bare ground. Experiments using this novel approach report that estimated building height with 1.5m residual, which out-performs conventional filtering methods. Finally, 3D buildings are digitally reconstructed and evaluated. Current 3D evaluation methods did not present the difference between 2D and 3D evaluation methods well; traditionally, wall accuracy is ignored. To address these problems, this thesis designs an evaluation system with three components: volume, surface, and point. As such, the resultant multi-criteria system provides an improved evaluation method for building reconstruction

A methodology to produce geographical information for land planning using very-high resolution images

Actualmente, os municípios são obrigados a produzir, no âmbito da elaboração dos instrumentos de gestão territorial, cartografia homologada pela autoridade nacional. O Plano Director Municipal (PDM) tem um período de vigência de 10 anos. Porém, no que diz respeito à cartografia para estes planos, principalmente em municípios onde a pressão urbanística é elevada, esta periodicidade não é compatível com a dinâmica de alteração de uso do solo. Emerge assim, a necessidade de um processo de produção mais eficaz, que permita a obtenção de uma nova cartografia de base e temática mais frequentemente. Em Portugal recorre-se à fotografia aérea como informação de base para a produção de cartografia de grande escala. Por um lado, embora este suporte de informação resulte em mapas bastante rigorosos e detalhados, a sua produção têm custos muito elevados e consomem muito tempo. As imagens de satélite de muito alta-resolução espacial podem constituir uma alternativa, mas sem substituir as fotografias aéreas na produção de cartografia temática, a grande escala. O tema da tese trata assim da satisfação das necessidades municipais em informação geográfica actualizada. Para melhor conhecer o valor e utilidade desta informação, realizou-se um inquérito aos municípios Portugueses. Este passo foi essencial para avaliar a pertinência e a utilidade da introdução de imagens de satélite de muito alta-resolução espacial na cadeia de procedimentos de actualização de alguns temas, quer na cartografia de base quer na cartografia temática. A abordagem proposta para solução do problema identificado baseia-se no uso de imagens de satélite e outros dados digitais em ambiente de Sistemas de Informação Geográfica. A experimentação teve como objectivo a extracção automática de elementos de interesse municipal a partir de imagens de muito alta-resolução espacial (fotografias aéreas ortorectificadas, imagem QuickBird, e imagem IKONOS), bem como de dados altimétricos (dados LiDAR). Avaliaram-se as potencialidades da informação geográfica extraídas das imagens para fins cartográficos e analíticos. Desenvolveram-se quatro casos de estudo que reflectem diferentes usos para os dados geográficos a nível municipal, e que traduzem aplicações com exigências diferentes. No primeiro caso de estudo, propõe-se uma metodologia para actualização periódica de cartografia a grande escala, que faz uso de fotografias aéreas vi ortorectificadas na área da Alta de Lisboa. Esta é uma aplicação quantitativa onde as qualidades posicionais e geométricas dos elementos extraídos são mais exigentes. No segundo caso de estudo, criou-se um sistema de alarme para áreas potencialmente alteradas, com recurso a uma imagem QuickBird e dados LiDAR, no Bairro da Madre de Deus, com objectivo de auxiliar a actualização de cartografia de grande escala. No terceiro caso de estudo avaliou-se o potencial solar de topos de edifícios nas Avenidas Novas, com recurso a dados LiDAR. No quarto caso de estudo, propõe-se uma série de indicadores municipais de monitorização territorial, obtidos pelo processamento de uma imagem IKONOS que cobre toda a área do concelho de Lisboa. Esta é uma aplicação com fins analíticos onde a qualidade temática da extracção é mais relevante.Currently, the Portuguese municipalities are required to produce homologated cartography, under the Territorial Management Instruments framework. The Municipal Master Plan (PDM) has to be revised every 10 years, as well as the topographic and thematic maps that describe the municipal territory. However, this period is inadequate for representing counties where urban pressure is high, and where the changes in the land use are very dynamic. Consequently, emerges the need for a more efficient mapping process, allowing obtaining recent geographic information more often. Several countries, including Portugal, continue to use aerial photography for large-scale mapping. Although this data enables highly accurate maps, its acquisition and visual interpretation are very costly and time consuming. Very-High Resolution (VHR) satellite imagery can be an alternative data source, without replacing the aerial images, for producing large-scale thematic cartography. The focus of the thesis is the demand for updated geographic information in the land planning process. To better understand the value and usefulness of this information, a survey of all Portuguese municipalities was carried out. This step was essential for assessing the relevance and usefulness of the introduction of VHR satellite imagery in the chain of procedures for updating land information. The proposed methodology is based on the use of VHR satellite imagery, and other digital data, in a Geographic Information Systems (GIS) environment. Different algorithms for feature extraction that take into account the variation in texture, color and shape of objects in the image, were tested. The trials aimed for automatic extraction of features of municipal interest, based on aerial and satellite high-resolution (orthophotos, QuickBird and IKONOS imagery) as well as elevation data (altimetric information and LiDAR data). To evaluate the potential of geographic information extracted from VHR images, two areas of application were identified: mapping and analytical purposes. Four case studies that reflect different uses of geographic data at the municipal level, with different accuracy requirements, were considered. The first case study presents a methodology for periodic updating of large-scale maps based on orthophotos, in the area of Alta de Lisboa. This is a situation where the positional and geometric accuracy of the extracted information are more demanding, since technical mapping standards must be complied. In the second case study, an alarm system that indicates the location of potential changes in building areas, using a QuickBird image and LiDAR data, was developed for the area of Bairro da Madre de Deus. The goal of the system is to assist the updating of large scale mapping, providing a layer that can be used by the municipal technicians as the basis for manual editing. In the third case study, the analysis of the most suitable roof-tops for installing solar systems, using LiDAR data, was performed in the area of Avenidas Novas. A set of urban environment indicators obtained from VHR imagery is presented. The concept is demonstrated for the entire city of Lisbon, through IKONOS imagery processing. In this analytical application, the positional quality issue of extraction is less relevant.GEOSAT – Methodologies to extract large scale GEOgraphical information from very high resolution SATellite images (PTDC/GEO/64826/2006), e-GEO – Centro de Estudos de Geografia e Planeamento Regional, da Faculdade de Ciências Sociais e Humanas, no quadro do Grupo de Investigação Modelação Geográfica, Cidades e Ordenamento do Territóri