The SARptical Dataset for Joint Analysis of SAR and Optical Image in Dense Urban Area

The joint interpretation of very high resolution SAR and optical images in dense urban area are not trivial due to the distinct imaging geometry of the two types of images. Especially, the inevitable layover caused by the side-looking SAR imaging geometry renders this task even more challenging. Only until recently, the "SARptical" framework [1], [2] proposed a promising solution to tackle this. SARptical can trace individual SAR scatterers in corresponding high-resolution optical images, via rigorous 3-D reconstruction and matching. This paper introduces the SARptical dataset, which is a dataset of over 10,000 pairs of corresponding SAR, and optical image patches extracted from TerraSAR-X high-resolution spotlight images and aerial UltraCAM optical images. This dataset opens new opportunities of multisensory data analysis. One can analyze the geometry, material, and other properties of the imaged object in both SAR and optical image domain. More advanced applications such as SAR and optical image matching via deep learning [3] is now also possible.Comment: This manuscript was submitted to IGARSS 201

Buildings Detection in VHR SAR Images Using Fully Convolution Neural Networks

This paper addresses the highly challenging problem of automatically detecting man-made structures especially buildings in very high resolution (VHR) synthetic aperture radar (SAR) images. In this context, the paper has two major contributions: Firstly, it presents a novel and generic workflow that initially classifies the spaceborne TomoSAR point clouds $-$ generated by processing VHR SAR image stacks using advanced interferometric techniques known as SAR tomography (TomoSAR) $-$ into buildings and non-buildings with the aid of auxiliary information (i.e., either using openly available 2-D building footprints or adopting an optical image classification scheme) and later back project the extracted building points onto the SAR imaging coordinates to produce automatic large-scale benchmark labelled (buildings/non-buildings) SAR datasets. Secondly, these labelled datasets (i.e., building masks) have been utilized to construct and train the state-of-the-art deep Fully Convolution Neural Networks with an additional Conditional Random Field represented as a Recurrent Neural Network to detect building regions in a single VHR SAR image. Such a cascaded formation has been successfully employed in computer vision and remote sensing fields for optical image classification but, to our knowledge, has not been applied to SAR images. The results of the building detection are illustrated and validated over a TerraSAR-X VHR spotlight SAR image covering approximately 39 km$^2$ $-$ almost the whole city of Berlin $-$ with mean pixel accuracies of around 93.84%Comment: Accepted publication in IEEE TGR

Remote sensing satellite image processing techniques for image classification: a comprehensive survey

This paper is a brief survey of advance technological aspects of Digital Image Processing which are applied to remote sensing images obtained from various satellite sensors. In remote sensing, the image processing techniques can be categories in to four main processing stages: Image preprocessing, Enhancement, Transformation and Classification. Image pre-processing is the initial processing which deals with correcting radiometric distortions, atmospheric distortion and geometric distortions present in the raw image data. Enhancement techniques are applied to preprocessed data in order to effectively display the image for visual interpretation. It includes techniques to effectively distinguish surface features for visual interpretation. Transformation aims to identify particular feature of earth’s surface and classification is a process of grouping the pixels, that produces effective thematic map of particular land use and land cover

Fusing meter-resolution 4-D InSAR point clouds and optical images for semantic urban infrastructure monitoring

Synthetic aperture radar (SAR) interferometry is the only imaging-based method for assessing long-term millimetre-level deformation of individual building over a large area from space, credited to the availability of meter-resolution spaceborne SAR data, and the development in advanced InSAR techniques, such as SAR tomography. However, the inevitable SAR side-looking imaging geometry results in undesired occlusion and layover especially in urban areas, rendering the SAR images difficult to interpret. Aiming at a semantic-level urban infrastructure monitoring, this paper proposed an algorithm to bridge the precise deformation estimates of InSAR and good visual interpretability of optical images by a strict 3-D geometric fusion of SAR and optical images, which has not been mentioned for large urban area so far. Via the precise geometrical fusion, the semantics derived from optical image can be fused to the InSAR point clouds. The proposed approach provides the first InSAR point cloud of an entire urban area textured with optical attributes. Hence, the InSAR deformation analysis can be done systematically in a semantic level, instead of the current pixel-wised analysis and manual identification of the regions of interest. Examples on bridges and railway segments monitoring are demonstrated

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

ANALYZING THE LIFE-CYCLE OF UNSTABLE SLOPES USING APPLIED REMOTE SENSING WITHIN AN ASSET MANAGEMENT FRAMEWORK

An asset management framework provides a methodology for monitoring and maintaining assets, which include anthropogenic infrastructure (e.g., dams, embankments, and retaining structures) and natural geological features (e.g., soil and rock slopes). It is imperative that these assets operate efficiently, effectively, safely, and at a high standard since many assets are located along transportation corridors (highways, railways, and waterways) and can cause severe damage if compromised. Assets built on or around regions prone to natural hazards are at an increased risk of deterioration and failure. The objective of this study is to utilize remote sensing techniques such as InSAR, LiDAR, and optical photogrammetry to identify assets, assess past and current conditions, and perform long-term monitoring in transportation corridors and urbanized areas prone to natural hazards. Provided are examples of remote sensing techniques successfully applied to various asset management procedures: the characterization of rock slopes (Chapter 2), identification of potentially hazardous slopes along a railroad corridor (Chapter 3), monitoring subsidence rates of buildings in San Pedro, California (Chapter 4), and mapping displacement rates on dams in India (Chapter 5) and California (Chapter 6). A demonstration of how InSAR can be used to map slow landslides (those with a displacement rate \u3c 16 mm/year and may be undetectable without sensitive instrumentation) and update the California Landslide Inventory on the Palos Verdes Peninsula is provided in Chapter 7. Long-term landslide monitoring using optical photogrammetry, GPS, and InSAR measurements is also used to map landslide activity at three orders of magnitude (meter to millimeter scales) in Chapter 8. Remote sensing has proven to be an effective tool at measuring ground deformation, which is an implicit indicator of how geotechnical asset condition changes (e.g., deteriorates) over time. Incorporating these techniques into a geotechnical asset management framework will provide greater spatial and temporal data for preventative approaches towards natural hazards