Distributed processing of large remote sensing images using MapReduce - A case of Edge Detection

Dissertation submitted in partial fulfillment of the requirements for the Degree of Master of Science in Geospatial Technologies.Advances in sensor technology and their ever increasing repositories of the collected data are revolutionizing the mechanisms remotely sensed data are collected, stored and processed. This exponential growth of data archives and the increasing user’s demand for real-and near-real time remote sensing data products has pressurized remote sensing service providers to deliver the required services. The remote sensing community has recognized the challenge in processing large and complex satellite datasets to derive customized products. To address this high demand in computational resources, several efforts have been made in the past few years towards incorporation of high-performance computing models in remote sensing data collection, management and analysis. This study adds an impetus to these efforts by introducing the recent advancements in distributed computing technologies, MapReduce programming paradigm, to the area of remote sensing. The MapReduce model which is developed by Google Inc. encapsulates the efforts of distributed computing in a highly simplified single library. This simple but powerful programming model can provide us distributed environment without having deep knowledge of parallel programming. This thesis presents a MapReduce based processing of large satellite images a use case scenario of edge detection methods. Deriving from the conceptual massive remote sensing image processing applications, a prototype of edge detection methods was implemented on MapReduce framework using its open-source implementation, the Apache Hadoop environment. The experiences of the implementation of the MapReduce model of Sobel, Laplacian, and Canny edge detection methods are presented. This thesis also presents the results of the evaluation the effect of parallelization using MapReduce on the quality of the output and the execution time performance tests conducted based on various performance metrics. The MapReduce algorithms were executed on a test environment on heterogeneous cluster that supports the Apache Hadoop open-source software. The successful implementation of the MapReduce algorithms on a distributed environment demonstrates that MapReduce has a great potential for scaling large-scale remotely sensed images processing and perform more complex geospatial problems

Graph-based Data Modeling and Analysis for Data Fusion in Remote Sensing

Hyperspectral imaging provides the capability of increased sensitivity and discrimination over traditional imaging methods by combining standard digital imaging with spectroscopic methods. For each individual pixel in a hyperspectral image (HSI), a continuous spectrum is sampled as the spectral reflectance/radiance signature to facilitate identification of ground cover and surface material. The abundant spectrum knowledge allows all available information from the data to be mined. The superior qualities within hyperspectral imaging allow wide applications such as mineral exploration, agriculture monitoring, and ecological surveillance, etc. The processing of massive high-dimensional HSI datasets is a challenge since many data processing techniques have a computational complexity that grows exponentially with the dimension. Besides, a HSI dataset may contain a limited number of degrees of freedom due to the high correlations between data points and among the spectra. On the other hand, merely taking advantage of the sampled spectrum of individual HSI data point may produce inaccurate results due to the mixed nature of raw HSI data, such as mixed pixels, optical interferences and etc. Fusion strategies are widely adopted in data processing to achieve better performance, especially in the field of classification and clustering. There are mainly three types of fusion strategies, namely low-level data fusion, intermediate-level feature fusion, and high-level decision fusion. Low-level data fusion combines multi-source data that is expected to be complementary or cooperative. Intermediate-level feature fusion aims at selection and combination of features to remove redundant information. Decision level fusion exploits a set of classifiers to provide more accurate results. The fusion strategies have wide applications including HSI data processing. With the fast development of multiple remote sensing modalities, e.g. Very High Resolution (VHR) optical sensors, LiDAR, etc., fusion of multi-source data can in principal produce more detailed information than each single source. On the other hand, besides the abundant spectral information contained in HSI data, features such as texture and shape may be employed to represent data points from a spatial perspective. Furthermore, feature fusion also includes the strategy of removing redundant and noisy features in the dataset. One of the major problems in machine learning and pattern recognition is to develop appropriate representations for complex nonlinear data. In HSI processing, a particular data point is usually described as a vector with coordinates corresponding to the intensities measured in the spectral bands. This vector representation permits the application of linear and nonlinear transformations with linear algebra to find an alternative representation of the data. More generally, HSI is multi-dimensional in nature and the vector representation may lose the contextual correlations. Tensor representation provides a more sophisticated modeling technique and a higher-order generalization to linear subspace analysis. In graph theory, data points can be generalized as nodes with connectivities measured from the proximity of a local neighborhood. The graph-based framework efficiently characterizes the relationships among the data and allows for convenient mathematical manipulation in many applications, such as data clustering, feature extraction, feature selection and data alignment. In this thesis, graph-based approaches applied in the field of multi-source feature and data fusion in remote sensing area are explored. We will mainly investigate the fusion of spatial, spectral and LiDAR information with linear and multilinear algebra under graph-based framework for data clustering and classification problems

Recent Advances in Image Restoration with Applications to Real World Problems

In the past few decades, imaging hardware has improved tremendously in terms of resolution, making widespread usage of images in many diverse applications on Earth and planetary missions. However, practical issues associated with image acquisition are still affecting image quality. Some of these issues such as blurring, measurement noise, mosaicing artifacts, low spatial or spectral resolution, etc. can seriously affect the accuracy of the aforementioned applications. This book intends to provide the reader with a glimpse of the latest developments and recent advances in image restoration, which includes image super-resolution, image fusion to enhance spatial, spectral resolution, and temporal resolutions, and the generation of synthetic images using deep learning techniques. Some practical applications are also included

A Global Human Settlement Layer from optical high resolution imagery - Concept and first results

A general framework for processing of high and very-high resolution imagery for creating a Global Human Settlement Layer (GHSL) is presented together with a discussion on the results of the first operational test of the production workflow. The test involved the mapping of 24.3 millions of square kilometres of the Earth surface spread over four continents, corresponding to an estimated population of 1.3 billion of people in 2010. The resolution of the input image data ranges from 0.5 to 10 meters, collected by a heterogeneous set of platforms including satellite SPOT (2 and 5), CBERS-2B, RapidEye (2 and 4), WorldView (1 and 2), GeoEye-1, QuickBird-2, Ikonos-2, and airborne sensors. Several imaging modes were tested including panchromatic, multispectral and pan-sharpened images. A new fully automatic image information extraction, generalization and mosaic workflow is presented that is based on multiscale textural and morphological image features extraction. New image feature compression and optimization are introduced, together with new learning and classification techniques allowing for the processing of HR/VHR image data using low-resolution thematic layers as reference. A new systematic approach for quality control and validation allowing global spatial and thematic consistency checking is proposed and applied. The quality of the results are discussed by sensor, by band, by resolution, and eco-regions. Critical points, lessons learned and next steps are highlighted.JRC.G.2-Global security and crisis managemen

A New Deep Generative Network for Unsupervised Remote Sensing Single-Image Super-Resolution

Super-resolution (SR) brings an excellent opportunity to improve a wide range of different remote sensing applications. SR techniques are concerned about increasing the image resolution while providing finer spatial details than those captured by the original acquisition instrument. Therefore, SR techniques are particularly useful to cope with the increasing demand remote sensing imaging applications requiring fine spatial resolution. Even though different machine learning paradigms have been successfully applied in SR, more research is required to improve the SR process without the need of external high-resolution (HR) training examples. This paper proposes a new convolutional generator model to super-resolve low-resolution (LR) remote sensing data from an unsupervised perspective. That is, the proposed generative network is able to initially learn relationships between the LR and HR domains throughout several convolutional, downsampling, batch normalization, and activation layers. Then, the data are symmetrically projected to the target resolution while guaranteeing a reconstruction constraint over the LR input image. An experimental comparison is conducted using 12 different unsupervised SR methods over different test images. Our experiments reveal the potential of the proposed approach to improve the resolution of remote sensing imagery

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

An integrative approach using remote sensing and social analysis to identify different settlement types and the specific living conditions of its inhabitants

Someday in 2007, the world population reached a historical landmark: for the first time in human history, more than half of the world´s population was urban. A stagnation of this urbanization process is not in sight, so that by 2050, already 70 percent of humankind is projected to live in urban settlements. Over the last few decades, enormous migrations from rural hinterlands to steadily growing cities could be witnessed coming along with a dramatic growth of the world’s urban population. The speed and the scale of this growth, particularly in the so called less developed regions, are posing tremendous challenges to the countries concerned as well as to the world community. Within mega cities the strongest trends and the most extreme dimensions of the urbanization process can be observed. Their rapid growth results in uncontrolled processes of fragmentation which is often associated with pronounced poverty, social inequality, socio-spatial and political fragmentation, environmental degradation as well as population demands that outstrip environmental service capacity. For the majority of the mega cities a tremendous increase of informal structures and processes has to be observed. Consequentially informal settlements are growing, which represent those characteristic municipal areas being subject to particularly high population density, dynamics as well as marginalization. They have quickly become the most visible expression of urban poverty in developing world cities. Due to the extreme dynamics, the high complexity and huge spatial dimension of mega cities, urban administrations often only have an obsolete or not even existing data basis available to be at all informed about developments, trends and dimensions of urban growth and change. The knowledge about the living conditions of the residents is correspondingly very limited, incomplete and not up to date. Traditional methods such as statistical and regional analyses or fieldwork are no longer capable to capture such urban process. New data sources and monitoring methodologies are required in order to provide an up to date information basis as well as planning strate¬gies to enable sustainable developments and to simplify planning processes in complex urban structures. This research shall seize the described problem and aims to make a contribution to the requirements of monitoring fast developing mega cities. Against this background a methodology is developed to compensate the lack of socio-economic data and to deduce meaningful information on the living conditions of the inhabitants of mega cities. Neither social science methods alone nor the exclusive analysis of remote sensing data can solve the problem of the poor quality and outdated data base. Conventional social science methods cannot cope with the enormous developments and the tremendous growth as they are too labor-, as well as too time- and too cost-intensive. On the other hand, the physical discipline of remote sensing does not allow for direct conclusions on social parameters out of remote sensing images. The prime objective of this research is therefore the development of an integrative approach − bridging remote sensing and social analysis – in order to derive useful information about the living conditions in this specific case of the mega city Delhi and its inhabitants. Hence, this work is established in the overlapping range of the research topics remote sensing, urban areas and social science. Delhi, as India’s fast growing capital, meanwhile with almost 25 million residents the second largest city of the world, represents a prime example of a mega city. Since the second half of the 20th century, Delhi has been transformed from a modest town with mainly administrative and trade-related functions to a complex metropolis with a steep socio-economic gradient. The quality and amount of administrative and socio-economic data are poor and the knowledge about the circumstances of Delhi’s residents is correspondingly insufficient and outdated. Delhi represents therefore a perfectly suited study area for this research. In order to gather information about the living conditions within the different settlement types a methodology was developed and conducted to analyze the urban environment of the mega city Delhi. To identify different settlement types within the urban area, regarding the complex and heterogeneous appearance of the Delhi area, a semi-automated, object-oriented classification approach, based on segmentation derived image objects, was implemented. As the complete conceptual framework of this research, the classification methodology was developed based on a smaller representative training area at first and applied to larger test sites within Delhi afterwards. The object-oriented classification of VHR satellite imagery of the QuickBird sensor allowed for the identification of five different urban land cover classes within the municipal area of Delhi. In the focus of the image analysis is yet the identification of different settlement types and amongst these of informal settlements in particular. The results presented within this study demonstrate, that, based on density classes, the developed methodology is suitable to identify different settlement types and to detect informal settlements which are mega urban risk areas and thus potential residential zones of vulnerable population groups. The remote sensing derived land cover maps form the foundation for the integrative analysis concept and deliver there¬fore the general basis for the derivation of social attributes out of remote sensing data. For this purpose settlement characteristics (e.g., area of the settlement, average building size, and number of houses) are estimated from the classified QuickBird data and used to derive spatial information about the population distribution. In a next step, the derived information is combined with in-situ information on socio-economic conditions (e.g., family size, mean water consumption per capita/family) extracted from georeferenced questionnaires conducted during two field trips in Delhi. This combined data is used to characterize a given settlement type in terms of specific population and water related variables (e.g., population density, total water consumption). With this integrative methodology a catalogue can be compiled, comprising the living conditions of Delhi’s inhabitants living in specific settlement structures – and this in a quick, large-scaled, cost effective, by random or regularly repeatable way with a relatively small required data basis.The combined application of remotely sensed imagery and socio-economic data allows for the mapping, capturing and characterizing the socio-economic structures and dynamics within the mega city of Delhi, as well as it establishes a basis for the monitoring of the mega city of Delhi or certain areas within the city respectively by remote sensing. The opportunity to capture the condition of a mega city and to monitor its development in general enables the persons in charge to identify unbeneficial trends and to intervene accordingly from an urban planning perspective and to countersteer against a non-adequate supply of the inhabitants of different urban districts, primarily of those of informal settlements. This study is understood to be a first step to the development of methods which will help to identify and understand the different forms, actors and processes of urbanization in mega cities. It could support a more proactive and sustainable urban planning and land management – which in turn will increase the importance of urban remote sensing techniques. In this regard, the most obvious and direct beneficiaries are on the one hand the governmental agencies and urban planners and on the other hand, and which is possibly the most important goal, the inhabitants of the affected areas, whose living conditions can be monitored and improved as required. Only if the urban monitoring is quickly, inexpensively and easily available, it will be accepted and applied by the authorities, which in turn enables for the poorest to get the support they need. All in all, the listed benefits are very convincing and corroborate the combined use of remotely sensed and socio-economic data in mega city research