Advances in Image Processing, Analysis and Recognition Technology

For many decades, researchers have been trying to make computers’ analysis of images as effective as the system of human vision is. For this purpose, many algorithms and systems have previously been created. The whole process covers various stages, including image processing, representation and recognition. The results of this work can be applied to many computer-assisted areas of everyday life. They improve particular activities and provide handy tools, which are sometimes only for entertainment, but quite often, they significantly increase our safety. In fact, the practical implementation of image processing algorithms is particularly wide. Moreover, the rapid growth of computational complexity and computer efficiency has allowed for the development of more sophisticated and effective algorithms and tools. Although significant progress has been made so far, many issues still remain, resulting in the need for the development of novel approaches

Enhancing spatial resolution of remotely sensed data for mapping freshwater environments

Freshwater environments are important for ecosystem services and biodiversity. These environments are subject to many natural and anthropogenic changes, which influence their quality; therefore, regular monitoring is required for their effective management. High biotic heterogeneity, elongated land/water interaction zones, and logistic difficulties with access make field based monitoring on a large scale expensive, inconsistent and often impractical. Remote sensing (RS) is an established mapping tool that overcomes these barriers. However, complex and heterogeneous vegetation and spectral variability due to water make freshwater environments challenging to map using remote sensing technology. Satellite images available for New Zealand were reviewed, in terms of cost, and spectral and spatial resolution. Particularly promising image data sets for freshwater mapping include the QuickBird and SPOT-5. However, for mapping freshwater environments a combination of images is required to obtain high spatial, spectral, radiometric, and temporal resolution. Data fusion (DF) is a framework of data processing tools and algorithms that combines images to improve spectral and spatial qualities. A range of DF techniques were reviewed and tested for performance using panchromatic and multispectral QB images of a semi-aquatic environment, on the southern shores of Lake Taupo, New Zealand. In order to discuss the mechanics of different DF techniques a classification consisting of three groups was used - (i) spatially-centric (ii) spectrally-centric and (iii) hybrid. Subtract resolution merge (SRM) is a hybrid technique and this research demonstrated that for a semi aquatic QuickBird image it out performed Brovey transformation (BT), principal component substitution (PCS), local mean and variance matching (LMVM), and optimised high pass filter addition (OHPFA). However some limitations were identified with SRM, which included the requirement for predetermined band weights, and the over-representation of the spatial edges in the NIR bands due to their high spectral variance. This research developed three modifications to the SRM technique that addressed these limitations. These were tested on QuickBird (QB), SPOT-5, and Vexcel aerial digital images, as well as a scanned coloured aerial photograph. A visual qualitative assessment and a range of spectral and spatial quantitative metrics were used to evaluate these modifications. These included spectral correlation and root mean squared error (RMSE), Sobel filter based spatial edges RMSE, and unsupervised classification. The first modification addressed the issue of predetermined spectral weights and explored two alternative regression methods (Least Absolute Deviation, and Ordinary Least Squares) to derive image-specific band weights for use in SRM. Both methods were found equally effective; however, OLS was preferred as it was more efficient in processing band weights compared to LAD. The second modification used a pixel block averaging function on high resolution panchromatic images to derive spatial edges for data fusion. This eliminated the need for spectral band weights, minimised spectral infidelity, and enabled the fusion of multi-platform data. The third modification addressed the issue of over-represented spatial edges by introducing a sophisticated contrast and luminance index to develop a new normalising function. This improved the spatial representation of the NIR band, which is particularly important for mapping vegetation. A combination of the second and third modification of SRM was effective in simultaneously minimising the overall spectral infidelity and undesired spatial errors for the NIR band of the fused image. This new method has been labelled Contrast and Luminance Normalised (CLN) data fusion, and has been demonstrated to make a significant contribution in fusing multi-platform, multi-sensor, multi-resolution, and multi-temporal data. This contributes to improvements in the classification and monitoring of fresh water environments using remote sensing

Pansharpened landsat 8 thermal-infrared data for improved land surface temperature characterization in a heterogeneous urban landscape

Challenges associated with adolescents are prevalent in South African societies. During the adolescence stage, children may become involved in deviant behaviour. Although a significant number of studies have focused on the factors that contribute to adolescents’ deviant behaviour, including parental factors, there is paucity of research specifically in rural communities. This study explores the contribution of parental factors to adolescents’ deviant behaviour in rural communities in South Africa. Guided by the qualitative approach, the present study makes use of semi-structured interviews to collect data and thematic analysis to analyse data

Pixel-level Image Fusion Algorithms for Multi-camera Imaging System

This thesis work is motivated by the potential and promise of image fusion technologies in the multi sensor image fusion system and applications. With specific focus on pixel level image fusion, the process after the image registration is processed, we develop graphic user interface for multi-sensor image fusion software using Microsoft visual studio and Microsoft Foundation Class library. In this thesis, we proposed and presented some image fusion algorithms with low computational cost, based upon spatial mixture analysis. The segment weighted average image fusion combines several low spatial resolution data source from different sensors to create high resolution and large size of fused image. This research includes developing a segment-based step, based upon stepwise divide and combine process. In the second stage of the process, the linear interpolation optimization is used to sharpen the image resolution. Implementation of these image fusion algorithms are completed based on the graphic user interface we developed. Multiple sensor image fusion is easily accommodated by the algorithm, and the results are demonstrated at multiple scales. By using quantitative estimation such as mutual information, we obtain the experiment quantifiable results. We also use the image morphing technique to generate fused image sequence, to simulate the results of image fusion. While deploying our pixel level image fusion algorithm approaches, we observe several challenges from the popular image fusion methods. While high computational cost and complex processing steps of image fusion algorithms provide accurate fused results, they also makes it hard to become deployed in system and applications that require real-time feedback, high flexibility and low computation abilit

Deep Learning Meets Hyperspectral Image Analysis: A Multidisciplinary Review

Modern hyperspectral imaging systems produce huge datasets potentially conveying a great abundance of information; such a resource, however, poses many challenges in the analysis and interpretation of these data. Deep learning approaches certainly offer a great variety of opportunities for solving classical imaging tasks and also for approaching new stimulating problems in the spatial–spectral domain. This is fundamental in the driving sector of Remote Sensing where hyperspectral technology was born and has mostly developed, but it is perhaps even more true in the multitude of current and evolving application sectors that involve these imaging technologies. The present review develops on two fronts: on the one hand, it is aimed at domain professionals who want to have an updated overview on how hyperspectral acquisition techniques can combine with deep learning architectures to solve specific tasks in different application fields. On the other hand, we want to target the machine learning and computer vision experts by giving them a picture of how deep learning technologies are applied to hyperspectral data from a multidisciplinary perspective. The presence of these two viewpoints and the inclusion of application fields other than Remote Sensing are the original contributions of this review, which also highlights some potentialities and critical issues related to the observed development trends

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

An integrative approach using remote sensing and social analysis to identify different settlement types and the specific living conditions of its inhabitants

Someday in 2007, the world population reached a historical landmark: for the first time in human history, more than half of the world´s population was urban. A stagnation of this urbanization process is not in sight, so that by 2050, already 70 percent of humankind is projected to live in urban settlements. Over the last few decades, enormous migrations from rural hinterlands to steadily growing cities could be witnessed coming along with a dramatic growth of the world’s urban population. The speed and the scale of this growth, particularly in the so called less developed regions, are posing tremendous challenges to the countries concerned as well as to the world community. Within mega cities the strongest trends and the most extreme dimensions of the urbanization process can be observed. Their rapid growth results in uncontrolled processes of fragmentation which is often associated with pronounced poverty, social inequality, socio-spatial and political fragmentation, environmental degradation as well as population demands that outstrip environmental service capacity. For the majority of the mega cities a tremendous increase of informal structures and processes has to be observed. Consequentially informal settlements are growing, which represent those characteristic municipal areas being subject to particularly high population density, dynamics as well as marginalization. They have quickly become the most visible expression of urban poverty in developing world cities. Due to the extreme dynamics, the high complexity and huge spatial dimension of mega cities, urban administrations often only have an obsolete or not even existing data basis available to be at all informed about developments, trends and dimensions of urban growth and change. The knowledge about the living conditions of the residents is correspondingly very limited, incomplete and not up to date. Traditional methods such as statistical and regional analyses or fieldwork are no longer capable to capture such urban process. New data sources and monitoring methodologies are required in order to provide an up to date information basis as well as planning strate¬gies to enable sustainable developments and to simplify planning processes in complex urban structures. This research shall seize the described problem and aims to make a contribution to the requirements of monitoring fast developing mega cities. Against this background a methodology is developed to compensate the lack of socio-economic data and to deduce meaningful information on the living conditions of the inhabitants of mega cities. Neither social science methods alone nor the exclusive analysis of remote sensing data can solve the problem of the poor quality and outdated data base. Conventional social science methods cannot cope with the enormous developments and the tremendous growth as they are too labor-, as well as too time- and too cost-intensive. On the other hand, the physical discipline of remote sensing does not allow for direct conclusions on social parameters out of remote sensing images. The prime objective of this research is therefore the development of an integrative approach − bridging remote sensing and social analysis – in order to derive useful information about the living conditions in this specific case of the mega city Delhi and its inhabitants. Hence, this work is established in the overlapping range of the research topics remote sensing, urban areas and social science. Delhi, as India’s fast growing capital, meanwhile with almost 25 million residents the second largest city of the world, represents a prime example of a mega city. Since the second half of the 20th century, Delhi has been transformed from a modest town with mainly administrative and trade-related functions to a complex metropolis with a steep socio-economic gradient. The quality and amount of administrative and socio-economic data are poor and the knowledge about the circumstances of Delhi’s residents is correspondingly insufficient and outdated. Delhi represents therefore a perfectly suited study area for this research. In order to gather information about the living conditions within the different settlement types a methodology was developed and conducted to analyze the urban environment of the mega city Delhi. To identify different settlement types within the urban area, regarding the complex and heterogeneous appearance of the Delhi area, a semi-automated, object-oriented classification approach, based on segmentation derived image objects, was implemented. As the complete conceptual framework of this research, the classification methodology was developed based on a smaller representative training area at first and applied to larger test sites within Delhi afterwards. The object-oriented classification of VHR satellite imagery of the QuickBird sensor allowed for the identification of five different urban land cover classes within the municipal area of Delhi. In the focus of the image analysis is yet the identification of different settlement types and amongst these of informal settlements in particular. The results presented within this study demonstrate, that, based on density classes, the developed methodology is suitable to identify different settlement types and to detect informal settlements which are mega urban risk areas and thus potential residential zones of vulnerable population groups. The remote sensing derived land cover maps form the foundation for the integrative analysis concept and deliver there¬fore the general basis for the derivation of social attributes out of remote sensing data. For this purpose settlement characteristics (e.g., area of the settlement, average building size, and number of houses) are estimated from the classified QuickBird data and used to derive spatial information about the population distribution. In a next step, the derived information is combined with in-situ information on socio-economic conditions (e.g., family size, mean water consumption per capita/family) extracted from georeferenced questionnaires conducted during two field trips in Delhi. This combined data is used to characterize a given settlement type in terms of specific population and water related variables (e.g., population density, total water consumption). With this integrative methodology a catalogue can be compiled, comprising the living conditions of Delhi’s inhabitants living in specific settlement structures – and this in a quick, large-scaled, cost effective, by random or regularly repeatable way with a relatively small required data basis.The combined application of remotely sensed imagery and socio-economic data allows for the mapping, capturing and characterizing the socio-economic structures and dynamics within the mega city of Delhi, as well as it establishes a basis for the monitoring of the mega city of Delhi or certain areas within the city respectively by remote sensing. The opportunity to capture the condition of a mega city and to monitor its development in general enables the persons in charge to identify unbeneficial trends and to intervene accordingly from an urban planning perspective and to countersteer against a non-adequate supply of the inhabitants of different urban districts, primarily of those of informal settlements. This study is understood to be a first step to the development of methods which will help to identify and understand the different forms, actors and processes of urbanization in mega cities. It could support a more proactive and sustainable urban planning and land management – which in turn will increase the importance of urban remote sensing techniques. In this regard, the most obvious and direct beneficiaries are on the one hand the governmental agencies and urban planners and on the other hand, and which is possibly the most important goal, the inhabitants of the affected areas, whose living conditions can be monitored and improved as required. Only if the urban monitoring is quickly, inexpensively and easily available, it will be accepted and applied by the authorities, which in turn enables for the poorest to get the support they need. All in all, the listed benefits are very convincing and corroborate the combined use of remotely sensed and socio-economic data in mega city research

Novel pattern recognition methods for classification and detection in remote sensing and power generation applications

Novel pattern recognition methods for classification and detection in remote sensing and power generation application