Optimal Clustering Framework for Hyperspectral Band Selection

Band selection, by choosing a set of representative bands in hyperspectral image (HSI), is an effective method to reduce the redundant information without compromising the original contents. Recently, various unsupervised band selection methods have been proposed, but most of them are based on approximation algorithms which can only obtain suboptimal solutions toward a specific objective function. This paper focuses on clustering-based band selection, and proposes a new framework to solve the above dilemma, claiming the following contributions: 1) An optimal clustering framework (OCF), which can obtain the optimal clustering result for a particular form of objective function under a reasonable constraint. 2) A rank on clusters strategy (RCS), which provides an effective criterion to select bands on existing clustering structure. 3) An automatic method to determine the number of the required bands, which can better evaluate the distinctive information produced by certain number of bands. In experiments, the proposed algorithm is compared to some state-of-the-art competitors. According to the experimental results, the proposed algorithm is robust and significantly outperform the other methods on various data sets

Growing Cell Structures Neural Networks for Designing Spectral Indexes

Remote sensing can be defined as the technique that facilitates the acquisition of land surface data without contact with the material object of observation. The development of tools for analyzing and processing multispectral images captured by sensors aboard satellites has provided the automation of tasks that could not be possible otherwise. The main problem related with this discipline is the large volume of data of multidimensional nature that must be handled. The concept of spectral index emerged as an idea to reduce the number of dimensions to one, and thus facilitate the study of different features associated to the types of land cover categories that exhibits a multispectral image. Formally, a spectral index is defined as a combination of spectral bands whose function is to enhance the contribution of one type of land cover mitigating the rest of covers. In this work a no-supervised methodology to analyze and discover spectral indexes based on growing self-organizing neural network (GCS-Growing Cell Structures) is presented

Locality and Structure Regularized Low Rank Representation for Hyperspectral Image Classification

Hyperspectral image (HSI) classification, which aims to assign an accurate label for hyperspectral pixels, has drawn great interest in recent years. Although low rank representation (LRR) has been used to classify HSI, its ability to segment each class from the whole HSI data has not been exploited fully yet. LRR has a good capacity to capture the underlying lowdimensional subspaces embedded in original data. However, there are still two drawbacks for LRR. First, LRR does not consider the local geometric structure within data, which makes the local correlation among neighboring data easily ignored. Second, the representation obtained by solving LRR is not discriminative enough to separate different data. In this paper, a novel locality and structure regularized low rank representation (LSLRR) model is proposed for HSI classification. To overcome the above limitations, we present locality constraint criterion (LCC) and structure preserving strategy (SPS) to improve the classical LRR. Specifically, we introduce a new distance metric, which combines both spatial and spectral features, to explore the local similarity of pixels. Thus, the global and local structures of HSI data can be exploited sufficiently. Besides, we propose a structure constraint to make the representation have a near block-diagonal structure. This helps to determine the final classification labels directly. Extensive experiments have been conducted on three popular HSI datasets. And the experimental results demonstrate that the proposed LSLRR outperforms other state-of-the-art methods.Comment: 14 pages, 7 figures, TGRS201

Optimal Exploitation of the Sentinel-2 Spectral Capabilities for Crop Leaf Area Index Mapping

The continuously increasing demand of accurate quantitative high quality information on land surface properties will be faced by a new generation of environmental Earth observation (EO) missions. One current example, associated with a high potential to contribute to those demands, is the multi-spectral ESA Sentinel-2 (S2) system. The present study focuses on the evaluation of spectral information content needed for crop leaf area index (LAI) mapping in view of the future sensors. Data from a field campaign were used to determine the optimal spectral sampling from available S2 bands applying inversion of a radiative transfer model (PROSAIL) with look-up table (LUT) and artificial neural network (ANN) approaches. Overall LAI estimation performance of the proposed LUT approach (LUTN₅₀) was comparable in terms of retrieval performances with a tested and approved ANN method. Employing seven- and eight-band combinations, the LUTN₅₀ approach obtained LAI RMSE of 0.53 and normalized LAI RMSE of 0.12, which was comparable to the results of the ANN. However, the LUTN50 method showed a higher robustness and insensitivity to different band settings. Most frequently selected wavebands were located in near infrared and red edge spectral regions. In conclusion, our results emphasize the potential benefits of the Sentinel-2 mission for agricultural applications

Land cover classification using multi-temporal MERIS vegetation indices

The spectral, spatial, and temporal resolutions of Envisat's Medium Resolution Imaging Spectrometer (MERIS) data are attractive for regional- to global-scale land cover mapping. Moreover, two novel and operational vegetation indices derived from MERIS data have considerable potential as discriminating variables in land cover classification. Here, the potential of these two vegetation indices (the MERIS global vegetation index (MGVI), MERIS terrestrial chlorophyll index (MTCI)) was evaluated for mapping eleven broad land cover classes in Wisconsin. Data acquired in the high and low chlorophyll seasons were used to increase inter-class separability. The two vegetation indices provided a higher degree of inter-class separability than data acquired in many of the individual MERIS spectral wavebands. The most accurate landcover map (73.2%) was derived from a classification of vegetation index-derived data with a support vector machine (SVM), and was more accurate than the corresponding map derived from a classification using the data acquired in the original spectral wavebands

Remote sensing and machine learning for prediction of wheat growth in precision agriculture applications

This thesis focuses on remote sensing and machine learning for prediction of wheat growth in precision agriculture applications. Agriculture is the primary productive force, which plays an important role in human activities. Wheat, as one of the essential sources of food, is also a widely planted crop. The impact of weather and climate and some other uncertain factors on wheat production is crucial. Therefore, it is necessary to use reliable and statistically reasonable models for crop growth and yield prediction based on vegetation index variables and other factors, so as to obtain reliable prediction for efficient production. Applying certain artificial intelligence algorithms to the precision agriculture can significantly improve the efficiency of traditional agriculture in crop planting and reduce the consumption of human and natural resources. Remote sensing can objectively, accurately and timely provide a large amount of information for ecological environment and crop growth in agriculture applications. By combining the image and spectral data obtained by remote sensing technology with machine learning, information about wheat growth, yield and insect pests can be learned in time. This thesis focuses on its applications in agriculture, particularly using effective prediction models such as the back propagation neural network and some optimisation algorithms for predicting wheat growth, yield and aphid. The work presented in this thesis address the issues of wheat growth prediction, yield assessment and aphid validation by model building and machine learning algorithm optimisation by means of remote sensing data. Specifically, the following objectives are defined: 1. Analyse multiple vegetation indexes based on the TM 1-4 band data of Landsat satellite and use regression algorithms to train the models and predict wheat growth; 2. Analyse and compare multiple vegetation indexes models by means of spectral data and use regression algorithms to predict wheat yield; 3. Combine spectral vegetation indexes and multiple regression algorithms to predict wheat aphid; 4. Use accurate evaluation criteria for validating the efficacy of the various algorithms. In this thesis, the remote sensing data from the satellite has been applied instead of the airborne-based remote sensing data. Based on the TM 1-4 band image data of Landsat satellite, multiple vegetation indexes were used as the input of regression algorithms. After that, four kinds of regression algorithms such as the multiple linear regression (MR) algorithm, back propagation network (BPNN) algorithm, genetic algorithm (GA) optimised BPNN algorithm and particle swarm optimisation (PSO) optimised BPNN algorithm were used to train the model and predict the LAI and SPAD. The prediction results of each algorithm were compared with the ground truth information collected by hand held instruments on the ground. The relationship between wheat yield and spectral data has been studied. Based on the BPNN algorithm, four kinds of models such as visible hyperspectral index (VHI) model, hyperspectral vegetation index (HVI) model, difference hyperspectral index (DHI) model and normalized hyperspectral index (NHI) model have been utilized to predict wheat yield. For the optimal NHI model, three regression algorithms such as back propagation network (BPNN) algorithm, genetic algorithm (GA) optimised BPNN algorithm and particle swarm optimisation (PSO) optimised BPNN algorithm, were compared to predict wheat yield, and RMSE and R-square of the three algorithms were compared and analysed. Finally, the relationship between wheat aphid and spectral data has been investigated. Nine vegetation indexes related to aphid have been estimated from spectral data as the input of regression algorithms. Five kinds of regression algorithms such as back propagation network (BPNN) algorithm, genetic algorithm (GA) optimised BPNN algorithm, particle swarm optimisation (PSO) optimised BPNN algorithm, ant colony (ACO) optimisation algorithm optimised BPNN algorithm and cuckoo search (CS) optimised BPNN algorithm have been implemented to predict wheat aphid, which was validated with the ground truth information measured by hand-held instruments on the ground. The prediction results of each algorithm have been analysed. The major original contributions of this thesis are as follows: 1. A variety of optimisation algorithms are used to improve the regression analysis of the BPNN algorithm, so that the prediction results of each model for wheat growth, yield and aphid are more accurate. 2. The spectral characteristics of winter wheat canopy have been analysed. The correlation between the absorption band and the associated physical and chemical properties of crops, specially the red edge slope, with the crop yield and wheat aphid damage is established. 3. Adjusted MSE and un-centered R-square, as accurate evaluation criteria for practical applications, are used to compare the prediction results of the models under different dimensions of the observed data. 4. Improve algorithm training by using the cross-validation method to obtain reliable and stable models for the prediction of wheat growth, yield, and aphid. Through repeated cross-validation, a better model can be obtained in the last. Key word：Precision agriculture; BP network, wheat growth assessment; wheat yield prediction, wheat aphid validationThis thesis focuses on remote sensing and machine learning for prediction of wheat growth in precision agriculture applications. Agriculture is the primary productive force, which plays an important role in human activities. Wheat, as one of the essential sources of food, is also a widely planted crop. The impact of weather and climate and some other uncertain factors on wheat production is crucial. Therefore, it is necessary to use reliable and statistically reasonable models for crop growth and yield prediction based on vegetation index variables and other factors, so as to obtain reliable prediction for efficient production. Applying certain artificial intelligence algorithms to the precision agriculture can significantly improve the efficiency of traditional agriculture in crop planting and reduce the consumption of human and natural resources. Remote sensing can objectively, accurately and timely provide a large amount of information for ecological environment and crop growth in agriculture applications. By combining the image and spectral data obtained by remote sensing technology with machine learning, information about wheat growth, yield and insect pests can be learned in time. This thesis focuses on its applications in agriculture, particularly using effective prediction models such as the back propagation neural network and some optimisation algorithms for predicting wheat growth, yield and aphid. The work presented in this thesis address the issues of wheat growth prediction, yield assessment and aphid validation by model building and machine learning algorithm optimisation by means of remote sensing data. Specifically, the following objectives are defined: 1. Analyse multiple vegetation indexes based on the TM 1-4 band data of Landsat satellite and use regression algorithms to train the models and predict wheat growth; 2. Analyse and compare multiple vegetation indexes models by means of spectral data and use regression algorithms to predict wheat yield; 3. Combine spectral vegetation indexes and multiple regression algorithms to predict wheat aphid; 4. Use accurate evaluation criteria for validating the efficacy of the various algorithms. In this thesis, the remote sensing data from the satellite has been applied instead of the airborne-based remote sensing data. Based on the TM 1-4 band image data of Landsat satellite, multiple vegetation indexes were used as the input of regression algorithms. After that, four kinds of regression algorithms such as the multiple linear regression (MR) algorithm, back propagation network (BPNN) algorithm, genetic algorithm (GA) optimised BPNN algorithm and particle swarm optimisation (PSO) optimised BPNN algorithm were used to train the model and predict the LAI and SPAD. The prediction results of each algorithm were compared with the ground truth information collected by hand held instruments on the ground. The relationship between wheat yield and spectral data has been studied. Based on the BPNN algorithm, four kinds of models such as visible hyperspectral index (VHI) model, hyperspectral vegetation index (HVI) model, difference hyperspectral index (DHI) model and normalized hyperspectral index (NHI) model have been utilized to predict wheat yield. For the optimal NHI model, three regression algorithms such as back propagation network (BPNN) algorithm, genetic algorithm (GA) optimised BPNN algorithm and particle swarm optimisation (PSO) optimised BPNN algorithm, were compared to predict wheat yield, and RMSE and R-square of the three algorithms were compared and analysed. Finally, the relationship between wheat aphid and spectral data has been investigated. Nine vegetation indexes related to aphid have been estimated from spectral data as the input of regression algorithms. Five kinds of regression algorithms such as back propagation network (BPNN) algorithm, genetic algorithm (GA) optimised BPNN algorithm, particle swarm optimisation (PSO) optimised BPNN algorithm, ant colony (ACO) optimisation algorithm optimised BPNN algorithm and cuckoo search (CS) optimised BPNN algorithm have been implemented to predict wheat aphid, which was validated with the ground truth information measured by hand-held instruments on the ground. The prediction results of each algorithm have been analysed. The major original contributions of this thesis are as follows: 1. A variety of optimisation algorithms are used to improve the regression analysis of the BPNN algorithm, so that the prediction results of each model for wheat growth, yield and aphid are more accurate. 2. The spectral characteristics of winter wheat canopy have been analysed. The correlation between the absorption band and the associated physical and chemical properties of crops, specially the red edge slope, with the crop yield and wheat aphid damage is established. 3. Adjusted MSE and un-centered R-square, as accurate evaluation criteria for practical applications, are used to compare the prediction results of the models under different dimensions of the observed data. 4. Improve algorithm training by using the cross-validation method to obtain reliable and stable models for the prediction of wheat growth, yield, and aphid. Through repeated cross-validation, a better model can be obtained in the last. Key word：Precision agriculture; BP network, wheat growth assessment; wheat yield prediction, wheat aphid validatio

A Framework for Evaluating Land Use and Land Cover Classification Using Convolutional Neural Networks

Analyzing land use and land cover (LULC) using remote sensing (RS) imagery is essential for many environmental and social applications. The increase in availability of RS data has led to the development of new techniques for digital pattern classification. Very recently, deep learning (DL) models have emerged as a powerful solution to approach many machine learning (ML) problems. In particular, convolutional neural networks (CNNs) are currently the state of the art for many image classification tasks. While there exist several promising proposals on the application of CNNs to LULC classification, the validation framework proposed for the comparison of different methods could be improved with the use of a standard validation procedure for ML based on cross-validation and its subsequent statistical analysis. In this paper, we propose a general CNN, with a fixed architecture and parametrization, to achieve high accuracy on LULC classification over RS data from different sources such as radar and hyperspectral. We also present a methodology to perform a rigorous experimental comparison between our proposed DL method and other ML algorithms such as support vector machines, random forests, and k-nearest-neighbors. The analysis carried out demonstrates that the CNN outperforms the rest of techniques, achieving a high level of performance for all the datasets studied, regardless of their different characteristics.Ministerio de Economía y Competitividad TIN2014-55894-C2-1-RMinisterio de Economía y Competitividad TIN2017-88209-C2-2-

Multi-resolution analysis techniques and nonlinear PCA for hybrid pansharpening applications

International audienceHyperspectral images have a higher spectral resolution (i.e., a larger number of bands covering the electromagnetic spectrum), but a lower spatial resolution with respect to multispectral or panchromatic acquisitions. For increasing the capabilities of the data in terms of utilization and interpretation, hyperspectral images having both high spectral and spatial resolution are desired. This can be achieved by combining the hyperspectral image with a high spatial resolution panchromatic image. These techniques are generally known as pansharpening and can be divided into component substitution (CS) and multi-resolution analysis (MRA) based methods. In general, the CS methods result in fused images having high spatial quality but the fused images suffer from spectral distortions. On the other hand, images obtained using MRA techniques are not as sharp as CS methods but they are spectrally consistent. Both substitution and filtering approaches are considered adequate when applied to multispectral and PAN images, but have many drawbacks when the low-resolution image is a hyperspectral image. Thus, one of the main challenges in hyperspectral pansharpening is to improve the spatial resolution while preserving as much as possible of the original spectral information. An effective solution to these problems has been found in the use of hybrid approaches, combining the better spatial information of CS and the more accurate spectral information of MRA techniques. In general, in a hybrid approach a CS technique is used to project the original data into a low dimensionality space. Thus, the PAN image is fused with one or more features by means of MRA approach. Finally the inverse projection is used to obtain the enhanced image in the original data space. These methods, permit to effectively enhance the spatial resolution of the hyperspectral image without relevant spectral distortions and on the same time to reduce the computational load of the entire process. In particular, in this paper we focus our attention on the use of Non-linear Principal Component Analysis (NLPCA) for the projection of the image into a low dimensionality feature space. However, if on one hand the NLPCA has been proved to better represent the intrinsic information of hyperspectral images in the feature space, on the other hand, an analysis of the impact of different fusion techniques applied to the nonlinear principal components in order to define the optimal framework for the hybrid pansharpening has not been carried out yet. More in particular, in this paper we analyze the overall impact of several widely used MRA pansharpening algorithms applied in the nonlinear feature space. The results obtained on both synthetic and real data demonstrate that, an accurate selection of the pansharpening method can lead to an effective improvement of the enhanced hyperspectral image in terms of spectral quality and spatial consistency, as well as a strong reduction in the computational time

Sparse representation based hyperspectral image compression and classification

Abstract This thesis presents a research work on applying sparse representation to lossy hyperspectral image compression and hyperspectral image classification. The proposed lossy hyperspectral image compression framework introduces two types of dictionaries distinguished by the terms sparse representation spectral dictionary (SRSD) and multi-scale spectral dictionary (MSSD), respectively. The former is learnt in the spectral domain to exploit the spectral correlations, and the latter in wavelet multi-scale spectral domain to exploit both spatial and spectral correlations in hyperspectral images. To alleviate the computational demand of dictionary learning, either a base dictionary trained offline or an update of the base dictionary is employed in the compression framework. The proposed compression method is evaluated in terms of different objective metrics, and compared to selected state-of-the-art hyperspectral image compression schemes, including JPEG 2000. The numerical results demonstrate the effectiveness and competitiveness of both SRSD and MSSD approaches. For the proposed hyperspectral image classification method, we utilize the sparse coefficients for training support vector machine (SVM) and k-nearest neighbour (kNN) classifiers. In particular, the discriminative character of the sparse coefficients is enhanced by incorporating contextual information using local mean filters. The classification performance is evaluated and compared to a number of similar or representative methods. The results show that our approach could outperform other approaches based on SVM or sparse representation. This thesis makes the following contributions. It provides a relatively thorough investigation of applying sparse representation to lossy hyperspectral image compression. Specifically, it reveals the effectiveness of sparse representation for the exploitation of spectral correlations in hyperspectral images. In addition, we have shown that the discriminative character of sparse coefficients can lead to superior performance in hyperspectral image classification.EM201