A new Stack Autoencoder: Neighbouring Sample Envelope Embedded Stack Autoencoder Ensemble Model

Stack autoencoder (SAE), as a representative deep network, has unique and excellent performance in feature learning, and has received extensive attention from researchers. However, existing deep SAEs focus on original samples without considering the hierarchical structural information between samples. To address this limitation, this paper proposes a new SAE model-neighbouring envelope embedded stack autoencoder ensemble (NE_ESAE). Firstly, the neighbouring sample envelope learning mechanism (NSELM) is proposed for preprocessing of input of SAE. NSELM constructs sample pairs by combining neighbouring samples. Besides, the NSELM constructs a multilayer sample spaces by multilayer iterative mean clustering, which considers the similar samples and generates layers of envelope samples with hierarchical structural information. Second, an embedded stack autoencoder (ESAE) is proposed and trained in each layer of sample space to consider the original samples during training and in the network structure, thereby better finding the relationship between original feature samples and deep feature samples. Third, feature reduction and base classifiers are conducted on the layers of envelope samples respectively, and output classification results of every layer of samples. Finally, the classification results of the layers of envelope sample space are fused through the ensemble mechanism. In the experimental section, the proposed algorithm is validated with over ten representative public datasets. The results show that our method significantly has better performance than existing traditional feature learning methods and the representative deep autoencoders.Comment: 17 pages,6 figure

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A survey of outlier detection methodologies

Outlier detection has been used for centuries to detect and, where appropriate, remove anomalous observations from data. Outliers arise due to mechanical faults, changes in system behaviour, fraudulent behaviour, human error, instrument error or simply through natural deviations in populations. Their detection can identify system faults and fraud before they escalate with potentially catastrophic consequences. It can identify errors and remove their contaminating effect on the data set and as such to purify the data for processing. The original outlier detection methods were arbitrary but now, principled and systematic techniques are used, drawn from the full gamut of Computer Science and Statistics. In this paper, we introduce a survey of contemporary techniques for outlier detection. We identify their respective motivations and distinguish their advantages and disadvantages in a comparative review

Simulation of site-specific irrigation control strategies with sparse input data

Crop and irrigation water use efficiencies may be improved by managing irrigation application timing and volumes using physical and agronomic principles. However, the crop water requirement may be spatially variable due to different soil properties and genetic variations in the crop across the field. Adaptive control strategies can be used to locally control water applications in response to in-field temporal and spatial variability with the aim of maximising both crop development and water use efficiency. A simulation framework ‘VARIwise’ has been created to aid the development, evaluation and management of spatially and temporally varied adaptive irrigation control strategies (McCarthy et al., 2010). VARIwise enables alternative control strategies to be simulated with different crop and environmental conditions and at a range of spatial resolutions. An iterative learning controller and model predictive controller have been implemented in VARIwise to improve the irrigation of cotton. The iterative learning control strategy involves using the soil moisture response to the previous irrigation volume to adjust the applied irrigation volume applied at the next irrigation event. For field implementation this controller has low data requirements as only soil moisture data is required after each irrigation event. In contrast, a model predictive controller has high data requirements as measured soil and plant data are required at a high spatial resolution in a field implementation. Model predictive control involves using a calibrated model to determine the irrigation application and/or timing which results in the highest predicted yield or water use efficiency. The implementation of these strategies is described and a case study is presented to demonstrate the operation of the strategies with various levels of data availability. It is concluded that in situations of sparse data, the iterative learning controller performs significantly better than a model predictive controller