Spectral filtering as a method of visualising and removing striped artefacts in digital elevation data

Spectral filtering was compared with traditional mean spatial filters to assess their ability to identify and remove striped artefacts in digital elevation data. The techniques were applied to two datasets: a 100 m contour derived digital elevation model (DEM) of southern Norway and a 2 m LiDAR DSM of the Lake District, UK. Both datasets contained diagonal data artefacts that were found to propagate into subsequent terrain analysis. Spectral filtering used fast Fourier transformation (FFT) frequency data to identify these data artefacts in both datasets. These were removed from the data by applying a cut filter, prior to the inverse transform. Spectral filtering showed considerable advantages over mean spatial filters, when both the absolute and spatial distribution of elevation changes made were examined. Elevation changes from the spectral filtering were restricted to frequencies removed by the cut filter, were small in magnitude and consequently avoided any global smoothing. Spectral filtering was found to avoid the smoothing of kernel based data editing, and provided a more informative measure of data artefacts present in the FFT frequency domain. Artefacts were found to be heterogeneous through the surfaces, a result of their strong correlations with spatially autocorrelated variables: landcover and landsurface geometry. Spectral filtering performed better on the 100 m DEM, where signal and artefact were clearly distinguishable in the frequency data. Spectrally filtered digital elevation datasets were found to provide a superior and more precise representation of the landsurface and be a more appropriate dataset for any subsequent geomorphological applications

Power System Parameters Forecasting Using Hilbert-Huang Transform and Machine Learning

A novel hybrid data-driven approach is developed for forecasting power system parameters with the goal of increasing the efficiency of short-term forecasting studies for non-stationary time-series. The proposed approach is based on mode decomposition and a feature analysis of initial retrospective data using the Hilbert-Huang transform and machine learning algorithms. The random forests and gradient boosting trees learning techniques were examined. The decision tree techniques were used to rank the importance of variables employed in the forecasting models. The Mean Decrease Gini index is employed as an impurity function. The resulting hybrid forecasting models employ the radial basis function neural network and support vector regression. Apart from introduction and references the paper is organized as follows. The section 2 presents the background and the review of several approaches for short-term forecasting of power system parameters. In the third section a hybrid machine learning-based algorithm using Hilbert-Huang transform is developed for short-term forecasting of power system parameters. Fourth section describes the decision tree learning algorithms used for the issue of variables importance. Finally in section six the experimental results in the following electric power problems are presented: active power flow forecasting, electricity price forecasting and for the wind speed and direction forecasting

Cancer diagnosis using deep learning: A bibliographic review

In this paper, we first describe the basics of the field of cancer diagnosis, which includes steps of cancer diagnosis followed by the typical classification methods used by doctors, providing a historical idea of cancer classification techniques to the readers. These methods include Asymmetry, Border, Color and Diameter (ABCD) method, seven-point detection method, Menzies method, and pattern analysis. They are used regularly by doctors for cancer diagnosis, although they are not considered very efficient for obtaining better performance. Moreover, considering all types of audience, the basic evaluation criteria are also discussed. The criteria include the receiver operating characteristic curve (ROC curve), Area under the ROC curve (AUC), F1 score, accuracy, specificity, sensitivity, precision, dice-coefficient, average accuracy, and Jaccard index. Previously used methods are considered inefficient, asking for better and smarter methods for cancer diagnosis. Artificial intelligence and cancer diagnosis are gaining attention as a way to define better diagnostic tools. In particular, deep neural networks can be successfully used for intelligent image analysis. The basic framework of how this machine learning works on medical imaging is provided in this study, i.e., pre-processing, image segmentation and post-processing. The second part of this manuscript describes the different deep learning techniques, such as convolutional neural networks (CNNs), generative adversarial models (GANs), deep autoencoders (DANs), restricted Boltzmann’s machine (RBM), stacked autoencoders (SAE), convolutional autoencoders (CAE), recurrent neural networks (RNNs), long short-term memory (LTSM), multi-scale convolutional neural network (M-CNN), multi-instance learning convolutional neural network (MIL-CNN). For each technique, we provide Python codes, to allow interested readers to experiment with the cited algorithms on their own diagnostic problems. The third part of this manuscript compiles the successfully applied deep learning models for different types of cancers. Considering the length of the manuscript, we restrict ourselves to the discussion of breast cancer, lung cancer, brain cancer, and skin cancer. The purpose of this bibliographic review is to provide researchers opting to work in implementing deep learning and artificial neural networks for cancer diagnosis a knowledge from scratch of the state-of-the-art achievements