A kernel least mean square algorithm for fuzzy differential equations and its application in earth's energy balance model and climate

Abstract This paper concentrates on solving fuzzy dynamical differential equations (FDDEs) by use of unsupervised kernel least mean square (UKLMS). UKLMS is a nonlinear adaptive filter which works by applying kernel trick to LMS adaptive filter. UKLMS estimates multivariate function which is embedded to estimate the solution of FDDE. Adaptation mechanism of UKLMS helps for finding solution of FDDE in a recursive scenario. Without any desired response, UKLMS finds nonlinear functions. For this purpose, an approximate solution of FDDE is constructed based on adaptable parameters of UKLMS. An optimization algorithm, optimizes the values of adaptable parameters of UKLMS. The proposed algorithm is applied for solving Earth energy balance model (EBM) which is considered as a fuzzy differential equation for the first time. The method in comparison with the other existing approaches (such as numerical methods) has some advantages such as more accurate solution and also that the obtained solution has a functional form, thus the solution can be obtained at each time in training interval. Low error and applicability of developed algorithm are examined by applying it for solving several problems. After comparing the numerical results, with relative previous works, the superiority of the proposed method will be illustrated

Solving an Optimal Control Problem of Cancer Treatment by Artificial Neural Networks

Cancer is an uncontrollable growth of abnormal cells in any tissue of the body. Many researchers have focused on machine learning and artificial intelligence (AI) based on approaches for cancer treatment. Dissimilar to traditional methods, these approaches are efficient and are able to find the optimal solutions of cancer chemotherapy problems. In this paper, a system of ordinary differential equations (ODEs) with the state variables of immune cells, tumor cells, healthy cells and drug concentration is proposed to anticipate the tumor growth and to show their interactions in the body. Then, an artificial neural network (ANN) is applied to solve the ODEs system through minimizing the error function and modifying the parameters consisting of weights and biases. The mean square errors (MSEs) between the analytical and ANN results corresponding to four state variables are 1.54e-06, 6.43e-07, 6.61e-06, and 3.99e-07, respectively. These results show the good performance and efficiency of the proposed method. Moreover, the optimal dose of chemotherapy drug and the amount of drug needed to continue the treatment process are achieved

Training Echo State Networks with Regularization through Dimensionality Reduction

In this paper we introduce a new framework to train an Echo State Network to predict real valued time-series. The method consists in projecting the output of the internal layer of the network on a space with lower dimensionality, before training the output layer to learn the target task. Notably, we enforce a regularization constraint that leads to better generalization capabilities. We evaluate the performances of our approach on several benchmark tests, using different techniques to train the readout of the network, achieving superior predictive performance when using the proposed framework. Finally, we provide an insight on the effectiveness of the implemented mechanics through a visualization of the trajectory in the phase space and relying on the methodologies of nonlinear time-series analysis. By applying our method on well known chaotic systems, we provide evidence that the lower dimensional embedding retains the dynamical properties of the underlying system better than the full-dimensional internal states of the network

Semi-Supervised First-Person Activity Recognition in Body-Worn Video

Body-worn cameras are now commonly used for logging daily life, sports, and law enforcement activities, creating a large volume of archived footage. This paper studies the problem of classifying frames of footage according to the activity of the camera-wearer with an emphasis on application to real-world police body-worn video. Real-world datasets pose a different set of challenges from existing egocentric vision datasets: the amount of footage of different activities is unbalanced, the data contains personally identifiable information, and in practice it is difficult to provide substantial training footage for a supervised approach. We address these challenges by extracting features based exclusively on motion information then segmenting the video footage using a semi-supervised classification algorithm. On publicly available datasets, our method achieves results comparable to, if not better than, supervised and/or deep learning methods using a fraction of the training data. It also shows promising results on real-world police body-worn video