Recurrent backpropagation and the dynamical approach to adaptive neural computation

Error backpropagation in feedforward neural network models is a popular learning algorithm that has its roots in nonlinear estimation and optimization. It is being used routinely to calculate error gradients in nonlinear systems with hundreds of thousands of parameters. However, the classical architecture for backpropagation has severe restrictions. The extension of backpropagation to networks with recurrent connections will be reviewed. It is now possible to efficiently compute the error gradients for networks that have temporal dynamics, which opens applications to a host of problems in systems identification and control

A New Approach to Linear/Nonlinear Distributed Fusion Estimation Problem

Disturbance noises are always bounded in a practical system, while fusion estimation is to best utilize multiple sensor data containing noises for the purpose of estimating a quantity--a parameter or process. However, few results are focused on the information fusion estimation problem under bounded noises. In this paper, we study the distributed fusion estimation problem for linear time-varying systems and nonlinear systems with bounded noises, where the addressed noises do not provide any statistical information, and are unknown but bounded. When considering linear time-varying fusion systems with bounded noises, a new local Kalman-like estimator is designed such that the square error of the estimator is bounded as time goes to $\infty$. A novel constructive method is proposed to find an upper bound of fusion estimation error, then a convex optimization problem on the design of an optimal weighting fusion criterion is established in terms of linear matrix inequalities, which can be solved by standard software packages. Furthermore, according to the design method of linear time-varying fusion systems, each local nonlinear estimator is derived for nonlinear systems with bounded noises by using Taylor series expansion, and a corresponding distributed fusion criterion is obtained by solving a convex optimization problem. Finally, target tracking system and localization of a mobile robot are given to show the advantages and effectiveness of the proposed methods.Comment: 9 pages, 3 figure

Self-Sufficiency Under the Education for All Handicapped Children Act: A Suggested Judicial Approach

The Direct Weight Optimization (DWO) approach to statistical estimation and the application to nonlinear system identification has been proposed and developed during the last few years. Computationally, the approachis typically reduced to a convex (e.g., quadratic or conic) program, whichcan be solved efficiently. The optimality or sub-optimality of the obtained estimates, in a minimax sense w.r.t. the estimation error criterion, can be analyzed under weak a priori conditions. The main ideas of the approach are discussed here and an overview of the obtained results is presented

Black-Hole Optimization Applied to the Parametric Estimation in Distribution Transformers Considering Voltage and Current Measures

The problem of parametric estimation in single-phase transformers is addressed in this research from the point of view of metaheuristic optimization. The parameters of interest are the series resistance and reactance as well as the magnetization resistance and reactance. To obtain these parameters considering only the voltage and the currents measured in the terminals of the transformer, a nonlinear optimization model that deals with the minimization of the mean square error among the measured and calculated voltage and current variables is formulated. The nonlinear programming model is solved through the implementation of a simple but efficient metaheuristic optimization technique known as the black-hole optimizer. Numerical simulations demonstrate that the proposed optimization method allows for the reduction in the estimation error among the measured and calculated variables when compared with methods that are well established in the literature such as particle swarm optimization and genetic algorithms, among others. All the simulations were carried out in the MATLAB programming environment