Training Process Reduction Based On Potential Weights Linear Analysis To Accelarate Back Propagation Network

Learning is the important property of Back Propagation Network (BPN) and finding the suitable weights and thresholds during training in order to improve training time as well as achieve high accuracy. Currently, data pre-processing such as dimension reduction input values and pre-training are the contributing factors in developing efficient techniques for reducing training time with high accuracy and initialization of the weights is the important issue which is random and creates paradox, and leads to low accuracy with high training time. One good data preprocessing technique for accelerating BPN classification is dimension reduction technique but it has problem of missing data. In this paper, we study current pre-training techniques and new preprocessing technique called Potential Weight Linear Analysis (PWLA) which combines normalization, dimension reduction input values and pre-training. In PWLA, the first data preprocessing is performed for generating normalized input values and then applying them by pre-training technique in order to obtain the potential weights. After these phases, dimension of input values matrix will be reduced by using real potential weights. For experiment results XOR problem and three datasets, which are SPECT Heart, SPECTF Heart and Liver disorders (BUPA) will be evaluated. Our results, however, will show that the new technique of PWLA will change BPN to new Supervised Multi Layer Feed Forward Neural Network (SMFFNN) model with high accuracy in one epoch without training cycle. Also PWLA will be able to have power of non linear supervised and unsupervised dimension reduction property for applying by other supervised multi layer feed forward neural network model in future work.Comment: 11 pages IEEE format, International Journal of Computer Science and Information Security, IJCSIS 2009, ISSN 1947 5500, Impact factor 0.42

Process control of a laboratory combustor using neural networks

Active feedback and feedforward-feedback control systems based on static-trained feedforward multi-layer-perceptron (FMLP) neural networks were designed and demonstrated, by experiment and simulation, for selected species from a laboratory two stage combustor. These virtual controllers functioned through a Visual Basic platform. A proportional neural network controller (PNNC) was developed for a monotonic control problem - the variation of outlet oxygen level with overall equivalence ratio (Φ0). The FMLP neural network maps the control variable to the manipulated variable. This information is in turn transferred to a proportional controller, through the variable control bias value. The proposed feedback control methodology is robust and effective to improve control performance of the conventional control system without drastic changes in the control structure. A detailed case study in which two clusters of FMLP neural networks were applied to a non-monotonic control problem - the variation of outlet nitric oxide level with first-stage equivalence ratio (Φ0) - was demonstrated. The two clusters were used in the feedforward-feedback control scheme. The key novelty is the functionalities of these two network clusters. The first cluster is a neural network-based model-predictive controller (NMPC). It identifies the process disturbance and adjusts the manipulated variables. The second cluster is a neural network-based Smith time-delay compensator (NSTC) and is used to reduce the impact of the long sampling/analysis lags in the process. Unlike other neural network controllers reported in the control field, NMPC and NSTC are efficiently simple in terms of the network structure and training algorithm. With the pre-filtered steady-state training data, the neural networks converged rapidly. The network transient response was originally designed and enabled here using additional tools \u27and mathematical functions in the Visual Basic program. The controller based on NMPC/NSTC showed a superior performance over the conventional proportional-integral derivative (PID) controller. The control systems developed in this study are not limited to the combustion process. With sufficient steady-state training data, the proposed control systems can be applied to control applications in other engineering fields