Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

A neural network-based inversion method of a feedback linearization controller applied to a hydraulic actuator

In this work, we use a neural network as a substitute for the traditional analytic functions employed as an inversion set in feedback linearization control algorithms applied to hydraulic actuators. Although very efective and with strong stability guarantees, feedback linearization control depends on parameters that are difcult to determine, requiring large amounts of experimental efort to be identifed accurately. On the other hands, neural networks require little efort regarding parameter identifcation, but pose signifcant hindrances to the development of solid stability analyses and/or to the processing capabilities of the control hardware. Here, we combine these techniques to control the positioning of a hydraulic actuator, without requiring extensive identifcation procedures nor losing stability guarantees for the closed-loop system, at reasonable computing demands. The efectiveness of the proposed method is verifed both theoretically and by means of experimental results

Navigation Control of an Automated Guided Underwater Robot using Neural Network Technique

In recent years, under water robots play an important role in various under water operations. There is an increase in research in this area because of the application of autonomous underwater robots in several issues like exploring under water environment and resource, doing scientific and military tasks under water. We need good maneuvering capabilities and a well precision for moving in a specified track in these applications. However, control of these under water bots become very difficult due to the highly non-linear and dynamic characteristics of the underwater world. The logical answer to this problem is the application of non-linear controllers. As neural networks (NNs) are characterized by flexibility and an aptitude for dealing with non-linear problems, they are envisaged to be beneficial when used on underwater robots. In this research our artificial intelligence system is based on neural network model for navigation of an Automated Underwater robot in unpredictable and imprecise environment. Thus the back propagation algorithm has been used for the steering analysis of the underwater robot when it is encountered by a left, right and front as well as top obstacle. After training the neural network the neural network pattern was used in the controller of the underwater robot. The simulation of underwater robot under various obstacle conditions are shown using MATLAB

A brief review of neural networks based learning and control and their applications for robots

As an imitation of the biological nervous systems, neural networks (NN), which are characterized with powerful learning ability, have been employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification and patterns recognition etc. This article aims to bring a brief review of the state-of-art NN for the complex nonlinear systems. Recent progresses of NNs in both theoretical developments and practical applications are investigated and surveyed. Specifically, NN based robot learning and control applications were further reviewed, including NN based robot manipulator control, NN based human robot interaction and NN based behavior recognition and generation

Deep Learning Techniques for Music Generation -- A Survey

This paper is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. We propose a methodology based on five dimensions for our analysis: Objective - What musical content is to be generated? Examples are: melody, polyphony, accompaniment or counterpoint. - For what destination and for what use? To be performed by a human(s) (in the case of a musical score), or by a machine (in the case of an audio file). Representation - What are the concepts to be manipulated? Examples are: waveform, spectrogram, note, chord, meter and beat. - What format is to be used? Examples are: MIDI, piano roll or text. - How will the representation be encoded? Examples are: scalar, one-hot or many-hot. Architecture - What type(s) of deep neural network is (are) to be used? Examples are: feedforward network, recurrent network, autoencoder or generative adversarial networks. Challenge - What are the limitations and open challenges? Examples are: variability, interactivity and creativity. Strategy - How do we model and control the process of generation? Examples are: single-step feedforward, iterative feedforward, sampling or input manipulation. For each dimension, we conduct a comparative analysis of various models and techniques and we propose some tentative multidimensional typology. This typology is bottom-up, based on the analysis of many existing deep-learning based systems for music generation selected from the relevant literature. These systems are described and are used to exemplify the various choices of objective, representation, architecture, challenge and strategy. The last section includes some discussion and some prospects.Comment: 209 pages. This paper is a simplified version of the book: J.-P. Briot, G. Hadjeres and F.-D. Pachet, Deep Learning Techniques for Music Generation, Computational Synthesis and Creative Systems, Springer, 201

Artificial intelligence applied to speed sensorless induction motor drives

During the last two decades there has been considerable development of sensorless vector controlled induction motor drives for high performance industrial applications. Such control strategies reduce the drive's cost, size and maintenance requirements while increasing the system's reliability and robustness. Parameter sensitivity, high computational effort and instability at low and zero speed can be the main shortcomings of sensorless control. Sensorless drives have been successfully applied for medium and high speed operation, but low and zero speed operation is still a critical problem. Much recent research effort is focused on extending the operating region of sensorless drives near zero stator frequency. Several strategies have been proposed for rotor speed estimation in sensorless induction motor drives based on the machine fundamental excitation model. Among these techniques Model Reference Adaptive Systems (MRAS) schemes are the most common strategies employed due to their relative simplicity and low computational effort. Rotor flux-MRAS is the most popular MRAS strategy and significant attempts have been made to improve the performance of this scheme at low speed. Artificial Intelligence (AI) techniques have attracted much attention in the past few years as powerful tools to solve many control problems. Common AI strategies include neural networks, fuzzy logic and genetic algorithms. The mam purpose of this work is to show that AI can be used to improve the sensorless performance of the well-established MRAS observers in the critical low and zero speed region of operation. This thesis proposes various novel methods based on AI combined with MRAS observers. These methods have been implemented via simulation but also on an experimental drive based around a commercial induction machine. Detailed simulations and experimental tests are carried out to investigate the performance of the proposed schemes when compared to the conventional rotor fluxMRAS. Various schemes are implemented and tested in real time using a 7.5 kW induction machine and a dSP ACE DS 1103 controller board. The results presented for these new schemes show the great improvement in the performance of the MRAS observer in both open loop and sensorless modes of operation at low and zero speed.EThOS - Electronic Theses Online ServiceMinistry of Higher Education, Arab Republic of EgyptGBUnited Kingdo

Identification and control of dynamic systems using neural networks.

The aim of this thesis is to contribute in solving problems related to the on-line identification and control of unknown dynamic systems using feedforward neural networks. In this sense, this thesis presents new on-line learning algorithms for feedforward neural networks based upon the theory of variable structure system design, along with mathematical proofs regarding the convergence of solutions given by the algorithms; the boundedness of these solutions; and robustness features of the algorithms with respect to external perturbations affecting the neural networks' signals. In the thesis, the problems of on-line identification of the forward transfer operator, and the inverse transfer operator of unknown dynamic systems are also analysed, and neural networks-based identification schemes are proposed. These identification schemes are tested by computer simulations on linear and nonlinear unknown plants using both continuous-time and discrete-time versions of the proposed learning algorithms. The thesis reports about the direct inverse dynamics control problems using neural networks, and contributes towards solving these problems by proposing a direct inverse dynamics neural network-based control scheme with on-line learning capabilities of the inverse dynamics of the plant, and the addition of a feedback path that enables the resulting control scheme to exhibit robustness characteristics with respect to external disturbances affecting the output of the system. Computer simulation results on the performance of the mentioned control scheme in controlling linear and nonlinear plants are also included. The thesis also formulates a neural network-based internal model control scheme with on-line estimation capabilities of the forward transfer operator and the inverse transfer operator of unknown dynamic systems. The performance of this internal model control scheme is tested by computer simulations using a stable open-loop unknown plant with output signal corrupted by white noise. Finally, the thesis proposes a neural network-based adaptive control scheme where identification and control are simultaneously carried out

Nonlinear system identification and control using dynamic multi-time scales neural networks

In this thesis, on-line identification algorithm and adaptive control design are proposed for nonlinear singularly perturbed systems which are represented by dynamic neural network model with multi-time scales. A novel on-line identification law for the Neural Network weights and linear part matrices of the model has been developed to minimize the identification errors. Based on the identification results, an adaptive controller is developed to achieve trajectory tracking. The Lyapunov synthesis method is used to conduct stability analysis for both identification algorithm and control design. To further enhance the stability and performance of the control system, an improved . dynamic neural network model is proposed by replacing all the output signals from the plant with the state variables of the neural network. Accordingly, the updating laws are modified with a dead-zone function to prevent parameter drifting. By combining feedback linearization with one of three classical control methods such as direct compensator, sliding mode controller or energy function compensation scheme, three different adaptive controllers have been proposed for trajectory tracking. New Lyapunov function analysis method is applied for the stability analysis of the improved identification algorithm and three control systems. Extensive simulation results are provided to support the effectiveness of the proposed identification algorithms and control systems for both dynamic NN models