Metaheuristic design of feedforward neural networks: a review of two decades of research

Over the past two decades, the feedforward neural network (FNN) optimization has been a key interest among the researchers and practitioners of multiple disciplines. The FNN optimization is often viewed from the various perspectives: the optimization of weights, network architecture, activation nodes, learning parameters, learning environment, etc. Researchers adopted such different viewpoints mainly to improve the FNN's generalization ability. The gradient-descent algorithm such as backpropagation has been widely applied to optimize the FNNs. Its success is evident from the FNN's application to numerous real-world problems. However, due to the limitations of the gradient-based optimization methods, the metaheuristic algorithms including the evolutionary algorithms, swarm intelligence, etc., are still being widely explored by the researchers aiming to obtain generalized FNN for a given problem. This article attempts to summarize a broad spectrum of FNN optimization methodologies including conventional and metaheuristic approaches. This article also tries to connect various research directions emerged out of the FNN optimization practices, such as evolving neural network (NN), cooperative coevolution NN, complex-valued NN, deep learning, extreme learning machine, quantum NN, etc. Additionally, it provides interesting research challenges for future research to cope-up with the present information processing era

A Survey on Compiler Autotuning using Machine Learning

Since the mid-1990s, researchers have been trying to use machine-learning based approaches to solve a number of different compiler optimization problems. These techniques primarily enhance the quality of the obtained results and, more importantly, make it feasible to tackle two main compiler optimization problems: optimization selection (choosing which optimizations to apply) and phase-ordering (choosing the order of applying optimizations). The compiler optimization space continues to grow due to the advancement of applications, increasing number of compiler optimizations, and new target architectures. Generic optimization passes in compilers cannot fully leverage newly introduced optimizations and, therefore, cannot keep up with the pace of increasing options. This survey summarizes and classifies the recent advances in using machine learning for the compiler optimization field, particularly on the two major problems of (1) selecting the best optimizations and (2) the phase-ordering of optimizations. The survey highlights the approaches taken so far, the obtained results, the fine-grain classification among different approaches and finally, the influential papers of the field.Comment: version 5.0 (updated on September 2018)- Preprint Version For our Accepted Journal @ ACM CSUR 2018 (42 pages) - This survey will be updated quarterly here (Send me your new published papers to be added in the subsequent version) History: Received November 2016; Revised August 2017; Revised February 2018; Accepted March 2018

Model predictive control techniques for hybrid systems

This paper describes the main issues encountered when applying model predictive control to hybrid processes. Hybrid model predictive control (HMPC) is a research field non-fully developed with many open challenges. The paper describes some of the techniques proposed by the research community to overcome the main problems encountered. Issues related to the stability and the solution of the optimization problem are also discussed. The paper ends by describing the results of a benchmark exercise in which several HMPC schemes were applied to a solar air conditioning plant.Ministerio de Eduación y Ciencia DPI2007-66718-C04-01Ministerio de Eduación y Ciencia DPI2008-0581

Genetic Algorithm based Model Predictive Control of Fractional Order Systems

International audienceFractional calculus is a generalization of integration and derivative operators to no integer order. In the Last decades fractional systems receives a great attention in the research community, the reason lies in the fact that many real systems can be described accurately using dynamic models of fractional order. In our work a design of genetic algorithm based fractional order model predictive controller is simulated and applied to a given fractional order model plant

Born to learn: The inspiration, progress, and future of evolved plastic artificial neural networks

Biological plastic neural networks are systems of extraordinary computational capabilities shaped by evolution, development, and lifetime learning. The interplay of these elements leads to the emergence of adaptive behavior and intelligence. Inspired by such intricate natural phenomena, Evolved Plastic Artificial Neural Networks (EPANNs) use simulated evolution in-silico to breed plastic neural networks with a large variety of dynamics, architectures, and plasticity rules: these artificial systems are composed of inputs, outputs, and plastic components that change in response to experiences in an environment. These systems may autonomously discover novel adaptive algorithms, and lead to hypotheses on the emergence of biological adaptation. EPANNs have seen considerable progress over the last two decades. Current scientific and technological advances in artificial neural networks are now setting the conditions for radically new approaches and results. In particular, the limitations of hand-designed networks could be overcome by more flexible and innovative solutions. This paper brings together a variety of inspiring ideas that define the field of EPANNs. The main methods and results are reviewed. Finally, new opportunities and developments are presented

The predictive functional control and the management of constraints in GUANAY II autonomous underwater vehicle actuators

Autonomous underwater vehicle control has been a topic of research in the last decades. The challenges addressed vary depending on each research group's interests. In this paper, we focus on the predictive functional control (PFC), which is a control strategy that is easy to understand, install, tune, and optimize. PFC is being developed and applied in industrial applications, such as distillation, reactors, and furnaces. This paper presents the rst application of the PFC in autonomous underwater vehicles, as well as the simulation results of PFC, fuzzy, and gain scheduling controllers. Through simulations and navigation tests at sea, which successfully validate the performance of PFC strategy in motion control of autonomous underwater vehicles, PFC performance is compared with other control techniques such as fuzzy and gain scheduling control. The experimental tests presented here offer effective results concerning control objectives in high and intermediate levels of control. In high-level point, stabilization and path following scenarios are proven. In the intermediate levels, the results show that position and speed behaviors are improved using the PFC controller, which offers the smoothest behavior. The simulation depicting predictive functional control was the most effective regarding constraints management and control rate change in the Guanay II underwater vehicle actuator. The industry has not embraced the development of control theories for industrial systems because of the high investment in experts required to implement each technique successfully. However, this paper on the functional predictive control strategy evidences its easy implementation in several applications, making it a viable option for the industry given the short time needed to learn, implement, and operate, decreasing impact on the business and increasing immediacy.Peer ReviewedPostprint (author's final draft