Feedback control by online learning an inverse model

A model, predictor, or error estimator is often used by a feedback controller to control a plant. Creating such a model is difficult when the plant exhibits nonlinear behavior. In this paper, a novel online learning control framework is proposed that does not require explicit knowledge about the plant. This framework uses two learning modules, one for creating an inverse model, and the other for actually controlling the plant. Except for their inputs, they are identical. The inverse model learns by the exploration performed by the not yet fully trained controller, while the actual controller is based on the currently learned model. The proposed framework allows fast online learning of an accurate controller. The controller can be applied on a broad range of tasks with different dynamic characteristics. We validate this claim by applying our control framework on several control tasks: 1) the heating tank problem (slow nonlinear dynamics); 2) flight pitch control (slow linear dynamics); and 3) the balancing problem of a double inverted pendulum (fast linear and nonlinear dynamics). The results of these experiments show that fast learning and accurate control can be achieved. Furthermore, a comparison is made with some classical control approaches, and observations concerning convergence and stability are made

Application of Laguerre based adaptive predictive control to Shape Memory Alloy (SMA) actuators

This paper discusses the use of an existing adaptive predictive controller to control some Shape Memory Alloy (SMA) linear actuators. The model consists in a truncated linear combination of Laguerre filters identified online. The controller stability is studied in details. It is proven that the tracking error is asymptotically stable under some conditions on the modelling error. Moreover, the tracking error converge toward zero for step references, even if the identified model is inaccurate. Experimentalcresults obtained on two different kind of actuator validate the proposed control. They also show that it is robust with regard to input constraints.ANR MAFESM

Spatio-temporal learning with the online finite and infinite echo-state Gaussian processes

Successful biological systems adapt to change. In this paper, we are principally concerned with adaptive systems that operate in environments where data arrives sequentially and is multivariate in nature, for example, sensory streams in robotic systems. We contribute two reservoir inspired methods: 1) the online echostate Gaussian process (OESGP) and 2) its infinite variant, the online infinite echostate Gaussian process (OIESGP) Both algorithms are iterative fixed-budget methods that learn from noisy time series. In particular, the OESGP combines the echo-state network with Bayesian online learning for Gaussian processes. Extending this to infinite reservoirs yields the OIESGP, which uses a novel recursive kernel with automatic relevance determination that enables spatial and temporal feature weighting. When fused with stochastic natural gradient descent, the kernel hyperparameters are iteratively adapted to better model the target system. Furthermore, insights into the underlying system can be gleamed from inspection of the resulting hyperparameters. Experiments on noisy benchmark problems (one-step prediction and system identification) demonstrate that our methods yield high accuracies relative to state-of-the-art methods, and standard kernels with sliding windows, particularly on problems with irrelevant dimensions. In addition, we describe two case studies in robotic learning-by-demonstration involving the Nao humanoid robot and the Assistive Robot Transport for Youngsters (ARTY) smart wheelchair

A STUDY OF MODEL-BASED CONTROL STRATEGY FOR A GASOLINE TURBOCHARGED DIRECT INJECTION SPARK IGNITED ENGINE

To meet increasingly stringent fuel economy and emissions legislation, more advanced technologies have been added to spark-ignition (SI) engines, thus exponentially increase the complexity and calibration work of traditional map-based engine control. To achieve better engine performance without introducing significant calibration efforts and make the developed control system easily adapt to future engines upgrades and designs, this research proposes a model-based optimal control system for cycle-by-cycle Gasoline Turbocharged Direct Injection (GTDI) SI engine control, which aims to deliver the requested torque output and operate the engine to achieve the best achievable fuel economy and minimum emission under wide range of engine operating conditions. This research develops a model-based ignition timing prediction strategy for combustion phasing (crank angle of fifty percent of the fuel burned, CA50) control. A control-oriented combustion model is developed to predict burn duration from ignition timing to CA50. Using the predicted burn duration, the ignition timing needed for the upcoming cycle to track optimal target CA50 is calculated by a dynamic ignition timing prediction algorithm. A Recursive-Least-Square (RLS) with Variable Forgetting Factor (VFF) based adaptation algorithm is proposed to handle operating-point-dependent model errors caused by inherent errors resulting from modeling assumptions and limited calibration points, which helps to ensure the proper performance of model-based ignition timing prediction strategy throughout the entire engine lifetime. Using the adaptive combustion model, an Adaptive Extended Kalman Filter (AEKF) based CA50 observer is developed to provide filtered CA50 estimation from cyclic variations for the closed-loop combustion phasing control. An economic nonlinear model predictive controller (E-NMPC) based GTDI SI engine control system is developed to simultaneously achieve three objectives: tracking the requested net indicated mean effective pressure (IMEPn), minimizing the SFC, and reducing NOx emissions. The developed E-NMPC engine control system can achieve the above objectives by controlling throttle position, IVC timing, CA50, exhaust valve opening (EVO) timing, and wastegate position at the same time without violating engine operating constraints. A control-oriented engine model is developed and integrated into the E-NMPC to predict future engine behaviors. A high-fidelity 1-D GT-POWER engine model is developed and used as the plant model to tune and validate the developed control system. The performance of the entire model-based engine control system is examined through the software-in-the-loop (SIL) simulation using on-road vehicle test data

Neural self-tuning adaptive control of non-minimum phase system

The motivation of this research came about when a neural network direct adaptive control scheme was applied to control the tip position of a flexible robotic arm. Satisfactory control performance was not attainable due to the inherent non-minimum phase characteristics of the flexible robotic arm tip. Most of the existing neural network control algorithms are based on the direct method and exhibit very high sensitivity, if not unstable, closed-loop behavior. Therefore, a neural self-tuning control (NSTC) algorithm is developed and applied to this problem and showed promising results. Simulation results of the NSTC scheme and the conventional self-tuning (STR) control scheme are used to examine performance factors such as control tracking mean square error, estimation mean square error, transient response, and steady state response

Development of Neurofuzzy Architectures for Electricity Price Forecasting

In 20th century, many countries have liberalized their electricity market. This power markets liberalization has directed generation companies as well as wholesale buyers to undertake a greater intense risk exposure compared to the old centralized framework. In this framework, electricity price prediction has become crucial for any market player in their decision‐making process as well as strategic planning. In this study, a prototype asymmetric‐based neuro‐fuzzy network (AGFINN) architecture has been implemented for short‐term electricity prices forecasting for ISO New England market. AGFINN framework has been designed through two different defuzzification schemes. Fuzzy clustering has been explored as an initial step for defining the fuzzy rules while an asymmetric Gaussian membership function has been utilized in the fuzzification part of the model. Results related to the minimum and maximum electricity prices for ISO New England, emphasize the superiority of the proposed model over well‐established learning‐based models