Design of cross-coupled CMAC for contour-following – a reinforcement-based ILC approach

One of the most popular applications of a bi-axial motion stage is precision motion control. The reduction of tracking error and contour error is one of the most coveted goals in precision motion control systems. The accuracy of a motion control system is often affected by external disturbances. In addition, system non-linearity such as friction also represents a major hurdle to motion precision. In order to deal with the aforementioned problem, this paper proposes a fuzzy logic-based Reinforcement Iterative Learning Control (RILC) and a Cross-Coupled Cerebellar Model Articulation Controller (CCCMAC). In particular, the proposed fuzzy logicbased RILC and a LuGre friction model-based compensation approach are exploited to improve motion accuracy. The fuzzy logic-based RILC aims at reducing tracking error and compensating for external disturbance, while the LuGre friction model is responsible for friction compensation. In addition, the CCCMAC consisting of a cerebellar model articulation controller and a cross-coupled controller aims at reducing contour error and dealing with the problem of dynamics mismatch between different axes. Performance comparisons between the proposed fuzzy logic-based Reinforcement Iterative Learning Cross-Coupled Cerebellar Model Articulation Controller (RIL–CCCMAC) and several existing control schemes are conducted on a bi-axial motion stage. Experimental results verify the effectiveness of the proposed RIL–CCCMAC

Hierarchically Clustered Adaptive Quantization CMAC and Its Learning Convergence

No abstract availabl

Stability and weight smoothing in CMAC neural networks

Although the CMAC (Cerebellar Model Articulation Controller) neural network has been successfully used in control systems for many years, its property of local generalization, the availability of trained information for network responses at adjacent untrained locations, although responsible for the networks rapid learning and efficient implementation, results in network responses that is, when trained with sparse or widely spaced training data, spiky in nature even when the underlying function being learned is quite smooth. Since the derivative of such a network response can vary widely, the CMAC\u27s usefulness for solving optimization problems as well as for certain other control system applications can be severely limited. This dissertation presents the CMAC algorithm in sufficient detail to explore its strengths and weaknesses. Its properties of information generalization and storage are discussed and comparisons are made with other neural network algorithms and with other adaptive control algorithms. A synopsis of the development of the fields of neural networks and adaptive control is included to lend historical perspective. A stability analysis of the CMAC algorithm for open-loop function learning is developed. This stability analysis casts the function learning problem as a unique implementation of the model reference structure and develops a Lyapunov function to prove convergence of the CMAC to the target model. A new CMAC learning rule is developed by treating the CMAC as a set of simultaneous equations in a constrained optimization problem and making appropriate choices for the weight penalty matrix in the cost equation. This dissertation then presents a new CMAC learning algorithm which has the property of weight smoothing to improve generalization, function approximation in partially trained networks and the partial derivatives of learned functions. This new learning algorithm is significant in that it derives from an optimum solution and demonstrates a dramatic performance improvement for function learning in the presence of widely spaced training data. Developed from a completely unique analytical direction, this algorithm represents a coupling and extension of single- and multi-resolution CMAC algorithms developed by other researchers. The insights derived from the analysis of the optimum solution and the resulting new learning rules are discussed and suggestions for future work are presented

INVESTIGATION OF WIRELESS NETWORKED CONTROL SYSTEM FOR A MULTI-LOOP PLANT

Wireless network has the potential in control systems because it reduces the amount of space and cost of laying wires and cables. However, wireless network has some limitations such as time delay and loss of data. This is because as the number of nodes increase, the time delay also increases. Similarly, when there are multiple loops trying to send signals at the same time within the same bandwidth, the signals only can be sent based on queue. Hence when the bandwidth is busy the signals have to be sent many times and this can cause loss of data. In order to investigate the effects of wireless network on the performance of two heat exchanger plants, several open-loop control systems have been modelled in from these plants. Transfer functions from each loop involved have been obtained through lab experiments and statistical modelling. PID tuning parameters are calculated and tuned for each loop using Ziegler-Nichols, Cohen-Coon or Skogestad tuning method. PI controllers are used for all loops in this project. Using the controller and plant parameters, the control system is recreated in Matlab TrueTime where data is transmitted over a wireless network. From Matlab TrueTime, the effects of using a wireless network in controlling a heat exchanger plant simulation are different in performance and stability of the plant. From the simulation, it can be observed that the time delay is the main factor considered. The performance of all controllers of all loops are affected by time delay in Wireless Networked Control Systems (WNCS). The rise time and the settling time are slower when simulated in Matlab TrueTime

An Application of Modified T2FHC Algorithm in Two-Link Robot Controller

Parallel robotic systems have shown their advantages over the traditional serial robots such as high payload capacity, high speed, and high precision. Their applications are widespread from transportation to manufacturing fields. Therefore, most of the recent studies in parallel robots focus on finding the best method to improve the system accuracy. Enhancing this metric, however, is still the biggest challenge in controlling a parallel robot owing to the complex mathematical model of the system. In this paper, we present a novel solution to this problem with a Type 2 Fuzzy Coherent Controller Network (T2FHC), which is composed of a Type 2 Cerebellar Model Coupling Controller (CMAC) with its fast convergence ability and a Brain Emotional Learning Controller (BELC) using the Lyaponov-based weight updating rule. In addition, the T2FHC is combined with a surface generator to increase the system flexibility. To evaluate its applicability in real life, the proposed controller was tested on a Quanser 2-DOF robot system in three case studies: no load, 180 g load and 360 g load, respectively. The results showed that the proposed structure achieved superior performance compared to those of available algorithms such as CMAC and Novel Self-Organizing Fuzzy CMAC (NSOF CMAC). The Root Mean Square Error (RMSE) index of the system that was 2.20E-06 for angle A and 2.26E-06 for angle B and the tracking error that was -6.42E-04 for angle A and 2.27E-04 for angle B demonstrate the good stability and high accuracy of the proposed T2FHC. With this outstanding achievement, the proposed method is promising to be applied to many applications using nonlinear systems

Intelligent flight control systems

The capabilities of flight control systems can be enhanced by designing them to emulate functions of natural intelligence. Intelligent control functions fall in three categories. Declarative actions involve decision-making, providing models for system monitoring, goal planning, and system/scenario identification. Procedural actions concern skilled behavior and have parallels in guidance, navigation, and adaptation. Reflexive actions are spontaneous, inner-loop responses for control and estimation. Intelligent flight control systems learn knowledge of the aircraft and its mission and adapt to changes in the flight environment. Cognitive models form an efficient basis for integrating 'outer-loop/inner-loop' control functions and for developing robust parallel-processing algorithms

Autonomic management of virtualized resources in cloud computing

The last five years have witnessed a rapid growth of cloud computing in business, governmental and educational IT deployment. The success of cloud services depends critically on the effective management of virtualized resources. A key requirement of cloud management is the ability to dynamically match resource allocations to actual demands, To this end, we aim to design and implement a cloud resource management mechanism that manages underlying complexity, automates resource provisioning and controls client-perceived quality of service (QoS) while still achieving resource efficiency. The design of an automatic resource management centers on two questions: when to adjust resource allocations and how much to adjust. In a cloud, applications have different definitions on capacity and cloud dynamics makes it difficult to determine a static resource to performance relationship. In this dissertation, we have proposed a generic metric that measures application capacity, designed model-independent and adaptive approaches to manage resources and built a cloud management system scalable to a cluster of machines. To understand web system capacity, we propose to use a metric of productivity index (PI), which is defined as the ratio of yield to cost, to measure the system processing capability online. PI is a generic concept that can be applied to different levels to monitor system progress in order to identify if more capacity is needed. We applied the concept of PI to the problem of overload prevention in multi-tier websites. The overload predictor built on the PI metric shows more accurate and responsive overload prevention compared to conventional approaches. To address the issue of the lack of accurate server model, we propose a model-independent fuzzy control based approach for CPU allocation. For adaptive and stable control performance, we embed the controller with self-tuning output amplification and flexible rule selection. Finally, we build a QoS provisioning framework that supports multi-objective QoS control and service differentiation. Experiments on a virtual cluster with two service classes show the effectiveness of our approach in both performance and power control. To address the problems of complex interplay between resources and process delays in fine-grained multi-resource allocation, we consider capacity management as a decision-making problem and employ reinforcement learning (RL) to optimize the process. The optimization depends on the trial-and-error interactions with the cloud system. In order to improve the initial management performance, we propose a model-based RL algorithm. The neural network based environment model, which is learned from previous management history, generates simulated resource allocations for the RL agent. Experiment results on heterogeneous applications show that our approach makes efficient use of limited interactions and find near optimal resource configurations within 7 steps. Finally, we present a distributed reinforcement learning approach to the cluster-wide cloud resource management. We decompose the cluster-wide resource allocation problem into sub-problems concerning individual VM resource configurations. The cluster-wide allocation is optimized if individual VMs meet their SLA with a high resource utilization. For scalability, we develop an efficient reinforcement learning approach with continuous state space. For adaptability, we use VM low-level runtime statistics to accommodate workload dynamics. Prototyped in a iBalloon system, the distributed learning approach successfully manages 128 VMs on a 16-node close correlated cluster