New advances in H∞ control and filtering for nonlinear systems

The main objective of this special issue is to summarise recent advances in H∞ control and filtering for nonlinear systems, including time-delay, hybrid and stochastic systems. The published papers provide new ideas and approaches, clearly indicating the advances made in problem statements, methodologies or applications with respect to the existing results. The special issue also includes papers focusing on advanced and non-traditional methods and presenting considerable novelties in theoretical background or experimental setup. Some papers present applications to newly emerging fields, such as network-based control and estimation

Feedback control of quantum state reduction

Feedback control of quantum mechanical systems must take into account the probabilistic nature of quantum measurement. We formulate quantum feedback control as a problem of stochastic nonlinear control by considering separately a quantum filtering problem and a state feedback control problem for the filter. We explore the use of stochastic Lyapunov techniques for the design of feedback controllers for quantum spin systems and demonstrate the possibility of stabilizing one outcome of a quantum measurement with unit probability

Vision-based reinforcement learning using approximate policy iteration

A major issue for reinforcement learning (RL) applied to robotics is the time required to learn a new skill. While RL has been used to learn mobile robot control in many simulated domains, applications involving learning on real robots are still relatively rare. In this paper, the Least-Squares Policy Iteration (LSPI) reinforcement learning algorithm and a new model-based algorithm Least-Squares Policy Iteration with Prioritized Sweeping (LSPI+), are implemented on a mobile robot to acquire new skills quickly and efficiently. LSPI+ combines the benefits of LSPI and prioritized sweeping, which uses all previous experience to focus the computational effort on the most “interesting” or dynamic parts of the state space. The proposed algorithms are tested on a household vacuum cleaner robot for learning a docking task using vision as the only sensor modality. In experiments these algorithms are compared to other model-based and model-free RL algorithms. The results show that the number of trials required to learn the docking task is significantly reduced using LSPI compared to the other RL algorithms investigated, and that LSPI+ further improves on the performance of LSPI

Linear parameter-varying model to design control laws for an artificial pancreas

The contribution of this work is the generation of a control-oriented model for insulin-glucose dynamic regulation in type 1 diabetes mellitus (T1DM). The novelty of this model is that it includes the time-varying nature, and the inter-patient variability of the glucose-control problem. In addition, the model is well suited for well-known and standard controller synthesis procedures. The outcome is an average linear parameter-varying (LPV) model that captures the dynamics from the insulin delivery input to the glucose concentration output constructed based on the UVA/Padova metabolic simulator. Finally, a system-oriented reinterpretation of the classical ad-hoc 1800 rule is applied to adapt the model's gain. The effectiveness of this approach is quantified both in open- and closed-loop. The first one by computing the root mean square error (RMSE) between the glucose deviation predicted by the proposed model and the UVA/Padova one. The second measure is determined by using the ν-gap as a metric to determine distance, in terms of closed-loop performance, between both models. For comparison purposes, both open- (RMSE) and closed-loop (ν-gap metric) quality indicators are also computed for other control-oriented models previously presented. This model allows the design of LPV controllers in a straightforward way, considering its affine dependence on the time-varying parameter, which can be computed in real-time. Illustrative simulations are included. In addition, the presented modeling strategy was employed in the design of an artificial pancreas (AP) control law that successfully withstood rigorous testing using the UVA/Padova simulator, and that was subsequently deployed in a clinical trial campaign where five adults remained in closed-loop for 36 h. This was the first ever fully closed-loop clinical AP trial in Argentina, and the modeling strategy presented here is considered instrumental in resulting in a very successful clinical outcome.Fil: Colmegna, Patricio Hernán. Universidad Nacional de Quilmes. Departamento de Ciencia y Tecnología; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Sánchez Peña, Ricardo S.. Instituto Tecnológico de Buenos Aires; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Gondhalekar, R.. Harvard University; Estados Unido

Performance analysis with network-enhanced complexities: On fading measurements, event-triggered mechanisms, and cyber attacks

Copyright © 2014 Derui Ding et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.Nowadays, the real-world systems are usually subject to various complexities such as parameter uncertainties, time-delays, and nonlinear disturbances. For networked systems, especially large-scale systems such as multiagent systems and systems over sensor networks, the complexities are inevitably enhanced in terms of their degrees or intensities because of the usage of the communication networks. Therefore, it would be interesting to (1) examine how this kind of network-enhanced complexities affects the control or filtering performance; and (2) develop some suitable approaches for controller/filter design problems. In this paper, we aim to survey some recent advances on the performance analysis and synthesis with three sorts of fashionable network-enhanced complexities, namely, fading measurements, event-triggered mechanisms, and attack behaviors of adversaries. First, these three kinds of complexities are introduced in detail according to their engineering backgrounds, dynamical characteristic, and modelling techniques. Then, the developments of the performance analysis and synthesis issues for various networked systems are systematically reviewed. Furthermore, some challenges are illustrated by using a thorough literature review and some possible future research directions are highlighted.This work was supported in part by the National Natural Science Foundation of China under Grants 61134009, 61329301, 61203139, 61374127, and 61374010, the Royal Society of the UK, and the Alexander von Humboldt Foundation of Germany