Design and implementation of event-based multi-rate controllers for networked control systems

Tesis por compendio[ES] Con esta tesis se pretende dar solución a algunos de los problemas más habituales que aparecen en los Sistemas de control basados en red (NCS) como son los retardos variables en el tiempo, las pérdidas y el desorden de paquetes, y la restricción de ancho de banda y de recursos computacionales y energéticos de los dispositivos que forman parte del sistema de control. Para ello se ha planteado la integración de técnicas de control multifrecuencial, de control basado en paquetes, de control basado en predictor y de control basado en eventos. Los diseños de control realizados se han simulado utilizando Matlab-Simulink y Truetime, se ha analizado su estabilidad mediante LMIs y QFT, y se han validado experimentalmente en un péndulo invertido, un robot cartesiano 3D y en robots móviles de bajo coste. El artículo 1 aborda el control basado en eventos, el cual minimiza el ancho de banda consumido en el NCS mediante un control basado en eventos periódicos y presenta un método para obtener sus parámetros óptimos para el sistema específico en que se utilice. Los artículos 2, 4 y 6 añaden el control basado en paquetes, así como el control multifrecuencia, que aborda problemas de falta de datos por bajo uso del sensor y los retardos, pérdidas y desórdenes de paquetes en la red. También afrontan, mediante tecnicas de predicción basadas en un filtro de Kalman multifrecuencia variable en el tiempo, los problemas de ruido y perturbaciones, así como la observación de los estados completos del sistema. El artículo 7 hace frente a un modelo no lineal que utiliza las anteriores soluciones junto con un filtro de Kalman extendido para presentar otro tipo de estructura para un vehículo autónomo que, gracias a la información futura obtenida mediante estas técnicas, puede realizar de forma remota tareas de alto nivel como es la toma de decisiones y la monitorización de variables. Los artículos 3 y 5, presentan una forma de obtener y analizar la respuesta en frecuencia de sistemas SISO multifrecuencia y estudian su comportamiento ante ciertas incertidumbres o problemas en la red haciendo uso de procedimientos QFT.[CA] Amb aquesta tesi es pretén donar solució a alguns dels problemes més habituals que apareixen als Sistemes de Control Basats en xarxa (NCS) com son els retards d'accés i transferència variables en el temps, les pèrdues y desordenament de paquets, i la restricció d'ampli de banda així com de recursos computacionals i energètics dels dispositius que foment part del sistema de control. Per tal de resoldre'ls s'ha plantejat la integració de tècniques de control multifreqüencial, de control basat en paquets, de control basat en predictor i de control basat en events. Els dissenys de control realitzats s'han simulat fent ús de Matlab-Simulink i de TrueTime, s'ha analitzat la seua estabilitat mitjançant LMIs i QFT, i s'han validat experimentalment en un pèndul invertit, un robot cartesià 3D i en robots mòbils de baix cost. L'article 1 aborda el control basat en events, el qual minimitza l'ampli de banda consumit a l'NCS mitjançant un control basat en events periòdics i presenta un mètode per a obtindré els seus paràmetres òptims per al sistema específic en el qual s'utilitza. Els articles 2, 4 i 6 afegeixen el control basat en paquets, així com el control multifreqüència, que aborda problemes de falta de dades per el baix us del sensor i els retards, pèrdues i desordre de paquets en la xarxa. També afronten, mitjançant tècniques de predicció basades en un filtre de Kalman multifreqüència variable en el temps. Els problemes de soroll i pertorbacions, així com la observació dels estats complets del sistema. L'article 7 fa referència a un model no lineal que utilitza les anteriors solucions junt a un filtre de Kalman estès per a presentar altre tipus d'estructura per a un vehicle autònom que, gracies a la informació futura obtinguda mitjançant aquestes tècniques, pot realitzar de manera remota tasques d'alt nivell com son la presa de decisions i la monitorització de variables. Els articles 3 y 5 presenten la manera d'obtindre i analitzar la resposta en frequencia de sistemes SISO multifreqüència i estudien el seu comportament front a certes incerteses o problemes en la xarxa fent us de procediments QFT.[EN] This thesis attempts to solve some of the most frequent issues that appear in Networked Control Systems (NCS), such as time-varying delays, packet losses and packet disorders and the bandwidth limitation. Other frequent problems are scarce computational and energy resources of the local system devices. Thus, it is proposed to integrate multirate control, packet-based control, predictor-based control and event-based control techniques. The control designs have been simulated using Matlab-Simulink and Truetime, the stability has been analysed by LMIs and QFT, and the experimental validation has been done on an inverted pendulum, a 3D cartesian robot and in low-cost mobile robots. Paper 1 addresses event-based control, which minimizes the bandwidth consumed in NCS through a periodic event-triggered control and presents a method to obtain the optimal parameters for the specific system used. Papers 2, 4 and 6 include packet-based control and multirate control, addressing problems such as network delays, packet dropouts and packet disorders, and the scarce data due to low sensor usage in order to save battery in sensing tasks and transmissions of the sensed data. Also addressed, is how despite the existence of measurement noise and disturbances, time-varying dual-rate Kalman filter based prediction techniques observe the complete state of the system. Paper 7 tackles a non-linear model that uses all the previous solutions together with an extended Kalman filter to present another type of structure for an autonomous vehicle that, due to future information obtained through these techniques, can remotely carry out high level tasks, such as decision making and monitoring of variables. Papers 3 and 5, present a method for obtaining and analyzing the SISO dual-rate frequency response and using QFT procedures to study its behavior when faced with specific uncertainties or network problems.This work was supported by the Spanish Ministerio de Economía y Competitividad under Grant referenced TEC2012-31506.Alcaina Acosta, JJ. (2020). Design and implementation of event-based multi-rate controllers for networked control systems [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/159884TESISCompendi

Analysis of Embedded Controllers Subject to Computational Overruns

Microcontrollers have become an integral part of modern everyday embedded systems, such as smart bikes, cars, and drones. Typically, microcontrollers operate under real-time constraints, which require the timely execution of programs on the resource-constrained hardware. As embedded systems are becoming increasingly more complex, microcontrollers run the risk of violating their timing constraints, i.e., overrunning the program deadlines. Breaking these constraints can cause severe damage to both the embedded system and the humans interacting with the device. Therefore, it is crucial to analyse embedded systems properly to ensure that they do not pose any significant danger if the microcontroller overruns a few deadlines.However, there are very few tools available for assessing the safety and performance of embedded control systems when considering the implementation of the microcontroller. This thesis aims to fill this gap in the literature by presenting five papers on the analysis of embedded controllers subject to computational overruns. Details about the real-time operating system's implementation are included into the analysis, such as what happens to the controller's internal state representation when the timing constraints are violated. The contribution includes theoretical and computational tools for analysing the embedded system's stability, performance, and real-time properties.The embedded controller is analysed under three different types of timing violations: blackout events (when no control computation is completed during long periods), weakly-hard constraints (when the number of deadline overruns is constrained over a window), and stochastic overruns (when violations of timing constraints are governed by a probabilistic process). These scenarios are combined with different implementation policies to reduce the gap between the analysis and its practical applicability. The analyses are further validated with a comprehensive experimental campaign performed on both a set of physical processes and multiple simulations.In conclusion, the findings of this thesis reveal that the effect deadline overruns have on the embedded system heavily depends the implementation details and the system's dynamics. Additionally, the stability analysis of embedded controllers subject to deadline overruns is typically conservative, implying that additional insights can be gained by also analysing the system's performance

Dynamic Programming and Time-Varying Delay Systems

This thesis is divided into two separate parts. The first part is about Dynamic Programming for non-trivial optimal control problems. The second part introduces some useful tools for analysis of stability and performance of systems with time-varying delays. The two papers presented in the first part attacks optimal control problems with finite but rapidly increasing search space. In the first paper we try it reduce the complexity of the optimization by exploiting the structure of a certain problem. The result, if found, is an optimal solution. The second paper introduces a new general approach of relaxing the optimality constraint. The main contribution of the paper is an extension of the Bellman equality to a double inequality. This inequality is a sufficient condition for a suboptimal solution to be within a certain distance to the optimal solution. The main approach of solving the inequality in the paper is value iteration, which is shown to work well in many different applications. In the second part of the thesis, two analysis methods for systems with time-varying delays are presented in two papers. The first paper presents a set of simple graphical stability (and performance) criteria when the delays are bounded but otherwise unknown. All that is needed to verify stability is a Bode diagram of the closed loop system. For more exact computations, the last paper presents a toolbox for Matlab called Jitterbug. It calculates quadratic costs and power spectral densities of interconnected continuous-time and discrete-time linear systems. The main contribution of the toolbox is to make well known theory easily applicable for analysis of real-time systems

A Foot Placement Strategy for Robust Bipedal Gait Control

This thesis introduces a new measure of balance for bipedal robotics called the foot placement estimator (FPE). To develop this measure, stability first is defined for a simple biped. A proof of the stability of a simple biped in a controls sense is shown to exist using classical methods for nonlinear systems. With the addition of a contact model, an analytical solution is provided to define the bounds of the region of stability. This provides the basis for the FPE which estimates where the biped must step in order to be stable. By using the FPE in combination with a state machine, complete gait cycles are created without any precalculated trajectories. This includes gait initiation and termination. The bipedal model is then advanced to include more realistic mechanical and environmental models and the FPE approach is verified in a dynamic simulation. From these results, a 5-link, point-foot robot is designed and constructed to provide the final validation that the FPE can be used to provide closed-loop gait control. In addition, this approach is shown to demonstrate significant robustness to external disturbances. Finally, the FPE is shown in experimental results to be an unprecedented estimate of where humans place their feet for walking and jumping, and for stepping in response to an external disturbance

SVILUPPO DI UN SOFTWARE DI ANALISI E SINTESI PER IL CONTROLLO DI IMPIANTI SU RETE ETHERNET INDUSTRIALE

In questa tesi è stato realizzato un software di simulazione per lo sviluppo di tecniche di controllo per impianti di tipo NCS (Networked Control Systems). Attraverso l’editazione di file testuali è possibile procedere alla sintesi della logica di controllo ed alla verifica delle performance con essa raggiunte. Il software è strutturato su due moduli, uno dedicato all’elaborazione dell’intera logica di controllo, ed uno capace di simulare i comportamenti dell’impianto reale (utilizzabile nel caso in cui questo non sia nelle immediate disponibilità del progettista). Attraverso l’analisi di due esempi applicativi vengono descritte le modalità di configurazione ed utilizzo dell’ambiente elaborato

Closed-loop real-time control on distributed networks

This thesis is an effort to develop closed-loop control strategies on computer networks and study their stability in the presence of network delays and packet losses. An algorithm using predictors was designed to ensure the system stability in presence of network delays and packet losses. A single actuator magnetic ball levitation system was used as a test bed to validate the proposed algorithm. A brief study of real-time requirements of the networked control system is presented and a client-server architecture is developed using real-time operating environment to implement the proposed algorithm. Real-time performance of the communication on Ethernet based on user datagram protocol (UDP) was explored and UDP is presented as a suitable protocol for networked control systems. Predictors were designed based on parametric estimation models. Autoregressive (AR) and autoregressive moving average (ARMA) models of various orders were designed using MATLAB and an eighth order AR model was adopted based on the best-fit criterion. The system output was predicted several steps ahead using these predictors and control output was calculated using the predictions. This control output output was used in the events of excessive network delays to maintain system stability. Experiments employing simulations of consecutive packet losses and network delays were performed to validate the satisfactory performance of the predictor based algorithm. The current system compensates for up to 20 percent data losses in the network without loosing stability

Robust Intelligent Sensing and Control Multi Agent Analysis Platform for Research and Education

The aim of this thesis is the development and implementation of a controlled testing platform for the Robust Intelligent Sensing and Controls (RISC) Lab at Utah State University (USU). This will be an open source adaptable expandable robotics platform usable for both education and research. This differs from the many other platforms developed in that the entire platform software will be made open source. This open source software will encourage collaboration among other universities and enable researchers to essentially pick up where others have left off without the necessity of replicating months or even years of work. The expected results of this research will create a foundation for diverse robotics investigation at USU as well as enable attempts at novel methods of control, estimation and optimization. This will also contribute a complete software testbed setup to the already vibrant robotics open source research community. This thesis first outlines the platform setup and novel developments therein. The second stage provides an example of how this has been used in education, providing an example curriculum implementing modern control techniques. The third section provides some exploratory research in trajectory control and state estimation of the tip of an inverted pendulum atop a small unmanned aerial vehicle as well as bearing-only cooperative localization experimentation. Finally, a conclusion and future work is discussed

Real-time control over networks

A control system in which sensors, actuators, and controllers are interconnected over a communication network is called a networked control system (NCS). Enhanced computational capabilities and bandwidths in the networking technology enabled researchers to develop NCSs to implement distributed control schemes. This dissertation presents a framework for the modeling, design, stability analysis, control, and bandwidth allocation of real-time control over networks. This framework covers key research issues regarding control over networks and can be the guidelines of NCS design. A single actuator ball magnetic-levitation (maglev) system is implemented as a test bed for the real-time control over networks to illustrate and verify the theoretical results of this dissertation. Experimentally verifying the feasibility of Internet-based real-time control is another main objective of this dissertation. First, this dissertation proposes a novel NCS model in which the effects of the networkinduced time delay, data-packet loss, and out-of-order data transmission are all considered. Second, two simple algorithms based on model-estimator and predictor- and timeout-scheme are proposed to compensate for the network-induced time delay and packet loss simultaneously. These algorithms are verified experimentally by the ball maglev test bed. System stability analyses of original and compensated systems are presented. Then, a novel co-design consideration related to real-time control and network communication is also proposed. The working range of the sampling frequency is determined by the analysis of the system stability and network parameters such as time delay, data rate, and data-packet size. The NCS design chart developed in this dissertation can be a useful guideline for choosing the network and control parameters in the design of an NCS. Using a real-time operating system for real-time control over networks is also proposed as one of the main contributions of this dissertation. After a real-time NCS is successfully implemented, advanced control theories such as robust control, optimal control, and adaptive control are applied and formulated to improve the quality of control (QoC) of NCSs. Finally, an optimal dynamic bandwidth management method is proposed to solve the optimal network scheduling and bandwidth allocation problem when NCSs are connected to the same network and are sharing the network resource

Feedback Systems: An Introduction for Scientists and Engineers

This book provides an introduction to the basic principles and tools for the design and analysis of feedback systems. It is intended to serve a diverse audience of scientists and engineers who are interested in understanding and utilizing feedback in physical, biological, information and social systems.We have attempted to keep the mathematical prerequisites to a minimum while being careful not to sacrifice rigor in the process. We have also attempted to make use of examples from a variety of disciplines, illustrating the generality of many of the tools while at the same time showing how they can be applied in specific application domains. A major goal of this book is to present a concise and insightful view of the current knowledge in feedback and control systems. The field of control started by teaching everything that was known at the time and, as new knowledge was acquired, additional courses were developed to cover new techniques. A consequence of this evolution is that introductory courses have remained the same for many years, and it is often necessary to take many individual courses in order to obtain a good perspective on the field. In developing this book, we have attempted to condense the current knowledge by emphasizing fundamental concepts. We believe that it is important to understand why feedback is useful, to know the language and basic mathematics of control and to grasp the key paradigms that have been developed over the past half century. It is also important to be able to solve simple feedback problems using back-of-the-envelope techniques, to recognize fundamental limitations and difficult control problems and to have a feel for available design methods. This book was originally developed for use in an experimental course at Caltech involving students from a wide set of backgrounds. The course was offered to undergraduates at the junior and senior levels in traditional engineering disciplines, as well as first- and second-year graduate students in engineering and science. This latter group included graduate students in biology, computer science and physics. Over the course of several years, the text has been classroom tested at Caltech and at Lund University, and the feedback from many students and colleagues has been incorporated to help improve the readability and accessibility of the material. Because of its intended audience, this book is organized in a slightly unusual fashion compared to many other books on feedback and control. In particular, we introduce a number of concepts in the text that are normally reserved for second-year courses on control and hence often not available to students who are not control systems majors. This has been done at the expense of certain traditional topics, which we felt that the astute student could learn independently and are often explored through the exercises. Examples of topics that we have included are nonlinear dynamics, Lyapunov stability analysis, the matrix exponential, reachability and observability, and fundamental limits of performance and robustness. Topics that we have deemphasized include root locus techniques, lead/lag compensation and detailed rules for generating Bode and Nyquist plots by hand. Several features of the book are designed to facilitate its dual function as a basic engineering text and as an introduction for researchers in natural, information and social sciences. The bulk of the material is intended to be used regardless of the audience and covers the core principles and tools in the analysis and design of feedback systems. Advanced sections, marked by the “dangerous bend” symbol shown here, contain material that requires a slightly more technical background, of the sort that would be expected of senior undergraduates in engineering. A few sections are marked by two dangerous bend symbols and are intended for readers with more specialized backgrounds, identified at the beginning of the section. To limit the length of the text, several standard results and extensions are given in the exercises, with appropriate hints toward their solutions. To further augment the printed material contained here, a companion web site has been developed and is available from the publisher’s web page: http://press.princeton.edu/titles/8701.html The web site contains a database of frequently asked questions, supplemental examples and exercises, and lecture material for courses based on this text. The material is organized by chapter and includes a summary of the major points in the text as well as links to external resources. The web site also contains the source code for many examples in the book, as well as utilities to implement the techniques described in the text. Most of the code was originally written using MATLAB M-files but was also tested with LabView MathScript to ensure compatibility with both packages. Many files can also be run using other scripting languages such as Octave, SciLab, SysQuake and Xmath. The first half of the book focuses almost exclusively on state space control systems. We begin in Chapter 2 with a description of modeling of physical, biological and information systems using ordinary differential equations and difference equations. Chapter 3 presents a number of examples in some detail, primarily as a reference for problems that will be used throughout the text. Following this, Chapter 4 looks at the dynamic behavior of models, including definitions of stability and more complicated nonlinear behavior. We provide advanced sections in this chapter on Lyapunov stability analysis because we find that it is useful in a broad array of applications and is frequently a topic that is not introduced until later in one’s studies. The remaining three chapters of the first half of the book focus on linear systems, beginning with a description of input/output behavior in Chapter 5. In Chapter 6, we formally introduce feedback systems by demonstrating how state space control laws can be designed. This is followed in Chapter 7 by material on output feedback and estimators. Chapters 6 and 7 introduce the key concepts of reachability and observability, which give tremendous insight into the choice of actuators and sensors, whether for engineered or natural systems. The second half of the book presents material that is often considered to be from the field of “classical control.” This includes the transfer function, introduced in Chapter 8, which is a fundamental tool for understanding feedback systems. Using transfer functions, one can begin to analyze the stability of feedback systems using frequency domain analysis, including the ability to reason about the closed loop behavior of a system from its open loop characteristics. This is the subject of Chapter 9, which revolves around the Nyquist stability criterion. In Chapters 10 and 11, we again look at the design problem, focusing first on proportional-integral-derivative (PID) controllers and then on the more general process of loop shaping. PID control is by far the most common design technique in control systems and a useful tool for any student. The chapter on frequency domain design introduces many of the ideas of modern control theory, including the sensitivity function. In Chapter 12, we combine the results from the second half of the book to analyze some of the fundamental trade-offs between robustness and performance. This is also a key chapter illustrating the power of the techniques that have been developed and serving as an introduction for more advanced studies. The book is designed for use in a 10- to 15-week course in feedback systems that provides many of the key concepts needed in a variety of disciplines. For a 10-week course, Chapters 1–2, 4–6 and 8–11 can each be covered in a week’s time, with the omission of some topics from the final chapters. A more leisurely course, spread out over 14–15 weeks, could cover the entire book, with 2 weeks on modeling (Chapters 2 and 3) — particularly for students without much background in ordinary differential equations — and 2 weeks on robust performance (Chapter 12). The mathematical prerequisites for the book are modest and in keeping with our goal of providing an introduction that serves a broad audience. We assume familiarity with the basic tools of linear algebra, including matrices, vectors and eigenvalues. These are typically covered in a sophomore-level course on the subject, and the textbooks by Apostol [10], Arnold [13] and Strang [187] can serve as good references. Similarly, we assume basic knowledge of differential equations, including the concepts of homogeneous and particular solutions for linear ordinary differential equations in one variable. Apostol [10] and Boyce and DiPrima [42] cover this material well. Finally, we also make use of complex numbers and functions and, in some of the advanced sections, more detailed concepts in complex variables that are typically covered in a junior-level engineering or physics course in mathematical methods. Apostol [9] or Stewart [186] can be used for the basic material, with Ahlfors [6], Marsden and Hoffman [146] or Saff and Snider [172] being good references for the more advanced material. We have chosen not to include appendices summarizing these various topics since there are a number of good books available. One additional choice that we felt was important was the decision not to rely on a knowledge of Laplace transforms in the book. While their use is by far the most common approach to teaching feedback systems in engineering, many students in the natural and information sciences may lack the necessary mathematical background. Since Laplace transforms are not required in any essential way, we have included them only in an advanced section intended to tie things together for students with that background. Of course, we make tremendous use of transfer functions, which we introduce through the notion of response to exponential inputs, an approach we feel is more accessible to a broad array of scientists and engineers. For classes in which students have already had Laplace transforms, it should be quite natural to build on this background in the appropriate sections of the text. Acknowledgments: The authors would like to thank the many people who helped during the preparation of this book. The idea for writing this book came in part from a report on future directions in control [155] to which Stephen Boyd, Roger Brockett, John Doyle and Gunter Stein were major contributors. Kristi Morgansen and Hideo Mabuchi helped teach early versions of the course at Caltech on which much of the text is based, and Steve Waydo served as the head TA for the course taught at Caltech in 2003–2004 and provided numerous comments and corrections. Charlotta Johnsson and Anton Cervin taught from early versions of the manuscript in Lund in 2003–2007 and gave very useful feedback. Other colleagues and students who provided feedback and advice include Leif Andersson, John Carson, K. Mani Chandy, Michel Charpentier, Domitilla Del Vecchio, Kate Galloway, Per Hagander, Toivo Henningsson Perby, Joseph Hellerstein, George Hines, Tore Hägglund, Cole Lepine, Anders Rantzer, Anders Robertsson, Dawn Tilbury and Francisco Zabala. The reviewers for Princeton University Press and Tom Robbins at NI Press also provided valuable comments that significantly improved the organization, layout and focus of the book. Our editor, Vickie Kearn, was a great source of encouragement and help throughout the publishing process. Finally, we would like to thank Caltech, Lund University and the University of California at Santa Barbara for providing many resources, stimulating colleagues and students, and pleasant working environments that greatly aided in the writing of this book