Online learning-based model predictive control with Gaussian process models and stability guarantees

Model predictive control allows to provide high performance and safety guarantees in the form of constraint satisfaction. These properties, however, can be satisfied only if the underlying model, used for prediction, of the controlled process is sufficiently accurate. One way to address this challenge is by data-driven and machine learning approaches, such as Gaussian processes, that allow to refine the model online during operation. We present a combination of an output feedback model predictive control scheme and a Gaussian process-based prediction model that is capable of efficient online learning. To this end, the concept of evolving Gaussian processes is combined with recursive posterior prediction updates. The presented approach guarantees recursive constraint satisfaction and input-to-state stability with respect to the model–plant mismatch. Simulation studies underline that the Gaussian process prediction model can be successfully and efficiently learned online. The resulting computational load is significantly reduced via the combination of the recursive update procedure and by limiting the number of training data points while maintaining good performance.Ministerio de Economía y Competitividad ( España) DPI2016-76493-C3-1-

Switching Adaptive Concurrent Learning Control for Powered Rehabilitation Machines with FES

Interfacing robotic devices with humans presents significant control challenges, as the control algorithms governing these machines must accommodate for the inherent variability among individuals. This requirement necessitates the system’s ability to adapt to changes in the environment, particularly in the context of human-in-the-loop applications, wherein the system must identify specific features of the human interacting with the machine. In the field of rehabilitation, one promising approach for exercise-based rehabilitation involves the integration of hybrid rehabilitation machines, combining robotic devices such as motorized bikes and exoskeletons with functional electrical stimulation (FES) applied on lower-limb muscles. This integrated approach offers the potential for repetitive training, reduced therapist workload, improved range of motion, and therapeutic benefits. However, conducting prolonged rehabilitation sessions to maximize functional recovery using these hybrid machines imposes several difficulties. Firstly, the design and analysis of adaptive controllers are motivated, but challenges exist in coping with the inherent switching effects associated with hybrid machines. Notably, the transitions between gait phases and the dynamic switching of inputs between active lower-limb muscles and electric motors and their incorporation in the control design remain an open problem for the research community. Secondly, the system must effectively compensate for the influence of human input, which can be viewed as an external disturbance in the closed-loop system during rehabilitation. Robust methods for understanding and adapting to the variations in human input are critical for ensuring stability and accurate control of the human-robot closed-loop system. Lastly, FES-induced muscle fatigue diminishes the human torque contribution to the rehabilitation task, leading to input saturation and potential instabilities as the duration of the exercise extends. Overcoming this challenge requires the development of control algorithms that can adapt to variations in human performance by dynamically adjusting the control parameters accordingly. Consequently, the development of rehabilitative devices that effectively interface with humans requires the design and implementation of control algorithms capable of adapting to users with varying muscle and kinematic characteristics. In this regard, adaptive-based control methods provide tools for addressing the uncertainties in human-robot dynamics within exercise-based rehabilitation using FES, while ensuring stability and robustness in the human-robot closed-loop system. This dissertation develops adaptive controllers to enhance the effectiveness of exercise-based rehabilitation using FES. The objectives include the design and evaluation of adaptive control algorithms that effectively handle the switching effects inherent in hybrid machines, adapt to compensate for human input, and account for input saturation due to muscle fatigue. The control designs leverage kinematic and torque feedback and ensure the stability of the human-robot closed-loop system. These controllers have the potential to significantly enhance the practicality and effectiveness of assistive technologies in both clinical and community settings. In Chapter 1, the motivation to design switching adaptive closed-loop controllers for motorized FES-cycling and powered exoskeletons is described. A survey of closed-loop kinematic control methods related to the tracking objectives in the subsequent chapters of the dissertation is also introduced. In Chapter 2, the dynamic models for cycling and bipedal walking are described: (i) a stationary FES-cycling model with nonlinear dynamics and switched control inputs are introduced based on published literature. The muscle stimulation pattern is defined based on the kinematic effectiveness of the rider, which depends on the crank angle. (ii) A phase-dependent bipedal walking system model with switched dynamics is introduced to control a 4-degrees-of-freedom (DoF) lower-limb exoskeleton assuming single stance support. Moreover, the experimental setup of the cycle-rider and lower-limb exoskeleton system are described. Chapter 3 presents a switched concurrent learning adaptive controller for cadence tracking using the cycle-rider model. The control design is decoupled for the muscles and electric motor. An FES controller is developed with minimal parameters, capable of generating bounded muscle responses with an adjustable saturation limit. The electric motor controller employs an adaptive-based method that estimates uncertain parameters in the cycle-rider system and leverages the muscle input as a feedforward term to improve the tracking of crank trajectories. The adaptive motor controller and saturated muscle controller are implemented in able-bodied individuals and people with movement disorders. Three cycling trials were conducted to demonstrate the feasibility of tracking different crank trajectories with the same set of control parameters across all participants. The developed adaptive controller requires minimal tuning and handles rider uncertainty while ensuring predictable and satisfactory performance. This result has the potential to facilitate the widespread implementation of adaptive closed-loop controllers for FES-cycling systems in real clinical and home-based scenarios. Chapter 4 presents an integral torque tracking controller with anti-windup compensation, which achieves the dual objectives of kinematic and torque tracking (i.e., power tracking) for FES cycling. Designing an integral torque tracking controller to avoid feedback of high-order derivatives poses a significant challenge, as the integration action in the muscle loop can induce error buildup; demanding high FES input on the muscle. This can cause discomfort and accelerate muscle fatigue, thereby limiting the practical utility of the power tracking controller. To address this issue, this chapter builds upon the adaptive control for cadence tracking developed in Chapter 3 and integrates a novel torque tracking controller that allows for input saturation in the FES controller. By doing so, the controller achieves cadence and torque tracking while preventing error buildup. The analysis rigorously considers the saturation effect, and preliminary experimental results in able-bodied individuals demonstrate its feasibility. In Chapter 5, a switched concurrent learning adaptive controller is developed to achieve kinematic tracking throughout the step cycle for treadmill-based walking with a 4-DoF lower-limb hybrid exoskeleton. The developed controller leverages a phase-dependent human-exoskeleton model presented in Chapter 2. A multiple-Lyapunov stability analysis with a dwell time condition is developed to ensure exponential kinematic tracking and parameter estimation. The controller is tested in two able-bodied individuals for a six-minute walking trial and the performance of the controller is compared with a gradient descent classical adaptive controller. Chapter 6 highlights the contributions of the developed control methods and provides recommendations for future research directions

URANUS: Radio Frequency Tracking, Classification and Identification of Unmanned Aircraft Vehicles

Safety and security issues for Critical Infrastructures are growing as attackers adopt drones as an attack vector flying in sensitive airspaces, such as airports, military bases, city centers, and crowded places. Despite the use of UAVs for logistics, shipping recreation activities, and commercial applications, their usage poses severe concerns to operators due to the violations and the invasions of the restricted airspaces. A cost-effective and real-time framework is needed to detect the presence of drones in such cases. In this contribution, we propose an efficient radio frequency-based detection framework called URANUS. We leverage real-time data provided by the Radio Frequency/Direction Finding system, and radars in order to detect, classify and identify drones (multi-copter and fixed-wings) invading no-drone zones. We adopt a Multilayer Perceptron neural network to identify and classify UAVs in real-time, with $90$% accuracy. For the tracking task, we use a Random Forest model to predict the position of a drone with an MSE $\approx0.29$, MAE $\approx0.04$, and $R^2\approx 0.93$. Furthermore, coordinate regression is performed using Universal Transverse Mercator coordinates to ensure high accuracy. Our analysis shows that URANUS is an ideal framework for identifying, classifying, and tracking UAVs that most Critical Infrastructure operators can adopt

Fall Prediction for Bipedal Robots: The Standing Phase

This paper presents a novel approach to fall prediction for bipedal robots, specifically targeting the detection of potential falls while standing caused by abrupt, incipient, and intermittent faults. Leveraging a 1D convolutional neural network (CNN), our method aims to maximize lead time for fall prediction while minimizing false positive rates. The proposed algorithm uniquely integrates the detection of various fault types and estimates the lead time for potential falls. Our contributions include the development of an algorithm capable of detecting abrupt, incipient, and intermittent faults in full-sized robots, its implementation using both simulation and hardware data for a humanoid robot, and a method for estimating lead time. Evaluation metrics, including false positive rate, lead time, and response time, demonstrate the efficacy of our approach. Particularly, our model achieves impressive lead times and response times across different fault scenarios with a false positive rate of 0. The findings of this study hold significant implications for enhancing the safety and reliability of bipedal robotic systems.Comment: Submitted to ICRA 2024. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessibl

Enhancing Produce Safety: State Estimation-based Robust Adaptive Control of a Produce Wash System

The rapid introduction of fresh-cut produce into a produce wash system can dramatically decrease the free chlorine (FC) concentration level in the wash water, resulting in potential widespread cross-contamination throughout the entire wash system. To minimize such contamination, a sufficient level of FC must be maintained in the wash water. This paper presents a state estimation-based robust adaptive sliding mode (RASM) control strategy for the wash system to stabilize the FC concentration level during fresh-cut iceberg lettuce washing. This feedback control law for FC dosing is suggested to provide a sufficient FC injection rate (FCIR) to the wash system in order to compensate for the fall in the FC level and in turn to minimize the Escherichia coli (E. coli) O157:H7 levels on washed lettuce and in the wash water. The proposed controller uses the estimated chemical oxygen demand (COD) and FC concentration as feedback signals while system states are estimated by a hybrid extended Kalman filter (HEKF) and the unknown noise statistics are identified by a noise identification (NI) algorithm. Uniformly ultimately boundedness (UUB) of the FC concentration tracking error in the presence of unmodelled dynamics is proven using the Lyapunov framework and Barbalat\u27s lemma. The E. coli O157:H7 contamination levels are predicted from the joint estimator and controller properties. Simulation results show that the proposed NI-based HEKF/RASM control methodology achieves FC tracking while the pathogens converge to their predicted levels. The E. coli O157:H7 levels decrease as FC concentration increases and in particular, no E. coli O157:H7 is detected when FC concentration is regulated at 15 mg/L. Two robustness tests are performed to show the performance of the proposed controller in the presence of chlorine actuator failure and system parameter uncertainties. Finally, cross-contamination management is examined in terms of the prevalence and mean pathogen levels of incoming pre-wash lettuce in the context of FC regulation at 15 mg/L

Adaptive performance optimization for large-scale traffic control systems

In this paper, we study the problem of optimizing (fine-tuning) the design parameters of large-scale traffic control systems that are composed of distinct and mutually interacting modules. This problem usually requires a considerable amount of human effort and time to devote to the successful deployment and operation of traffic control systems due to the lack of an automated well-established systematic approach. We investigate the adaptive fine-tuning algorithm for determining the set of design parameters of two distinct mutually interacting modules of the traffic-responsive urban control (TUC) strategy, i.e., split and cycle, for the large-scale urban road network of the city of Chania, Greece. Simulation results are presented, demonstrating that the network performance in terms of the daily mean speed, which is attained by the proposed adaptive optimization methodology, is significantly better than the original TUC system in the case in which the aforementioned design parameters are manually fine-tuned to virtual perfection by the system operators

Robust control examples applied to a wind turbine simulated model

Wind turbine plants are complex dynamic and uncertain processes driven by stochastic inputs and disturbances, as well as different loads represented by gyroscopic, centrifugal and gravitational forces. Moreover, as their aerodynamic models are nonlinear, both modeling and control become challenging problems. On the one hand, high-fidelity simulators should contain different parameters and variables in order to accurately describe the main dynamic system behavior. Therefore, the development of modeling and control for wind turbine systems should consider these complexity aspects. On the other hand, these control solutions have to include the main wind turbine dynamic characteristics without becoming too complicated. The main point of this paper is thus to provide two practical examples of the development of robust control strategies when applied to a simulated wind turbine plant. Extended simulations with the wind turbine benchmark model and the Monte Carlo tool represent the instruments for assessing the robustness and reliability aspects of the developed control methodologies when the model-reality mismatch and measurement errors are also considered. Advantages and drawbacks of these regulation methods are also highlighted with respect to different control strategies via proper performance metrics.Wind turbine plants are complex dynamic and uncertain processes driven by stochastic inputs and disturbances, as well as different loads represented by gyroscopic, centrifugal and gravitational forces. Moreover, as their aerodynamic models are nonlinear, both modeling and control become challenging problems. On the one hand, high-fidelity simulators should contain different parameters and variables in order to accurately describe the main dynamic system behavior. Therefore, the development of modeling and control for wind turbine systems should consider these complexity aspects. On the other hand, these control solutions have to include the main wind turbine dynamic characteristics without becoming too complicated. The main point of this paper is thus to provide two practical examples of the development of robust control strategies when applied to a simulated wind turbine plant. Extended simulations with the wind turbine benchmark model and the Monte Carlo tool represent the instruments for assessing the robustness and reliability aspects of the developed control methodologies when the model-reality mismatch and measurement errors are also considered. Advantages and drawbacks of these regulation methods are also highlighted with respect to different control strategies via proper performance metrics

Data-Driven and Model-Based Control Techniques for a Wind Turbine Benchmark Model

Wind turbine plants are complex dynamic and uncertain processes driven by stochastic inputs and disturbances, as well as different loads represented by gyroscopic, centrifugal, and gravitational forces. Moreover, as their aerodynamic models are nonlinear, both modelling and control become challenging problems. On one hand, high–fidelity simulators should contain different parameters and variables in order to accurately describe the main dynamic system behaviour. Therefore, the development of modelling and control for wind turbine systems should consider these complexity aspects. On the other hand, these control solutions have to include the main wind turbine dynamic characteristics without becoming too complicated. The main point of this paper is thus to provide two practical examples of development of robust control strategies when applied to a simulated wind turbine plant. Extended simulations with the wind turbine benchhmark model and the Monte–Carlo tool represent the instruments for assessing the robustness and reliability aspects of the developed control methodologies when the model–reality mismatch and measurement errors are also considered. Advantages and drawbacks of these regulation methods are also highlighted with respect to different control strategies via proper performance metrics