Design and implementation of event-based multi-rate controllers for networked control systems

Tesis por compendio[ES] Con esta tesis se pretende dar solución a algunos de los problemas más habituales que aparecen en los Sistemas de control basados en red (NCS) como son los retardos variables en el tiempo, las pérdidas y el desorden de paquetes, y la restricción de ancho de banda y de recursos computacionales y energéticos de los dispositivos que forman parte del sistema de control. Para ello se ha planteado la integración de técnicas de control multifrecuencial, de control basado en paquetes, de control basado en predictor y de control basado en eventos. Los diseños de control realizados se han simulado utilizando Matlab-Simulink y Truetime, se ha analizado su estabilidad mediante LMIs y QFT, y se han validado experimentalmente en un péndulo invertido, un robot cartesiano 3D y en robots móviles de bajo coste. El artículo 1 aborda el control basado en eventos, el cual minimiza el ancho de banda consumido en el NCS mediante un control basado en eventos periódicos y presenta un método para obtener sus parámetros óptimos para el sistema específico en que se utilice. Los artículos 2, 4 y 6 añaden el control basado en paquetes, así como el control multifrecuencia, que aborda problemas de falta de datos por bajo uso del sensor y los retardos, pérdidas y desórdenes de paquetes en la red. También afrontan, mediante tecnicas de predicción basadas en un filtro de Kalman multifrecuencia variable en el tiempo, los problemas de ruido y perturbaciones, así como la observación de los estados completos del sistema. El artículo 7 hace frente a un modelo no lineal que utiliza las anteriores soluciones junto con un filtro de Kalman extendido para presentar otro tipo de estructura para un vehículo autónomo que, gracias a la información futura obtenida mediante estas técnicas, puede realizar de forma remota tareas de alto nivel como es la toma de decisiones y la monitorización de variables. Los artículos 3 y 5, presentan una forma de obtener y analizar la respuesta en frecuencia de sistemas SISO multifrecuencia y estudian su comportamiento ante ciertas incertidumbres o problemas en la red haciendo uso de procedimientos QFT.[CA] Amb aquesta tesi es pretén donar solució a alguns dels problemes més habituals que apareixen als Sistemes de Control Basats en xarxa (NCS) com son els retards d'accés i transferència variables en el temps, les pèrdues y desordenament de paquets, i la restricció d'ampli de banda així com de recursos computacionals i energètics dels dispositius que foment part del sistema de control. Per tal de resoldre'ls s'ha plantejat la integració de tècniques de control multifreqüencial, de control basat en paquets, de control basat en predictor i de control basat en events. Els dissenys de control realitzats s'han simulat fent ús de Matlab-Simulink i de TrueTime, s'ha analitzat la seua estabilitat mitjançant LMIs i QFT, i s'han validat experimentalment en un pèndul invertit, un robot cartesià 3D i en robots mòbils de baix cost. L'article 1 aborda el control basat en events, el qual minimitza l'ampli de banda consumit a l'NCS mitjançant un control basat en events periòdics i presenta un mètode per a obtindré els seus paràmetres òptims per al sistema específic en el qual s'utilitza. Els articles 2, 4 i 6 afegeixen el control basat en paquets, així com el control multifreqüència, que aborda problemes de falta de dades per el baix us del sensor i els retards, pèrdues i desordre de paquets en la xarxa. També afronten, mitjançant tècniques de predicció basades en un filtre de Kalman multifreqüència variable en el temps. Els problemes de soroll i pertorbacions, així com la observació dels estats complets del sistema. L'article 7 fa referència a un model no lineal que utilitza les anteriors solucions junt a un filtre de Kalman estès per a presentar altre tipus d'estructura per a un vehicle autònom que, gracies a la informació futura obtinguda mitjançant aquestes tècniques, pot realitzar de manera remota tasques d'alt nivell com son la presa de decisions i la monitorització de variables. Els articles 3 y 5 presenten la manera d'obtindre i analitzar la resposta en frequencia de sistemes SISO multifreqüència i estudien el seu comportament front a certes incerteses o problemes en la xarxa fent us de procediments QFT.[EN] This thesis attempts to solve some of the most frequent issues that appear in Networked Control Systems (NCS), such as time-varying delays, packet losses and packet disorders and the bandwidth limitation. Other frequent problems are scarce computational and energy resources of the local system devices. Thus, it is proposed to integrate multirate control, packet-based control, predictor-based control and event-based control techniques. The control designs have been simulated using Matlab-Simulink and Truetime, the stability has been analysed by LMIs and QFT, and the experimental validation has been done on an inverted pendulum, a 3D cartesian robot and in low-cost mobile robots. Paper 1 addresses event-based control, which minimizes the bandwidth consumed in NCS through a periodic event-triggered control and presents a method to obtain the optimal parameters for the specific system used. Papers 2, 4 and 6 include packet-based control and multirate control, addressing problems such as network delays, packet dropouts and packet disorders, and the scarce data due to low sensor usage in order to save battery in sensing tasks and transmissions of the sensed data. Also addressed, is how despite the existence of measurement noise and disturbances, time-varying dual-rate Kalman filter based prediction techniques observe the complete state of the system. Paper 7 tackles a non-linear model that uses all the previous solutions together with an extended Kalman filter to present another type of structure for an autonomous vehicle that, due to future information obtained through these techniques, can remotely carry out high level tasks, such as decision making and monitoring of variables. Papers 3 and 5, present a method for obtaining and analyzing the SISO dual-rate frequency response and using QFT procedures to study its behavior when faced with specific uncertainties or network problems.This work was supported by the Spanish Ministerio de Economía y Competitividad under Grant referenced TEC2012-31506.Alcaina Acosta, JJ. (2020). Design and implementation of event-based multi-rate controllers for networked control systems [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/159884TESISCompendi

Design and Simulation Analysis of Deep Learning Based Approaches and Multi-Attribute Algorithms for Warehouse Task Selection

With the growth and adoption of global supply chains and internet technologies, warehouse operations have become more demanding. Particularly, the number of orders being processed over a given time frame is drastically increasing, leading to more work content. This makes operational tasks, such as material retrieval and storage, done manually more inefficient. To improve system-level warehouse efficiency, collaborating Autonomous Vehicles (AVs) are needed. Several design challenges encompass an AV, some critical aspects are navigation, path planning, obstacle avoidance, task selection decisions, communication, and control systems. The current study addresses the warehouse task selection problem given a dynamic pending task list and considering multiple attributes: distance, traffic, collaboration, and due date, using situational decision-making approaches. The study includes the design and analysis of two situational decision-making approaches for multi-attribute dynamic warehouse task selection: Deep Learning Approach for Multi-Attribute Task Selection (DLT) and Situation based Greedy (SGY) algorithm that uses a traditional algorithmic approach. The two approaches are designed and analyzed in the current work. Further, they are evaluated using a simulation-based experiment. The results show that both the DLT and SGY have potential and are effective in comparison to the earliest due date first and shortest travel distance-based rules in addressing the multi-attribute task selection needs of a warehouse operation under the given experimental conditions and trade-offs

Adoption of vehicular ad hoc networking protocols by networked robots

This paper focuses on the utilization of wireless networking in the robotics domain. Many researchers have already equipped their robots with wireless communication capabilities, stimulated by the observation that multi-robot systems tend to have several advantages over their single-robot counterparts. Typically, this integration of wireless communication is tackled in a quite pragmatic manner, only a few authors presented novel Robotic Ad Hoc Network (RANET) protocols that were designed specifically with robotic use cases in mind. This is in sharp contrast with the domain of vehicular ad hoc networks (VANET). This observation is the starting point of this paper. If the results of previous efforts focusing on VANET protocols could be reused in the RANET domain, this could lead to rapid progress in the field of networked robots. To investigate this possibility, this paper provides a thorough overview of the related work in the domain of robotic and vehicular ad hoc networks. Based on this information, an exhaustive list of requirements is defined for both types. It is concluded that the most significant difference lies in the fact that VANET protocols are oriented towards low throughput messaging, while RANET protocols have to support high throughput media streaming as well. Although not always with equal importance, all other defined requirements are valid for both protocols. This leads to the conclusion that cross-fertilization between them is an appealing approach for future RANET research. To support such developments, this paper concludes with the definition of an appropriate working plan

Reinforcement Learning for Mobile Robot Collision Avoidance in Navigation Tasks

Collision avoidance is fundamental for mobile robot navigation. In general, its solutions include: {\it map-based} and {\it mapless approaches.} In the map-based approach, robots pre-plan collision-free paths based on an environment map and follow their paths during navigation. On the other hand, the mapless approach requires robots to avoid collisions without referencing to an environment map. This thesis first studies the map-based approach for multiple robots to collectively build environment maps. In this study, a robot following a pre-planned path may encounter unexpected obstacles, such as other moving robots and obstacles inaccurately presented on an environment map. This motivates us to study mapless collision avoidance in the second part of the thesis. Mapless collision avoidance requires a robot to infer an optimal action based on sensor data and operate in real time. Inferring an optimal action in a timely manner is computationally expensive, particularly when a robot has limited on-board computing resources. To avoid the expensive online action inferring, this thesis presents a reinforcement learning approach which learns policies for mapless collision avoidance under real-world settings. We first propose a Real-Time Actor-Critic Architecture (RTAC) to support asynchronous reinforcement learning under real-time constraint. Based on RTAC, we propose asynchronous reinforcement learning methods for mapless collision avoidance of various numbers of robots under different environment configurations. Through extensive experiments, we demonstrate that RTAC serves as a solid foundation to support multi-task and multi-agent learning for mapless collision avoidance under asynchronous settings