Control of Networked Robotic Systems

With the infrastructure of ubiquitous networks around the world, the study of robotic systems over communication networks has attracted widespread attention. This area is denominated as networked robotic systems. By exploiting the fruitful technological developments in networking and computing, networked robotic systems are endowed with potential and capabilities for several applications. Robots within a network are capable of connecting with control stations, human operators, sensors, and other robots via digital communication over possibly noisy channels/media. The issues of time delays in communication and data losses have emerged as a pivotal issue that have stymied practical deployment. The aim of this dissertation is to develop control algorithms and architectures for networked robotic systems that guarantee stability with improved overall performance in the presence of time delays in communication. The first topic addressed in this dissertation is controlled synchronization that is utilized for networked robotic systems to achieve collective behaviors. Exploiting passivity property of individual robotic systems, the proposed control schemes and interconnections are shown to ensure stability and convergence of synchronizing errors. The robustness of the control algorithms to constant and time-varying communication delays is also studied. In addition to time delays, the number of communication links, which prevents scalability of networked robotic systems, is another challenging issue. Thus, a synchronizing control with practically feasible constraints of network topology is developed. The problem of networked robotic systems interacting with human operators is then studied subsequently. This research investigates a teleoperation system with heterogeneous robots under asymmetric and unknown communication delays. Sub-task controllers are proposed for redundant slave robot to autonomously achieve additional tasks, such as singularity avoidance, joint angle limits, and collision avoidance. The developed control algorithms can enhance the efficiency of teleoperation systems, thereby ameliorating the performance degradation due to cognitive limitations of human operator and incomplete information about the environment. Compared to traditional robotic systems, control of robotic manipulators over networks has significant advantages; for example, increased flexibility and ease of maintenance. With the utilization of scattering variables, this research demonstrates that transmitting scattering variables over delayed communications can stabilize an otherwise unstable system. An architecture utilizing delayed position feedback in conjunction with scattering variables is developed for the case of time-varying communication delays. The proposed control architecture improves tracking performance and stabilizes robotic manipulators with input-output communication delays. The aforementioned control algorithms and architectures for networked robotic systems are validated via numerical examples and experiments

Teleoperation control based on combination of wave variable and neural networks

In this paper, a novel control scheme is developed for a teleoperation system, combining the radial basis function (RBF) neural networks (NNs) and wave variable technique to simultaneously compensate for the effects caused by communication delays and dynamics uncertainties. The teleoperation system is set up with a TouchX joystick as the master device and a simulated Baxter robot arm as the slave robot. The haptic feedback is provided to the human operator to sense the interaction force between the slave robot and the environment when manipulating the stylus of the joystick. To utilize the workspace of the telerobot as much as possible, a matching process is carried out between the master and the slave based on their kinematics models. The closed loop inverse kinematics method and RBF NN approximation technique are seamlessly integrated in the control design. To overcome the potential instability problem in the presence of delayed communication channels, wave variables and their corrections are effectively embedded into the control system, and Lyapunov-based analysis is performed to theoretically establish the closed-loop stability. Comparative experiments have been conducted for a trajectory tracking task, under the different conditions of various communication delays. Experimental results show that in terms of tracking performance and force reflection, the proposed control approach shows superior performance over the conventional methods

Comparison of Semi-autonomous Mobile Robot Control Strategies in Presence of Large Delay Fluctuation

We propose semi-autonomous control strategies to assist in the teleoperation of mobile robots under unstable communication conditions. A short-term autonomous control system is the assistance in the semi-autonomous control strategies, when the teleoperation is compromised. The short-term autonomous control comprises of lateral and longitudinal functions. The lateral control is based on an artificial potential field method where obstacles are repulsive, and a route is attractive. LiDAR-based artificial potential field methods are well studied. We present a novel artificial potential field method based on color and depth images. Benefit of a camera system compared to a LiDAR is that a camera detects color, is cheaper, and does not have moving parts. Moreover, utilization of active sensors is not desired in the particle accelerator environment. A set of experiments with a robot prototype are carried out to validate this system. The experiments are carried out in an environment which mimics the accelerator tunnel environment. The difficulty of the teleoperation is altered with obstacles. Fully manual and autonomous control are compared with the proposed semi-autonomous control strategies. The results show that the teleoperation is improved with autonomous, delay-dependent, and control-dependent assist compared to the fully manual control. Based on the operation time, control-dependent assist performed the best, reducing the time by 12% on the tunnel section with most obstacles. The presented system can be easily applied to common industrial robots operating e.g. in warehouses or factories due to hardware simplicity and light computational demand.Peer reviewe

Expert-in-the-Loop Multilateral Telerobotics for Haptics-Enabled Motor Function and Skills Development

Among medical robotics applications are Robotics-Assisted Mirror Rehabilitation Therapy (RAMRT) and Minimally-Invasive Surgical Training (RAMIST) that extensively rely on motor function development. Haptics-enabled expert-in-the-loop motor function development for such applications is made possible through multilateral telerobotic frameworks. While several studies have validated the benefits of haptic interaction with an expert in motor learning, contradictory results have also been reported. This emphasizes the need for further in-depth studies on the nature of human motor learning through haptic guidance and interaction. The objective of this study was to design and evaluate expert-in-the-loop multilateral telerobotic frameworks with stable and human-safe control loops that enable adaptive “hand-over-hand” haptic guidance for RAMRT and RAMIST. The first prerequisite for such frameworks is active involvement of the patient or trainee, which requires the closed-loop system to remain stable in the presence of an adaptable time-varying dominance factor. To this end, a wave-variable controller is proposed in this study for conventional trilateral teleoperation systems such that system stability is guaranteed in the presence of a time-varying dominance factor and communication delay. Similar to other wave-variable approaches, the controller is initially developed for the Velocity-force Domain (VD) based on the well-known passivity assumption on the human arm in VD. The controller can be applied straightforwardly to the Position-force Domain (PD), eliminating position-error accumulation and position drift, provided that passivity of the human arm in PD is addressed. However, the latter has been ignored in the literature. Therefore, in this study, passivity of the human arm in PD is investigated using mathematical analysis, experimentation as well as user studies involving 12 participants and 48 trials. The results, in conjunction with the proposed wave-variables, can be used to guarantee closed-loop PD stability of the supervised trilateral teleoperation system in its classical format. The classic dual-user teleoperation architecture does not, however, fully satisfy the requirements for properly imparting motor function (skills) in RAMRT (RAMIST). Consequently, the next part of this study focuses on designing novel supervised trilateral frameworks for providing motor learning in RAMRT and RAMIST, each customized according to the requirements of the application. The framework proposed for RAMRT includes the following features: a) therapist-in-the-loop mirror therapy; b) haptic feedback to the therapist from the patient side; c) assist-as-needed therapy realized through an adaptive Guidance Virtual Fixture (GVF); and d) real-time task-independent and patient-specific motor-function assessment. Closed-loop stability of the proposed framework is investigated using a combination of the Circle Criterion and the Small-Gain Theorem. The stability analysis addresses the instabilities caused by: a) communication delays between the therapist and the patient, facilitating haptics-enabled tele- or in-home rehabilitation; and b) the integration of the time-varying nonlinear GVF element into the delayed system. The platform is experimentally evaluated on a trilateral rehabilitation setup consisting of two Quanser rehabilitation robots and one Quanser HD2 robot. The framework proposed for RAMIST includes the following features: a) haptics-enabled expert-in-the-loop surgical training; b) adaptive expertise-oriented training, realized through a Fuzzy Interface System, which actively engages the trainees while providing them with appropriate skills-oriented levels of training; and c) task-independent skills assessment. Closed-loop stability of the architecture is analyzed using the Circle Criterion in the presence and absence of haptic feedback of tool-tissue interactions. In addition to the time-varying elements of the system, the stability analysis approach also addresses communication delays, facilitating tele-surgical training. The platform is implemented on a dual-console surgical setup consisting of the classic da Vinci surgical system (Intuitive Surgical, Inc., Sunnyvale, CA), integrated with the da Vinci Research Kit (dVRK) motor controllers, and the dV-Trainer master console (Mimic Technology Inc., Seattle, WA). In order to save on the expert\u27s (therapist\u27s) time, dual-console architectures can also be expanded to accommodate simultaneous training (rehabilitation) for multiple trainees (patients). As the first step in doing this, the last part of this thesis focuses on the development of a multi-master/single-slave telerobotic framework, along with controller design and closed-loop stability analysis in the presence of communication delays. Various parts of this study are supported with a number of experimental implementations and evaluations. The outcomes of this research include multilateral telerobotic testbeds for further studies on the nature of human motor learning and retention through haptic guidance and interaction. They also enable investigation of the impact of communication time delays on supervised haptics-enabled motor function improvement through tele-rehabilitation and mentoring