Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decisionmaking between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. The Sensing-Knowledge-Command (SKC) fusion network is proposed as a fundamental architecture for implementing cooperative and interactive sensing and control. Simulation results are shown

NASA space station automation: AI-based technology review

Research and Development projects in automation for the Space Station are discussed. Artificial Intelligence (AI) based automation technologies are planned to enhance crew safety through reduced need for EVA, increase crew productivity through the reduction of routine operations, increase space station autonomy, and augment space station capability through the use of teleoperation and robotics. AI technology will also be developed for the servicing of satellites at the Space Station, system monitoring and diagnosis, space manufacturing, and the assembly of large space structures

Control strategy for cooperating disparate manipulators

To manipulate large payloads typical of space construction, the concept of a small arm mounted on the end of a large arm is introduced. The main purposes of such a configuration are to increase the structural stiffness of the robot by bracing against or locking to a stationary frame, and to maintain a firm position constraint between the robot's base and workpieces by grasping them. Possible topologies for a combination of disparate large and small arms are discussed, and kinematics, dynamics, controls, and coordination of the two arms, especially when they brace at the tip of the small arm, are developed. The feasibility and improvement in performance are verified, not only with analytical work and simulation results but also with experiments on the existing arrangement Robotic Arm Large and Flexible and Small Articulated Manipulator

Datura: distributing activity in peer to peer collaborative virtual environments

Collaborative Virtual Environments (CVEs) are an exciting advance in the field of Virtual Reality (VR) research. By joining VR systems---and users---at widely scattered geographic locations, VR changes from an isolated experience to one of communication, interaction, and collaboration. Much research effort is being placed into the development of tools and techniques to power these collaborative experiences.;This dissertation describes the Datura toolkit for CVE development and, more importantly, the new concepts and methods that make Datura unique. We focus on the idea of Location of Computation (LoC)---methods for determining where, among all the sites participating in a CVE, particular calculations or particular decisions should be made. Datura connects sites into a peer to peer network, allowing each one to participate fully in bringing the virtual world to life.;Datura works at the level of elements---individual components that imbue shared objects with data, behaviors, and capabilities. These elements are shared among all sites, and control over them can be granted or migrated individually. This dissertation discusses the mechanisms for transferring control and computation, and provides a system for deciding where control should reside for each element in a CVE. An extensive set of tests and evaluations are also described, verifying the capabilities of the Datura system and demonstrating the performance and error-handling gains that are made by this fine-grained control over the location of computation

Observer based dynamic control model for bilaterally controlled MU-lapa robot: Surgical tool force limiting

During laparoscopic surgeries, primary surgical tool insertion is the demanding and strenuous task. As the surgeon is unaware of the type of the tissue and associated parameters to conduct the insertion, therefore, to ease the procedure, the movement of the surgical tool needs to be controlled. It’s the operational capabilities that are to be manipulated to perform a smooth surgery even from a distant location. In this study, a robot system is being introduced for laparoscopic primary surgical tool insertion. It will incorporate a novel observer based dynamic control along with robot assisted bilateral control. Moreover, a virtual spring damper force lock system is introduced through which the slave system will notify the master regarding the target achieved and excessive force. The validation of the proposed control system is experimented with bilaterally controlled MU-LapaRobot. The experiment is comprising 3 cases of bilateral control criteria which are non-contact motion, contact motion, and limit force locking. The results defined the same value for contact and non-contact motion by 0.3N. The results depicted a force error of 3.6% and a position error of 5.8% which validated the proposed algorithm

Model following control with discrete time SMC for time-delayed bilateral control systems

This paper proposes a new algorithm based on model following control to recover the uncompensated slave disturbance on time delayed motion control systems having contact with environment. In the previous works, a modified Communication Disturbance Observer (CDOB) was shown to be successful in ensuring position tracking in free motion under varying time delay. However, experiments show that due to the imperfections in slave plant Disturbance Observer (DOB) when there is rapid change of external force on the slave side, as in the case of environment contact, position tracking is degraded. This paper first analyzes the effect of environment contact for motion control systems with disturbance observers. Following this analysis, a model following controller scheme is proposed to restore the ideal motion on the slave system. A virtual plant is introduced which accepts the current from the master side and determines what the position output would be if there was no environment. Based on the error bet ween actual system and model system, a discrete time sliding mode controller is designed which enforces the real slave system to track the virtual slave output. In other words, convergence of slave position to the master position is achieved even though there is contact with environment. Experimental verification of the proposed control scheme also shows the improvement in slave position tracking under contact forces

Stabilization and control of teleoperation systems with time delays

A control scheme for teleoperation systems with time delay is developed based on the concept of passivity. This control method requires neither detailed knowledge of the manipulator systems nor the mathematical models of the environments, and it is applicable for any time delays. The main contribution of this method is that it is less conservative than the traditional passivity based method. In this method, the passivity controller only operates when the system loses passivity, while in a traditional passivity formulation, the controller works at all times during operation and thus adversely affect the performance of the system.;Using the proposed control scheme, a sub-system is defined that is composed of the communication channel, slave robot and the manipulated environment. This sub system is treated as a one-port network component, and passivity theory is applied to this component to assure stability. The energy flowing into the one-port network, in the form of the control command and the force feedback, is monitored. A passivity regulator is activated to maintain the passivity of the network by modifying the feedback force to the master, and thus adjust the energy exchange between the master and the communication channel.;When this method is applied, only the information at the interface between the master manipulator and the communication channel is collected and observed, there is no need for accurate or detailed knowledge of the structure or timing of the communication channel. The method can make the system lossless regardless of the feedback force, the coordinating force controlling the slave joint motions or the contact force. The approach can stabilize the system regardless of the time delay, discontinuities with environmental contact, or discretization of the physical plant. It will pose no problem when the environmental contact force is directly fed back. The results of this work show that it is advantageous to use the measured environmental force as the feedback, providing superior performance for free motion and more realistic haptic feedback for the operator from the remote environment.;Simulation and experimental results are presented to verify the proposed control scheme