Experiments in cooperative manipulation: A system perspective

In addition to cooperative dynamic control, the system incorporates real time vision feedback, a novel programming technique, and a graphical high level user interface. By focusing on the vertical integration problem, not only these subsystems are examined, but also their interfaces and interactions. The control system implements a multi-level hierarchical structure; the techniques developed for operator input, strategic command, and cooperative dynamic control are presented. At the highest level, a mouse-based graphical user interface allows an operator to direct the activities of the system. Strategic command is provided by a table-driven finite state machine; this methodology provides a powerful yet flexible technique for managing the concurrent system interactions. The dynamic controller implements object impedance control; an extension of Nevill Hogan's impedance control concept to cooperative arm manipulation of a single object. Experimental results are presented, showing the system locating and identifying a moving object catching it, and performing a simple cooperative assembly. Results from dynamic control experiments are also presented, showing the controller's excellent dynamic trajectory tracking performance, while also permitting control of environmental contact force

Virtual Coordination in Collective Object Manipulation

Inspired by nature, swarm robotics aims to increase system robustness while utilizing simple agents. In this work, we present a novel approach to achieve decentralized coordination of forces during collective manipulation tasks resulting in a highly scalable, versatile, and robust solution. In this approach, each robot involved in the collective object manipulation task relies on the behavior of a cooperative ``virtual teammate\u27 in a fully decentralized architecture, regardless of the size and configuration of the real team. By regulating their actions with their corresponding virtual counterparts, robots achieve continuous pose control of the manipulated object, while eliminating the need for inter-agent communication or a leader-follower architecture. To experimentally study the scalability, versatility, and robustness of the proposed collective object manipulation algorithm, a new swarm agent, Δρ is introduced which is able to apply linear forces in any planar direction. Efficiency and effectiveness of the proposed decentralized algorithm are investigated by quantitative performance metrics of settling time, steady-state error, path efficiency, and object velocity profiles in comparison with a force-optimal centralized version that requires complete information. Employing impedance control during manipulation of an object provides a mean to control its dynamic interactions with the environment. The proposed decentralized algorithm is extended to achieve a desired multi-dimensional impedance behavior of the object during a collective manipulation without inter-agent communication. The proposed algorithm extension is built upon the concept of ``virtual coordination\u27 which demands every agent to locally coordinate with one virtual teammate. Since the real population of the team is unknown to the agents, the resultant force applied to the manipulated object would be directly scaled with the team population. Although this scaling effect proves useful during position control of the object, it leads to a deviation from the desired dynamic response when employed in an impedance control scheme. To minimize such deviations, a gradient descent algorithm is implemented to determine a scaling parameter defined on the control action. The simulation results of a multi-robot system with different populations and formations verify the effectiveness of the proposed method in both generating the desired impedance response and estimating the population of the group. Eventually, as two case studies, the introduced algorithm is used in robotic collective manipulation and human- assistance scenarios. Simulation and experimental results indicate that the proposed decentralized communication- free algorithm successfully performs collective manipulation in all tested scenarios, and matches the performance of the centralized controller for increasing number of agents, demonstrating its utility in communication- limited systems, remote environments, and access-limited objects

Cooperative Object Manipulation with Force Tracking on the da Vinci Research Kit

The da Vinci Surgical System is one of the most established robot-assisted surgery device commended for its dexterity and ergonomics in minimally invasive surgery. Conversely, it inherits disadvantages which are lack of autonomy and haptic feedback. In order to address these issues, this work proposes an industry-inspired solution to the field of force control in medical robotics. This approach contributes to shared autonomy by developing a controller for cooperative object manipulation with force tracking utilizing available manipulators and force feedback. To achieve simultaneous position and force tracking of the object, master and slave manipulators were assigned then controlled with Cartesian position control and impedance control respectively. Because impedance control requires a model-based feedforward compensation, we identified the lumped base parameters of mass, inertias, and frictions of a three degree-of-freedom double four-bar linkage mechanism with least squares and weighted least squares regression methods. Additionally, semidefinite programming was used to constrain the parameters to a feasible physical solution in standard parameter space. Robust stick-slip static friction compensation was applied where linear Viscous and Coulomb friction was inadequate in modeling the prismatic third joint. The Robot Operating System based controller was tested in RViz to check the cooperative kinematics of up to three manipulators. Additionally, simulation with the dynamic engine Gazebo verified the cooperative controller applying a constant tension force on a massless spring-damper virtual object. With adequate model feedback linearization, the cooperative impedance controller tested on the da Vinci Research Kit yielded stable tension force tracking while simultaneously moving in Cartesian space. The maximum force tracking error was +/- 0.5 N for both a compliant and stiff manipulated object

Robust Cooperative Manipulation without Force/Torque Measurements: Control Design and Experiments

This paper presents two novel control methodologies for the cooperative manipulation of an object by N robotic agents. Firstly, we design an adaptive control protocol which employs quaternion feedback for the object orientation to avoid potential representation singularities. Secondly, we propose a control protocol that guarantees predefined transient and steady-state performance for the object trajectory. Both methodologies are decentralized, since the agents calculate their own signals without communicating with each other, as well as robust to external disturbances and model uncertainties. Moreover, we consider that the grasping points are rigid, and avoid the need for force/torque measurements. Load distribution is also included via a grasp matrix pseudo-inverse to account for potential differences in the agents' power capabilities. Finally, simulation and experimental results with two robotic arms verify the theoretical findings

Control of free-flying space robot manipulator systems

New control techniques for self contained, autonomous free flying space robots were developed and tested experimentally. Free flying robots are envisioned as a key element of any successful long term presence in space. These robots must be capable of performing the assembly, maintenance, and inspection, and repair tasks that currently require human extravehicular activity (EVA). A set of research projects were developed and carried out using lab models of satellite robots and a flexible manipulator. The second generation space robot models use air cushion vehicle (ACV) technology to simulate in 2-D the drag free, zero g conditions of space. The current work is divided into 5 major projects: Global Navigation and Control of a Free Floating Robot, Cooperative Manipulation from a Free Flying Robot, Multiple Robot Cooperation, Thrusterless Robotic Locomotion, and Dynamic Payload Manipulation. These projects are examined in detail

A study of event traffic during the shared manipulation of objects within a collaborative virtual environment

Event management must balance consistency and responsiveness above the requirements of shared object interaction within a Collaborative Virtual Environment (CVE) system. An understanding of the event traffic during collaborative tasks helps in the design of all aspects of a CVE system. The application, user activity, the display interface, and the network resources, all play a part in determining the characteristics of event management. Linked cubic displays lend themselves well to supporting natural social human communication between remote users. To allow users to communicate naturally and subconsciously, continuous and detailed tracking is necessary. This, however, is hard to balance with the real-time consistency constraints of general shared object interaction. This paper aims to explain these issues through a detailed examination of event traffic produced by a typical CVE, using both immersive and desktop displays, while supporting a variety of collaborative activities. We analyze event traffic during a highly collaborative task requiring various forms of shared object manipulation, including the concurrent manipulation of a shared object. Event sources are categorized and the influence of the form of object sharing as well as the display device interface are detailed. With the presented findings the paper wishes to aid the design of future systems