Coordinated Control of a Mobile Manipulator

In this technical report, we investigate modeling, control, and coordination of mobile manipulators. A mobile manipulator in this study consists of a robotic manipulator and a mobile platform, with the manipulator being mounted atop the mobile platform. A mobile manipulator combines the dextrous manipulation capability offered by fixed-base manipulators and the mobility offered by mobile platforms. While mobile manipulators offer a tremendous potential for flexible material handling and other tasks, at the same time they bring about a number of challenging issues rather than simply increasing the structural complexity. First, combining a manipulator and a platform creates redundancy. Second, a wheeled mobile platform is subject to nonholonomic constraints. Third, there exists dynamic interaction between the manipulator and the mobile platform. Fourth, manipulators and mobile platforms have different bandwidths. Mobile platforms typically have slower dynamic response than manipulators. The objective of the thesis is to develop control algorithms that effectively coordinate manipulation and mobility of mobile manipulators. We begin with deriving the motion equations of mobile manipulators. The derivation presented here makes use of the existing motion equations of manipulators and mobile platforms, and simply introduces the velocity and acceleration dependent terms that account for the dynamic interaction between manipulators and mobile platforms. Since nonholonomic constraints play a critical role in control of mobile manipulators, we then study the control properties of nonholonomic dynamic systems, including feedback linearization and internal dynamics. Based on the newly proposed concept of preferred operating region, we develop a set of coordination algorithms for mobile manipulators. While the manipulator performs manipulation tasks, the mobile platform is controlled to always bring the configuration of the manipulator into a preferred operating region. The control algorithms for two types of tasks - dragging motion and following motion - are discussed in detail. The effects of dynamic interaction are also investigated. To verify the efficacy of the coordination algorithms, we conduct numerical simulations with representative task trajectories. Additionally, the control algorithms for the dragging motion and following motion have been implemented on an experimental mobile manipulator. The results from the simulation and experiment are presented to support the proposed control algorithms

Performance and Usability Evaluation Scheme for Mobile Manipulator Teleoperation

This article presents a standardized human–robot teleoperation interface (HRTI) evaluation scheme for mobile manipulators. Teleoperation remains the predominant control type for mobile manipulators in open environments, particularly for quadruped manipulators. However, mobile manipulators, especially quadruped manipulators, are relatively novel systems to be implemented in the industry compared to traditional machinery. Consequently, no standardized interface evaluation method has been established for them. The proposed scheme is the first of its kind in evaluating mobile manipulator teleoperation. It comprises a set of robot motion tests, objective measures, subjective measures, and a prediction model to provide a comprehensive evaluation. The motion tests encompass locomotion, manipulation, and a combined test. The duration for each trial is collected as the response variable in the objective measure. Statistical tools, including mean value, standard deviation, and T-test, are utilized to cross-compare between different predictor variables. Based on an extended Fitts' law, the prediction model employs the time and mission difficulty index to forecast system performance in future missions. The subjective measures utilize the NASA-task load index and the system usability scale to assess workload and usability. Finally, the proposed scheme is implemented on a real-world quadruped manipulator with two widely-used HRTIs, the gamepad and the wearable motion capture system

Motion Planning and Posture Control of Multiple n-link Doubly Nonholonomic Manipulators

The paper considers the problem of motion planning and posture control of multiple n-link doubly nonholonomic mobile manipulators in an obstacle-cluttered and bounded workspace. The workspace is constrained with the existence of an arbitrary number of fixed obstacles (disks, rods and curves), artificial obstacles and moving obstacles. The coordination of multiple n-link doubly nonholonomic mobile manipulators subjected to such constraints becomes therefore a challenging navigational and steering problem that few papers have considered in the past. Our approach to developing the controllers, which are novel decentralized nonlinear acceleration controllers, is based on a Lyapunov control scheme that is not only intuitively understandable but also allows simple but rigorous development of the controllers. Via the scheme, we showed that the avoidance of all types of obstacles was possible, that the manipulators could reach a neighborhood of their goal and that their final orientation approximated the desired orientation. Computer simulations illustrate these results. KEYWORDS: Lyapunov-based control scheme; Doubly nonholonomic manipulators; Ghost parking bays; Minimum distance technique; Stability; Kinodynamic constraints

Motion design for autonomous mobile manipulator based on programming style "action primitive"

Our research goal is to realize an intelligent autonomous motion for a mobile manipulator. A model task for mobile manipulators, &#34;returning books to bookshelf&#34; was chosen as our research task. To realize the task, we adopt a programming style named &#34;action primitive&#34; for programming the robot controller. Each action primitive is a basic motion control program, and the whole motion of the robot is generated by executing a sequence of action primitives step by step. The paper describes motion design for the above research task based on the action primitive concept, and reports simulation results of the designed motion </p

Contact aware robust semi-autonomous teleoperation of mobile manipulators

In the context of human-robot collaboration, cooperation and teaming, the use of mobile manipulators is widespread on applications involving unpredictable or hazardous environments for humans operators, like space operations, waste management and search and rescue on disaster scenarios. Applications where the manipulator's motion is controlled remotely by specialized operators. Teleoperation of manipulators is not a straightforward task, and in many practical cases represent a common source of failures. Common issues during the remote control of manipulators are: increasing control complexity with respect the mechanical degrees of freedom; inadequate or incomplete feedback to the user (i.e. limited visualization or knowledge of the environment); predefined motion directives may be incompatible with constraints or obstacles imposed by the environment. In the latter case, part of the manipulator may get trapped or blocked by some obstacle in the environment, failure that cannot be easily detected, isolated nor counteracted remotely. While control complexity can be reduced by the introduction of motion directives or by abstraction of the robot motion, the real-time constraint of the teleoperation task requires the transfer of the least possible amount of data over the system's network, thus limiting the number of physical sensors that can be used to model the environment. Therefore, it is of fundamental to define alternative perceptive strategies to accurately characterize different interaction with the environment without relying on specific sensory technologies. In this work, we present a novel approach for safe teleoperation, that takes advantage of model based proprioceptive measurement of the robot dynamics to robustly identify unexpected collisions or contact events with the environment. Each identified collision is translated on-the-fly into a set of local motion constraints, allowing the exploitation of the system redundancies for the computation of intelligent control laws for automatic reaction, without requiring human intervention and minimizing the disturbance of the task execution (or, equivalently, the operator efforts). More precisely, the described system consist in two different building blocks. The first, for detecting unexpected interactions with the environment (perceptive block). The second, for intelligent and autonomous reaction after the stimulus (control block). The perceptive block is responsible of the contact event identification. In short, the approach is based on the claim that a sensorless collision detection method for robot manipulators can be extended to the field of mobile manipulators, by embedding it within a statistical learning framework. The control deals with the intelligent and autonomous reaction after the contact or impact with the environment occurs, and consist on an motion abstraction controller with a prioritized set of constrains, where the highest priority correspond to the robot reconfiguration after a collision is detected; when all related dynamical effects have been compensated, the controller switch again to the basic control mode

Model-Free Large-Scale Cloth Spreading With Mobile Manipulation: Initial Feasibility Study

Cloth manipulation is common in domestic and service tasks, and most studies use fixed-base manipulators to manipulate objects whose sizes are relatively small with respect to the manipulators' workspace, such as towels, shirts, and rags. In contrast, manipulation of large-scale cloth, such as bed making and tablecloth spreading, poses additional challenges of reachability and manipulation control. To address them, this paper presents a novel framework to spread large-scale cloth, with a single-arm mobile manipulator that can solve the reachability issue, for an initial feasibility study. On the manipulation control side, without modeling highly deformable cloth, a vision-based manipulation control scheme is applied and based on an online-update Jacobian matrix mapping from selected feature points to the end-effector motion. To coordinate the control of the manipulator and mobile platform, Behavior Trees (BTs) are used because of their modularity. Finally, experiments are conducted, including validation of the model-free manipulation control for cloth spreading in different conditions and the large-scale cloth spreading framework. The experimental results demonstrate the large-scale cloth spreading task feasibility with a single-arm mobile manipulator and the model-free deformation controller.Comment: 6 pages, 6 figures, submit to CASE202

Numerical approach of collision avoidance and optimal control on robotic manipulators

Collision-free optimal motion and trajectory planning for robotic manipulators are solved by a method of sequential gradient restoration algorithm. Numerical examples of a two degree-of-freedom (DOF) robotic manipulator are demonstrated to show the excellence of the optimization technique and obstacle avoidance scheme. The obstacle is put on the midway, or even further inward on purpose, of the previous no-obstacle optimal trajectory. For the minimum-time purpose, the trajectory grazes by the obstacle and the minimum-time motion successfully avoids the obstacle. The minimum-time is longer for the obstacle avoidance cases than the one without obstacle. The obstacle avoidance scheme can deal with multiple obstacles in any ellipsoid forms by using artificial potential fields as penalty functions via distance functions. The method is promising in solving collision-free optimal control problems for robotics and can be applied to any DOF robotic manipulators with any performance indices and mobile robots as well. Since this method generates optimum solution based on Pontryagin Extremum Principle, rather than based on assumptions, the results provide a benchmark against which any optimization techniques can be measured

Haptic Device Design and Teleoperation Control Algorithms for Mobile Manipulators

The increasing need of teleoperated robotic systems implies more and more often to use, as slave devices, mobile platforms (terrestrial, aerial or underwater) with integrated manipulation capabilities, provided e.g. by robotic arms with proper grasping/manipulation tools. Despite this, the research activity in teleoperation of robotic systems has mainly focused on the control of either fixed-base manipulators or mobile robots, non considering the integration of these two types of systems in a single device. Such a combined robotic devices are usually referred to as mobile manipulators: systems composed by both a robotic manipulator and a mobile platform (on which the arm is mounted) whose purpose is to enlarge the manipulator’s workspace. The combination of a mobile platform and a serial manipulator creates redundancy: a particular point in the space can be reached by moving the manipulator, by moving the mobile platform, or by a combined motion of both. A synchronized motion of both devices need then to be addressed. Although specific haptic devices explicitly oriented to the control of mobile manipulators need to be designed, there are no commercial solution yet. For this reason it is often necessary to control such as combined systems with traditional haptic devices not specifically oriented to the control of mobile manipulators. The research activity presented in this Ph.D. thesis focuses in the first place on the design of a teleoperation control scheme which allows the simultaneous control of both the manipulator and the mobile platform by means of a single haptic device characterized by fixed base and an open kinematic chain. Secondly the design of a novel cable-drive haptic devices has been faced. Investigating the use of twisted strings actuation in force rendering is the most interesting challenge of the latter activity