26 research outputs found

    Manipulation Planning for Forceful Human-Robot-Collaboration

    Get PDF
    This thesis addresses the problem of manipulation planning for forceful human-robot collaboration. Particularly, the focus is on the scenario where a human applies a sequence of changing external forces through forceful operations (e.g. cutting a circular piece off a board) on an object that is grasped by a cooperative robot. We present a range of planners that 1) enable the robot to stabilize and position the object under the human applied forces by exploiting supports from both the object-robot and object-environment contacts; 2) improve task efficiency by minimizing the need of configuration and grasp changes required by the changing external forces; 3) improve human comfort during the forceful interaction by optimizing the defined comfort criteria. We first focus on the instance of using only robotic grasps, where the robot is supposed to grasp/regrasp the object multiple times to keep it stable under the changing external forces. We introduce a planner that can generate an efficient manipulation plan by intelligently deciding when the robot should change its grasp on the object as the human applies the forces, and choosing subsequent grasps such that they minimize the number of regrasps required in the long-term. The planner searches for such an efficient plan by first finding a minimal sequence of grasp configurations that are able to keep the object stable under the changing forces, and then generating connecting trajectories to switch between the planned configurations, i.e. planning regrasps. We perform the search for such a grasp (configuration) sequence by sampling stable configurations for the external forces, building an operation graph using these stable configurations and then searching the operation graph to minimize the number of regrasps. We solve the problem of bimanual regrasp planning under the assumption of no support surface, enabling the robot to regrasp an object in the air by finding intermediate configurations at which both the bimanual and unimanual grasps can hold the object stable under gravity. We present a variety of experiments to show the performance of our planner, particularly in minimizing the number of regrasps for forceful manipulation tasks and planning stable regrasps. We then explore the problem of using both the object-environment contacts and object-robot contacts, which enlarges the set of stable configurations and thus boosts the robot’s capability in stabilizing the object under external forces. We present a planner that can intelligently exploit the environment’s and robot’s stabilization capabilities within a unified planning framework to search for a minimal number of stable contact configurations. A big computational bottleneck in this planner is due to the static stability analysis of a large number of candidate configurations. We introduce a containment relation between different contact configurations, to efficiently prune the stability checking process. We present a set of real-robot and simulated experiments illustrating the effectiveness of the proposed framework. We present a detailed analysis of the proposed containment relationship, particularly in improving the planning efficiency. We present a planning algorithm to further improve the cooperative robot behaviour concerning human comfort during the forceful human-robot interaction. Particularly, we are interested in empowering the robot with the capability of grasping and positioning the object not only to ensure the object stability against the human applied forces, but also to improve human experience and comfort during the interaction. We address human comfort as the muscular activation level required to apply a desired external force, together with the human spatial perception, i.e. the so-called peripersonal-space comfort during the interaction. We propose to maximize both comfort metrics to optimize the robot and object configuration such that the human can apply a forceful operation comfortably. We present a set of human-robot drilling and cutting experiments which verify the efficiency of the proposed metrics in improving the overall comfort and HRI experience, without compromising the force stability. In addition to the above planning work, we present a conic formulation to approximate the distribution of a forceful operation in the wrench space with a polyhedral cone, which enables the planner to efficiently assess the stability of a system configuration even in the presence of force uncertainties that are inherent in the human applied forceful operations. We also develop a graphical user interface, which human users can easily use to specify various forceful tasks, i.e. sequences of forceful operations on selected objects, in an interactive manner. The user interface ties in human task specification, on-demand manipulation planning and robot-assisted fabrication together. We present a set of human-robot experiments using the interface demonstrating the feasibility of our system. In short, in this thesis we present a series of planners for object manipulation under changing external forces. We show the object contacts with the robot and the environment enable the robot to manipulate an object under external forces, while making the most of the object contacts has the potential to eliminate redundant changes during manipulation, e.g. regrasp, and thus improve task efficiency and smoothness. We also show the necessity of optimizing human comfort in planning for forceful human-robot manipulation tasks. We believe the work presented here can be a key component in a human-robot collaboration framework

    Occlusion-based cooperative transport with a swarm of miniature mobile robots

    Get PDF
    This paper proposes a strategy for transporting a large object to a goal using a large number of mobile robots that are significantly smaller than the object. The robots only push the object at positions where the direct line of sight to the goal is occluded by the object. This strategy is fully decentralized and requires neither explicit communication nor specific manipulation mechanisms. We prove that it can transport any convex object in a planar environment. We implement this strategy on the e-puck robotic platform and present systematic experiments with a group of 20 e-pucks transporting three objects of different shapes. The objects were successfully transported to the goal in 43 out of 45 trials. When using a mobile goal, teleoperated by a human, the object could be navigated through an environment with obstacles. We also tested the strategy in a 3-D environment using physics-based computer simulation. Due to its simplicity, the transport strategy is particularly suited for implementation on microscale robotic systems

    Transport collaboratif d’une charge par deux robots humanoïdes

    Get PDF
    La structure bipède des robots humanoïdes leur confère une grande agilité et la capacité de se déplacer dans des environnements encombrés qui ne sont pas accessibles à des robots à roues plus traditionnelles. Cette particularité fait en sorte que ce type de robot est le mieux adapté pour évoluer dans des environnements conçus pour et par l’homme. Cette grande agilité a toutefois un prix puisque les humanoïdes sont plus complexes à contrôler étant donné l’instabilité inhérente à la marche bipède. Dans ce projet de recherche, on s’intéresse au contrôle de robots humanoïdes dans le cadre de tâches très communes et intéressantes à reléguer aux robots, soit le transport d’objet. Le cas d’intérêt est le transport collaboratif d’une charge par deux humanoïdes étant donné que ça ne nécessite aucun outil externe et est ainsi applicable en toute circonstance. En premier lieu, un estimateur d’état applicable pour les robots humanoïdes de petite taille est proposé, permettant ainsi d’estimer les interactions entre le robot et son environnement. Ensuite, une stratégie de contrôle permettant à un humanoïde d’utiliser un chariot de transport pour déplacer un objet lourd est présentée. Finalement, le transport collaboratif par deux robots humanoïdes est abordé. Le système développé utilise un contrôleur externe qui planifie la trajectoire des robots et valide la stabilité des déplacements à l’aide d’un modèle dynamique simple du système basé sur des pendules inversés. Tous les algorithmes développés ont été validés et testés sur des robots humanoïdes NAO. Les résultats démontrent qu’il est possible de transporter un objet lourd sans modifier les composantes matérielles des robots, soit en utilisant un chariot ou bien en coopérant avec un autre robot. Les résultats obtenus pourraient s’avérer utiles dans certaines situations réelles telles que les tâches de manutention dans un domaine manufacturier ou bien le transport de blessé sur une civière

    Physics-, social-, and capability- based reasoning for robotic manipulation

    Get PDF
    Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2012.Cataloged from PDF version of thesis.Includes bibliographical references (p. 124-128).Robots that can function in human-centric domains have the potential to help humans with the chores of everyday life. Moreover, dexterous robots with the ability to reason about the maneuvers they execute for manipulation tasks can function more autonomously and intelligently. This thesis outlines the development of a reasoning architecture that uses physics-, social-, and agent capability-based knowledge to generate manipulation strategies that a dexterous robot can implement in the physical world. The reasoning system learns object affordances through a combination of observations from human interactions, explicit rules and constraints imposed on the system, and hardcoded physics-based logic. Observations from humans performing manipulation tasks are also used to develop a unique manipulation repertoire suitable for the robot. The system then uses Bayesian Networks to probabilistically determine the best manipulation strategies for the robot to execute on new objects. The robot leverages this knowledge during experimental trials where manipulation strategies suggested by the reasoning architecture are shown to perform well in new manipulation environments.by Kenton J. Williams.S.M

    Cooperation in Swarms of Robots without Communication

    Get PDF
    Swarm robotics aims to use a large group of relatively simple robots to solve tasks that can hardly be achieved by a single robot in the group. Compared to single robot systems with increased capability, a swarm robotic system may have advantages in robustness, flexibility and scalability. However, designing cooperative behaviors for a swarm robotic system is a challenging problem, especially when the robots may not have communication capabilities and thus only know local information. For a swarm of miniature mobile robots that cannot communicate explicitly, this thesis studies fully decentralized solutions of two problems. For the problem of cooperative transport, the thesis presents a strategy to push an object that is large enough to occlude the robots' perception of the goal of the transportation. For the problem of pattern formation, the thesis investigates algorithms based on the Brazil nut effect that can organize the swarm of robots into an annular formation. These problems are studied using physics-based computer simulations as well as experimental implementations based on the e-puck robotic platform. The simplicity of the solutions make them suitable for applications that require the individual robots to be as simple as possible. Example application scenarios could be micro robot swarms working in the human body

    Parameter tuning and cooperative control for automated guided vehicles

    Get PDF
    For several practical control engineering applications it is desirable that multiple systems can operate independently as well as in cooperation with each other. Especially when the transition between individual and cooperative behavior and vice versa can be carried out easily, this results in ??exible and scalable systems. A subclass is formed by systems that are physically separated during individual operation, and very tightly coupled during cooperative operation. One particular application of multiple systems that can operate independently as well as in concert with each other is the cooperative transportation of a large object by multiple Automated Guided Vehicles (AGVs). AGVs are used in industry to transport all kinds of goods, ranging from small trays of compact and video discs to pallets and 40-tonne coils of steel. Current applications typically comprise a ??eet of AGVs, and the vehicles transport products on an individual basis. Recently there has been an increasing demand to transport very large objects such as sewer pipes, rotor blades of wind turbines and pieces of scenery for theaters, which may reach lengths of over thirty meters. A realistic option is to let several AGVs operate together to handle these types of loads. This Ph.D. thesis describes the development, implementation, and testing of distributed control algorithms for transporting a load by two or more Automated Guided Vehicles in industrial environments. We focused on the situations where the load is connected to the AGVs by means of (semi-)rigid interconnections. Attention was restricted to control on the velocity level, which we regard as an intermediate step for achieving fully automatic operation. In our setup the motion setpoint is provided by an external host. The load is assumed to be already present on the vehicles. Docking and grasping procedures are not considered. The project is a collaboration between the company FROG Navigation Systems (Utrecht, The Netherlands) and the Control Systems group of the Technische Universiteit Eindhoven. FROG provided testing facilities including two omni-directional AGVs. Industrial AGVs are custom made for the transportation tasks at hand and come in a variety of forms. To reduce development times it is desirable to follow a model-based control design approach as this allows generalization to a broad class of vehicles. We have adopted rigid body modeling techniques from the ??eld of robotic manipulators to derive the equations of motion for the AGVs and load in a systematic way. These models are based on physical considerations such as Newton's second law and the positions and dimensions of the wheels, sensors, and actuators. Special emphasis is put on the modeling of the wheel-??oor interaction, for which we have adopted tire models that stem from the ??eld of vehicle dynamics. The resulting models have a clear physical interpretation and capture a large class of vehicles with arbitrary wheel con??gurations. This ensures us that the controllers, which are based on these models, are applicable to a broad class of vehicles. An important prerequisite for achieving smooth cooperative behavior is that the individual AGVs operate at the required accuracy. The performance of an individual AGV is directly related to the precision of the estimates for the odometric parameters, i.e. the effective wheel diameters and the offsets of the encoders that measure the steering angles of the wheels. Cooperative transportation applications will typically require AGVs that are highly maneuverable, which means that all the wheels of an individual AGV ahould be able to steer. Since there will be more than one steering angle encoder, the identi??cation of the odometric parameters is substantially more dif??cult for these omni-directional AGVs than for the mobile wheeled robots that are commonly seen in literature and laboratory settings. In this thesis we present a novel procedure for simultaneously estimating effective wheel diameters and steering angle encoder offsets by driving several pure circle segments. The validity of the tuning procedure is con??rmed by experiments with the two omni-directional test vehicles with varying loads. An interesting result is that the effective wheel diameters of the rubber wheels of our AGVs increase with increasing load. A crucial aspect in all control designs is the reconstruction of the to-be-controlled variables from measurement data. Our to-be-controlled variables are the planar motion of the load and the motions of the AGVs with respect to the load, which have to be reconstruct from the odometric sensor information. The odometric sensor information consists of the drive encoder and steering encoder readings. We analyzed the observability of an individual AGV and proved that it is theoretically possible to reconstruct its complete motion from the odometric measurements. Due to practical considerations, we pursued a more pragmatic least-squares based observer design. We show that the least-squares based motion estimate is independent of the coordinate system that is being used. The motion estimator was subsequently analyzed in a stochastic setting. The relation between the motion estimator and the estimated velocity of an arbitrary point on the vehicle was explored. We derived how the covariance of the velocity estimate of an arbitrary point on the vehicle is related to the covariance of the motion estimate. We proved that there is one unique point on the vehicle for which the covariance of the estimated velocity is minimal. Next, we investigated how the local motion estimates of the individual AGVs can be combined to yield one global estimate. When the load and AGVs are rigidly interconnected, it suf??ces that each AGVs broadcasts its local motion estimate and receives the estimates of the other AGVs. When the load is semi-rigidly interconnected to the AGVs, e.g. by means of revolute or prismatic joints, then generally each AGV needs to broadcasts the corresponding information matrix as well. We showed that the information matrix remains constant when the load is connected to the AGV with a revolute joint that is mounted at the aforementioned unique point with the smallest velocity estimate covariance. This means that the corresponding AGV does not have to broadcast its information matrix for this special situation. The key issue in the control design for cooperative transportation tasks is that the various AGVs must not counteract each others' actions. The decentralized controller that we derived makes the AGVs track an externally provided planar motion setpoint while minimizing the interconnection forces between the load and the vehicles. Although the control design is applicable to cooperative transportation by multiple AGVs with arbitrary semi-rigid AGV-load interconnections, it is noteworthy that a particularly elegant solution arises when all interconnections are completely rigid. Then the derived local controllers have the same structure as the controllers that are normally used for individual operation. As a result, changing a few parameter settings and providing the AGVs with identical setpoints is all that is required to achieve cooperative behavior on the velocity level for this situation. The observer and controller designs for the case that the AGVs are completely rigidly interconnected to the load were successfully implemented on the two test vehicles. Experi ments were carried out with and without a load that consisted of a pallet with 300 kg pave stones. The results were reproducible and illustrated the practical validity of the observer and controller designs. There were no substantial drawbacks when the local observers used only their local sensor information, which means that our setup can also operate satisfactory when the velocity estimates are not shared with the other vehicles
    corecore