A Framework of Hybrid Force/Motion Skills Learning for Robots

Human factors and human-centred design philosophy are highly desired in today’s robotics applications such as human-robot interaction (HRI). Several studies showed that endowing robots of human-like interaction skills can not only make them more likeable but also improve their performance. In particular, skill transfer by imitation learning can increase usability and acceptability of robots by the users without computer programming skills. In fact, besides positional information, muscle stiffness of the human arm, contact force with the environment also play important roles in understanding and generating human-like manipulation behaviours for robots, e.g., in physical HRI and tele-operation. To this end, we present a novel robot learning framework based on Dynamic Movement Primitives (DMPs), taking into consideration both the positional and the contact force profiles for human-robot skills transferring. Distinguished from the conventional method involving only the motion information, the proposed framework combines two sets of DMPs, which are built to model the motion trajectory and the force variation of the robot manipulator, respectively. Thus, a hybrid force/motion control approach is taken to ensure the accurate tracking and reproduction of the desired positional and force motor skills. Meanwhile, in order to simplify the control system, a momentum-based force observer is applied to estimate the contact force instead of employing force sensors. To deploy the learned motion-force robot manipulation skills to a broader variety of tasks, the generalization of these DMP models in actual situations is also considered. Comparative experiments have been conducted using a Baxter Robot to verify the effectiveness of the proposed learning framework on real-world scenarios like cleaning a table

A passivity-based strategy for manual corrections in human-robot coaching

In recent years, new programming techniques have been developed in the human-robot collaboration (HRC) field. For example, walk-through programming allows to program the robot in an easy and intuitive way. In this context, a modification of a portion of the trajectory usually requires the teaching of the path from the beginning. In this paper we propose a passivity-based method to locally change a trajectory based on a manual human correction. At the beginning the robot follows the nominal trajectory, encoded through the Dynamical Movement Primitives, by setting high control gains. When the human grasps the end-effector, the robot is made compliant and he/she can drive it along the correction. The correction is optimally joined to the nominal trajectory, resuming the path tracking. In order to avoid unstable behaviors, the variation of the control gains is performed exploiting energy tanks, preserving the passivity of the interaction. Finally, the correction is spatially fixed so that a variation in the boundary conditions (e.g., the initial/final points) does not affect the modification

Learning to Avoid Obstacles With Minimal Intervention Control

Programming by demonstration has received much attention as it offers a general framework which allows robots to efficiently acquire novel motor skills from a human teacher. While traditional imitation learning that only focuses on either Cartesian or joint space might become inappropriate in situations where both spaces are equally important (e.g., writing or striking task), hybrid imitation learning of skills in both Cartesian and joint spaces simultaneously has been studied recently. However, an important issue which often arises in dynamical or unstructured environments is overlooked, namely how can a robot avoid obstacles? In this paper, we aim to address the problem of avoiding obstacles in the context of hybrid imitation learning. Specifically, we propose to tackle three subproblems: (i) designing a proper potential field so as to bypass obstacles, (ii) guaranteeing joint limits are respected when adjusting trajectories in the process of avoiding obstacles, and (iii) determining proper control commands for robots such that potential human-robot interaction is safe. By solving the aforementioned subproblems, the robot is capable of generalizing observed skills to new situations featuring obstacles in a feasible and safe manner. The effectiveness of the proposed method is validated through a toy example as well as a real transportation experiment on the iCub humanoid robot

Dynamic movement primitives: volumetric obstacle avoidance

Dynamic Movement Primitives (DMPs) are a framework for learning a trajectory from a demonstration. The trajectory can be learned efficiently after only one demonstration, and it is immediate to adapt it to new goal positions and time duration. Moreover, the trajectory is also robust against perturbations. However, obstacle avoidance for DMPs is still an open problem. In this work, we propose an extension of DMPs to support volumetric obstacle avoidance based on the use of superquadric potentials. We show the advantages of this approach when obstacles have known shape, and we extend it to unknown objects using minimal enclosing ellipsoids. A simulation and experiments with a real robot validate the framework, and we make freely available our implementation

Dynamic Movement Primitives: Volumetric Obstacle Avoidance Using Dynamic Potential Functions

Obstacle avoidance for DMPs is still a challenging problem. In our previous work, we proposed a framework for obstacle avoidance based on superquadric potential functions to represent volumes. In this work, we extend our previous work to include the velocity of the trajectory in the definition of the potential. Our formulations guarantee smoother behavior with respect to state-of-the-art point-like methods. Moreover, our new formulation allows to obtain a smoother behavior in proximity of the obstacle than when using a static (i.e. velocity independent) potential. We validate our framework for obstacle avoidance in a simulated multi-robot scenario and with different real robots: a pick-and-place task for an industrial manipulator and a surgical robot to show scalability; and navigation with a mobile robot in dynamic environment.Comment: Preprint for Journal of Intelligent and Robotic System

A Learning from demonstration approach for robot trajectories through motion-sensing human demonstrations

The objective of this thesis is to teach a Baxter robot to learn certain arm trajectories. The robot must be capable of generalizing the primitive movement of the trajectory to new unseen poses. The thesis is framed within a robotized kitchen project with aims to help people with mobility problems. To solve this problem end, a human will record demonstrations, which will be translated to the robots’ morphology using an Inverse Kinematics (IK) module. For the learning part Dynamic Movement Primitives (DMP) will be used, due to their capability to take profit of human experience. The proposed system works in the majority of the scenarios, but, it would be expected to behave better when generalizing to new orientations of the arm. However a proposal has been suggested to correct this issue

Recovering from External Disturbances in Online Manipulation through State-Dependent Revertive Recovery Policies

Robots are increasingly entering uncertain and unstructured environments. Within these, robots are bound to face unexpected external disturbances like accidental human or tool collisions. Robots must develop the capacity to respond to unexpected events. That is not only identifying the sudden anomaly, but also deciding how to handle it. In this work, we contribute a recovery policy that allows a robot to recovery from various anomalous scenarios across different tasks and conditions in a consistent and robust fashion. The system organizes tasks as a sequence of nodes composed of internal modules such as motion generation and introspection. When an introspection module flags an anomaly, the recovery strategy is triggered and reverts the task execution by selecting a target node as a function of a state dependency chart. The new skill allows the robot to overcome the effects of the external disturbance and conclude the task. Our system recovers from accidental human and tool collisions in a number of tasks. Of particular importance is the fact that we test the robustness of the recovery system by triggering anomalies at each node in the task graph showing robust recovery everywhere in the task. We also trigger multiple and repeated anomalies at each of the nodes of the task showing that the recovery system can consistently recover anywhere in the presence of strong and pervasive anomalous conditions. Robust recovery systems will be key enablers for long-term autonomy in robot systems. Supplemental info including code, data, graphs, and result analysis can be found at [1].Comment: 8 pages, 8 figures, 1 tabl

Learning of Surgical Gestures for Robotic Minimally Invasive Surgery Using Dynamic Movement Primitives and Latent Variable Models

Full and partial automation of Robotic Minimally Invasive Surgery holds significant promise to improve patient treatment, reduce recovery time, and reduce the fatigue of the surgeons. However, to accomplish this ambitious goal, a mathematical model of the intervention is needed. In this thesis, we propose to use Dynamic Movement Primitives (DMPs) to encode the gestures a surgeon has to perform to achieve a task. DMPs allow to learn a trajectory, thus imitating the dexterity of the surgeon, and to execute it while allowing to generalize it both spatially (to new starting and goal positions) and temporally (to different speeds of executions). Moreover, they have other desirable properties that make them well suited for surgical applications, such as online adaptability, robustness to perturbations, and the possibility to implement obstacle avoidance. We propose various modifications to improve the state-of-the-art of the framework, as well as novel methods to handle obstacles. Moreover, we validate the usage of DMPs to model gestures by automating a surgical-related task and using DMPs as the low-level trajectory generator. In the second part of the thesis, we introduce the problem of unsupervised segmentation of tasks' execution in gestures. We will introduce latent variable models to tackle the problem, proposing further developments to combine such models with the DMP theory. We will review the Auto-Regressive Hidden Markov Model (AR-HMM) and test it on surgical-related datasets. Then, we will propose a generalization of the AR-HMM to general, non-linear, dynamics, showing that this results in a more accurate segmentation, with a less severe over-segmentation. Finally, we propose a further generalization of the AR-HMM that aims at integrating a DMP-like dynamic into the latent variable model

Development of lower-limb rehabilitation exercises using 3-PRS Parallel Robot and Dynamic Movement Primitives

[EN] The design of rehabilitation exercises applied to sprained ankles requires extreme caution, regarding the trajectories and the speed of the movements that will affect the patient. This paper presents a technique that allows a 3-PRS parallel robot to control such exercises, consisting of dorsi/plantar flexion and inversion/eversion ankle movements. The work includes a position control scheme for the parallel robot in order to follow a reference trajectory for each limb with the possibility of stopping the exercise in mid-execution without control loss. This stop may be motivated by the forces that the robot applies to the patient, acting like an alarm mechanism. The procedure introduced here is based on Dynamic Movement Primitives (DMPs).This work has been partially funded by FEDER-CICYT project with reference DPI2017-84201-R financed by Ministerio de Economía, Industria e Innovación (Spain).Escarabajal Sánchez, RJ.; Abu Dakka, FJM.; Pulloquinga Zapata, J.; Mata Amela, V.; Vallés Miquel, M.; Valera Fernández, Á. (2020). Development of lower-limb rehabilitation exercises using 3-PRS Parallel Robot and Dynamic Movement Primitives. Multidisciplinary Journal for Education, Social and Technological Sciences. 7(2):30-44. https://doi.org/10.4995/muse.2020.13907OJS304472Abu-Dakka, F. J., Valera, A., Escalera, J. A., Vallés, M., Mata, V., & Abderrahim, M. (2015). Trajectory adaptation and learning for ankle rehabilitation using a 3-PRS parallel robot. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9245, 483-494. https://doi.org/10.1007/978-3-319-22876-1_41Atkeson, C. G., Moore, A. W., & Schaal, S. (1997). Locally Weighted Learning. Artificial Intelligence Review, 11(1-5), 11-73. https://doi.org/10.1007/978-94-017-2053-3_2Brockett, C. L., & Chapman, G. J. (2016). Biomechanics of the ankle. Orthopaedics and Trauma, 30(3), 232-238. https://doi.org/10.1016/j.mporth.2016.04.015Dai, J. S., Zhao, T., & Nester, C. (2004). Sprained Ankle Physiotherapy Based Mechanism Synthesis and Stiffness Analysis of a Robotic Rehabilitation Device. Autonomous Robots, 16(2), 207-218. https://doi.org/10.1023/B:AURO.0000016866.80026.d7Díaz-Rodríguez, M., Mata, V., Valera, Á., & Page, Á. (2010). A methodology for dynamic parameters identification of 3-DOF parallel robots in terms of relevant parameters. Mechanism and Machine Theory, 45(9), 1337-1356. https://doi.org/10.1016/j.mechmachtheory.2010.04.007Díaz, I., Gil, J. J., & Sánchez, E. (2011). Lower-Limb Robotic Rehabilitation: Literature Review and Challenges. Journal of Robotics, 2011(i), 1-11. https://doi.org/10.1155/2011/759764Fanger, Y., Umlauft, J., & Hirche, S. (2016). Gaussian Processes for Dynamic Movement Primitives with application in knowledge-based cooperation. IEEE International Conference on Intelligent Robots and Systems, 2016-Novem, 3913-3919. https://doi.org/10.1109/IROS.2016.7759576Gosselin, C., & Angeles, J. (1990). Singularity Analysis of Closed-Loop Kinematic Chains. IEEE Transactions on Robotics and Automation, 6(3), 281-290. https://doi.org/10.1109/70.56660Hesse, S., & Uhlenbrock, D. (2000). A mechanized gait trainer for restoration of gait. Journal of Rehabilitation Research and Development, 37(6), 701-708.Ijspeert, A. J., Nakanishi, J., Hoffmann, H., Pastor, P., & Schaal, S. (2013). Dynamical movement primitives: Learning attractor models formotor behaviors. Neural Computation, 25(2), 328-373. https://doi.org/10.1162/NECO_a_00393Ijspeert, A. J., Nakanishi, J., & Schaal, S. (2002). Movement imitation with nonlinear dynamical systems in humanoid robots. Proceedings - IEEE International Conference on Robotics and Automation, 2, 1398-1403. https://doi.org/10.1109/ROBOT.2002.1014739Liu, G., Gao, J., Yue, H., Zhang, X., & Lu, G. (2006). Design and kinematics simulation of parallel robots for ankle rehabilitation. 2006 IEEE International Conference on Mechatronics and Automation, ICMA 2006, 2006, 1109-1113. https://doi.org/10.1109/ICMA.2006.257780Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Schaal, S., & Kawato, M. (2004). Learning from demonstration and adaptation of biped locomotion. Robotics and Autonomous Systems, 47(2-3), 79-91. https://doi.org/10.1016/j.robot.2004.03.003Nemec, B., & Ude, A. (2012). Action sequencing using dynamic movement primitives. Robotica, 30(5), 837-846. https://doi.org/10.1017/S0263574711001056Patel, Y. D., & George, P. M. (2012). Parallel Manipulators Applications-A Survey. Modern Mechanical Engineering, 02(03), 57-64. https://doi.org/10.4236/mme.2012.23008Paul, R. P. (1981). Robot Manipulators: Mathematics, Programming, and Control : the Computer Control of Robot Manipulators (p. 279).Reinkensmeyer, D. J., Aoyagi, D., Emken, J. L., Galvez, J. A., Ichinose, W., Kerdanyan, G., Maneekobkunwong, S., Minakata, K., Nessler, J. A., Weber, R., Roy, R. R., De Leon, R., Bobrow, J. E., Harkema, S. J., & Reggie Edgerton, V. (2006). Tools for understanding and optimizing robotic gait training. Journal of Rehabilitation Research and Development, 43(5), 657-670. https://doi.org/10.1682/JRRD.2005.04.0073Safran, M. R., Benedetti, R. S., Bartolozzi, A. R., & Mandelbaum, B. R. (1999). Lateral ankle sprains: A comprehensive review part 1: Etiology, pathoanatomy, histopathogenesis, and diagnosis. In Medicine and Science in Sports and Exercise (Vol. 31, Issue 7 SUPPL., pp. S429-S437).https://doi.org/10.1097/00005768-199907001-00004Saglia, J. A., Tsagarakis, N. G., Dai, J. S., & Caldwell, D. G. (2013). Control strategies for patient-assisted training using the ankle rehabilitation robot (ARBOT). IEEE/ASME Transactions on Mechatronics, 18(6), 1799-1808. https://doi.org/10.1109/TMECH.2012.2214228Schaal, S. (2006). Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics. In Adaptive Motion of Animals and Machines (pp. 261-280). https://doi.org/10.1007/4-431-31381-8_23Sui, P., Yao, L., Lin, Z., Yan, H., & Dai, J. S. (2009). Analysis and synthesis of ankle motion and rehabilitation robots. 2009 IEEE International Conference on Robotics and Biomimetics, ROBIO 2009, 3, 2533-2538. https://doi.org/10.1109/ROBIO.2009.5420487Tsoi, Y. H., Xie, S. Q., & Graham, A. E. (2009). Design, modeling and control of an ankle rehabilitation robot. Studies in Computational Intelligence, 177, 377-399. https://doi.org/10.1007/978-3-540-89933-4_18Vallés, M., Díaz-Rodrguez, M., Valera, Á., Mata, V., & Page, Á. (2012). Mechatronic development and dynamic control of a 3-dof parallel manipulator. Mechanics Based Design of Structures and Machines, 40(4), 434-452. https://doi.org/10.1080/15397734.2012.687292Xie, S. (2016). Advanced robotics for medical rehabilitation: current state of the art and recent advances. In Springer tracts in advanced robotics (Issue 108). https://doi.org/10.1007/978-3-319-19896-5Yoon, J., Ryu, J., & Lim, K. B. (2006). Reconfigurable ankle rehabilitation robot for various exercises. Journal of Robotic Systems, 22(SUPPL.), 15-33. https://doi.org/10.1002/rob.2015