Human Like Adaptation of Force and Impedance in Stable and Unstable Tasks

Abstract—This paper presents a novel human-like learning con-troller to interact with unknown environments. Strictly derived from the minimization of instability, motion error, and effort, the controller compensates for the disturbance in the environment in interaction tasks by adapting feedforward force and impedance. In contrast with conventional learning controllers, the new controller can deal with unstable situations that are typical of tool use and gradually acquire a desired stability margin. Simulations show that this controller is a good model of human motor adaptation. Robotic implementations further demonstrate its capabilities to optimally adapt interaction with dynamic environments and humans in joint torque controlled robots and variable impedance actuators, with-out requiring interaction force sensing. Index Terms—Feedforward force, human motor control, impedance, robotic control. I

Human-Like Impedance and Minimum Effort Control for Natural and Efficient Manipulation

Humans incorporate and switch between learnt neuromotor strategies while performing complex tasks. Towards this purpose, kinematic redundancy is exploited in order to achieve optimized performance. Inspired by the superior motor skills of humans, in this paper, we investigate a combined free motion and interaction controller in a certain class of robotic manipulation. In this bimodal controller, kinematic degrees of redundancy are adapted according to task-suitable dynamic costs. The proposed algorithm attributes high priority to minimum-effort controller while performing point to point free space movements. Once the robot comes in contact with the environment, the Tele-Impedance, common mode and configuration dependent stiffness (CMS-CDS) controller will replicate the human’s estimated endpoint stiffness and measured equilibrium position profiles in the slave robotic arm, in real-time. Results of the proposed controller in contact with the environment are compared with the ones derived from Tele-Impedance implemented using torque based classical Cartesian stiffness control. The minimum-effort and interaction performance achieved highlights the possibility of adopting human-like and sophisticated strategies in humanoid robots or the ones with adequate degrees of redundancy, in order to accomplish tasks in a certain class of robotic manipulatio

Mechanisms of motor learning: by humans, for robots

Whenever we perform a movement and interact with objects in our environment, our central nervous system (CNS) adapts and controls the redundant system of muscles actuating our limbs to produce suitable forces and impedance for the interaction. As modern robots are increasingly used to interact with objects, humans and other robots, they too require to continuously adapt the interaction forces and impedance to the situation. This thesis investigated the motor mechanisms in humans through a series of technical developments and experiments, and utilized the result to implement biomimetic motor behaviours on a robot. Original tools were first developed, which enabled two novel motor imaging experiments using functional magnetic resonance imaging (fMRI). The first experiment investigated the neural correlates of force and impedance control to understand the control structure employed by the human brain. The second experiment developed a regressor free technique to detect dynamic changes in brain activations during learning, and applied this technique to investigate changes in neural activity during adaptation to force fields and visuomotor rotations. In parallel, a psychophysical experiment investigated motor optimization in humans in a task characterized by multiple error-effort optima. Finally a computational model derived from some of these results was implemented to exhibit human like control and adaptation of force, impedance and movement trajectory in a robot

A versatile biomimetic controller for contact tooling and haptic exploration

International audienceThis article presents a versatile controller that enables various contact tooling tasks with minimal prior knowledge of the tooled surface. The controller is derived from results of neuroscience studies that investigated the neural mechanisms utilized by humans to control and learn complex interactions with the environment. We demonstrate here the versatility of this controller in simulations of cutting, drilling and surface exploration tasks, which would normally require different control paradigms. We also present results on the exploration of an unknown surface with a 7-DOF manipulator, where the robot builds a 3D surface map of the surface profile and texture while applying constant force during motion. Our controller provides a unified control framework encompassing behaviors expected from the different specialized control paradigms like position control, force control and impedance control

Concept of an exoskeleton for industrial applications with modulated impedance based on Electromyographic signal recorded from the operator

The introduction of an active exoskeleton that enhances the operator power in the manufacturing field was demonstrated in literature to lead to beneficial effects in terms of reducing fatiguing and the occurrence of musculo-skeletal diseases. However, a large number of manufacturing operations would not benefit from power increases because it rather requires the modulation of the operator stiffness. However, in literature, considerably less attention was given to those robotic devices that regulate their stiffness based on the operator stiffness, even if their introduction in the line would aid the operator during different manipulations respect with the exoskeletons with variable power. In this thesis the description of the command logic of an exoskeleton for manufacturing applications, whose stiffness is modulated based on the operator stiffness, is described. Since the operator stiffness cannot be mechanically measured without deflecting the limb, an estimation based on the superficial Electromyographic signal is required. A model composed of 1 joint and 2 antagonist muscles was developed to approximate the elbow and the wrist joints. Each muscle was approximated as the Hill model and the analysis of the joint stiffness, at different joint angle and muscle activations, was performed. The same Hill muscle model was then implemented in a 2 joint and 6 muscles (2J6M) model which approximated the elbow-shoulder system. Since the estimation of the exerted stiffness with a 2J6M model would be quite onerous in terms of processing time, the estimation of the operator end-point stiffness in realtime would therefore be questionable. Then, a linear relation between the end-point stiffness and the component of muscle activation that does not generate any end-point force, is proposed. Once the stiffness the operator exerts was estimated, three command logics that identifies the stiffness the exoskeleton is required to exert are proposed. These proposed command logics are: Proportional, Integral 1 s, and Integral 2 s. The stiffening exerted by a device in which a Proportional logic is implemented is proportional, sample by sample, to the estimated stiffness exerted by the operator. The stiffening exerted by the exoskeleton in which an Integral logic is implemented is proportional to the stiffness exerted by the operator, averaged along the previous 1 second (Integral 1 s) or 2 seconds (Integral 2 s). The most effective command logic, among the proposed ones, was identified with empirical tests conducted on subjects using a wrist haptic device (the Hi5, developed by the Bioengineering group of the Imperial College of London). The experimental protocol consisted in a wrist flexion/extension tracking task with an external perturbation, alternated with isometric force exertion for the estimation of the occurrence of the fatigue. The fatigue perceived by the subject, the tracking error, defined as the RMS of the difference between wrist and target angles, and the energy consumption, defined as the sum of the squared signals recorded from two antagonist muscles, indicated the Integral 1 s logic to be the most effective for controlling the exoskeleton. A logistic relation between the stiffness exerted by the subject and the stiffness exerted by the robotic devices was selected, because it assured a smooth transition between the maximum and the minimum stiffness the device is required to exert. However, the logistic relation parameters are subject-specific, therefore an experimental estimation is required. An example was provided. Finally, the literature about variable stiffness actuators was analyzed to identify the most suitable device for exoskeleton stiffness modulation. This actuator is intended to be integrated on an existing exoskeleton that already enhances the operator power based on the operator Electromyographic signal. The identified variable stiffness actuator is the DLR FSJ, which controls its stiffness modulating the preload of a single spring

Spinal circuits can accommodate interaction torques during multijoint limb movements

The dynamic interaction of limb segments during movements that involve multiple joints creates torques in one joint due to motion about another. Evidence shows that such interaction torques are taken into account during the planning or control of movement in humans. Two alternative hypotheses could explain the compensation of these dynamic torques. One involves the use of internal models to centrally compute predicted interaction torques and their explicit compensation through anticipatory adjustment of descending motor commands. The alternative, based on the equilibrium-point hypothesis, claims that descending signals can be simple and related to the desired movement kinematics only, while spinal feedback mechanisms are responsible for the appropriate creation and coordination of dynamic muscle forces. Partial supporting evidence exists in each case. However, until now no model has explicitly shown, in the case of the second hypothesis, whether peripheral feedback is really sufficient on its own for coordinating the motion of several joints while at the same time accommodating intersegmental interaction torques. Here we propose a minimal computational model to examine this question. Using a biomechanics simulation of a two-joint arm controlled by spinal neural circuitry, we show for the first time that it is indeed possible for the neuromusculoskeletal system to transform simple descending control signals into muscle activation patterns that accommodate interaction forces depending on their direction and magnitude. This is achieved without the aid of any central predictive signal. Even though the model makes various simplifications and abstractions compared to the complexities involved in the control of human arm movements, the finding lends plausibility to the hypothesis that some multijoint movements can in principle be controlled even in the absence of internal models of intersegmental dynamics or learned compensatory motor signals.This work is funded by the project "eSMCs: Extending Sensorimotor Contingencies to Cognition," FP7-ICT-2009-6 no: 270212

Stabilization Strategies for Unstable Dynamics

Background: When humans are faced with an unstable task, two different stabilization mechanisms are possible: a highstiffness strategy, based on the inherent elastic properties of muscles/tools/manipulated objects, or a low-stiffness strategy, based on an explicit positional feedback mechanism. Specific constraints related to the dynamics of the task and/or the neuromuscular system often force people to adopt one of these two strategies. Methodology/Findings: This experiment was designed such that subjects could achieve stability using either strategy, with a marked difference in terms of effort and control requirements between the two strategies. The task was to balance a virtual mass in an unstable environment via two elastic linkages that connected the mass to each hand. The dynamics of the mass under the influence of the unstable force field and the forces applied through the linkages were simulated using a bimanual, planar robot. The two linkages were non-linear, with a stiffness that increased with the amount of stretch. The mass could be stabilized by stretching the linkages to achieve a stiffness that was greater than the instability coefficient of the unstable field (high-stiffness), or by balancing the mass with sequences of small force impulses (low-stiffness). The results showed that 62 % of the subjects quickly adopted the high-stiffness strategy, with stiffness ellipses that were aligned along the direction of instability. The remaining subjects applied the low-stiffness strategy, with no clear preference for the orientation of the stiffness ellipse

Development and Biomechanical Analysis toward a Mechanically Passive Wearable Shoulder Exoskeleton

Shoulder disability is a prevalent health issue associated with various orthopedic and neurological conditions, like rotator cuff tear and peripheral nerve injury. Many individuals with shoulder disability experience mild to moderate impairment and struggle with elevating the shoulder or holding the arm against gravity. To address this clinical need, I have focused my research on developing wearable passive exoskeletons that provide continuous at-home movement assistance. Through a combination of experiments and computational tools, I aim to optimize the design of these exoskeletons. In pursuit of this goal, I have designed, fabricated, and preliminarily evaluated a wearable, passive, cam-driven shoulder exoskeleton prototype. Notably, the exoskeleton features a modular spring-cam-wheel module, allowing customizable assistive force to compensate for different proportions of the shoulder elevation moment due to gravity. The results of my research demonstrated that this exoskeleton, providing modest one-fourth gravity moment compensation at the shoulder, can effectively reduce muscle activity, including deltoid and rotator cuff muscles. One crucial aspect of passive shoulder exoskeleton design is determining the optimal anti-gravity assistance level. I have addressed this challenge using computational tools and found that an assistance level within the range of 20-30% of the maximum gravity torque at the shoulder joint yields superior performance for specific shoulder functional tasks. When facing a new task dynamic, such as wearing a passive shoulder exoskeleton, the human neuro-musculoskeletal system adapts and modulates limb impedance at the end-limb (i.e., hand) to enhance task stability. I have presented development and validation of a realistic neuromusculoskeletal model of the upper limb that can predict stiffness modulation and motor adaptation in response to newly introduced environments and force fields. Future studies will explore the model\u27s applicability in predicting stiffness modulation for 3D movements in novel environments, such as passive assistive devices\u27 force fields