Switching in Feedforward Control of Grip Force During Tool-Mediated Interaction With Elastic Force Fields

Switched systems are common in artificial control systems. Here, we suggest that the brain adopts a switched feedforward control of grip forces during manipulation of objects. We measured how participants modulated grip force when interacting with soft and rigid virtual objects when stiffness varied continuously between trials. We identified a sudden phase transition between two forms of feedforward control that differed in the timing of the synchronization between the anticipated load force and the applied grip force. The switch occurred several trials after a threshold stiffness level in the range 100–200 N/m. These results suggest that in the control of grip force, the brain acts as a switching control system. This opens new research questions as to the nature of the discrete state variables that drive the switching

Neglect-Like Effects on Drawing Symmetry Induced by Adaptation to a Laterally Asymmetric Visuomotor Delay

In daily interactions, our sensorimotor system accounts for spatial and temporal discrepancies between the senses. Functional lateralization between hemispheres causes differences in attention and in the control of action across the left and right workspaces. In addition, differences in transmission delays between modalities affect movement control and internal representations. Studies on motor impairments such as hemispatial neglect syndrome suggested a link between lateral spatial biases and temporal processing. To understand this link, we computationally modeled and experimentally validated the effect of laterally asymmetric delay in visual feedback on motor learning and its transfer to the control of drawing movements without visual feedback. In the behavioral experiments, we asked healthy participants to perform lateral reaching movements while adapting to delayed visual feedback in either left, right, or both workspaces. We found that the adaptation transferred to blind drawing and caused movement elongation, which is consistent with a state representation of the delay. However, the pattern of the spatial effect varied between conditions: whereas adaptation to delay in only the left workspace or in the whole workspace caused selective leftward elongation, adaptation to delay in only the right workspace caused drawing elongation in both directions. We simulated arm movements according to different models of perceptual and motor spatial asymmetry in the representation of delay and found that the best model that accounts for our results combines both perceptual and motor asymmetry between the hemispheres. These results provide direct evidence for an asymmetrical processing of delayed visual feedback that is associated with both perceptual and motor biases that are similar to those observed in hemispatial neglect syndrome

An uncontrolled manifold analysis of arm joint variability in virtual planar position and orientation tele-manipulation

Objective: In teleoperated robot-assisted tasks, the user interacts with manipulators to finely control remote tools. Manipulation of robotic devices, characterized by specific kinematic and dynamic proprieties, is a complex task for the human sensorimotor system due to the inherent biomechanical and neuronal redundancies that characterize the human arm and its control. We investigate how master devices with different kinematics structures and how different task constraints influence users capabilities in exploiting arm redundancy. Methods: A virtual teleoperation workbench was designed and the arm kinematics of seven users was acquired during the execution of two planar virtual tasks, involving either the control of position only or position-orientation of a tool. Using the UnControlled Manifold Analysis of arm joint variability we estimated the logarithmic ratio between task irrelevant and the task relevant manifolds (Rv). Results: The Rv values obtained in the position-orientation task were higher than in the position only task while no differences were found between the master devices. A modulation of Rv was found through the execution of the position task and a positive correlation was found between task performance and redundancy exploitation. Conclusion: Users exploited additional portions of arm redundancy when dealing with the tool orientation. The Rv modulation seems influenced by the task constraints and by the users possibility of reconfiguring the arm position. Significance: This work advances the general understanding of the exploitation of arm redundancy in complex tasks, and can improve the development of future robotic devices

Tactile-STAR: A novel tactile STimulator And Recorder system for evaluating and improving tactile perception

Many neurological diseases impair the motor and somatosensory systems. While several different technologies are used in clinical practice to assess and improve motor functions, somatosensation is evaluated subjectively with qualitative clinical scales. Treatment of somatosensory deficits has received limited attention. To bridge the gap between the assessment and training of motor vs. somatosensory abilities, we designed, developed, and tested a novel, low-cost, two-component (bimanual) mechatronic system targeting tactile somatosensation: the Tactile-STAR\u2014a tactile stimulator and recorder. The stimulator is an actuated pantograph structure driven by two servomotors, with an end-effector covered by a rubber material that can apply two different types of skin stimulation: brush and stretch. The stimulator has a modular design, and can be used to test the tactile perception in different parts of the body such as the hand, arm, leg, big toe, etc. The recorder is a passive pantograph that can measure hand motion using two potentiometers. The recorder can serve multiple purposes: participants can move its handle to match the direction and amplitude of the tactile stimulator, or they can use it as a master manipulator to control the tactile stimulator as a slave. Our ultimate goal is to assess and affect tactile acuity and somatosensory deficits. To demonstrate the feasibility of our novel system, we tested the Tactile-STAR with 16 healthy individuals and with three stroke survivors using the skin-brush stimulation. We verified that the system enables the mapping of tactile perception on the hand in both populations. We also tested the extent to which 30 min of training in healthy individuals led to an improvement of tactile perception. The results provide a first demonstration of the ability of this new system to characterize tactile perception in healthy individuals, as well as a quantification of the magnitude and pattern of tactile impairment in a small cohort of stroke survivors. The finding that short-term training with Tactile-STAR can improve the acuity of tactile perception in healthy individuals suggests that Tactile-STAR may have utility as a therapeutic intervention for somatosensory deficits

Attention-based Robot Learning of Haptic Interaction

Moringen A, Fleer S, Walck G, Ritter H. Attention-based Robot Learning of Haptic Interaction. In: Nisky I, Hartcher-O’Brien J, Wiertlewski M, Smeets J, eds. Haptics: Science, Technology, Applications. 12th International Conference, EuroHaptics 2020, Leiden, The Netherlands, September 6–9, 2020, Proceedings. Lecture Notes in Computer Science. Vol 12272. Cham: Springer; 2020: 462-470.Haptic interaction involved in almost any physical interaction with the environment performed by humans is a highly sophisticated and to a large extent a computationally unmodelled process. Unlike humans, who seamlessly handle a complex mixture of haptic features and profit from their integration over space and time, even the most advanced robots are strongly constrained in performing contact-rich interaction tasks. In this work we approach the described problem by demonstrating the success of our online haptic interaction learning approach on an example task: haptic identification of four unknown objects. Building upon our previous work performed with a floating haptic sensor array, here we show functionality of our approach within a fully-fledged robot simulation. To this end, we utilize the haptic attention model (HAM), a meta-controller neural network architecture trained with reinforcement learning. HAM is able to learn to optimally parameterize a sequence of so-called haptic glances, primitive actions of haptic control derived from elementary human haptic interaction. By coupling a simulated KUKA robot arm with the haptic attention model, we pursue to mimic the functionality of a finger. Our modeling strategy allowed us to arrive at a tactile reinforcement learning architecture and characterize some of its advantages. Owing to a rudimentary experimental setting and an easy acquisition of simulated data, we believe our approach to be particularly useful for both time-efficient robot training and a flexible algorithm prototyping

Haptic Guidance and Haptic Error Amplification in a Virtual Surgical Robotic Training Environment

Teleoperated robotic systems have introduced more intuitive control for minimally invasive surgery, but the optimal method for training remains unknown. Recent motor learning studies have demonstrated that exaggeration of errors helps trainees learn to perform tasks with greater speed and accuracy. We hypothesized that training in a force field that pushes the operator away from a desired path would improve their performance on a virtual reality ring-on-wire task. Forty surgical novices trained under a no-force, guidance, or error-amplifying force field over five days. Completion time, translational and rotational path error, and combined error-time were evaluated under no force field on the final day. The groups significantly differed in combined error-time, with the guidance group performing the worst. Error-amplifying field participants showed the most improvement and did not plateau in their performance during training, suggesting that learning was still ongoing. Guidance field participants had the worst performance on the final day, confirming the guidance hypothesis. Participants with high initial path error benefited more from guidance. Participants with high initial combined error-time benefited more from guidance and error-amplifying force field training. Our results suggest that error-amplifying and error-reducing haptic training for robot-assisted telesurgery benefits trainees of different abilities differently.Comment: 11 pages, 7 Figure, Under Revie