Deep Haptic Model Predictive Control for Robot-Assisted Dressing

Robot-assisted dressing offers an opportunity to benefit the lives of many people with disabilities, such as some older adults. However, robots currently lack common sense about the physical implications of their actions on people. The physical implications of dressing are complicated by non-rigid garments, which can result in a robot indirectly applying high forces to a person's body. We present a deep recurrent model that, when given a proposed action by the robot, predicts the forces a garment will apply to a person's body. We also show that a robot can provide better dressing assistance by using this model with model predictive control. The predictions made by our model only use haptic and kinematic observations from the robot's end effector, which are readily attainable. Collecting training data from real world physical human-robot interaction can be time consuming, costly, and put people at risk. Instead, we train our predictive model using data collected in an entirely self-supervised fashion from a physics-based simulation. We evaluated our approach with a PR2 robot that attempted to pull a hospital gown onto the arms of 10 human participants. With a 0.2s prediction horizon, our controller succeeded at high rates and lowered applied force while navigating the garment around a persons fist and elbow without getting caught. Shorter prediction horizons resulted in significantly reduced performance with the sleeve catching on the participants' fists and elbows, demonstrating the value of our model's predictions. These behaviors of mitigating catches emerged from our deep predictive model and the controller objective function, which primarily penalizes high forces.Comment: 8 pages, 12 figures, 1 table, 2018 IEEE International Conference on Robotics and Automation (ICRA

Robotic exoskeleton control for lower limb rehabilitation of knee joint

Wearable devices such as exoskeletons are being opted frequently during rehabilitation processes for the post stroke recovery. Such de-vices are playing important role in the development of assistive rehabilitation robotic systems. In this paper three control strategies MPC and LQR and PID are introduced which were applied to knee joint of lower limb exoskeleton model for passive exercise. The two con-trols MPC and LQR are model based control which empowers them for stable responses. In this paper the analysis of robustness of con-trol is done under the noisy and disturbance conditions. The results showed good performance of the exoskeleton model with the applied controls in the provided condition. In the future work the applied controls will be implemented on hardware

A quantitative analysis of dressing dynamics for robotic dressing assistance

© 2017 Chance, Jevtić, Caleb-Solly and Dogramadzi. Assistive robots have a great potential to address issues related to an aging population and an increased demand for caregiving. Successful deployment of robots working in close proximity with people requires consideration of both safety and human-robot interaction (HRI). One of the established activities of daily living where robots could play an assistive role is dressing. Using the correct force profile for robot control will be essential in this application of HRI requiring careful exploration of factors related to the user's pose and the type of garments involved. In this paper, a Baxter robot was used to dress a jacket onto a mannequin and human participants considering several combinations of user pose and clothing type (base layers), while recording dynamic data from the robot, a load cell, and an IMU. We also report on suitability of these sensors for identifying dressing errors, e.g., fabric snagging. Data were analyzed by comparing the overlap of confidence intervals to determine sensitivity to dressing. We expand the analysis to include classification techniques such as decision tree and support vector machines using k-fold cross-validation. The 6-axis load cell successfully discriminated between clothing types with predictive model accuracies between 72 and 97%. Used independently, the IMU and Baxter sensors were insufficient to discriminate garment types with the IMU showing 40-72% accuracy, but when used in combination this pair of sensors achieved an accuracy similar to the more expensive load cell (98%). When observing dressing errors (snagging), Baxter's sensors and the IMU data demonstrated poor sensitivity but applying machine learning methods resulted in model with high predicative accuracy and low false negative rates (≤5%). The results show that the load cell could be used independently for this application with good accuracy but a combination of the lower cost sensors could also be used without a significant loss in precision, which will be a key element in the robot control architecture for safe HRI

Observer Sliding Mode Control Design for lower Exoskeleton system: Rehabilitation Case

Sliding mode (SM) has been selected as the controlling technique, and the state observer (SO) design is used as a component of active disturbance rejection control (ADRC) to reduce the knee position trajectory for therapeutic purposes. The suggested controller will improve the needed position performances for the Exoskeleton system when compared to the proportional-derivative controller (PD) and SMC as feed-forward in the ADRC approach, as shown theoretically and through computer simulations. Simulink tool is used in this comparison to analyze the nominal case and several disruption cases. The results of mathematical modeling and simulation studies demonstrated that SMC with a disturbance observer strategy performs better than the PD control system and SMC in feed-forward with a greater capacity to reject disturbances and significantly better than these controllers. Performance indices are used for numerical comparison to demonstrate the superiority of these controllers

Grasping Angle Estimation of Human Forearm with Underactuated Grippers Using Proprioceptive Feedback

In this paper, a method for the estimation of the angle of grasping of a human forearm, when grasped by a robot with an underactuated gripper, using proprioceptive information only, is presented. Knowing the angle around the forearm’s axis (i.e. roll angle) is key for the safe manipulation of the human limb and biomedical sensor placement among others. The adaptive gripper has two independent underactuated fingers with two phalanges and a single actuator each. The final joint position of the gripper provides information related to the shape of the grasped object without the need for external contact or force sensors. Regression methods to estimate the roll angle of the grasping have been trained with forearm grasping information from different humans at each angular position. The results show that it is possible to accurately estimate the rolling angle of the human arm, for trained and unknown people.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tec

Electromyography-Based Control of Lower Limb Prostheses: A Systematic Review

Most amputations occur in lower limbs and despite improvements in prosthetic technology, no commercially available prosthetic leg uses electromyography (EMG) information as an input for control. Efforts to integrate EMG signals as part of the control strategy have increased in the last decade. In this systematic review, we summarize the research in the field of lower limb prosthetic control using EMG. Four different online databases were searched until June 2022: Web of Science, Scopus, PubMed, and Science Direct. We included articles that reported systems for controlling a prosthetic leg (with an ankle and/or knee actuator) by decoding gait intent using EMG signals alone or in combination with other sensors. A total of 1,331 papers were initially assessed and 121 were finally included in this systematic review. The literature showed that despite the burgeoning interest in research, controlling a leg prosthesis using EMG signals remains challenging. Specifically, regarding EMG signal quality and stability, electrode placement, prosthetic hardware, and control algorithms, all of which need to be more robust for everyday use. In the studies that were investigated, large variations were found between the control methodologies, type of research participant, recording protocols, assessments, and prosthetic hardware

Neural feedback strategies to improve grasping coordination in neuromusculoskeletal prostheses

Conventional prosthetic arms suffer from poor controllability and lack of sensory feedback. Owing to the absence of tactile sensory information, prosthetic users must rely on incidental visual and auditory cues. In this study, we investigated the effect of providing tactile perception on motor coordination during routine grasping and grasping under uncertainty. Three transhumeral amputees were implanted with an osseointegrated percutaneous implant system for direct skeletal attachment and bidirectional communication with implanted neuromuscular electrodes. This neuromusculoskeletal prosthesis is a novel concept of artificial limb replacement that allows to extract control signals from electrodes implanted on viable muscle tissue, and to stimulate severed afferent nerve fibers to provide somatosensory feedback. Subjects received tactile feedback using three biologically inspired stimulation paradigms while performing a pick and lift test. The grasped object was instrumented to record grasping and lifting forces and its weight was either constant or unexpectedly changed in between trials. The results were also compared to the no-feedback control condition. Our findings confirm, in line with the neuroscientific literature, that somatosensory feedback is necessary for motor coordination during grasping. Our results also indicate that feedback is more relevant under uncertainty, and its effectiveness can be influenced by the selected neuromodulation paradigm and arguably also the prior experience of the prosthesis user

Assistive Care Robots

Assistive care robots have evolved rapidly in the last 25 years, bringing efficiency into the medical field. Purpose: Understand how assistive care robotics are presently helping in surgery, prosthetic and rehabilitation. Additionally, the effects they will have upon medical professionals within the next ten years. Methods: The team will research on past, present and future projects involving assistive care robotics. Posteriorly to the research, interviews were conducted with medical doctors, professors, and PhD researchers. Results: Assistive care robots are currently improving lives, and bringing efficiency to the medical field. Conclusions: Robots are improving lives of medical professionals and patients by serving as tools that enhance the ability of the users

Robotic Platforms for Assistance to People with Disabilities

People with congenital and/or acquired disabilities constitute a great number of dependents today. Robotic platforms to help people with disabilities are being developed with the aim of providing both rehabilitation treatment and assistance to improve their quality of life. A high demand for robotic platforms that provide assistance during rehabilitation is expected because of the health status of the world due to the COVID-19 pandemic. The pandemic has resulted in countries facing major challenges to ensure the health and autonomy of their disabled population. Robotic platforms are necessary to ensure assistance and rehabilitation for disabled people in the current global situation. The capacity of robotic platforms in this area must be continuously improved to benefit the healthcare sector in terms of chronic disease prevention, assistance, and autonomy. For this reason, research about human–robot interaction in these robotic assistance environments must grow and advance because this topic demands sensitive and intelligent robotic platforms that are equipped with complex sensory systems, high handling functionalities, safe control strategies, and intelligent computer vision algorithms. This Special Issue has published eight papers covering recent advances in the field of robotic platforms to assist disabled people in daily or clinical environments. The papers address innovative solutions in this field, including affordable assistive robotics devices, new techniques in computer vision for intelligent and safe human–robot interaction, and advances in mobile manipulators for assistive tasks