Adaptive impedance control of robot manipulators based on Q-learning and disturbance observer

In this paper, an adaptive impedance control combined with disturbance observer (DOB) is developed for a general class of uncertain robot manipulators in discrete time. The impedance control is applied to realize the interaction force control of robot manipulators in unknown, time-varying environments. The optimal reference trajectory is produced by impedance control, and the impedance parameters are achieved using Q-learning technique, which is implemented based on trajectory tracking errors. The position control with DOB of robot manipulators is implemented to track the virtual desired trajectory, and the DOB is designed to compensate for unknown compounded disturbance function by bounding both tracking error inputs and compounded disturbance inputs in a permitted control region, of which the compounded disturbance function is taken into account of all uncertain terms and external disturbances. The appropriate DOB parameters are selected applying linear matrix inequalities (LMIs) method. Both the impedance control and the bounded DOB control can well guarantee semiglobal uniform boundness of the closed-loop robot systems based on Lyapunov analysis and Schur complement theory. Simulation results are performed to test and verify effectiveness of the investigated combining adaptive impedance control with DOB

An EMG-based force prediction and control approach for robot-assisted lower limb rehabilitation

This paper proposes an electromyography (EMG)-based method for online force prediction and control of a lower limb rehabilitation robot. Root mean square (RMS) features of EMG signals from four muscles of the lower limb are used as the inputs to a support vector regression (SVR) model to estimate the human-robot interaction force. The autoregressive algorithm is utilized to construct the relationship between EMG signals and the impact force. Combining the force prediction model with the position-based impedance controller, the robot can be controlled to track the desired force of the lower limb, and so as to achieve an adaptive and active rehabilitation mode, which is adaptable to the individual muscle strength and movement ability. Finally, the method was validated through experiments on a healthy subject. The results show that the EMG-based SVR model can predict the lower limb force accurately and the robot can be controlled to track the estimated force by using simplified impedance model

Force and impedance control for hydraulically driven hexapod robot walking on uneven terrain

A variety approach of multi-legged robot designs, especially on a large scale design with hydraulically driven actuators exist, but most of it still unsolved and used primitive techniques on control solutions. This made this area of research still far from demonstrating the scientific solutions, which is more towards developing and optimizing the algorithm, control technique and software engineering for practical locomotion (flexibility and reliability). Therefore in this thesis,the study is done to propose two categories of solution for statically stable and hydraulically driven hexapod robot, named COMET-IV, which are dynamic walking trajectory generation and force/impedance control implementation (during body start patching), in order to solve the stability problems (horizontal) that encountered when walking on extremely uneven terrains.Only three sensors are used for control feedback; potentiometers (each leg joint), pressure sensors (hydraulic cylinders) and attitude sensor (center of body). For dynamic walking trajectory generation, the fixed/determined of tripod walking trajectory is modified with force threshold-based, named as environment trailed trajectory (ETT),on each first step of foot during support phase (preliminary sensing uneven terrain surfaces). Moreover,the proposed dynamic trajectory generation is then upgraded with capability of omni-directional walking with a proposed center of body rotational-based method. The instability of using the ETT module alone and with proposed hybrid force/position control in the previous progress, during body patching on walking session is then solved using the proposed pull-back position-based force control (PPF). PPF controller is derived from the ETT module itself and supported by proposed compliant (switching) mechanism, logical attitude control and dynamic swing rising control. The limitation of PPF controller applied with ETT module for walking on uneven terrain contains extreme soft surface makes the study narrowed to the impedance control approaches as a replacement of PPF controller. Three new adaptive impedance controller are designed and proposed: Optimal single leg impedance control based on body inertia, Optimal center of mass—based impedance control based on body inertia and Single leg impedance control with self-tuning stiffness. To reduce the hard swinging/shaking of the robot's body in motion that arise after applying the proposed impedance controllers, fuzzy logic control via Takagaki-Sugeno-Kang (TSK) model is proposed to be cascaded on the input feedback of the controller.The study has verified the effectiveness of both categories of control unit (dynamic trajectory,force controller and impedance controllers) combination throughout several experiments of COMET-IV walking on uneven/unstructured terrains

An EMG-based force prediction and control approach for robot-assisted lower limb rehabilitation

This paper proposes an electromyography (EMG)-based method for online force prediction and control of a lower limb rehabilitation robot. Root mean square (RMS) features of EMG signals from four muscles of the lower limb are used as the inputs to a support vector regression (SVR) model to estimate the human-robot interaction force. The autoregressive algorithm is utilized to construct the relationship between EMG signals and the impact force. Combining the force prediction model with the position-based impedance controller, the robot can be controlled to track the desired force of the lower limb, and so as to achieve an adaptive and active rehabilitation mode, which is adaptable to the individual muscle strength and movement ability. Finally, the method was validated through experiments on a healthy subject. The results show that the EMG-based SVR model can predict the lower limb force accurately and the robot can be controlled to track the estimated force by using simplified impedance model

Reference adaptation for robots in physical interactions with unknown environments

In this paper, we propose a method of reference adaptation for robots in physical interactions with unknown environments. A cost function is constructed to describe the interaction performance, which combines trajectory tracking error and interaction force between the robot and the environment. It is minimized by the proposed reference adaptation based on trajectory parametrization and iterative learning. An adaptive impedance control is developed to make the robot be governed by the target impedance model. Simulation and experiment studies are conducted to verify the effectiveness of the proposed method

Design and Development of an Affordable Haptic Robot with Force-Feedback and Compliant Actuation to Improve Therapy for Patients with Severe Hemiparesis

The study describes the design and development of a single degree-of-freedom haptic robot, Haptic Theradrive, for post-stroke arm rehabilitation for in-home and clinical use. The robot overcomes many of the weaknesses of its predecessor, the TheraDrive system, that used a Logitech steering wheel as the haptic interface for rehabilitation. Although the original TheraDrive system showed success in a pilot study, its wheel was not able to withstand the rigors of use. A new haptic robot was developed that functions as a drop-in replacement for the Logitech wheel. The new robot can apply larger forces in interacting with the patient, thereby extending the functionality of the system to accommodate low-functioning patients. A new software suite offers appreciably more options for tailored and tuned rehabilitation therapies. In addition to describing the design of the hardware and software, the paper presents the results of simulation and experimental case studies examining the system\u27s performance and usability

Feasibility of Manual Teach-and-Replay and Continuous Impedance Shaping for Robotic Locomotor Training Following Spinal Cord Injury

Robotic gait training is an emerging technique for retraining walking ability following spinal cord injury (SCI). A key challenge in this training is determining an appropriate stepping trajectory and level of assistance for each patient, since patients have a wide range of sizes and impairment levels. Here, we demonstrate how a lightweight yet powerful robot can record subject-specific, trainer-induced leg trajectories during manually assisted stepping, then immediately replay those trajectories. Replay of the subject-specific trajectories reduced the effort required by the trainer during manual assistance, yet still generated similar patterns of muscle activation for six subjects with a chronic SCI. We also demonstrate how the impedance of the robot can be adjusted on a step-by-step basis with an error-based, learning law. This impedance-shaping algorithm adapted the robot's impedance so that the robot assisted only in the regions of the step trajectory where the subject consistently exhibited errors. The result was that the subjects stepped with greater variability, while still maintaining a physiologic gait pattern. These results are further steps toward tailoring robotic gait training to the needs of individual patients