Adaptive impedance control of robot manipulators based on Q-learning and disturbance observer

In this paper, an adaptive impedance control combined with disturbance observer (DOB) is developed for a general class of uncertain robot manipulators in discrete time. The impedance control is applied to realize the interaction force control of robot manipulators in unknown, time-varying environments. The optimal reference trajectory is produced by impedance control, and the impedance parameters are achieved using Q-learning technique, which is implemented based on trajectory tracking errors. The position control with DOB of robot manipulators is implemented to track the virtual desired trajectory, and the DOB is designed to compensate for unknown compounded disturbance function by bounding both tracking error inputs and compounded disturbance inputs in a permitted control region, of which the compounded disturbance function is taken into account of all uncertain terms and external disturbances. The appropriate DOB parameters are selected applying linear matrix inequalities (LMIs) method. Both the impedance control and the bounded DOB control can well guarantee semiglobal uniform boundness of the closed-loop robot systems based on Lyapunov analysis and Schur complement theory. Simulation results are performed to test and verify effectiveness of the investigated combining adaptive impedance control with DOB

A generalised proportional-derivative force/vision controller for torque-driven planar robotic manipulators

summary:In this paper, a family of hybrid control algorithms is presented; where it is merged a free camera-calibration image-based control scheme and a direct force controller, both with the same priority level. The aim of this generalised hybrid controller is to regulate the robot-environment interaction into a two-dimensional task-space. The design of the proposed control structure takes into account most of the dynamic effects present in robot manipulators whose inputs are torque signals. As examples of this generalised structure of hybrid force/vision controllers, a linear proportional-derivative structure and a nonlinear proportional-derivative one (based on the hyperbolic tangent function) are presented. The corresponding stability analysis, using Lyapunov's direct method and invariance theory, is performed to proof the asymptotic stability of the equilibrium vector of the closed-loop system. Experimental tests of the control scheme are presented and a suitable performance is observed in all the cases. Unlike most of the previously presented hybrid schemes, the control structure proposed herein achieves soft contact forces without overshoots, fast convergence of force and position error signals, robustness of the controller in the face of some uncertainties (such as camera rotation), and safe operation of the robot actuators when saturating functions (non-linear case) are used in the mathematical structure. This is one of the first works to propose a generalized structure of hybrid force/vision control that includes a closed loop stability analysis for torque-driven robot manipulators

Applied Joint-Space Torque and Stiffness Control of Tendon-Driven Fingers

Existing tendon-driven fingers have applied force control through independent tension controllers on each tendon, i.e. in the tendon-space. The coupled kinematics of the tendons, however, cause such controllers to exhibit a transient coupling in their response. This problem can be resolved by alternatively framing the controllers in the joint-space of the manipulator. This work presents a joint-space torque control law that demonstrates both a decoupled and significantly faster response than an equivalent tendon-space formulation. The law also demonstrates greater speed and robustness than comparable PI controllers. In addition, a tension distribution algorithm is presented here to allocate forces from the joints to the tendons. It allocates the tensions so that they satisfy both an upper and lower bound, and it does so without requiring linear programming or open-ended iterations. The control law and tension distribution algorithm are implemented on the robotic hand of Robonaut-2

Cooperative impedance control with time-varying stiffness

The focus of much automation research has been to design controllers and robots that safely interact with the environment. One approach is to use impedance control to specify a relationship between a robot\u27s motion and force and control a grasped object\u27s apparent stiffness, damping, and inertia. Conventional impedance control practices have focused on position-based manipulators - which are inherently non-compliant - using constant, task-dependent impedances. In the event of large trajectory tracking errors, this implementation method generates large interaction forces that can damage the workcell. Additionally, these position-based devices require dedicated force/torque sensors to measure and apply forces. In this paper, we present an alternative impedance controller implemented on cooperating torque-based manipulators. Through the use of time-varying impedance parameters, this controller limits the interaction forces to ensure harmless manipulation. Successful completion of transport and insertion tasks demonstrated the effectiveness of the controller

Intelligent control of nonlinear systems with actuator saturation using neural networks

Common actuator nonlinearities such as saturation, deadzone, backlash, and hysteresis are unavoidable in practical industrial control systems, such as computer numerical control (CNC) machines, xy-positioning tables, robot manipulators, overhead crane mechanisms, and more. When the actuator nonlinearities exist in control systems, they may exhibit relatively large steady-state tracking error or even oscillations, cause the closed-loop system instability, and degrade the overall system performance. Proportional-derivative (PD) controller has observed limit cycles if the actuator nonlinearity is not compensated well. The problems are particularly exacerbated when the required accuracy is high, as in micropositioning devices. Due to the non-analytic nature of the actuator nonlinear dynamics and the fact that the exact actuator nonlinear functions, namely operation uncertainty, are unknown, the saturation compensation research is a challenging and important topic with both theoretical and practical significance. Adaptive control can accommodate the system modeling, parametric, and environmental structural uncertainties. With the universal approximating property and learning capability of neural network (NN), it is appealing to develop adaptive NN-based saturation compensation scheme without explicit knowledge of actuator saturation nonlinearity. In this dissertation, intelligent anti-windup saturation compensation schemes in several scenarios of nonlinear systems are investigated. The nonlinear systems studied within this dissertation include the general nonlinear system in Brunovsky canonical form, a second order multi-input multi-output (MIMO) nonlinear system such as a robot manipulator, and an underactuated system-flexible robot system. The abovementioned methods assume the full states information is measurable and completely known. During the NN-based control law development, the imposed actuator saturation is assumed to be unknown and treated as the system input disturbance. The schemes that lead to stability, command following and disturbance rejection is rigorously proved, and verified using the nonlinear system models. On-line NN weights tuning law, the overall closed-loop performance, and the boundedness of the NN weights are rigorously derived and guaranteed based on Lyapunov approach. The NN saturation compensator is inserted into a feedforward path. The simulation conducted indicates that the proposed schemes can effectively compensate for the saturation nonlinearity in the presence of system uncertainty

Advanced Strategies for Robot Manipulators

Amongst the robotic systems, robot manipulators have proven themselves to be of increasing importance and are widely adopted to substitute for human in repetitive and/or hazardous tasks. Modern manipulators are designed complicatedly and need to do more precise, crucial and critical tasks. So, the simple traditional control methods cannot be efficient, and advanced control strategies with considering special constraints are needed to establish. In spite of the fact that groundbreaking researches have been carried out in this realm until now, there are still many novel aspects which have to be explored

A new learning controller for periodic disturbance rejection

A new acceleration based learning control approach is developed to tackle the robust periodic trajectory tracking problem for robot manipulators. The acceleration feedback is incorporated into the learning feedforward term to provide high stiffness to the system against unknown periodic dynamics with a known period. A cascaded high gain observer is used to obtain reliable position, velocity and acceleration signals from noisy encoder measurements. A closed-loop stability proof is provided where it is shown that all system signals remain bounded and the proposed learning controller achieves global asymptotic position tracking. Simulation results obtained from a high fidelity model show that the proposed controller outperforms the learning controller that does not utilize the acceleration feedback