Learning and Reacting with Inaccurate Prediction: Applications to Autonomous Excavation

Motivated by autonomous excavation, this work investigates solutions to a class of problem where disturbance prediction is critical to overcoming poor performance of a feedback controller, but where the disturbance prediction is intrinsically inaccurate. Poor feedback controller performance is related to a fundamental control problem: there is only a limited amount of disturbance rejection that feedback compensation can provide. It is known, however, that predictive action can improve the disturbance rejection of a control system beyond the limitations of feedback. While prediction is desirable, the problem in excavation is that disturbance predictions are prone to error due to the variability and complexity of soil-tool interaction forces. This work proposes the use of iterative learning control to map the repetitive components of excavation forces into feedforward commands. Although feedforward action shows useful to improve excavation performance, the non-repetitive nature of soil-tool interaction forces is a source of inaccurate predictions. To explicitly address the use of imperfect predictive compensation, a disturbance observer is used to estimate the prediction error. To quantify inaccuracy in prediction, a feedforward model of excavation disturbances is interpreted as a communication channel that transmits corrupted disturbance previews, for which metrics based on the sensitivity function exist. During field trials the proposed method demonstrated the ability to iteratively achieve a desired dig geometry, independent of the initial feasibility of the excavation passes in relation to actuator saturation. Predictive commands adapted to different soil conditions and passes were repeated autonomously until a pre-specified finish quality of the trench was achieved. Evidence of improvement in disturbance rejection is presented as a comparison of sensitivity functions of systems with and without the use of predictive disturbance compensation

Modeling, Control and Estimation of Reconfigurable Cable Driven Parallel Robots

The motivation for this thesis was to develop a cable-driven parallel robot (CDPR) as part of a two-part robotic device for concrete 3D printing. This research addresses specific research questions in this domain, chiefly, to present advantages offered by the addition of kinematic redundancies to CDPRs. Due to the natural actuation redundancy present in a fully constrained CDPR, the addition of internal mobility offers complex challenges in modeling and control that are not often encountered in literature. This work presents a systematic analysis of modeling such kinematic redundancies through the application of reciprocal screw theory (RST) and Lie algebra while further introducing specific challenges and drawbacks presented by cable driven actuators. It further re-contextualizes well-known performance indices such as manipulability, wrench closure quality, and the available wrench set for application with reconfigurable CDPRs. The existence of both internal redundancy and static redundancy in the joint space offers a large subspace of valid solutions that can be condensed through the selection of appropriate objective priorities, constraints or cost functions. Traditional approaches to such redundancy resolution necessitate computationally expensive numerical optimization. The control of both kinematic and actuation redundancies requires cascaded control frameworks that cannot easily be applied towards real-time control. The selected cost functions for numerical optimization of rCDPRs can be globally (and sometimes locally) non-convex. In this work we present two applied examples of redundancy resolution control that are unique to rCDPRs. In the first example, we maximize the directional wrench ability at the end-effector while minimizing the joint torque requirement by utilizing the fitness of the available wrench set as a constraint over wrench feasibility. The second example focuses on directional stiffness maximization at the end-effector through a variable stiffness module (VSM) that partially decouples the tension and stiffness. The VSM introduces an additional degrees of freedom to the system in order to manipulate both reconfigurability and cable stiffness independently. The controllers in the above examples were designed with kinematic models, but most CDPRs are highly dynamic systems which can require challenging feedback control frameworks. An approach to real-time dynamic control was implemented in this thesis by incorporating a learning-based frameworks through deep reinforcement learning. Three approaches to rCDPR training were attempted utilizing model-free TD3 networks. Robustness and safety are critical features for robot development. One of the main causes of robot failure in CDPRs is due to cable breakage. This not only causes dangerous dynamic oscillations in the workspace, but also leads to total robot failure if the controllability (due to lack of cables) is lost. Fortunately, rCDPRs can be utilized towards failure tolerant control for task recovery. The kinematically redundant joints can be utilized to help recover the lost degrees of freedom due to cable failure. This work applies a Multi-Model Adaptive Estimation (MMAE) framework to enable online and automatic objective reprioritization and actuator retasking. The likelihood of cable failure(s) from the estimator informs the mixing of the control inputs from a bank of feedforward controllers. In traditional rigid body robots, safety procedures generally involve a standard emergency stop procedure such as actuator locking. Due to the flexibility of cable links, the dynamic oscillations of the end-effector due to cable failure must be actively dampened. This work incorporates a Linear Quadratic Regulator (LQR) based feedback stabilizer into the failure tolerant control framework that works to stabilize the non-linear system and dampen out these oscillations. This research contributes to a growing, but hitherto niche body of work in reconfigurable cable driven parallel manipulators. Some outcomes of the multiple engineering design, control and estimation challenges addressed in this research warrant further exploration and study that are beyond the scope of this thesis. This thesis concludes with a thorough discussion of the advantages and limitations of the presented work and avenues for further research that may be of interest to continuing scholars in the community

Robust Control of Nonlinear Systems with applications to Aerial Manipulation and Self Driving Cars

This work considers the problem of planning and control of robots in an environment with obstacles and external disturbances. The safety of robots is harder to achieve when planning in such uncertain environments. We describe a robust control scheme that combines three key components: system identification, uncertainty propagation, and trajectory optimization. Using this control scheme we tackle three problems. First, we develop a Nonlinear Model Predictive Controller (NMPC) for articulated rigid bodies and apply it to an aerial manipulation system to grasp object mid-air. Next, we tackle the problem of obstacle avoidance under unknown external disturbances. We propose two approaches, the first approach using adaptive NMPC with open- loop uncertainty propagation and the second approach using Tube NMPC. After that, we introduce dynamic models which use Artificial Neural Networks (ANN) and combine them with NMPC to control a ground vehicle and an aerial manipulation system. Finally, we introduce a software framework for integrating the above algorithms to perform complex tasks. The software framework provides users with the ability to design systems that are robust to control and hardware failures where preventive action is taken before-hand. The framework also allows for safe testing of control and task logic in simulation before evaluating on the real robot. The software framework is applied to an aerial manipulation system to perform a package sorting task, and extensive experiments demonstrate the ability of the system to recover from failures. In addition to robust control, we present two related control problems. The first problem pertains to designing an obstacle avoidance controller for an underactuated system that is Lyapunov stable. We extend a standard gyroscopic obstacle avoidance controller to be applicable to an underactuated system. The second problem addresses the navigation of an Unmanned Ground Vehicle (UGV) on an unstructured terrain. We propose using NMPC combined with a high fidelity physics engine to generate a reference trajectory that is dynamically feasible and accounts for unsafe areas in the terrain

Controlling a contactless planar actuator with manipulator

An existing magnetically levitated planar actuator with manipulator has been studied and improved from a control point of view. This prototype consists of a magnetically levitated six-degree-of-freedom (6-DOF) planar actuator with moving magnets, with a 2-DOF manipulator on top of it. This system contains three different contactless technologies: contactless bearing and propulsion of the planar actuator, wireless powering of the manipulator, and wireless communication and control of the manipulator. The planar actuator (PA) consists of a Halbach magnet array, which is levitated and controlled in all six DOF’s above a stationary coil array. The PA is propelled in two horizontal translational DOF’s while the other four DOF’s are stabilized to accomplish a stiff bearing. Each active coil contributes to the production of forces and torques acting on the magnet array. Since the number of active coils is much larger than the number of DOF’s, the desired force production can be distributed over many coils. Therefore, a commutation algorithm has to be used to invert the mapping of the forces and torques exerted by the set of active coils as a function of the coil currents and the position and orientation of the translator. One method for linearization and decoupling of the forces and torques was developed in the past. The method is called direct wrench decoupling and guaranties minimal dissipation of energy. However, no constraints on the maximum current can be given. This study proposes two novel, norm-based commutation methods: l8-norm and clipped l2-norm based commutation. Both methods can put bounds on the maximum currents in the coils to prevent saturation of the current amplifiers. The first method focuses on minimization of the maximum current whereas the second method limits the peak current while it minimizes the power losses. Consequently, a higher acceleration of the translator can be achieved and/or less powerful (cheaper) current amplifiers can be utilized and/or fewer commutation errors arise. Only a long-stroke translational movement of the moving magnet planar actuators has been considered in the past. The possibility of a completely propelled and controlled rotation about the vertical axis instead of just stabilizing it for bearing has been analyzed in this thesis from a control point of view. Enhancing the planar actuator with a long-range rotation will increase its utility value and opens new application areas. Based on this investigation, a novel coil array with a triangular grid of rounded coils has been proposed for better controllability in any orientation of the PA. In addition, other coil and magnet topologies have been studied from a control point of view for their suitability for full rotation. The influence of different kinds of error-causes on the commutation precision has been studied. From this investigation, it has been found that the offsets of the measurement system have the highest influence on the precision of the commutation. Investigation of the convergence of the procedure for estimation and elimination of these offsets has been performed. Although it was not proven that the procedure could be applied on the whole workspace of the PA, the convergence has been shown at least for all the investigated points. From this investigation, convergence for any position in the workspace of the PA is expected. It was found that it is possible to use the procedure also with different topologies and with different commutations. A novel wireless link has been developed for the real-time control of a fast motion system. The wireless link communicates via infrared-light transceivers and the link has a delay and a packet-loss ratio almost indistinguishable from the wired connection for the bandwidth of the system up to several kilohertz. The clipped l2-norm based commutation method has been successfully tested on the experimental setup after improving the measurement system, the contactless energy transfer and the wireless communication. With a new, interferometer sensor system, a well-controlled PA with two long-stroke DOF’s has become available. Improved contactless energy transfer does not cause increased electromagnetic interference during switching between the primary coils any more and the wireless connection using the infrared link provides a reliable communication channel between the manipulator and the fixed world. Several control approaches have been tested on the experimental setup. Both, the classical PID control, Sliding-mode control and Iterative learning control have been implemented. Each controller brought better performance than the previous one. Also, a fourth-order trajectory and enhanced feedforward control helped to improve performance. Finally, the tracking errors, in comparison to the initial situation, were reduced by a factor 10 (and even more than by a factor 50 with deactivated contactless energy transfer) while the velocity and acceleration of the system were a factor 4 and 14, respectively, higher

Visual Servoing

The goal of this book is to introduce the visional application by excellent researchers in the world currently and offer the knowledge that can also be applied to another field widely. This book collects the main studies about machine vision currently in the world, and has a powerful persuasion in the applications employed in the machine vision. The contents, which demonstrate that the machine vision theory, are realized in different field. For the beginner, it is easy to understand the development in the vision servoing. For engineer, professor and researcher, they can study and learn the chapters, and then employ another application method

Model-Based Robot Control and Multiprocessor Implementation

Model-based control of robot manipulators has been gaining momentum in recent years. Unfortunately there are very few experimental validations to accompany simulation results and as such majority of conclusions drawn lack the credibility associated with the real control implementation

Robotic Trajectory Tracking: Position- and Force-Control

This thesis employs a bottom-up approach to develop robust and adaptive learning algorithms for trajectory tracking: position and torque control. In a first phase, the focus is put on the following of a freeform surface in a discontinuous manner. Next to resulting switching constraints, disturbances and uncertainties, the case of unknown robot models is addressed. In a second phase, once contact has been established between surface and end effector and the freeform path is followed, a desired force is applied. In order to react to changing circumstances, the manipulator needs to show the features of an intelligent agent, i.e. it needs to learn and adapt its behaviour based on a combination of a constant interaction with its environment and preprogramed goals or preferences. The robotic manipulator mimics the human behaviour based on bio-inspired algorithms. In this way it is taken advantage of the know-how and experience of human operators as their knowledge is translated in robot skills. A selection of promising concepts is explored, developed and combined to extend the application areas of robotic manipulators from monotonous, basic tasks in stiff environments to complex constrained processes. Conventional concepts (Sliding Mode Control, PID) are combined with bio-inspired learning (BELBIC, reinforcement based learning) for robust and adaptive control. Independence of robot parameters is guaranteed through approximated robot functions using a Neural Network with online update laws and model-free algorithms. The performance of the concepts is evaluated through simulations and experiments. In complex freeform trajectory tracking applications, excellent absolute mean position errors (<0.3 rad) are achieved. Position and torque control are combined in a parallel concept with minimized absolute mean torque errors (<0.1 Nm)

Industrial Robotics

This book covers a wide range of topics relating to advanced industrial robotics, sensors and automation technologies. Although being highly technical and complex in nature, the papers presented in this book represent some of the latest cutting edge technologies and advancements in industrial robotics technology. This book covers topics such as networking, properties of manipulators, forward and inverse robot arm kinematics, motion path-planning, machine vision and many other practical topics too numerous to list here. The authors and editor of this book wish to inspire people, especially young ones, to get involved with robotic and mechatronic engineering technology and to develop new and exciting practical applications, perhaps using the ideas and concepts presented herein