Modeling, Control and Estimation of Reconfigurable Cable Driven Parallel Robots

The motivation for this thesis was to develop a cable-driven parallel robot (CDPR) as part of a two-part robotic device for concrete 3D printing. This research addresses specific research questions in this domain, chiefly, to present advantages offered by the addition of kinematic redundancies to CDPRs. Due to the natural actuation redundancy present in a fully constrained CDPR, the addition of internal mobility offers complex challenges in modeling and control that are not often encountered in literature. This work presents a systematic analysis of modeling such kinematic redundancies through the application of reciprocal screw theory (RST) and Lie algebra while further introducing specific challenges and drawbacks presented by cable driven actuators. It further re-contextualizes well-known performance indices such as manipulability, wrench closure quality, and the available wrench set for application with reconfigurable CDPRs. The existence of both internal redundancy and static redundancy in the joint space offers a large subspace of valid solutions that can be condensed through the selection of appropriate objective priorities, constraints or cost functions. Traditional approaches to such redundancy resolution necessitate computationally expensive numerical optimization. The control of both kinematic and actuation redundancies requires cascaded control frameworks that cannot easily be applied towards real-time control. The selected cost functions for numerical optimization of rCDPRs can be globally (and sometimes locally) non-convex. In this work we present two applied examples of redundancy resolution control that are unique to rCDPRs. In the first example, we maximize the directional wrench ability at the end-effector while minimizing the joint torque requirement by utilizing the fitness of the available wrench set as a constraint over wrench feasibility. The second example focuses on directional stiffness maximization at the end-effector through a variable stiffness module (VSM) that partially decouples the tension and stiffness. The VSM introduces an additional degrees of freedom to the system in order to manipulate both reconfigurability and cable stiffness independently. The controllers in the above examples were designed with kinematic models, but most CDPRs are highly dynamic systems which can require challenging feedback control frameworks. An approach to real-time dynamic control was implemented in this thesis by incorporating a learning-based frameworks through deep reinforcement learning. Three approaches to rCDPR training were attempted utilizing model-free TD3 networks. Robustness and safety are critical features for robot development. One of the main causes of robot failure in CDPRs is due to cable breakage. This not only causes dangerous dynamic oscillations in the workspace, but also leads to total robot failure if the controllability (due to lack of cables) is lost. Fortunately, rCDPRs can be utilized towards failure tolerant control for task recovery. The kinematically redundant joints can be utilized to help recover the lost degrees of freedom due to cable failure. This work applies a Multi-Model Adaptive Estimation (MMAE) framework to enable online and automatic objective reprioritization and actuator retasking. The likelihood of cable failure(s) from the estimator informs the mixing of the control inputs from a bank of feedforward controllers. In traditional rigid body robots, safety procedures generally involve a standard emergency stop procedure such as actuator locking. Due to the flexibility of cable links, the dynamic oscillations of the end-effector due to cable failure must be actively dampened. This work incorporates a Linear Quadratic Regulator (LQR) based feedback stabilizer into the failure tolerant control framework that works to stabilize the non-linear system and dampen out these oscillations. This research contributes to a growing, but hitherto niche body of work in reconfigurable cable driven parallel manipulators. Some outcomes of the multiple engineering design, control and estimation challenges addressed in this research warrant further exploration and study that are beyond the scope of this thesis. This thesis concludes with a thorough discussion of the advantages and limitations of the presented work and avenues for further research that may be of interest to continuing scholars in the community

Stochastic optimal control with learned dynamics models

The motor control of anthropomorphic robotic systems is a challenging computational task mainly because of the high levels of redundancies such systems exhibit. Optimality principles provide a general strategy to resolve such redundancies in a task driven fashion. In particular closed loop optimisation, i.e., optimal feedback control (OFC), has served as a successful motor control model as it unifies important concepts such as costs, noise, sensory feedback and internal models into a coherent mathematical framework. Realising OFC on realistic anthropomorphic systems however is non-trivial: Firstly, such systems have typically large dimensionality and nonlinear dynamics, in which case the optimisation problem becomes computationally intractable. Approximative methods, like the iterative linear quadratic gaussian (ILQG), have been proposed to avoid this, however the transfer of solutions from idealised simulations to real hardware systems has proved to be challenging. Secondly, OFC relies on an accurate description of the system dynamics, which for many realistic control systems may be unknown, difficult to estimate, or subject to frequent systematic changes. Thirdly, many (especially biologically inspired) systems suffer from significant state or control dependent sources of noise, which are difficult to model in a generally valid fashion. This thesis addresses these issues with the aim to realise efficient OFC for anthropomorphic manipulators. First we investigate the implementation of OFC laws on anthropomorphic hardware. Using ILQG we optimally control a high-dimensional anthropomorphic manipulator without having to specify an explicit inverse kinematics, inverse dynamics or feedback control law. We achieve this by introducing a novel cost function that accounts for the physical constraints of the robot and a dynamics formulation that resolves discontinuities in the dynamics. The experimental hardware results reveal the benefits of OFC over traditional (open loop) optimal controllers in terms of energy efficiency and compliance, properties that are crucial for the control of modern anthropomorphic manipulators. We then propose a new framework of OFC with learned dynamics (OFC-LD) that, unlike classic approaches, does not rely on analytic dynamics functions but rather updates the internal dynamics model continuously from sensorimotor plant feedback. We demonstrate how this approach can compensate for unknown dynamics and for complex dynamic perturbations in an online fashion. A specific advantage of a learned dynamics model is that it contains the stochastic information (i.e., noise) from the plant data, which corresponds to the uncertainty in the system. Consequently one can exploit this information within OFC-LD in order to produce control laws that minimise the uncertainty in the system. In the domain of antagonistically actuated systems this approach leads to improved motor performance, which is achieved by co-contracting antagonistic actuators in order to reduce the negative effects of the noise. Most importantly the shape and source of the noise is unknown a priory and is solely learned from plant data. The model is successfully tested on an antagonistic series elastic actuator (SEA) that we have built for this purpose. The proposed OFC-LD model is not only applicable to robotic systems but also proves to be very useful in the modelling of biological motor control phenomena and we show how our model can be used to predict a wide range of human impedance control patterns during both, stationary and adaptation tasks

Locomoção bípede adaptativa a partir de uma única demonstração usando primitivas de movimento

Doutoramento em Engenharia EletrotécnicaEste trabalho aborda o problema de capacidade de imitação da locomoção humana através da utilização de trajetórias de baixo nível codificadas com primitivas de movimento e utilizá-las para depois generalizar para novas situações, partindo apenas de uma demonstração única. Assim, nesta linha de pensamento, os principais objetivos deste trabalho são dois: o primeiro é analisar, extrair e codificar demonstrações efetuadas por um humano, obtidas por um sistema de captura de movimento de forma a modelar tarefas de locomoção bípede. Contudo, esta transferência não está limitada à simples reprodução desses movimentos, requerendo uma evolução das capacidades para adaptação a novas situações, assim como lidar com perturbações inesperadas. Assim, o segundo objetivo é o desenvolvimento e avaliação de uma estrutura de controlo com capacidade de modelação das ações, de tal forma que a demonstração única apreendida possa ser modificada para o robô se adaptar a diversas situações, tendo em conta a sua dinâmica e o ambiente onde está inserido. A ideia por detrás desta abordagem é resolver o problema da generalização a partir de uma demonstração única, combinando para isso duas estruturas básicas. A primeira consiste num sistema gerador de padrões baseado em primitivas de movimento utilizando sistemas dinâmicos (DS). Esta abordagem de codificação de movimentos possui propriedades desejáveis que a torna ideal para geração de trajetórias, tais como a possibilidade de modificar determinados parâmetros em tempo real, tais como a amplitude ou a frequência do ciclo do movimento e robustez a pequenas perturbações. A segunda estrutura, que está embebida na anterior, é composta por um conjunto de osciladores acoplados em fase que organizam as ações de unidades funcionais de forma coordenada. Mudanças em determinadas condições, como o instante de contacto ou impactos com o solo, levam a modelos com múltiplas fases. Assim, em vez de forçar o movimento do robô a situações pré-determinadas de forma temporal, o gerador de padrões de movimento proposto explora a transição entre diferentes fases que surgem da interação do robô com o ambiente, despoletadas por eventos sensoriais. A abordagem proposta é testada numa estrutura de simulação dinâmica, sendo que várias experiências são efetuadas para avaliar os métodos e o desempenho dos mesmos.This work addresses the problem of learning to imitate human locomotion actions through low-level trajectories encoded with motion primitives and generalizing them to new situations from a single demonstration. In this line of thought, the main objectives of this work are twofold: The first is to analyze, extract and encode human demonstrations taken from motion capture data in order to model biped locomotion tasks. However, transferring motion skills from humans to robots is not limited to the simple reproduction, but requires the evaluation of their ability to adapt to new situations, as well as to deal with unexpected disturbances. Therefore, the second objective is to develop and evaluate a control framework for action shaping such that the single-demonstration can be modulated to varying situations, taking into account the dynamics of the robot and its environment. The idea behind the approach is to address the problem of generalization from a single-demonstration by combining two basic structures. The first structure is a pattern generator system consisting of movement primitives learned and modelled by dynamical systems (DS). This encoding approach possesses desirable properties that make them well-suited for trajectory generation, namely the possibility to change parameters online such as the amplitude and the frequency of the limit cycle and the intrinsic robustness against small perturbations. The second structure, which is embedded in the previous one, consists of coupled phase oscillators that organize actions into functional coordinated units. The changing contact conditions plus the associated impacts with the ground lead to models with multiple phases. Instead of forcing the robot’s motion into a predefined fixed timing, the proposed pattern generator explores transition between phases that emerge from the interaction of the robot system with the environment, triggered by sensor-driven events. The proposed approach is tested in a dynamics simulation framework and several experiments are conducted to validate the methods and to assess the performance of a humanoid robot

On the intrinsic control properties of muscle and relexes: exploring the interaction between neural and musculoskeletal dynamics in the framework of the equilbrium-point hypothesis

The aim of this thesis is to examine the relationship between the intrinsic dynamics of the body and its neural control. Specifically, it investigates the influence of musculoskeletal properties on the control signals needed for simple goal-directed movements in the framework of the equilibriumpoint (EP) hypothesis. To this end, muscle models of varying complexity are studied in isolation and when coupled to feedback laws derived from the EP hypothesis. It is demonstrated that the dynamical landscape formed by non-linear musculoskeletal models features a stable attractor in joint space whose properties, such as position, stiffness and viscosity, can be controlled through differential- and co-activation of antagonistic muscles. The emergence of this attractor creates a new level of control that reduces the system’s degrees of freedom and thus constitutes a low-level motor synergy. It is described how the properties of this stable equilibrium, as well as transient movement dynamics, depend on the various modelling assumptions underlying the muscle model. The EP hypothesis is then tested on a chosen musculoskeletal model by using an optimal feedback control approach: genetic algorithm optimisation is used to identify feedback gains that produce smooth single- and multijoint movements of varying amplitude and duration. The importance of different feedback components is studied for reproducing invariants observed in natural movement kinematics. The resulting controllers are demonstrated to cope with a plausible range of reflex delays, predict the use of velocity-error feedback for the fastest movements, and suggest that experimentally observed triphasic muscle bursts are an emergent feature rather than centrally planned. Also, control schemes which allow for simultaneous control of movement duration and distance are identified. Lastly, it is shown that the generic formulation of the EP hypothesis fails to account for the interaction torques arising in multijoint movements. Extensions are proposed which address this shortcoming while maintaining its two basic assumptions: control signals in positional rather than force-based frames of reference; and the primacy of control properties intrinsic to the body over internal models. It is concluded that the EP hypothesis cannot be rejected for single- or multijoint reaching movements based on claims that predicted movement kinematics are unrealistic

Proceedings of the NASA Conference on Space Telerobotics, volume 3

The theme of the Conference was man-machine collaboration in space. The Conference provided a forum for researchers and engineers to exchange ideas on the research and development required for application of telerobotics technology to the space systems planned for the 1990s and beyond. The Conference: (1) provided a view of current NASA telerobotic research and development; (2) stimulated technical exchange on man-machine systems, manipulator control, machine sensing, machine intelligence, concurrent computation, and system architectures; and (3) identified important unsolved problems of current interest which can be dealt with by future research

Advancing Musculoskeletal Robot Design for Dynamic and Energy-Efficient Bipedal Locomotion

Achieving bipedal robot locomotion performance that approaches human performance is a challenging research topic in the field of humanoid robotics, requiring interdisciplinary expertise from various disciplines, including neuroscience and biomechanics. Despite the remarkable results demonstrated by current humanoid robots---they can walk, stand, turn, climb stairs, carry a load, push a cart---the versatility, stability, and energy efficiency of humans have not yet been achieved. However, with robots entering our lives, whether in the workplace, in clinics, or in normal household environments, such improvements are increasingly important. The current state of research in bipedal robot locomotion reveals that several groups have continuously demonstrated enhanced locomotion performance of the developed robots. But each of these groups has taken a unilateral approach and placed the focus on only one aspect, in order to achieve enhanced movement abilities;---for instance, the motion control and postural stability or the mechanical design. The neural and mechanical systems in human and animal locomotion, however, are strongly coupled and should therefore not be treated separately. Human-inspired musculoskeletal design of bipedal robots offers great potential for enhanced dynamic and energy-efficient locomotion but also imposes major challenges for motion planning and control. In this thesis, we first present a detailed review of the problems related to achieving enhanced dynamic and energy-efficient bipedal locomotion, from various important perspectives, and examine the essential properties of the human locomotory apparatus. Subsequently, existing insights and approaches from biomechanics, to understand the neuromechanical motion apparatus, and from robotics, to develop more human-like robots that can move in our environment, are discussed in detail. These thorough investigations of the interrelated essential design decisions are used to develop a novel design for a musculoskeletal bipedal robot, BioBiped1, such that, in the long term, it is capable of realizing dynamic hopping, running, and walking motions. The BioBiped1 robot features a highly compliant tendon-driven actuation system that mimics key functionalities of the human lower limb system. In experiments, BioBiped1's locomotor function for the envisioned gaits is validated globally. It is shown that the robot is able to rebound passively, store and release energy, and actively push off from the ground. The proof of concept of BioBiped1's locomotor function, however, marks only the starting point for our investigations, since this novel design concept opens up a number of questions regarding the required design complexity for the envisioned motions and the appropriate motion generation and control concept. For this purpose, a simulator specifically designed for the requirements of musculoskeletally actuated robotic systems, including sufficiently realistic ground reaction forces, is developed. It relies on object-oriented design and is based on a numerical solver, without model switching, to enable the analysis of impact peak forces and the simulation of flight phases. The developed library also contains the models of the actuated and passive mono- and biarticular elastic tendons and a penalty-based compliant contact model with nonlinear damping, to incorporate the collision, friction, and stiction forces occurring during ground contact. Using these components, the full multibody system (MBS) dynamics model is developed. To ensure a sufficiently similar behavior of the simulated and the real musculoskeletal robot, various measurements and parameter identifications for sub-models are performed. Finally, it is shown that the simulation model behaves similarly to the real robot platform. The intelligent combination of actuated and passive mono- and biarticular tendons, imitating important human muscle groups, offers tremendous potential for improved locomotion performance but also requires a sophisticated concept for motion control of the robot. Therefore, a further contribution of this thesis is the development of a centralized, nonlinear model-based method for motion generation and control that utilizes the derived detailed dynamics models of the implemented actuators. The concept is used to realize both computer-generated hopping and human jogging motions. Additionally, the problem of appropriate motor-gear unit selection prior to the robot's construction is tackled, using this method. The thesis concludes with a number of simulation studies in which several leg actuation designs are examined for their optimality with regard to systematically selected performance criteria. Furthermore, earlier paradoxical biomechanical findings about biarticular muscles in running are presented and, for the first time, investigated by detailed simulation of the motion dynamics. Exploring the Lombard paradox, a novel reduced and energy-efficient locomotion model without knee extensor has been simulated successfully. The models and methods developed within this thesis, as well as the insights gained, are already being employed to develop future prototypes. In particular, the optimal dimensioning and setting of the actuators, including all mono- and biarticular muscle-tendon units, are based on the derived design guidelines and are extensively validated by means of the simulation models and the motion control method. These developments are expected to significantly enhance progress in the field of bipedal robot design and, in the long term, to drive improvements in rehabilitation for humans through an understanding of the neuromechanics underlying human walking and the application of this knowledge to the design of prosthetics

Contemporary Robotics

This book book is a collection of 18 chapters written by internationally recognized experts and well-known professionals of the field. Chapters contribute to diverse facets of contemporary robotics and autonomous systems. The volume is organized in four thematic parts according to the main subjects, regarding the recent advances in the contemporary robotics. The first thematic topics of the book are devoted to the theoretical issues. This includes development of algorithms for automatic trajectory generation using redudancy resolution scheme, intelligent algorithms for robotic grasping, modelling approach for reactive mode handling of flexible manufacturing and design of an advanced controller for robot manipulators. The second part of the book deals with different aspects of robot calibration and sensing. This includes a geometric and treshold calibration of a multiple robotic line-vision system, robot-based inline 2D/3D quality monitoring using picture-giving and laser triangulation, and a study on prospective polymer composite materials for flexible tactile sensors. The third part addresses issues of mobile robots and multi-agent systems, including SLAM of mobile robots based on fusion of odometry and visual data, configuration of a localization system by a team of mobile robots, development of generic real-time motion controller for differential mobile robots, control of fuel cells of mobile robots, modelling of omni-directional wheeled-based robots, building of hunter- hybrid tracking environment, as well as design of a cooperative control in distributed population-based multi-agent approach. The fourth part presents recent approaches and results in humanoid and bioinspirative robotics. It deals with design of adaptive control of anthropomorphic biped gait, building of dynamic-based simulation for humanoid robot walking, building controller for perceptual motor control dynamics of humans and biomimetic approach to control mechatronic structure using smart materials

Novel Bidirectional Body - Machine Interface to Control Upper Limb Prosthesis

Objective. The journey of a bionic prosthetic user is characterized by the opportunities and limitations involved in adopting a device (the prosthesis) that should enable activities of daily living (ADL). Within this context, experiencing a bionic hand as a functional (and, possibly, embodied) limb constitutes the premise for mitigating the risk of its abandonment through the continuous use of the device. To achieve such a result, different aspects must be considered for making the artificial limb an effective support for carrying out ADLs. Among them, intuitive and robust control is fundamental to improving amputees’ quality of life using upper limb prostheses. Still, as artificial proprioception is essential to perceive the prosthesis movement without constant visual attention, a good control framework may not be enough to restore practical functionality to the limb. To overcome this, bidirectional communication between the user and the prosthesis has been recently introduced and is a requirement of utmost importance in developing prosthetic hands. Indeed, closing the control loop between the user and a prosthesis by providing artificial sensory feedback is a fundamental step towards the complete restoration of the lost sensory-motor functions. Within my PhD work, I proposed the development of a more controllable and sensitive human-like hand prosthesis, i.e., the Hannes prosthetic hand, to improve its usability and effectiveness. Approach. To achieve the objectives of this thesis work, I developed a modular and scalable software and firmware architecture to control the Hannes prosthetic multi-Degree of Freedom (DoF) system and to fit all users’ needs (hand aperture, wrist rotation, and wrist flexion in different combinations). On top of this, I developed several Pattern Recognition (PR) algorithms to translate electromyographic (EMG) activity into complex movements. However, stability and repeatability were still unmet requirements in multi-DoF upper limb systems; hence, I started by investigating different strategies to produce a more robust control. To do this, EMG signals were collected from trans-radial amputees using an array of up to six sensors placed over the skin. Secondly, I developed a vibrotactile system to implement haptic feedback to restore proprioception and create a bidirectional connection between the user and the prosthesis. Similarly, I implemented an object stiffness detection to restore tactile sensation able to connect the user with the external word. This closed-loop control between EMG and vibration feedback is essential to implementing a Bidirectional Body - Machine Interface to impact amputees’ daily life strongly. For each of these three activities: (i) implementation of robust pattern recognition control algorithms, (ii) restoration of proprioception, and (iii) restoration of the feeling of the grasped object's stiffness, I performed a study where data from healthy subjects and amputees was collected, in order to demonstrate the efficacy and usability of my implementations. In each study, I evaluated both the algorithms and the subjects’ ability to use the prosthesis by means of the F1Score parameter (offline) and the Target Achievement Control test-TAC (online). With this test, I analyzed the error rate, path efficiency, and time efficiency in completing different tasks. Main results. Among the several tested methods for Pattern Recognition, the Non-Linear Logistic Regression (NLR) resulted to be the best algorithm in terms of F1Score (99%, robustness), whereas the minimum number of electrodes needed for its functioning was determined to be 4 in the conducted offline analyses. Further, I demonstrated that its low computational burden allowed its implementation and integration on a microcontroller running at a sampling frequency of 300Hz (efficiency). Finally, the online implementation allowed the subject to simultaneously control the Hannes prosthesis DoFs, in a bioinspired and human-like way. In addition, I performed further tests with the same NLR-based control by endowing it with closed-loop proprioceptive feedback. In this scenario, the results achieved during the TAC test obtained an error rate of 15% and a path efficiency of 60% in experiments where no sources of information were available (no visual and no audio feedback). Such results demonstrated an improvement in the controllability of the system with an impact on user experience. Significance. The obtained results confirmed the hypothesis of improving robustness and efficiency of a prosthetic control thanks to of the implemented closed-loop approach. The bidirectional communication between the user and the prosthesis is capable to restore the loss of sensory functionality, with promising implications on direct translation in the clinical practice

Optimality, Objectives, and Trade-Offs in Motor Control under Uncertainty

Biological motor control involves multiple objectives and constraints. In this thesis, I investigated the influence of uncertainty on biological sensorimotor control and decision-making, considering various objectives. In the first study, I used a simple biped walking model simulation to study the control of a rhythmic movement under uncertainty. Uncertainty necessitates a more sophisticated form of motor control involving internal model and sensing, and their effective integration. The optimality of the neural pattern generator incorporating sensory information was shown to be dependent on the relative amount of physical disturbance and sensor noise. When the controller was optimized for state estimation, other objectives of improved energy efficiency, reduced variability, and reduced number of falls were also satisfied. In the second study, human participants performed regression and classification tasks on visually presented scatterplot data. The tasks involved a trade-off between acting on small but prevalent errors and acting on big but scarce errors. We used inverse optimization to characterize the loss function used by humans in these regression and classification tasks, and found that these loss functions change systematically as the data sparsity changed. Despite being highly variable, there were overall shifts towards compensating for prevalent small errors more when the sparsity of the visual data decreased. In the third study, I extended the pattern recognition tasks to include visually mediated force tracking. When participants tracked force targets with visual noise, we observed a slight yet consistent force tracking bias. This bias, which increased with noise, was not explained by commonly hypothesized objectives such as a tendency to reduce effort while regulating error. Additional experiments revealed that a model balancing error reduction and transition reduction tendencies effectively explained and predicted experimental data. Transition reduction tendency was further separated into recency bias and central tendency bias. Notably, this bias disappeared when the task became purely visual, suggesting that such biases could be task-dependent. These findings across the three studies provide useful insights into understanding how uncertainty changes objectives and their trade-offs in biological motor control, and in turn, results in a different control strategy and behaviors