Bending angle prediction and control of soft pneumatic actuators with embedded flex sensors - a data-driven approach

In this paper, a purely data-driven modelling approach is presented for predicting and controlling the free bending angle response of a typical soft pneumatic actuator (SPA), embedded with a resistive flex sensor. An experimental setup was constructed to test the SPA at different input pressure values and orientations, while recording the resulting feedback from the embedded flex sensor and on-board pressure sensor. A calibrated high speed camera captures image frames during the actuation, which are then analysed using an image processing program to calculate the actual bending angle and synchronise it with the recorded sensory feedback. Empirical models were derived based on the generated experimental data using two common data-driven modelling techniques; regression analysis and artificial neural networks. Both techniques were validated using a new dataset at untrained operating conditions to evaluate their prediction accuracy. Furthermore, the derived empirical model was used as part of a closed-loop PID controller to estimate and control the bending angle of the tested SPA based on the real-time sensory feedback generated. The tuned PID controller allowed the bending SPA to accurately follow stepped and sinusoidal reference signals, even in the presence of pressure leaks in the pneumatic supply. This work demonstrates how purely data-driven models can be effectively used in controlling the bending of SPAs under different operating conditions, avoiding the need for complex analytical modelling and material characterisation. Ultimately, the aim is to create more controllable soft grippers based on such SPAs with embedded sensing capabilities, to be used in applications requiring both a ‘soft touch’ as well as a more controllable object manipulation

Model Based Control of Soft Robots: A Survey of the State of the Art and Open Challenges

Continuum soft robots are mechanical systems entirely made of continuously deformable elements. This design solution aims to bring robots closer to invertebrate animals and soft appendices of vertebrate animals (e.g., an elephant's trunk, a monkey's tail). This work aims to introduce the control theorist perspective to this novel development in robotics. We aim to remove the barriers to entry into this field by presenting existing results and future challenges using a unified language and within a coherent framework. Indeed, the main difficulty in entering this field is the wide variability of terminology and scientific backgrounds, making it quite hard to acquire a comprehensive view on the topic. Another limiting factor is that it is not obvious where to draw a clear line between the limitations imposed by the technology not being mature yet and the challenges intrinsic to this class of robots. In this work, we argue that the intrinsic effects are the continuum or multi-body dynamics, the presence of a non-negligible elastic potential field, and the variability in sensing and actuation strategies.Comment: 69 pages, 13 figure

Естимација крутости и адаптивно управљање код попустљивих робота

Although there has been an astonishing increase in the development of nature- inspired robots equipped with compliant features,i.e.soft robots, their full potential has not been exploited yet. One aspect is that the soft robotics research has mainly focused on their position control only, whilest iffness is managed in open loop. Moreover, due to the difficulties of achieving consistent production of the actuation systems for soft articulated robots and the time-varyingnatureoftheirinternalflexibleelements,whicharesubjecttoplasticdeformation overtime,itiscurrentlyachallengetopreciselydeterminethejointstiffness. . In this regard, the thesis puts an emphasis on stiffness estimation and adaptive control for soft articulated robots driven by antagonistic Variable Stiffness Actuators (VSAs) with the aim to impose the desired dynamics of both position and stiffness, which would finally contribute to the overall safety and improved performance of a soft robot. By building upon Unknown Input Observer (UIO) theory, invasive and non-invasive solutions for estimation of stiffness in pneumatic and electro-mechanical actuators are proposed and in the latter case also experimentally validated. Beyond the linearity and scalability advantage, the approaches have an appealing feature that torque and velocity sensors are not needed. Once the stiffness is determined, innovative control approaches are introduced for soft articulated robots comprising an adaptive compensator and a dynamic decoupler. The solutions are able to cope with uncertainties of the robot dynamic model and, when the desired stiffness is constant or slowly-varying, also of the pneumatic actuator. Their verification is performed via simulations and then the pneumatic one is successfully tested on an experimental setup. Finally, the thesis shows via extensive simulations the effectiveness of adaptive technique ap- plied to soft-bodied robots, previously deriving the sufficient and necessary conditions for the controller convergence.Iako se danas izuzetno intenzivno radi na razvoju robota inspirisanih prirodom koje odlikuje elastična struktura, njihov puni potencijal jox uvek nije iskorišćen. Sa jedne strane, istraživanja u oblasti popustljivih robota su uglavnom fokusirana samo na upravljanje njihovom pozicijom, dok se krutost reguliše u otvorenoj sprezi. Pored toga, zbog poteškoća u postiznju konzistentne proizvodnje aktuatora i promenljive prirode njihovih elastičnih elemenata, koji su vremenom podlo_ni plastičnoj deformaciji, trenutno je izazov precizno odrediti krutost zglobova robota. U cilju doprinosa poboljšanja_u performansi i bezbednosti rada popustivih robota, teza prikazuje doprinos proceni krutosti i adaptivnog simultanog upravljanja pozicijom i krutosti antagonističkih aktuatora promenljive krutosti (VSA). Oslanjajući se na teoriju opservera nepoznatih ulaza (UIO), predložena su invazivna i neinvazivna rešenja za procenu krutosti u pneumatskim i elektromehaničkim aktuatorima i eksperimentalno verifikovana u slučaju druge grupe aktuatora. Pored linearnosti i skalabilnosti, ovi pristupi imaju privlaqnu osobinu da senzori momenta i brzine nisu potrebni. Teza predla_e inovativne sisteme upravljanja koji poseduju adaptivni kompenzator i dinamički dekupler. Predložene metode upravljanja demonstriraju mogućnost da kompenzuju nesigurnosti dinamičkog modela robota bez obzira da li je on pogođen električnim ili pneumatskim aktuatorima. Nakon simulacija, razvijeno upravljanje je verifikovano i na pneumatskom robotu. Na kraju teze, obimne simulacije pokazuju efikasnost adaptivne tehnike kada se primeni na robote sa fleksibilnim linkovima, prethodno izvodeći dovoljne i potrebne uslove za konvergenciju kontrolera

A Multi-Level Control Architecture for the Bionic Handling Assistant

Rolf M, Neumann K, Queißer J, Reinhart F, Nordmann A, Steil JJ. A Multi-Level Control Architecture for the Bionic Handling Assistant. Advanced Robotics. 2015;29(13: SI):847-859.The Bionic Handling Assistant is one of the largest soft continuum robots and very special in be- ing a pneumatically operated platform that is able to bend, stretch, and grasp in all directions. It nevertheless shares many challenges with smaller continuum and other softs robots such as parallel actuation, complex movement dynamics, slow pneumatic actuation, non-stationary behavior, and a lack of analytic models. To master the control of this challenging robot, we argue for a tight inte- gration of standard analytic tools, simulation, control, and state of the art machine learning into an overall architecture that can serve as blueprint for control design also beyond the BHA. To this aim, we show how to integrate specific modes of operation and different levels of control in a synergistic manner, which is enabled by using modern paradigms of software architecture and middleware. We thereby achieve an architecture with unique overall control abilities for a soft continuum robot that allow for exible experimentation towards compliant user-interaction, grasping, and online learning of internal models

Robotic System Development for Precision MRI-Guided Needle-Based Interventions

This dissertation describes the development of a methodology for implementing robotic systems for interventional procedures under intraoperative Magnetic Resonance Imaging (MRI) guidance. MRI is an ideal imaging modality for surgical guidance of diagnostic and therapeutic procedures, thanks to its ability to perform high resolution, real-time, and high soft tissue contrast imaging without ionizing radiation. However, the strong magnetic field and sensitivity to radio frequency signals, as well as tightly confined scanner bore render great challenges to developing robotic systems within MRI environment. Discussed are potential solutions to address engineering topics related to development of MRI-compatible electro-mechanical systems and modeling of steerable needle interventions. A robotic framework is developed based on a modular design approach, supporting varying MRI-guided interventional procedures, with stereotactic neurosurgery and prostate cancer therapy as two driving exemplary applications. A piezoelectrically actuated electro-mechanical system is designed to provide precise needle placement in the bore of the scanner under interactive MRI-guidance, while overcoming the challenges inherent to MRI-guided procedures. This work presents the development of the robotic system in the aspects of requirements definition, clinical work flow development, mechanism optimization, control system design and experimental evaluation. A steerable needle is beneficial for interventional procedures with its capability to produce curved path, avoiding anatomical obstacles or compensating for needle placement errors. Two kinds of steerable needles are discussed, i.e. asymmetric-tip needle and concentric-tube cannula. A novel Gaussian-based ContinUous Rotation and Variable-curvature (CURV) model is proposed to steer asymmetric-tip needle, which enables variable curvature of the needle trajectory with independent control of needle rotation and insertion. While concentric-tube cannula is suitable for clinical applications where a curved trajectory is needed without relying on tissue interaction force. This dissertation addresses fundamental challenges in developing and deploying MRI-compatible robotic systems, and enables the technologies for MRI-guided needle-based interventions. This study applied and evaluated these techniques to a system for prostate biopsy that is currently in clinical trials, developed a neurosurgery robot prototype for interstitial thermal therapy of brain cancer under MRI guidance, and demonstrated needle steering using both asymmetric tip and pre-bent concentric-tube cannula approaches on a testbed

Multi-modal Skill Memories for Online Learning of Interactive Robot Movement Generation

Queißer J. Multi-modal Skill Memories for Online Learning of Interactive Robot Movement Generation. Bielefeld: Universität Bielefeld; 2018.Modern robotic applications pose complex requirements with respect to the adaptation of actions regarding the variability in a given task. Reinforcement learning can optimize for changing conditions, but relearning from scratch is hardly feasible due to the high number of required rollouts. This work proposes a parameterized skill that generalizes to new actions for changing task parameters. The actions are encoded by a meta-learner that provides parameters for task-specific dynamic motion primitives. Experimental evaluation shows that the utilization of parameterized skills for initialization of the optimization process leads to a more effective incremental task learning. A proposed hybrid optimization method combines a fast coarse optimization on a manifold of policy parameters with a fine-grained parameter search in the unrestricted space of actions. It is shown that the developed algorithm reduces the number of required rollouts for adaptation to new task conditions. Further, this work presents a transfer learning approach for adaptation of learned skills to new situations. Application in illustrative toy scenarios, for a 10-DOF planar arm, a humanoid robot point reaching task and parameterized drumming on a pneumatic robot validate the approach. But parameterized skills that are applied on complex robotic systems pose further challenges: the dynamics of the robot and the interaction with the environment introduce model inaccuracies. In particular, high-level skill acquisition on highly compliant robotic systems such as pneumatically driven or soft actuators is hardly feasible. Since learning of the complete dynamics model is not feasible due to the high complexity, this thesis examines two alternative approaches: First, an improvement of the low-level control based on an equilibrium model of the robot. Utilization of an equilibrium model reduces the learning complexity and this thesis evaluates its applicability for control of pneumatic and industrial light-weight robots. Second, an extension of parameterized skills to generalize for forward signals of action primitives that result in an enhanced control quality of complex robotic systems. This thesis argues for a shift in the complexity of learning the full dynamics of the robot to a lower dimensional task-related learning problem. Due to the generalization in relation to the task variability, online learning for complex robots as well as complex scenarios becomes feasible. An experimental evaluation investigates the generalization capabilities of the proposed online learning system for robot motion generation. Evaluation is performed through simulation of a compliant 2-DOF arm and scalability to a complex robotic system is demonstrated for a pneumatically driven humanoid robot with 8-DOF