Magnetic motion control and planning of untethered soft grippers using ultrasound image feedback

Soft miniaturized untethered grippers can be used to manipulate and transport biological material in unstructured and tortuous environments. Previous studies on control of soft miniaturized grippers employed cameras and optical images as a feedback modality. However, the use of cameras might be unsuitable for localizing miniaturized agents that navigate within the human body. In this paper, we demonstrate the wireless magnetic motion control and planning of soft untethered grippers using feedback extracted from B-mode ultrasound images. Results show that our system employing ultrasound images can be used to control the miniaturized grippers with an average tracking error of 0.4±0.13 mm without payload and 0.36±0.05 mm when the agent performs a transportation task with a payload. The proposed ultrasound feedback magnetic control system demonstrates the ability to control miniaturized grippers in situations where visual feedback cannot be provided via cameras

Tandem actuation of legged locomotion and grasping manipulation in soft robots using magnetic fields

Untethered soft robots have the potential to impact a variety of applications, particularly if they are capable of controllable locomotion and dexterous manipulation. Magnetic fields can provide humansafe, contactless actuation, opening the gates to applications in confined spaces - for example, in minimally invasive surgery. To translate these concepts into reality, soft robots are being developed with different capabilities, such as functional components to achieve motion and object manipulation. This paper investigates the tandem actuation of two separate functions (locomotion and grasping) through multi-legged soft robots with grippers, actuated by magnetic fields. The locomotion and grasping functions are activated separately by exploiting the difference in the response of the soft robots to the magnitude, frequency and direction of the actuating magnetic field. Two robots capable of performing controllable straight and turning motions are demonstrated: a millipede-inspired robot with legs moving in a rhythmic pattern, and a hexapod robot with six magnetic legs following an alternating tripod gait. Two types of grippers are developed: one inspired by prehensile tails and another similar to flowers or jellyfish. The various components are fabricated using a composite of silicone rubber with magnetic powder, and analyzed using quasi-static models and experimental results. Fully untethered locomotion of the robots and independent gripper actuation are illustrated through experiments. The maneuverability of the robots is proven through teleoperated steering experiments where the robots navigate through the workspace while avoiding obstacles. The ability of the robots to manipulate objects by operating in tandem with the grippers is demonstrated through multiple experiments, including pick-and-place tasks where the robots grasp and release cargo at specific locations when triggered using magnetic fields. (C) 2020 The Authors. Published by Elsevier Ltd

Design, characterization and control of thermally-responsive and magnetically-actuated micro-grippers at the air-water interface

The design and control of untethered microrobotic agents has drawn a lot of attention in recent years. This technology truly possesses the potential to revolutionize the field of minimally invasive surgery and microassembly. However, miniaturization and reliable actuation of micro-fabricated grippers are still challenging at sub-millimeter scale. In this study, we design, manufacture, characterize, and control four similarly-structured semi-rigid thermoresponsive micro-grippers. Furthermore, we develop a closed loop-control algorithm to demonstrate and compare the performance of the said grippers when moving in hard-to-reach and unpredictable environments. Finally, we analyze the grasping characteristics of three of the presented designs. Overall, not only does the study demonstrate motion control in unstructured dynamic environments-at velocities up to 3.4, 2.9, 3.3, and 1 body-lengths/s with 980, 750, 250, and 100 μm-sized grippers, respectively-but it also aims to provide quantitative data and considerations to help a targeted design of magnetically-controlled thin micro-grippers

Contactless Haptic Display Through Magnetic Field Control

Haptic rendering enables people to touch, perceive, and manipulate virtual objects in a virtual environment. Using six cascaded identical hollow disk electromagnets and a small permanent magnet attached to an operator's finger, this paper proposes and develops an untethered haptic interface through magnetic field control. The concentric hole inside the six cascaded electromagnets provides the workspace, where the 3D position of the permanent magnet is tracked with a Microsoft Kinect sensor. The driving currents of six cascaded electromagnets are calculated in real-time for generating the desired magnetic force. Offline data from an FEA (finite element analysis) based simulation, determines the relationship between the magnetic force, the driving currents, and the position of the permanent magnet. A set of experiments including the virtual object recognition experiment, the virtual surface identification experiment, and the user perception evaluation experiment were conducted to demonstrate the proposed system, where Microsoft HoloLens holographic glasses are used for visual rendering. The proposed magnetic haptic display leads to an untethered and non-contact interface for natural haptic rendering applications, which overcomes the constraints of mechanical linkages in tool-based traditional haptic devices

Robotic Actuation and Control with Programmable, Field-Activated Material Systems

This dissertation presents novel, field-activated smart material systems for the actuation and control of autonomous robots. Smart materials, a type of material whose properties can be changed with an external stimuli, represent a promising direction to expand upon existing robotic control and actuation methods, particularly in the sub-fields of soft robotics and robotic grasping. Specifically, this work makes the following contributions: i) a literature review that synthesizes recent work on field-activated smart materials and their use in soft robotics; ii) an electrorheological fluid (ERF) valve to control soft actuators; iii) magnetic elastomers (MEs) to increase the grip strength of soft grippers; and iv) a low-power method for torque transmission enabled by magnetorheological fluid (MRF) and electropermanent magnet arrays. After the introduction, this dissertation presents a comprehensive literature review paper (Chapter 2) regarding the use of field-activated materials in soft robotics, with an emphasis on magnetic elastomers. The second paper (Chapter 3) describes the development of a 3D-printed pressure valve intended to leverage the pressuring-holding properties of ERF when under the influence of a high voltage field to actuate soft actuators. The third paper (Chapter 4) demonstrates how magnetic elastomers and magnetic fields can enhance soft robotic grip strength and versatility. The fourth paper (Chapter 5) models, fabricates, and characterizes a MRF-containing clutch device able to rapidly and reversibly module the amount of torque transmitted from an input shaft to an output by leveraging low-power electropermanent magnet arrays. Each work focuses on a field-activated smart material to perform a specific robotic function, with particular emphasis given to compliant mechanisms and soft robotics, as well as to reducing cost and improving ease of fabrication with the use of modern fabrication techniques. In these described papers, field-activated materials are first modeled and then deployed in functional prototypes, and their robotic utility is described in detail after extensive experimental characterization

Micro/nanoscale magnetic robots for biomedical applications

Magnetic small-scale robots are devices of great potential for the biomedical field because of the several benefits of this method of actuation. Recent work on the development of these devices has seen tremendous innovation and refinement toward ​improved performance for potential clinical applications. This review briefly details recent advancements in small-scale robots used for biomedical applications, covering their design, fabrication, applications, and demonstration of ability, and identifies the gap in studies and the difficulties that have persisted in the optimization of the use of these devices. In addition, alternative biomedical applications are also suggested for some of the technologies that show potential for other functions. This study concludes that although the field of small-scale robot research is highly innovative ​there is need for more concerted efforts to improve functionality and reliability of these devices particularly in clinical applications. Finally, further suggestions are made toward ​the achievement of commercialization for these devices

Monolithic self-supportive bi-directional bending pneumatic bellows catheter

The minimally invasive surgery has proven to be advantageous over conventional open surgery in terms of reduction in recovery time, patient trauma, and overall cost of treatment. To perform a minimally invasive procedure, preliminary insertion of a flexible tube or catheter is crucial without sacrificing its ability to manoeuvre. Nevertheless, despite the vast amount of research reported on catheters, the ability to implement active catheters in the minimally invasive application is still limited. To date, active catheters are made of rigid structures constricted to the use of wires or on-board power supplies for actuation, which increases the risk of damaging the internal organs and tissues. To address this issue, an active catheter made of soft, flexible and biocompatible structure, driven via nonelectric stimulus is of utmost importance. This thesis presents the development of a novel monolithic self-supportive bi-directional bending pneumatic bellows catheter using a sacrificial molding technique. As a proof of concept, in order to understand the effects of structural parameters on the bending performance of a bellows-structured actuator, a single channel circular bellows pneumatic actuator was designed. The finite element analysis was performed in order to analyze the unidirectional bending performance, while the most optimal model was fabricated for experimental validation. Moreover, to attain biocompatibility and bidirectional bending, the novel monolithic polydimethylsiloxane (PDMS)-based dual-channel square bellows pneumatic actuator was proposed. The actuator was designed with an overall cross-sectional area of 5 x 5 mm2, while the input sequence and the number of bellows were characterized to identify their effects on the bending performance. A novel sacrificial molding technique was adopted for developing the monolithic-structured actuator, which enabled simple fabrication for complex designs. The experimental validation revealed that the actuator model with a size of5 x 5 x 68.4 mm3 i.e. having the highest number of bellows, attained optimal bi-directional bending with maximum angles of -65° and 75°, and force of 0.166 and 0.221 N under left and right channel actuation, respectively, at 100 kPa pressure. The bending performance characterization and thermal insusceptibility achieved by the developed pneumatic catheter presents a promising implementation of flexibility and thermal stability for various biomedical applications, such as dialysis and cardiac catheterization

Design, Optimization, and Experimental Characterization of a Novel Magnetically Actuated Finger Micromanipulator

The ability of external magnetic fields to precisely control micromanipulator systems has received a great deal of attention from researchers in recent years due to its off-board power source. As these micromanipulators provide frictionless motion, and precise motion control, they have promising potential applications in many fields. Conversely, major drawbacks of electromagnetic micromanipulators, include a limited motion range compared to the micromanipulator volume, the inability to handle heavy payloads, and the need for a large drive unit compared to the size of the levitated object, and finally, a low ratio of the generated magnetic force to the micromanipulator weight. To overcome these limitations, we designed a novel electromagnetic finger micromanipulator that was adapted from the well-known spherical robot. The design and optimization procedures for building a three Degree of Freedoms (DOF) electromagnetic finger micromanipulator are firstly introduced. This finger micromanipulator has many potential applications, such as cell manipulation, and pick and place operations. The system consists of two main subsystems: a magnetic actuator, and an electromagnetic end-effector that is connected to the magnetic actuator by a needle. The magnetic actuator consists of four permanent magnets and four electromagnetic coils that work together to guide the micromanipulator finger in the xz plane. The electromagnetic end-effector consists of a rod shape permanent magnet that is aligned along the y axis and surrounded by an electromagnetic coil. The optimal configuration that maximizes the micromanipulator actuation force, and a closed form solution for micromanipulator magnetic actuation force are presented. The model is verified by measuring the interaction force between an electromagnet and a permanent magnet experimentally, and using Finite Element Methods (FEM) analysis. The results show an agreement between the model, the experiment, and the FEM results. The error difference between the FEM, experimental, and model data was 0.05 N. The micromanipulator can be remotely operated by transferring magnetic energy from outside, which means there is no mechanical contact between the actuator and the micromanipulator. Moreover, three control algorithms are designed in order to compute control input currents that are able to control the position of the end-effector in the x, y, and z axes. The proposed controllers are: PID controller, state-feedback controller, and adaptive controller. The experimental results show that the micromanipulator is able to track the desired trajectory with a steady-state error less than 10 µm for a payload free condition. Finally, the ability of the micromanipulator to pick-and-place unknown payloads is demonstrated. To achieve this objective, a robust model reference adaptive controller (MRAC) using the MIT rule for an adaptive mechanism to guide the micromanipulator in the workspace is implemented. The performance of the MRAC is compared with a standard PID controller and state-feedback controller. For the payload free condition, the experimental results show the ability of the micromanipulator to follow a desired motion trajectory in all control strategies with a root mean square error less than 0.2 mm. However, while there is payload variation, the PID controller response yields a non smooth motion with a large overshoot and undershoot. Similarly, the state-feedback controller suffers from variability of dynamics and disturbances due to the payload variation, which yields to non-smooth motion and large overshoot. The micromanipulator motion under the MRAC control scheme conversely follows the desired motion trajectory with the same accuracy. It is found that the micromanipulator can handle payloads up to 75 grams and it has a motion range of ∓ 15 mm in all axes