Dexterous Soft Hands Linearize Feedback-Control for In-Hand Manipulation

This paper presents a feedback-control framework for in-hand manipulation (IHM) with dexterous soft hands that enables the acquisition of manipulation skills in the real-world within minutes. We choose the deformation state of the soft hand as the control variable. To control for a desired deformation state, we use coarsely approximated Jacobians of the actuation-deformation dynamics. These Jacobian are obtained via explorative actions. This is enabled by the self-stabilizing properties of compliant hands, which allow us to use linear feedback control in the presence of complex contact dynamics. To evaluate the effectiveness of our approach, we show the generalization capabilities for a learned manipulation skill to variations in object size by 100 %, 360 degree changes in palm inclination and to disabling up to 50 % of the involved actuators. In addition, complex manipulations can be obtained by sequencing such feedback-skills.Comment: Accepted at 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS

Silicone Based Capacitive E-Skin Sensor for Soft Surgical Robots

In this extended abstract, we present a soft stretchable multi-modal capacitive skin sensor that can be used for exteroception and proprioception in soft surgical manipulators. A soft skin prototype was made using Ecoflex, embedding three conductive carbon grease terminal layers. This soft skin is capable of measuring stretch and touch simultaneously. The soft skin measures uniaxial stretches from 1 to 1.2475 within an error range of 2.6% and can also quantify as well as localize local indentation. An algorithm is developed that decouples local change, i.e., due to indentation, from global strain, due to stretch. An experimental study was conducted; results are presented

Strain Sensor-Embedded Soft Pneumatic Actuators for Extension and Bending Feedback

For soft robots to leave the lab and enter unstructured environments, proprioception is required to understand how interactions in the field affect the soft structure. In this work, we present sensor-embedded soft pneumatic actuators (sSPA) that can observe both extension and bending. The sensors are strain sensitive capacitors, which are bonded to the interior of fiber-reinforced extension actuators on opposing faces. This construction allows extension and bending to be measured by calculating the mean and difference in sensor responses, respectively. The sSPAs are bonded together to form a flat fascicle to increase the force output and prevent buckling under load, and are robust to component failure by incorporating redundancy. In this paper, we discuss the fabrication of the sensors and their subsequent integration into the actuators. We also report the work capacity and sensor. response of the sSPA fascicles under extension, bending, and the combination of both modes of deformation. The sensor- embedded soft pneumatic actuators presented here will advance the field of soft robotics by enabling closed-loop control of soft robots

Directly Printable Flexible Strain Sensors for Bending and Contact Feedback of Soft Actuators

This paper presents a fully printable sensorized bending actuator that can be calibrated to provide reliable bending feedback and simple contact detection. A soft bending actuator following a pleated morphology, as well as a flexible resistive strain sensor, were directly 3D printed using easily accessible FDM printer hardware with a dual-extrusion tool head. The flexible sensor was directly welded to the bending actuator’s body and systematically tested to characterize and evaluate its response under variable input pressure. A signal conditioning circuit was developed to enhance the quality of the sensory feedback, and flexible conductive threads were used for wiring. The sensorized actuator’s response was then calibrated using a vision system to convert the sensory readings to real bending angle values. The empirical relationship was derived using linear regression and validated at untrained input conditions to evaluate its accuracy. Furthermore, the sensorized actuator was tested in a constrained setup that prevents bending, to evaluate the potential of using the same sensor for simple contact detection by comparing the constrained and free-bending responses at the same input pressures. The results of this work demonstrated how a dual-extrusion FDM printing process can be tuned to directly print highly customizable flexible strain sensors that were able to provide reliable bending feedback and basic contact detection. The addition of such sensing capability to bending actuators enhances their functionality and reliability for applications such as controlled soft grasping, flexible wearables, and haptic devices

Force Control for Soft Robotic Hands Applied to Grasping

Robotic grasping has been studied for more than 30 years, but it is still a challenging field. Today, most robotic grippers are rigid, making it hard for them to grasp and handle irregularly shaped objects that are delicate and easily deformed such as a compact disc, an egg, or an empty plastic cup. To tackle this issue, soft robotic hands have been introduced. Despite advantages of soft robotic hands, their applications are still limited to simple pick-and-place tasks. The main reason for this is their lack of sensing capabilities, which leads to the absence of information about the internal state of the hand or the interaction between the hand and the environment. This thesis aims to tackle this issue by integrating appropriate sensors into a soft robotic hand. The information extracted from the sensory readings is then used to develop a control strategy to study the interaction between the hand and objects. Experiments performed on the developed soft hand and controller board showed that the interaction between the hand and objects could be studied by using only sensors integrated into the hand. The final results also showed that this information could be used to successfully control the soft hand in real time to achieve a manipulation task such as grasping deformable planar objects especially thin-shell objects like empty plastic cups

Directly Printable Flexible Strain Sensors for Bending and Contact Feedback of Soft Actuators

This paper presents a fully printable sensorized bending actuator that can be calibrated to provide reliable bending feedback and simple contact detection. A soft bending actuator following a pleated morphology, as well as a flexible resistive strain sensor, were directly 3D printed using easily accessible FDM printer hardware with a dual-extrusion tool head. The flexible sensor was directly welded to the bending actuator’s body and systematically tested to characterize and evaluate its response under variable input pressure. A signal conditioning circuit was developed to enhance the quality of the sensory feedback, and flexible conductive threads were used for wiring. The sensorized actuator’s response was then calibrated using a vision system to convert the sensory readings to real bending angle values. The empirical relationship was derived using linear regression and validated at untrained input conditions to evaluate its accuracy. Furthermore, the sensorized actuator was tested in a constrained setup that prevents bending, to evaluate the potential of using the same sensor for simple contact detection by comparing the constrained and free-bending responses at the same input pressures. The results of this work demonstrated how a dual-extrusion FDM printing process can be tuned to directly print highly customizable flexible strain sensors that were able to provide reliable bending feedback and basic contact detection. The addition of such sensing capability to bending actuators enhances their functionality and reliability for applications such as controlled soft grasping, flexible wearables, and haptic devices

사람 근골격 특성을 반영한 로봇 손가락 설계

학위논문(박사) -- 서울대학교대학원 : 융합과학기술대학원 융합과학부(지능형융합시스템전공), 2023. 2. 박재흥.What the manipulator can perform is determined by what the end-effectors, including the robotic hand, can do because it is the gateway that directly interacts with the surrounding environment or objects. In order for robots to have human-level task performance in a human-centered environment, the robotic hand with human-hand-level capabilities is essential. Here, the human-hand-level capabilities include not only force-speed, and dexterity, but also size and weight. However, to our knowledge, no robotic hand exists that simultaneously realizes the weight, size, force, and dexterity of the human hand and continues to remain a challenge. In this thesis, to improve the performance of the robotic hand, the modular robotic finger design with three novel mechanisms based on the musculoskeletal characteristics of the human hand was proposed. First, the tendon-driven robotic finger with intrinsic/extrinsic actuator arrangement like the muscle arrangement of the human hand was proposed and analyzed. The robotic finger consists of five different tendons and ligaments. By analyzing the fingertip speed while a human is performing various object grasping motions, the actuators of the robotic finger were separated into intrinsic actuators responsible for slow motion and an extrinsic actuator that performs the motions requiring both large force and high speed. Second, elastomeric continuously variable transmission (ElaCVT), a new concept relating to continuously variable transmission (CVT), was designed to improve the performance of the electric motors remaining weight and size and applied as an extrinsic actuator of the robotic finger. The primary purpose of ElaCVT is to expand the operating region of a twisted string actuator (TSA) and duplicate the force-velocity curve of the muscles by passively changing the reduction ratio according to the external load applied to the end of the TSA. A combination of ElaCVT and TSA (ElaCVT-TSA) is proposed as a linear actuator. With ElaCVT-TSA, an expansion of the operating region of electric motors to the operating region of the muscles was experimentally demonstrated. Finally, as the flexion/extension joints of the robotic finger, anthropomorphic rolling contact joint, which mimicked the structures of the human finger joint like tongue-and-groove, and collateral ligaments, was proposed. As compliant joints not only compensate for the lack of actuated degrees of freedom of an under-actuated system and improve grasp stability but also prevent system failure from unexpected contacts, various types of compliant joints have been applied to end-effectors. Although joint compliance increases the success rate of power grasping, when the finger wraps around large objects, it can reduce the grasping success rate in pinch gripping when dealing with small objects using the fingertips. To overcome this drawback, anthropomorphic rolling contact joint is designed to passively adjust the torsional stiffness according to the joint angle without additional weight and space. With the anthropomorphic rolling contact joint, the stability of pinch grasping improved.엔드이팩터는 로봇과 주변 환경이 상호작용하는 통로로 매니퓰레이터가 수행할 수 있는 작업은 엔드이펙터의 성능에 제한된다. 사람 중심의 환경에 로봇이 적용되어 사람 수준의 다양한 작업을 수행하기 위해서는 사람 손 수준의 성능을 갖는 로봇 손이 필수적이며 사람 손 수준의 성능은 단순히 힘-속도, 자유도만을 포함하는 것이 아닌 크기와 무게 그리고 물체 조작에 도움을 주는 여러 손 특성도 포함한다. 그러나 현재까지 사람 손 수준의 무게, 크기, 힘 그리고 자유도를 모두 만족시키는 로봇 손은 개발되지 않았으며 여전히 도전적인 과제로 남아있다. 본 논문에서는 로봇 손가락의 성능을 향상하기 위하여 사람의 근골격 특성을 반영한 세 가지의 새로운 메커니즘을 제안하고 이를 통합한 모듈형 로봇 손가락 구조를 보인다. 첫 번째로, 사람의 손 근육 배치와 유사한 내재/외재 구동기 배치를 적용한 힘줄 구동 로봇 손가락 구조를 제안하고 분석한다. 로봇 손가락은 다섯 개의 서로 다른 힘줄과 인대로 구성된다. 사람 손동작 분석에 기반하여 로봇 손가락의 구동기는 느린 속도를 담당하는 내재 구동기와 빠르고 큰 힘이 모두 요구되는 외재 구동기로 구분된다. 두 번째로, 구동기의 크기와 무게를 유지하며 성능을 향상하기 위하여 새로운 개념의 무단 변속기 Elastomeric Continuously Variable Transmission (ElaCVT) 을 제안하고 이를 로봇 손가락의 외재 구동기에 적용하였다. ElaCVT는 선형 구동기의 작동 영역을 확장하고 출력단에 가해지는 외부 하중에 따라 감속비를 수동적으로 변경하여 근육의 힘-속도 곡선을 모사할 수 있다. 본 연구에서는 근육의 특성을 모사하기 위해 선형 액추에이터로 ElaCVT에 줄 꼬임 메커니즘을 적용한 ElaCVT-TSA를 제안, 근육의 동작 영역을 모사할 수 있음을 보였다. 마지막으로 로봇 손가락의 모든 굽힘/펼침 관절에 적용된 사람의 관절구조를 모사한 유연 구름 접촉 관절 (Anthropomorphic Rolling Contact joint)을 제안한다. Anthropomorphic rolling contact joint는 사람 관절의 tongue-and-groove 형상과 collateral ligament를 모사하여 관절의 안정성을 향상시켰다. 기존의 유연 관절과 달리 관절이 펴진 상태에서는 유연한 상태를 유지하며 굽혀진 상태에서는 강성이 증가한다는 특징을 갖는다. 특히, 강성 변화에 별도의 구동기가 요구되지 않아 기존의 관절에서 무게, 크기 증가 없이 해당 특징 구현이 가능하다. 이는 로봇 손가락에 적용되어 손가락을 펴고 물체를 탐색하는 과정에서는 충격을 흡수하여 안정적인 접촉을 구현할 수 있으며 물체를 파지하는 과정에서는 손가락을 굽혀 강인하게 물체를 파지할 수 있게 한다. Anthropomorphic rolling contact joint를 적용한 그립퍼를 이용하여 제안하는 가변 강성 유연 관절이 pinch grasping의 파지 안정성을 높임을 보였다.1 INTRODUCTION 1 1.1 MOTIVATION: ROBOTIC HANDS 1 1.2 CONTRIBUTIONS OF THESIS 10 1.2.1 Intrinsic/Extrinsic Actuator arrangement 11 1.2.2 Linear actuator mimicking human muscle properties 11 1.2.3 Flexible rolling contact joint 12 2 ROBOTIC FINGER STRUCTURE WITH HUMAN-LIKE ACTUATOR ARRANGEMENT 13 2.1 ANALYSIS OF HUMAN FINGERTIP VELOCITY 14 2.2 THE ROBOTIC FINGER WITH INTRINSIC/EXTRINSIC ACTUATORS 18 2.2.1 The structure of proposed robotic finger 18 2.2.2 Kinematics of the robotic finger 20 2.2.3 Tendons and Ligaments of the proposed robotic finger 26 2.2.4 Decoupled fingertip motion in the sagittal plane 28 3 ELASTOMERIC CONTINUOUSLY VARIABLE TRANSMISSION COMBINED WITH TWISTED STRING ACTUATOR 35 3.1 BACKGROUND & RELATED WORKS 35 3.2 COMPARISON OF OPERATING REGIONS 40 3.3 DESIGN OF THE ELASTOMERIC CONTINUOUSLY VARIABLE TRANSMISSION 42 3.3.1 Structure of ElaCVT 42 3.3.2 Design of Elastomer and Lateral Disc 43 3.3.3 Advantages of ElaCVT 48 3.4 PERFORMANCE EVALUATION 50 3.4.1 Experimental Setup 50 3.4.2 Contraction with Fixed external load 50 3.4.3 Contraction with Variable external load 55 3.4.4 Performance variation of ElaCVT over long term usage 55 3.4.5 Specifications and Limitations of ElaCVT-TSA 59 4 ANTHROPOMORPHIC ROLLING CONTACT JOINT 61 4.1 INTRODUCTION: COMPLIANT JOINT 61 4.2 RELATED WORKS: ROLLING CONTACT JOINT 65 4.3 ANTHROPOMORPHIC ROLLING CONTACT JOINT 67 4.3.1 Fundamental Components of ARC joint 69 4.3.2 Advantages of ARC joint 73 4.4 TORSIONAL STIFFNESS EVALUATION 75 4.4.1 Experimental Setup 75 4.4.2 Design and Manufacturing of ARC joints 77 4.4.3 Torsional Stiffness Change according to Joint Angle and Twist Angle 79 4.5 TORSIONAL STIFFNESS WITH JOINT COMPRESSION FORCE DUE TO TNESION OF TENDONS 80 4.6 TORSIONAL STIFFNESS WITH LUBRICATION STRUCTURE 82 4.7 GRASPING PERFORMANCE COMPARISON OF GRIPPERS WITH DIFFERENT ARC JOINTS 86 5 CONCLUSIONS 92 Abstract (In Korean) 107박

Bio-inspired soft robotic systems: Exploiting environmental interactions using embodied mechanics and sensory coordination

Despite the widespread development of highly intelligent robotic systems exhibiting great precision, reliability, and dexterity, robots remain incapable of performing basic manipulation tasks that humans take for granted. Manipulation in unstructured environments continues to be acknowledged as a significant challenge. Soft robotics, the use of less rigid materials in robots, has been proposed as one means of addressing these limitations. The technique enables more compliant interactions with the environment, allowing for increasingly adaptive behaviours better suited to more human-centric applications. Embodied intelligence is a biologically inspired concept in which intelligence is a function of the entire system, not only the controller or `brain'. This thesis focuses on the use of embodied intelligence for the development of soft robots, with a particular focus on how it can aid both perception and adaptability. Two main hypotheses are raised: first, that the mechanical design and fabrication of soft-rigid hybrid robots can enable increasingly environmentally adaptive behaviours, and second, that sensing materials and morphology can provide intelligence that assists perception through embodiment. A number of approaches and frameworks for the design and development of embodied systems are presented that address these hypotheses. It is shown how embodiment in soft sensor morphology can be used to perform localised processing and thereby distribute the intelligence over the body of a system. Specifically in soft robots, sensor morphology utilises the directional deformations created by interactions with the environment to aid in perception. Building on and formalising these ideas, a number of morphology-based frameworks are proposed for detecting different stimuli. The multifaceted role of materials in soft robots is demonstrated through the development of materials capable of both sensing and changes in material property. Such materials provide additional functionality beyond their integral scaffolding and static mechanical characteristics. In particular, an integrated material has been created exhibiting both sensing capabilities and also variable stiffness and `tack’ force, thereby enabling complex single-point grasping. To maximise the intelligence that can be gained through embodiment, a design approach to soft robots, `soft-rigid hybrid' design is introduced. This approach exploits passive behaviours and body dynamics to provide environmentally adaptive behaviours and sensing. It is leveraged by multi-material 3D printing techniques and novel approaches and frameworks for designing mechanical structures. The findings in this thesis demonstrate that an embodied approach to soft robotics provides capabilities and behaviours that are not currently otherwise achievable. Utilising the concept of `embodiment' results in softer robots with an embodied intelligence that aids perception and adaptive behaviours, and has the potential to bring the physical abilities of robots one step closer to those of animals and humans.EPSR

Stretchable metallization technologies for skin-like transducers

The skin is not only the largest human organ, capable of accomplishing distributed and multimodal sensing functions. Replicating the versatility of skin artificially is a significant challenge, not only in terms of signal processing but also in mechanics. Stretchable electronics are an approach designed to cover human and artificial limbs and provide wearable sensing capabilities: motion sensors distributed on the hand of neurologically impaired patients could help therapists quantify their abilities; prostheses equipped with multiple tactile sensors could enable amputees to naturally adjust their grasp force. Skin-like electronic systems have specific requirements: they must mechanically adapt to the deformations imposed by the body they equip with minimal impediment to its natural movements, while also providing sufficient electrical performance for sensor transduction and passing electrical signals and power. A metallization ensuring stable conductivity under large strains is a prerequisite to designing and assembling wearable circuits that are integrated with several types of sensors. In this work, two innovative metallization processes have been developed to enable scalable integration of multiple sensing modalities in stretchable circuits. First, stretchable micro-cracked gold (Au) thin films were interfaced with gallium indium eutectic (EGaIn) liquid metal wires. The Au films, thermally evaporated on silicone elastomer substrates, combined high sheet resistance (9 to 30 Ohm/sq) and high sensitivity to strain up to 50%. The EGaIn wires drawn using a micro-plotting setup had a low gauge factor (2) and a low sheet resistance (5 mOhm/sq). Second, a novel physical vapor deposition method to deposit of thin gallium-based biphasic (solid-liquid) films over large areas was achieved. The obtained conductors combined a low sheet resistance (0.5 Ohm/sq), a low gauge factor (~1 up to 80% strain), and a failure strain of more than 400%. They could be patterned down to 10 µm critical dimensions. Skin-like sensors for the hand were assembled using the two processes and their capabilities were demonstrated. Thin (0.5 mm) silicone strips integrating EGaIN wires and micro-cracked Au strain gauges were mounted on gloves to encode the position of a biomimetic robotic finger and a human finger. In combination with soft pressure sensors, they enabled precise grasp analysis over a limited range of motion. Then, biphasic films were micro-patterned on silicone to assemble 50 µm thin epidermal strain gauges. The strain gauges were attached on a user's finger and accurately encoded fine grasping tasks covering most of the human hand range of motion. The biphasic films were also used to power wireless MEMS pressure sensors integrated in a rubber scaffold. The device was mounted on a prosthetic hand to encode normal forces in the 0 N to 20 N range with excellent linearity. The epidermal strain sensors are currently being used to quantify the tremors of patients with Parkinson's disease. In the future, the unique properties of the biphasic films could enable advanced artificial skins integrating a high density of soft transducers and traditional high-performance circuits