Design and Characterization of a Three-Axis Hall Effect-Based Soft Skin Sensor

This research was partially supported by the JSPS Grant-in-Aid for Scientific Research (S) No. 25220005, JSPS Grant-in-Aid for Young Scientists (B) No. 15K21443, NEDO project No. 15657422, Research Institute for Science and Engineering of Waseda University, the Program for Leading Graduate Schools, “Graduate Program for Embodiment Informatics” of the Ministry of Education, Culture, Sports, Science and Technology, and Project LIMOMAN [PIEF-GA-2013-628315]

ホール効果を利用したコンパクトかつ柔軟な分散型3軸スキンセンサー「uSkin」の開発

早大学位記番号:新8143早稲田大

Design and fabrication of force sensing robotic foot utilizing the volumetric displacement of a hyperelastic polymer

Thesis (S.B.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2012.Cataloged from PDF version of thesis.Includes bibliographical references (p. 39-40).This thesis illustrates the fabrication and characterization of a footpad based on an original principle of volumetric displacement sensing. It is intended for use in detecting ground reaction forces in a running quadrupedal robot. The footpad is manufactured as a monolithic, composite structure composed of multi-graded polymers reinforced by glass fiber to increase durability and traction. The volumetric displacement sensing principle utilizes a hyperelastic gel-like pad with embedded magnets and Hall-effect sensors. Normal and shear forces can be detected as contact forces cause the gel-like pad to deform into rigid wells without the need to expose the sensor. A one-time training process using an artificial neural network was used to relate the normal and shear forces with the volumetric displacement sensor output. Two iterations on geometry are prototyped and tested. The first shows the ability to accurately predict normal forces in the Z-axis up to 80 N with a root mean squared error of 6% but little information about shear forces in the X an Y-axis. The second iteration demonstrates an ability to pick up the presence and direction of shear forces up to 40 N but with a root mean squared error of 70%. This project demonstrates a proof-of-concept for a more robust force sensor suitable for use in robotics that requires compliance while interacting with its environment.by Matthew A. Estrada.S.B

An Embedded, Multi-Modal Sensor System for Scalable Robotic and Prosthetic Hand Fingers

Grasping and manipulation with anthropomorphic robotic and prosthetic hands presents a scientific challenge regarding mechanical design, sensor system, and control. Apart from the mechanical design of such hands, embedding sensors needed for closed-loop control of grasping tasks remains a hard problem due to limited space and required high level of integration of different components. In this paper we present a scalable design model of artificial fingers, which combines mechanical design and embedded electronics with a sophisticated multi-modal sensor system consisting of sensors for sensing normal and shear force, distance, acceleration, temperature, and joint angles. The design is fully parametric, allowing automated scaling of the fingers to arbitrary dimensions in the human hand spectrum. To this end, the electronic parts are composed of interchangeable modules that facilitate the echanical scaling of the fingers and are fully enclosed by the mechanical parts of the finger. The resulting design model allows deriving freely scalable and multimodally sensorised fingers for robotic and prosthetic hands. Four physical demonstrators are assembled and tested to evaluate the approach

Design and Characterization of Tri-axis Soft Inductive Tactile Sensors

Tactile sensors are essential for robotic systems to safely and effectively interact with the environment and humans. In particular, tri-axis tactile sensors are crucial for dexterous robotic manipulations by providing shear force, slip or contact angle information. The Soft Inductive Tactile Sensor (SITS) is a new type of tactile sensor that measures inductance variations caused by eddy-current effect. In this paper, we present a soft tri-axis tactile sensor using the configuration of four planar coils and a single conductive film with hyperelastic material in between them. The working principle is explained and design methods are outlined. A 3D finite element model was developed to characterize the tri-axis SITS and to optimize the target design through parameter study. Prototypes were fabricated, characterized and calibrated, and a force measurement resolution of 0.3 mN is achieved in each axis. Demonstrations show that the sensor can clearly measure light touch (a few mN normal force) and shear force pulses (10 to 30 mN) produced by a serrated leaf when it is moved across the sensor surface. The presented sensor is low cost, high performance, robust, durable, and easily customizable for a variety of robotic and healthcare applications

An Embedded, Multi-Modal Sensor System for Scalable Robotic and Prosthetic Hand Fingers

Grasping and manipulation with anthropomorphic robotic and prosthetic hands presents a scientific challenge regarding mechanical design, sensor system, and control. Apart from the mechanical design of such hands, embedding sensors needed for closed-loop control of grasping tasks remains a hard problem due to limited space and required high level of integration of different components. In this paper we present a scalable design model of artificial fingers, which combines mechanical design and embedded electronics with a sophisticated multi-modal sensor system consisting of sensors for sensing normal and shear force, distance, acceleration, temperature, and joint angles. The design is fully parametric, allowing automated scaling of the fingers to arbitrary dimensions in the human hand spectrum. To this end, the electronic parts are composed of interchangeable modules that facilitate the echanical scaling of the fingers and are fully enclosed by the mechanical parts of the finger. The resulting design model allows deriving freely scalable and multimodally sensorised fingers for robotic and prosthetic hands. Four physical demonstrators are assembled and tested to evaluate the approach

A Soft Multiple-Degree of Freedom Load Cell Based on The Hall Effect

The goal of this thesis is to develop a soft multiple-degree-of-freedom (multi-DOF) load cell that is robust and light weight for use in robotics applications to sense three axes of force and a single axis of torque. The displacement of the magnet within the elastomer changes the magnetic flux density which is sensed by two 3-axis Hall effect sensors. Experimental measurements of magnetic flux density within the area of interest were used to formulate analytic expressions that relate magnet field strength to the position of the magnet. The displacement and orientation measurement and the material properties of the elastomer are used to calibrate and calculate the applied load. The ability to measure 3-DOF force and axial torque was evaluated with combined loading applied by a robotic arm (KUKA, LBR r820 iiwa). The decoupled results show the 4-DOF load cell was able to distinguish 3-axis force and 1-axis torque with 6.9% averaged error for normal force, 4.3% and 2.6% for shear force in the X and Y axis and 8.6% for the torque. The results show good accuracy for a soft multi-axis sensor that would be applicable in many robotic applications where high accuracy is not required

Magnetosensitive e-skins for interactive electronics

The rapid progress of electronics and computer science in the last years has brought humans and machines closer than ever before. Current trends like the Internet of Things and artificial intelligence are closing the gap even further, by providing ubiquitous data processing and sensing. As this ongoing revolution advances, novel forms of human-machine interactions are required in an ever more connected world. A crucial component to enable these interactions is the field of flexible electronics, which aims to establish a seamless link between living and artificial entities using electronic skins (e-skins). E-skins combine the functionality of commercial electronics with the soft, stretchable and biocompatible characteristics of human skin or tissue. Until lately, the focus had been to replicate the standard functions associated with human skin, such as, temperature, pressure and chemical detection. Yet, recent developments have also introduced non-standard sensing capabilities like magnetic field detection to create the field of magnetosensitive e-skins. The addition of a supplementary information channel—an electronic sixth sense—has sparked a wide range of applications in the fields of cognitive psychology and human-machine interactions. In this thesis, we expand the concept of magnetosensitive e-skins to include the notion of directionality, which utilizes the full interaction potential of the magnetic field vector. Also, we introduce the use of flexible magnetoelectronics in virtual/augmented reality and human-computer interfaces. Three main results are attained in the course of this work: (i) we first demonstrate how magnetosensitive e-skins can be used as humanmachine interfaces driven by permanent magnet sources in the range of 5 mT. (ii) Building upon this milestone, we realize the first magnetosensitive e-skins which are driven by the earth’s magnetic field of 50 μT. (iii) We fabricate magnetosensitive e-skins which push the detection limit below 1 μT. The magnetosensitive e-skins in this work open exciting possibilities for sensory substitution experiments and sensory processing disorder therapies. Futhermore, for human-machine interactions, they provide a new interactive platform for touchless and gestural control in virtual and augmented reality scenarios beyond the limitations of optics-based systems.Der rasante Fortschritt der Elektronik und der Informatik in den letzten Jahren hat Mensch und Maschine nähergebracht als je zuvor. Aktuelle Trends wie das Internet der Dinge und künstliche Intelligenz schließen die Lücke noch weiter, indem sie eine allgegenwärtige Datenverarbeitung und -erfassung ermöglichen. Mit fortschreitender Revolution sind neue Formen der Mensch-Maschine-Interaktion in einer immer vernetzter werdenden Welt erforderlich. Eine entscheidende Komponente, um diese Interaktionen zu ermöglichen, ist das Gebiet der flexiblen Elektronik, das darauf abzielt, mithilfe elektronischer Häute (e-skins) eine nahtlose Verbindung zwischen lebenden und künstlichen Entitäten herzustellen. E-skins verbinden die Funktionalität kommerzieller Elektronik mit den weichen, dehnbaren und biokompatiblen Eigenschaften menschlicher Haut oder menschlichen Gewebes. Bis vor kurzem lag der Schwerpunkt auf der Nachbildung der mit der menschlichen Haut verbundenen Standardfunktionen wie Temperatur-, Druck- und Chemikalienerkennung. Jüngste Entwicklungen haben jedoch auch nicht standardmäßige Erfassungsfähigkeiten wie die Magnetfelderkennung eingeführt, um das Feld magnetoempfindlicher e-skins zu erzeugen. Die Hinzufügung eines zusätzlichen Informationskanals - eines elektronischen sechsten Sinns - hat eine breite Palette von Anwendungen auf den Gebieten der kognitiven Psychologie und der Mensch-Maschine-Interaktionen ausgelöst. In dieser Arbeit erweitern wir das Konzept der magnetoempfindlichen e-skins um den Begriff der Richtwirkung, bei dem das volle Wechselwirkungspotential des Magnetfeldvektors genutzt wird. Außerdem führen wir die Verwendung flexibler Magnetoelektronik in der virtuellen Realität / erweiterten Realität und in Mensch-Computer-Schnittstellen ein. Im Verlauf dieser Arbeit werden drei Hauptergebnisse erzielt: (i) Wir demonstrieren erstmals, wie magnetoempfindliche e-skins als Mensch-Maschine-Schnittstellen verwendet werden können, die von Permanentmagnetquellen im Bereich von 5 mT angetrieben werden. (ii) Aufbauend auf diesem Meilenstein realisieren wir die ersten magnetoempfindlichen e-skins, die vom Erdmagnetfeld von 50 μT angetrieben werden. (iii) Wir fertigen magnetoempfindliche e-skins, bei denen die Nachweisgrenze unter 1 μT liegt. Die magnetoempfindlichen e-skins in dieser Arbeit eröffnen aufregende Möglichkeiten für sensorische Substitutionsexperimente und Therapien bei sensorischen Verarbeitungsstörungen. Darüber hinaus bieten sie für die Mensch-Maschine-Interaktion eine neue interaktive Plattform für die berührungslose und gestische Steuerung in virtuellen und Augmented Reality-Szenarien, die über die Grenzen optikbasierter Systeme hinausgehen

Utilizing Compliance To Address Modern Challenges in Robotics

Mechanical compliance will be an essential component for agile robots as they begin to leave the laboratory settings and join our world. The most crucial finding of this dissertation is showing how lessons learned from soft robotics can be adapted into traditional robotics to introduce compliance. Therefore, it presents practical knowledge on how to build soft bodied sensor and actuation modules: first example being soft-bodied curvature sensors. These sensors contain both standard electronic components soldered on flexible PCBs and hyperelastic materials that cover the electronics. They are built by curing multi-material composites inside hyper elastic materials. Then it shows, via precise sensing by using magnets and Hall-effect sensors, how closed-loop control of soft actuation modules can be achieved via proprioceptive feedback. Once curvature sensing idea is verified, the dissertation describes how the same sensing methodology, along with the same multi-material manufacturing technique can be utilized to construct soft bodied tri-axial force sensors. It shows experimentally that these sensors can be used by traditional robotic grippers to increase grasping quality. At this point, I observe that compliance is an important property that robots may utilize for different types of motions. One example being Raibert\u27s 2D hopper mechanism. It uses its leg-spring to store energy while on the ground and release this energy before jumping. I observe that via soft material design, it would be possible to embed compliance directly into the linkage design itself. So I go over the design details of an extremely lightweight compliant five-bar mechanism design that can store energy when compressed via soft ligaments embedded in its joints. I experimentally show that the compliant leg design offers increased efficiency compared to a rigid counterpart. I also utilize the previously mentioned soft bodied force sensors for rapid contact detection (~5-10 Hz) in the hopper test platform. In the end, this thesis connects soft robotics with the traditional body of robotic knowledge in two aspects: a) I show that manufacturing techniques we use for soft bodied sensor/actuator designs can be utilized for creating soft ligaments that add strength and compliance to robot joints; and b) I demonstrate that soft bodied force sensing techniques can be used reliably for robotic contact detection