Enriching passive touch sensation on flat surfaces using visual feedback

While human computer interaction has evolved around touch interaction a lot in recent years, it's been lacking any haptic feedback from the very beginning. Nowadays, devices using touch interaction all to do on a flat surface, using either a projection of digital contents or a touch screen. Since haptic feedback is an important factor in human surface perception, people have tried various ways to simulate haptic feedback even on completely flat surfaces. One of these ways is electrotacile feedback, which has mostly been used to simulate surface properties on active touch where the user has to move their finger over the surface in order to feel the haptic sensation. Previous research shows that vision is also a very important factor in surface perception and proprioception in general. We conducted a user study to investigate the influence of visual feedback on passive touch using electrotactile feedback. We concentrated on simulating depth instead of roughness which doesn't word particularly well for passive touch. We found that even though both electrotactile and visual feedback work well for depth or softness if applied individually, as soon as we presented our study subjects a condition with both feedback types, they did not repond to it anymore.Während sich die Mensch-Computer-Interaktion in den letzten Jahren stark um Touch-Interaktion entwickelt hat, hat dieser Interaktion von Anfang an jegliche Form des haptischen Feedbacks gefehlt. Heutzutage nuten alle touchfähigen Gerate flache Displays oder Projektionen von digitalen Inhalten auf flache Oberflächen. Da haptisches Feedback ein wichtiger Faktor der menschlichen Oberflächenwahrnehmung ist wurden schon viele Wege erforscht um haptisches Feedback auf komplett flachen Oberflächen zu simulieren. Eine dieser Wege ist elektrotaktiles Feedback was bisher hauptsächlich benutzt wurde um Oberflächeneigenschaften bei aktiver Berührung zu simulieren, also bei einem sich bewegenden Finger auf der Oberfläche. Vorige Studien zeigen auch, dass Visuelle Reize ein wichtiger Faktor bei der Oberflächenwahrnehmung sind und sogar die Wahrnehmung im Generellen dominieren. Wir haben eine Benutzerstudie durchgeführt um den Einfluss von visuellem Feedback auf passive Berührungen mit elektrotaktilem Feedback zu bestimmen. Wir haben und auf die Simulaton von Tiefe statt Rauhheit konzentriert, was schlecht mit passiven Berührungen funktioniert. Unsere Studie hat gezeigt dass obwohl das elektrotaktile und das visuelle Feedback alleine gut funktionieren um Weichheit oder Tiefe zu simulieren, beide Feedbackarten zusammen keine signifikanten Unterschiede erzielen

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022, held in Hamburg, Germany, in May 2022. The 36 regular papers included in this book were carefully reviewed and selected from 129 submissions. They were organized in topical sections as follows: haptic science; haptic technology; and haptic applications

Enabling wearable soft tactile displays with dielectric elastomer actuators

PhDTouch is one of the less exploited sensory channels in human machine interactions. While the introduction of the tactile feedback would improve the user experience in several fields, such as training for medical operators, teleoperation, computer aided design and 3D model exploration, no interfaces able to mimic accurately and realistically the tactile feeling produced by the contact with a real soft object are currently available. Devices able to simulate the contact with soft bodies, such as the human organs, might improve the experience. The existing commercially available tactile displays consist of complex mechanisms that limit their portability. Moreover, no devices are able to provide tactile stimuli via a soft interface that can also modulate the contact area with the finger pad, which is required to realistically mimic the contact with soft bodies, as needed for example in systems aimed at simulating interactions with virtual biological tissues or in robot-assisted minimally invasive surgery. The aim of this thesis is to develop such a wearable tactile display based on the dielectric elastomer actuators (DEAs). DEAs are a class of materials that respond to an electric field producing a deformation. In particular, in this thesis, the tactile element consists of a so-called hydrostatically coupled dielectric elastomer actuator (HC-DEAs). HC-DEAs rely on an incompressible fluid that hydrostatically couples a DEA-based active part to a passive part interfaced to the user. The display was also tested within a closed-loop configuration consisting of a hand tracking system and a custom made virtual environment. This proof of concept system allowed for a validation of the abilities of the display. Mechanical and psychophysical tests were performed in order to assess the ability of the system to provide tactile stimuli that can be distinguished by the users. Also, the miniaturisation of the HC-DEA was investigated for applications in refreshable Braille displays or arrays of tactile elements for tactile maps

Electronic Textiles as Tangible Interface for Virtual Reality

This project investigates the development of a series of experimental, tangible, electronic textile (e-textile) interfaces to virtual reality (VR), using the approach of human-computer interaction (HCI). The e-textile interface is an unconventional controller that manipulates objects (3D visual asset) within virtual reality. This research has been framed within the context of HCI using a framework of Tangible User Interfaces (Ulmer and Ishii 2000). Through this research I explore how human touch relates to tangible objects and passive haptics. I also explore the overlap between visual experience and virtual reality by employing the theory of Haptic-Visual overlap (Fitzmaurice 1998), which deals with 3D volumetric perception of a physical object as well as the idea of Active Touch (Gibson 1962, Lederman and Klatzky 2009, Visell et al. 2016). Using the aforementioned theoretical frameworks and employing research through design methodology, I prototyped a series of explorative e-textile interfaces and virtual reality digital counterparts

Modeling of frictional forces during bare-finger interactions with solid surfaces

Touching an object with our fingers yields frictional forces that allow us to perceive and explore its texture, shape, and other features, facilitating grasping and manipulation. While the relevance of dynamic frictional forces to sensory and motor function in the hand is well established, the way that they reflect the shape, features, and composition of touched objects is poorly understood. Haptic displays -electronic interfaces for stimulating the sense of touch- often aim to elicit the perceptual experience of touching real surfaces by delivering forces to the fingers that mimic those felt when touching real surfaces. However, the design and applications of such displays have been limited by the lack of knowledge about what forces are felt during real touch interactions. This represents a major gap in current knowledge about tactile function and haptic engineering. This dissertation addresses some aspects that would assist in their understanding. The goal of this research was to measure, characterize, and model frictional forces produced by a bare finger sliding over surfaces of multiple shapes. The major contributions of this work are (1) the design and development of a sensing system for capturing fingertip motion and forces during tactile exploration of real surfaces; (2) measurement and characterization of contact forces and the deformation of finger tissues during sliding over relief surfaces; (3) the development of a low order model of frictional force production based on surface specifications; (4) the analysis and modeling of contact geometry, interfacial mechanics, and their effects in frictional force production during tactile exploration of relief surfaces. This research aims to guide the design of algorithms for the haptic rendering of surface textures and shape. Such algorithms can be used to enhance human-machine interfaces, such as touch-screen displays, by (1) enabling users to feel surface characteristics also presented visually; (2) facilitating interaction with these devices; and (3) reducing the need for visual input to interact with them.Ph.D., Electrical Engineering -- Drexel University, 201

Haptics Rendering and Applications

There has been significant progress in haptic technologies but the incorporation of haptics into virtual environments is still in its infancy. A wide range of the new society's human activities including communication, education, art, entertainment, commerce and science would forever change if we learned how to capture, manipulate and reproduce haptic sensory stimuli that are nearly indistinguishable from reality. For the field to move forward, many commercial and technological barriers need to be overcome. By rendering how objects feel through haptic technology, we communicate information that might reflect a desire to speak a physically- based language that has never been explored before. Due to constant improvement in haptics technology and increasing levels of research into and development of haptics-related algorithms, protocols and devices, there is a belief that haptics technology has a promising future

Haptic Media Scenes

The aim of this thesis is to apply new media phenomenological and enactive embodied cognition approaches to explain the role of haptic sensitivity and communication in personal computer environments for productivity. Prior theory has given little attention to the role of haptic senses in influencing cognitive processes, and do not frame the richness of haptic communication in interaction design—as haptic interactivity in HCI has historically tended to be designed and analyzed from a perspective on communication as transmissions, sending and receiving haptic signals. The haptic sense may not only mediate contact confirmation and affirmation, but also rich semiotic and affective messages—yet this is a strong contrast between this inherent ability of haptic perception, and current day support for such haptic communication interfaces. I therefore ask: How do the haptic senses (touch and proprioception) impact our cognitive faculty when mediated through digital and sensor technologies? How may these insights be employed in interface design to facilitate rich haptic communication? To answer these questions, I use theoretical close readings that embrace two research fields, new media phenomenology and enactive embodied cognition. The theoretical discussion is supported by neuroscientific evidence, and tested empirically through case studies centered on digital art. I use these insights to develop the concept of the haptic figura, an analytical tool to frame the communicative qualities of haptic media. The concept gauges rich machine- mediated haptic interactivity and communication in systems with a material solution supporting active haptic perception, and the mediation of semiotic and affective messages that are understood and felt. As such the concept may function as a design tool for developers, but also for media critics evaluating haptic media. The tool is used to frame a discussion on opportunities and shortcomings of haptic interfaces for productivity, differentiating between media systems for the hand and the full body. The significance of this investigation is demonstrating that haptic communication is an underutilized element in personal computer environments for productivity and providing an analytical framework for a more nuanced understanding of haptic communication as enabling the mediation of a range of semiotic and affective messages, beyond notification and confirmation interactivity

Artificial Tactile System and Signal Processing for Haptic applications

Human have the ability to interact with the external environment through five main senses which are vision, hearing, smell, taste and touch. Most of all, the sensation like vision or hearing have been well developed and the use of various applications like TV, Camera, or artificial cochlear have been widely generalized. As the next steps, recently, the tactile sensor to mimic the tactile system of human have been attracted by many groups. Especially, after the development of Apple’s iPhone, the public interest about touch sensing applications have been increased explosively. Other researches for tactile sensing have focused on enhancing the performance of tactile sensor like the sensitivity, stability, response time and so on. As a result, there are some researches that the sensor performance of certain criteria is better than that of human tactile system. However, a human tactile system is not only very sensitive but also complex. In other words, ultimately, the tactile system mimicking the human tactile sensation should detect various parameters such as the pressure, temperature, hardness or roughness and also decide the psychological feeling like the pain by a hot material in touching or the smooth/roughness feeling in sliding the certain material. Therefore, in this thesis, it has been studied for the development of multifunctional tactile sensing system detecting various tactile parameters and deciding the kinds of psychological tactile feeling by measured stimulation. As the first step for the development of tactile system, we have studied the tactile sensor using ZnO nanowire. Therefore, in this chapter, the basic characteristics of ZnO nanowire are investigated to confirm the possibility for the tactile sensor. In addition, structural design factors of sensor units have been studied in order to enhance the sensitivity of ZnO nanowire-based tactile sensor. We have primarily demonstrated the effect of a square pattern array design in a pressure sensor using ZnO nanowires. Nanowires grown on the edge of cells can be bent easily because of growth direction, density of nanowires, and buckling effect. Since smaller square pattern arrays induce a higher circumference to cell area ratio, if one sensor unit consists of many micro-level square pattern arrays, the design enhances the piezoelectric efficiency and the sensitivity. As a result, 20um × 20um cell arrays showed three times higher pressure sensitivity than 250um × 250um cell array structures at a pressure range from 4kPa to 14kPa. The induced piezoelectric voltage with the same pressure level also increased drastically. Therefore, the smaller pattern array design is more appropriate for a high-sensitive pressure sensor than a simple one-body cell design for tactile systems, and it has the advantage of better power efficiency, which is also important for artificial tactile systems. Even if, in previous experiments, the possibility of piezoelectric materials as the tactile sensor and the method for the enhancement of pressure sensitivity are confirmed well, the tactile sensor for mimicking the human tactile sensation should measure various parameters as well as the pressure. However, many studies about ‘smooth-rough’ sensation depend on the machine learning technology with simple tactile sensors rather than developing the sensors that can measure various parameters like surface topography, hardness, quality of materials at the same time. Therefore, after the development of the pressure sensor, specific structures based on PDMS are proposed to measure and analyze above-mentioned parameters related to ‘smooth-rough’ decision, as like fingerprint of human. To find the optimized structure, three kinds of the structure shape (cone, cylinder and dome) are fabricated and the pressure sensitivity according to the shape are also measured. FEM simulation is also carried out to support the experimental result. Our tactile sensor with optimized dome structure (500um height) provides high shear force sensitivity, fast response time, stability, and durability. The high sensitivity about the shear force enables better the tactile sensor to measure the various surface information such as the pitch of pattern, the depth, the sliding velocity, the hardness and so on. In addition, after the study to measure the various surface information by dome structure, the research to measure the other surface information is also followed. In our previous study, we confirmed that the surface topography can be reconstructed by mapping the piezoelectric signals according to the location. In this research, to reduce the number of measurements from dozens to once and minimize the data loss at the empty space between adjacent sensors, the electrode array of Zig-Zag type is applied to the tactile sensor. As a result, with just one measurement, the surface topography of broad region can be successfully reconstructed by our tactile sensor as the high-resolution image. Additionally, the temperature sensor based on the resistive mechanism is fabricated between the Zig-Zag electrode lines to measures the temperature of surface materials when the tactile sensor rubs on the materials in real time. Over the development of the tactile sensing applications, the demand for an artificial system like human tactile sensation have been much more increased. Therefore, in this study, as a surrogate for human tactile sensation, we propose an artificial tactile sensing system based on the developed sensors in previous sections. For this, the piezoelectric tactile signal generated by touching and rubbing the material is transferred to DAQ system connected with our tactile sensor. First, the system decides whether the contacted material is dangerous or not. If dangerous like sharp or hot materials, the warning signal is generated by our artificial tactile system. If not, the sensor connected with the system rubs the materials and detects the roughness of the materials. Especially, the human test data related to ‘soft-rough’ detection is applied to a deep learning structure allowing personalization of the system, because tactile responses vary among humans. This approach could be applied to electronic devices with tactile emotional exchange capabilities, as well as various advanced digital experiences. In this thesis, human-like tactile sensing system based on the piezoelectric effect is successfully confirmed through various experiments. Although there are still some issues that need to be improved, this research is expected to be fundamental results for human-like tactile sensing system detecting a variety of the parameters such as the pressure, temperature, surface morphology, hardness, roughness and so on. In the future, through collaborative research with other fields like brain science, signal processing, we hope that this research can mimic psychological tactile sensations and communicate emotional exchange with external environment like real human skin.YList of Contents Abstract i List of contents iii List of tables vi List of figures vii Ⅰ. INTRODUCTION 1 1.1 Motivation 1 1.2 Various transduction mechanisms for the tactile sensor 5 1.2.1 Capacitive mechanism 5 1.2.2 Resistive mechanism 6 1.2.3 Triboelectric effect 7 1.2.4 Piezoelectric effect 9 1.3 Objectives 12 1.4 Reference 13 II. BASIC CHARACTERISTICS AND THE METHOD FOR ENHANC-ING THE PRESSURE SENSITIVITY OF THE TACTILE SENSOR BASED ON ZnO NANOWIRE 19 2.1 Introduction 19 2.2 Basic characteristics of ZnO nanowire 22 2.3 Device Fabrication 31 2.4 Morphological and Electrical characteristics 33 2.5 Pattern structure for enhanced for pressure sensitivity 38 2.6 Simulation result of piezoelectric effect for pattern structure 42 2.7 Reference 46 III. DOME STRUCTURE TO MEAUSRE THE SURFACE INFOR-MATION 52 3.1 Introduction 52 3.2 Basic characteristics of P(VDF-TrFE) 53 3.3 Device fabrication 61 3.4 Interaction mechanism between dome structure and surface material 63 3.5 Simulation and Experimental result comparing cone, cylinder, and dome structure 64 3.6 Simulation and Experimental result of the sensitivity enhancement ef-fect by dome structure 66 3.7 Depth measurement by tactile sensor with dome structure 72 3.8 Pattern of pitch by multi-array tactile sensor with dome structure 77 3.9 Hardness measurement by the tactile sensor with dome structure 79 3.10 Reference 83 IV. ZIG-ZAG ARRAYED TACTILE SENSOR BASED ON PIEZOE-LECTRIC-RESISTIVE MECHANISM TO DETECT THE SURFACE TOPOG-RAPHY AND TEMPERATURE 87 4.1 Introduction 87 4.2 Device fabrication 88 4.3 Piezoelectric characteristics of fabricated tactile sensor 90 4.4 Surface rendering method by the piezoelectric effect 95 4.5 Surface rendering result of 3D printed materials 96 4.6 Temperature sensing in sliding the high temperature material on Zig-Zag tactile sensor 99 4.7 Reference 103 V. TACTILE SENSING SYSTEM FOR PAIN AND SMOOTH/ROUGH DETECTION 105 5.1 Introduction 105 5.2 Components of the tactile sensing system 107 5.3 Artificial tactile sensing system for generating the pain warning 108 5.4 Artificial tactile sensing system for smooth/rough sensing 112 5.5 Reference 117 VⅠ. CONCLUSION 120DoctordCollectio