HapBead: on-skin microfluidic haptic interface using tunable bead

On-skin haptic interfaces using soft elastomers which are thin and flexible have significantly improved in recent years. Many are focused on vibrotactile feedback that requires complicated parameter tuning. Another approach is based on mechanical forces created via piezoelectric devices and other methods for non-vibratory haptic sensations like stretching, twisting. These are often bulky with electronic components and associated drivers are complicated with limited control of timing and precision. This paper proposes HapBead, a new on-skin haptic interface that is capable of rendering vibration like tactile feedback using microfluidics. HapBead leverages a microfluidic channel to precisely and agilely oscillate a small bead via liquid flow, which then generates various motion patterns in channel that creates highly tunable haptic sensations on skin. We developed a proof-of-concept design to implement thin, flexible and easily affordable HapBead platform, and verified its haptic rendering capabilities via attaching it to users’ fingertips. A study was carried out and confirmed that participants could accurately tell six different haptic patterns rendered by HapBead. HapBead enables new wearable display applications with multiple integrated functionalities such as on-skin haptic doodles, mixed reality haptics and visual-haptic displays

From wearable towards epidermal computing : soft wearable devices for rich interaction on the skin

Human skin provides a large, always available, and easy to access real-estate for interaction. Recent advances in new materials, electronics, and human-computer interaction have led to the emergence of electronic devices that reside directly on the user's skin. These conformal devices, referred to as Epidermal Devices, have mechanical properties compatible with human skin: they are very thin, often thinner than human hair; they elastically deform when the body is moving, and stretch with the user's skin. Firstly, this thesis provides a conceptual understanding of Epidermal Devices in the HCI literature. We compare and contrast them with other technical approaches that enable novel on-skin interactions. Then, through a multi-disciplinary analysis of Epidermal Devices, we identify the design goals and challenges that need to be addressed for advancing this emerging research area in HCI. Following this, our fundamental empirical research investigated how epidermal devices of different rigidity levels affect passive and active tactile perception. Generally, a correlation was found between the device rigidity and tactile sensitivity thresholds as well as roughness discrimination ability. Based on these findings, we derive design recommendations for realizing epidermal devices. Secondly, this thesis contributes novel Epidermal Devices that enable rich on-body interaction. SkinMarks contributes to the fabrication and design of novel Epidermal Devices that are highly skin-conformal and enable touch, squeeze, and bend sensing with co-located visual output. These devices can be deployed on highly challenging body locations, enabling novel interaction techniques and expanding the design space of on-body interaction. Multi-Touch Skin enables high-resolution multi-touch input on the body. We present the first non-rectangular and high-resolution multi-touch sensor overlays for use on skin and introduce a design tool that generates such sensors in custom shapes and sizes. Empirical results from two technical evaluations confirm that the sensor achieves a high signal-to-noise ratio on the body under various grounding conditions and has a high spatial accuracy even when subjected to strong deformations. Thirdly, Epidermal Devices are in contact with the skin, they offer opportunities for sensing rich physiological signals from the body. To leverage this unique property, this thesis presents rapid fabrication and computational design techniques for realizing Multi-Modal Epidermal Devices that can measure multiple physiological signals from the human body. Devices fabricated through these techniques can measure ECG (Electrocardiogram), EMG (Electromyogram), and EDA (Electro-Dermal Activity). We also contribute a computational design and optimization method based on underlying human anatomical models to create optimized device designs that provide an optimal trade-off between physiological signal acquisition capability and device size. The graphical tool allows for easily specifying design preferences and to visually analyze the generated designs in real-time, enabling designer-in-the-loop optimization. Experimental results show high quantitative agreement between the prediction of the optimizer and experimentally collected physiological data. Finally, taking a multi-disciplinary perspective, we outline the roadmap for future research in this area by highlighting the next important steps, opportunities, and challenges. Taken together, this thesis contributes towards a holistic understanding of Epidermal Devices}: it provides an empirical and conceptual understanding as well as technical insights through contributions in DIY (Do-It-Yourself), rapid fabrication, and computational design techniques.Die menschliche Haut bietet eine große, stets verfügbare und leicht zugängliche Fläche für Interaktion. Jüngste Fortschritte in den Bereichen Materialwissenschaft, Elektronik und Mensch-Computer-Interaktion (Human-Computer-Interaction, HCI) [so that you can later use the Englisch abbreviation] haben zur Entwicklung elektronischer Geräte geführt, die sich direkt auf der Haut des Benutzers befinden. Diese sogenannten Epidermisgeräte haben mechanische Eigenschaften, die mit der menschlichen Haut kompatibel sind: Sie sind sehr dünn, oft dünner als ein menschliches Haar; sie verformen sich elastisch, wenn sich der Körper bewegt, und dehnen sich mit der Haut des Benutzers. Diese Thesis bietet, erstens, ein konzeptionelles Verständnis von Epidermisgeräten in der HCI-Literatur. Wir vergleichen sie mit anderen technischen Ansätzen, die neuartige Interaktionen auf der Haut ermöglichen. Dann identifizieren wir durch eine multidisziplinäre Analyse von Epidermisgeräten die Designziele und Herausforderungen, die angegangen werden müssen, um diesen aufstrebenden Forschungsbereich voranzubringen. Im Anschluss daran untersuchten wir in unserer empirischen Grundlagenforschung, wie epidermale Geräte unterschiedlicher Steifigkeit die passive und aktive taktile Wahrnehmung beeinflussen. Im Allgemeinen wurde eine Korrelation zwischen der Steifigkeit des Geräts und den taktilen Empfindlichkeitsschwellen sowie der Fähigkeit zur Rauheitsunterscheidung festgestellt. Basierend auf diesen Ergebnissen leiten wir Designempfehlungen für die Realisierung epidermaler Geräte ab. Zweitens trägt diese Thesis zu neuartigen Epidermisgeräten bei, die eine reichhaltige Interaktion am Körper ermöglichen. SkinMarks trägt zur Herstellung und zum Design neuartiger Epidermisgeräte bei, die hochgradig an die Haut angepasst sind und Berührungs-, Quetsch- und Biegesensoren mit gleichzeitiger visueller Ausgabe ermöglichen. Diese Geräte können an sehr schwierigen Körperstellen eingesetzt werden, ermöglichen neuartige Interaktionstechniken und erweitern den Designraum für die Interaktion am Körper. Multi-Touch Skin ermöglicht hochauflösende Multi-Touch-Eingaben am Körper. Wir präsentieren die ersten nicht-rechteckigen und hochauflösenden Multi-Touch-Sensor-Overlays zur Verwendung auf der Haut und stellen ein Design-Tool vor, das solche Sensoren in benutzerdefinierten Formen und Größen erzeugt. Empirische Ergebnisse aus zwei technischen Evaluierungen bestätigen, dass der Sensor auf dem Körper unter verschiedenen Bedingungen ein hohes Signal-Rausch-Verhältnis erreicht und eine hohe räumliche Auflösung aufweist, selbst wenn er starken Verformungen ausgesetzt ist. Drittens, da Epidermisgeräte in Kontakt mit der Haut stehen, bieten sie die Möglichkeit, reichhaltige physiologische Signale des Körpers zu erfassen. Um diese einzigartige Eigenschaft zu nutzen, werden in dieser Arbeit Techniken zur schnellen Herstellung und zum computergestützten Design von multimodalen Epidermisgeräten vorgestellt, die mehrere physiologische Signale des menschlichen Körpers messen können. Die mit diesen Techniken hergestellten Geräte können EKG (Elektrokardiogramm), EMG (Elektromyogramm) und EDA (elektrodermale Aktivität) messen. Darüber hinaus stellen wir eine computergestützte Design- und Optimierungsmethode vor, die auf den zugrunde liegenden anatomischen Modellen des Menschen basiert, um optimierte Gerätedesigns zu erstellen. Diese Designs bieten einen optimalen Kompromiss zwischen der Fähigkeit zur Erfassung physiologischer Signale und der Größe des Geräts. Das grafische Tool ermöglicht die einfache Festlegung von Designpräferenzen und die visuelle Analyse der generierten Designs in Echtzeit, was eine Optimierung durch den Designer im laufenden Betrieb ermöglicht. Experimentelle Ergebnisse zeigen eine hohe quantitative Übereinstimmung zwischen den Vorhersagen des Optimierers und den experimentell erfassten physiologischen Daten. Schließlich skizzieren wir aus einer multidisziplinären Perspektive einen Fahrplan für zukünftige Forschung in diesem Bereich, indem wir die nächsten wichtigen Schritte, Möglichkeiten und Herausforderungen hervorheben. Insgesamt trägt diese Arbeit zu einem ganzheitlichen Verständnis von Epidermisgeräten bei: Sie liefert ein empirisches und konzeptionelles Verständnis sowie technische Einblicke durch Beiträge zu DIY (Do-It-Yourself), schneller Fertigung und computergestützten Entwurfstechniken

Like a Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception

The emerging class of epidermal devices opens up new opportunities for skin-based sensing, computing, and interaction. Future design of these devices requires an understanding of how skin-worn devices affect the natural tactile perception. In this study, we approach this research challenge by proposing a novel classification system for epidermal devices based on flexural rigidity and by testing advanced adhesive materials, including tattoo paper and thin films of poly (dimethylsiloxane) (PDMS). We report on the results of three psychophysical experiments that investigated the effect of epidermal devices of different rigidity on passive and active tactile perception. We analyzed human tactile sensitivity thresholds, two-point discrimination thresholds, and roughness discrimination abilities on three different body locations (fingertip, hand, forearm). Generally, a correlation was found between device rigidity and tactile sensitivity thresholds as well as roughness discrimination ability. Surprisingly, thin epidermal devices based on PDMS with a hundred times the rigidity of commonly used tattoo paper resulted in comparable levels of tactile acuity. The material offers the benefit of increased robustness against wear and the option to re-use the device. Based on our findings, we derive design recommendations for epidermal devices that combine tactile perception with device robustness

Bio-Mimetic Smart System Functioning Like Natural Skin and Muscle

Soft machines, or soft robotics, are emerging technologies bringing many exciting prospects for the coming future. Creating soft machines with biomimetic functions is of key importance for applications in bettering human life and creating more complex robotic systems. Various mechanisms have been adopted to mimic natural tactile sense, tough, muscular motion, and even artificial intelligence. Among these, developing a bio-mimetic system capable of self-healing and degradation that behaves like a muscular hydrostat is appealing for soft robotics. This thesis will mainly focus on developing both artificial skin and artificial muscles that can self-heal, be recycled, and function like biological tissue. To develop a biomimetic artificial skin, we adopted an imine-bonded polymer as the main component, and embedded silver nanoparticles as well as liquid metals to create conductive components. Our artificial skin is capable of re-healing and recycling, and can be mounted to a complex 3D surface without introducing damage and strains. Such artificial skin, at the same time, can sense pressure and temperature change, flow across the surface, and humidity change in the atmosphere. Recyclability enables this platform to not only serve as an artificial skin, but also for other electronics applications. The artificial muscles were also developed for this project based on a recently invented Liquid Crystal Elastomer, whose behavior is most similar to that of natural muscles. To achieve large actuation strains, a fast response, and small scale local controlling, a Liquid Metal was introduced for stimulating the artificial muscle. Over 100% linear contracting strain was realized based on such a combination, which is greater than that of natural muscles. Bending and twisting deformation were also realized easily on such system. To further demonstrate the advantages of our artificial muscle, we integrated it into other passive soft elastomers like Ecoflex to mimic the camouflage behavior of cephalopods

Functional Materials and Innovative Strategies for Wearable Thermal Management Applications

Thermal management is essential in our body as it affects various bodily functions, ranging from thermal discomfort to serious organ failures, as an example of the worst-case scenario. There have been extensive studies about wearable materials and devices that augment thermoregulatory functionalities in our body, employing diverse materials and systematic approaches to attaining thermal homeostasis. This paper reviews the recent progress of functional materials and devices that contribute to thermoregulatory wearables, particularly emphasizing the strategic methodology to regulate body temperature. There exist several methods to promote personal thermal management in a wearable form. For instance, we can impede heat transfer using a thermally insulating material with extremely low thermal conductivity or directly cool and heat the skin surface. Thus, we classify many studies into two branches, passive and active thermal management modes, which are further subdivided into specific strategies. Apart from discussing the strategies and their mechanisms, we also identify the weaknesses of each strategy and scrutinize its potential direction that studies should follow to make substantial contributions to future thermal regulatory wearable industries

Wireless haptic system design for a multiplayer VR game scenario

Tactile sensation plays a crucial role in helping people intensely experience their surroundings in the real world. Thus, it is incorporated, in the form of haptic feedback, into a range of devices from smartwatches and tablets to handwriting-training devices and aviation vests. In addition, research has indicated potential associations between haptic feedback and Virtual Reality (VR). Consequently, many companies have gradually introduced this feature to VR as tactile alerts. However, most high-density vibration studies have only focused on the human torso rather than hands. Moreover, most existing commercial VR gloves support vibrotactile reactions with only five vibration motors attached to fingertip positions, resulting in virtual touch loss. In contrast, adding more actuators to the gloves can increase tactile resolution and enhance users’ levels of immersion in VR. This thesis investigates the effect of touch sensations produced with high-density vibration patterns on users’ sense of immersion in VR. This study followed the Research through Design (RtD) approach to design and prototyped a pair of affordable haptic gloves with 18 vibratory motors. In addition, the research systematically labeled these motors by converting their locations into a two-dimensional matrix for convenient manipulation and future extension. Next, eight vibration modes were implemented and remotely controlled in real time via a custom Representational State Transfer (REST) Application Programming Interface (API) with parameters such as oscillating intensity, duration, and the specific motor to trigger. Furthermore, the study documented the design process of four versions of the gloves and compared their wearability in terms of modularization for quick replacement and hygiene standards, starting from the creation with Through-Hole Technology (THT) electronic components to Surface-Mount Technology (SMT) materials soldered on soft and hard Printed Circuit Board (PCB). Questionnaire assessments of VR immersion improved by the vibration patterns and the wearability of the haptic gloves were collected from 20 adults after a user test. The results showed that the haptic gloves were comfortable to wear during long-lasting VR sessions because of reduced stiffness, and the vibrotactile patterns truly enhanced users’ sense of VR immersion in some circumstances. On the other hand, the test findings highlighted the shortage of integration between the vibrotactile modes and the VR visuals. A possible future application of the haptic gloves could be stroke-patient rehabilitation with custom vibration patterns. Finally, the research illustrates technical difficulties in self-fabrication regarding size minimization of the glove control box and hardware debugging and provides practical suggestions for further improvements.Media files notes: Media rights: CC-BY-NC-ND 4.

Soft Tactile Sensors for Mechanical Imaging

Tactile sensing aims to electronically capture physical attributes of an object via mechanical contact. It proves indispensable to many engineering tasks and systems, in areas ranging from manufacturing to medicine and autonomous robotics. Biological skin, which is highly compliant, is able to perform sensing under challenging and highly variable conditions with levels of performance that far exceed what is possible with conventional tactile sensors, which are normally fabricated with non-conforming materials. The development of stretchable, skin-like tactile sensors has, as a result, remained a longstanding goal of engineering. However, to date, artificial tactile sensors that might mimic both the mechanical and multimodal tactile sensory capabilities of biological skin remain far from realization, due to the challenges of fabricating spatially dense, mechanically robust, and compliant sensors in elastic media. Inspired by these demands, this dissertation addresses many aspects of the challenging problem of engineering skin-like electronic sensors. In the first part of the thesis, new methods for the design and fabrication of thin, highly deformable, high resolution tactile sensors are presented. The approach is based on a novel configuration of arrays of microfluidic channels embedded in thin elastomer membranes. To form electrodes, these channels are filled with a metal alloy, eutectic Gallium Indium, that remains liquid at room temperature. Using capacitance sensing techniques, this approach achieves sensing resolutions of 1 mm$^{-1}$. To fabricate these devices, an efficient and robust soft lithography method is introduced, based on a single step cast. An analytical model for the performance of these devices is derived from electrostatic theory and continuum mechanics, and is demonstrated to yield excellent agreement with measured performance. This part of the investigation identified fundamental limitations, in the form of nonmonotonic behavior at low strains, that is demonstrated to generically affect solid cast soft capacitive sensors. The next part of the thesis is an investigation of new methods for designing soft tactile sensors based on multi-layer heterogeneous 3D structures that combine active layers, containing embedded liquid metal electrodes, with passive and mechanically tunable layers, containing air cavities and micropillar geometric supports. In tandem with analytical and computational modeling, these methods are demonstrated to facilitate greater control over mechanical and electronic performance. A new soft lithography fabrication method is also presented, based on the casting, alignment, and fusion of multiple functional layers in a soft polymer substrate. Measurements indicate that the resulting devices achieve excellent performance specifications, and avoid the limiting nonmonotonic behavior identified in the first part of the thesis. In order to demonstrate the practical utility of the devices, we used them to perform dynamic two-dimensional tactile imaging under distributed indentation loads. The results reflect the excellent static and dynamic performance of these devices. The final part of the thesis investigates the utility of the tactile sensing methods pursued here for imaging lumps embedded in simulated tissue. In order to facilitate real-time sensing, an electronic system for fast, array based measurement of small, sub-picofarad (pF) capacitance levels was developed. Using this system, we demonstrated that it is possible to accurately capture strain images depicting small lumps embedded in simulated tissue with either an electronic imaging system or a sensor worn on the finger, supporting the viability of wearable sensors for tactile imaging in medicine. In conclusion, this dissertation confronts many of the most vexing problems arising in the pursuit of skin-like electronic sensors, including fundamental operating principles, structural and functional electronic design, mechanical and electronic modeling, fabrication, and applications to biomedical imaging. The thesis also contributes knowledge needed to enable applications of tactile sensing in medicine, an area that has served as a key source of motivation for this work, and aims to facilitate other applications in areas such as manufacturing, robotics, and consumer electronics.Ph.D., Electrical Engineering -- Drexel University, 201