A Novel Untethered Hand Wearable with Fine-Grained Cutaneous Haptic Feedback

During open surgery, a surgeon relies not only on the detailed view of the organ being operated upon and on being able to feel the fine details of this organ but also heavily relies on the combination of these two senses. In laparoscopic surgery, haptic feedback provides surgeons information on interaction forces between instrument and tissue. There have been many studies to mimic the haptic feedback in laparoscopic-related telerobotics studies to date. However, cutaneous feedback is mostly restricted or limited in haptic feedback-based minimally invasive studies. We argue that fine-grained information is needed in laparoscopic surgeries to study the details of the instrument’s end and can convey via cutaneous feedback. We propose an exoskeleton haptic hand wearable which consists of five 4 ⇥ 4 miniaturized fingertip actuators, 80 in total, to convey cutaneous feedback. The wearable is described as modular, lightweight, Bluetooth, and WiFi-enabled, and has a maximum power consumption of 830 mW. Software is developed to demonstrate rapid tactile actuation of edges; this allows the user to feel the contours in cutaneous feedback. Moreover, to demonstrate the idea as an object displayed on a flat monitor, initial tests were carried out in 2D. In the second phase, the wearable exoskeleton glove is then further developed to feel 3D virtual objects by using a virtual reality (VR) headset demonstrated by a VR environment. Two-dimensional and 3D objects were tested by our novel untethered haptic hand wearable. Our results show that untethered humans understand actuation in cutaneous feedback just in a single tapping with 92.22% accuracy. Our wearable has an average latency of 46.5 ms, which is much less than the 600 ms tolerable delay acceptable by a surgeon in teleoperation. Therefore, we suggest our untethered hand wearable to enhance multimodal perception in minimally invasive surgeries to naturally feel the immediate environments of the instruments

Laterotactile Rendering of Vector Graphics with the Stroke Pattern

Abstract. Raised line patterns are used extensively in the design of tactile graphics for persons with visual impairments. A tactile stroke pattern was therefore developed to enable the rendering of vector graphics by lateral skin deformation. The stroke pattern defines a transversal profile and a longitudinal texture which provide tactile feedback while respectively crossing over the stroke and tracing its length. The stroke pattern is demonstrated with the rendering of lines, circles and polygons, and is extensible to other vector graphics primitives such as curves. The parametric nature of the stroke allows the representation of distinctive line types and the online adjustment of line thickness and other parameters according to user preferences and capabilities. The stroke pattern was informally evaluated with four visually impaired volunteers. Key words: assistive technology, visual impairment, tactile graphics, tactile display, haptic rendering, laterotactile renderin

Tactile Arrays for Virtual Textures

This thesis describes the development of three new tactile stimulators for active touch, i.e. devices to deliver virtual touch stimuli to the fingertip in response to exploratory movements by the user. All three stimulators are designed to provide spatiotemporal patterns of mechanical input to the skin via an array of contactors, each under individual computer control. Drive mechanisms are based on piezoelectric bimorphs in a cantilever geometry. The first of these is a 25-contactor array (5 × 5 contactors at 2 mm spacing). It is a rugged design with a compact drive system and is capable of producing strong stimuli when running from low voltage supplies. Combined with a PC mouse, it can be used for active exploration tasks. Pilot studies were performed which demonstrated that subjects could successfully use the device for discrimination of line orientation, simple shape identification and line following tasks. A 24-contactor stimulator (6 × 4 contactors at 2 mm spacing) with improved bandwidth was then developed. This features control electronics designed to transmit arbitrary waveforms to each channel (generated on-the-fly, in real time) and software for rapid development of experiments. It is built around a graphics tablet, giving high precision position capability over a large 2D workspace. Experiments using two-component stimuli (components at 40 Hz and 320 Hz) indicate that spectral balance within active stimuli is discriminable independent of overall intensity, and that the spatial variation (texture) within the target is easier to detect at 320 Hz that at 40 Hz. The third system developed (again 6 × 4 contactors at 2 mm spacing) was a lightweight modular stimulator developed for fingertip and thumb grasping tasks; furthermore it was integrated with force-feedback on each digit and a complex graphical display, forming a multi-modal Virtual Reality device for the display of virtual textiles. It is capable of broadband stimulation with real-time generated outputs derived from a physical model of the fabric surface. In an evaluation study, virtual textiles generated from physical measurements of real textiles were ranked in categories reflecting key mechanical and textural properties. The results were compared with a similar study performed on the real fabrics from which the virtual textiles had been derived. There was good agreement between the ratings of the virtual textiles and the real textiles, indicating that the virtual textiles are a good representation of the real textiles and that the system is delivering appropriate cues to the user

Force Sensing Surgical Scissor Blades using Fibre Bragg Grating Sensors

This thesis considers the development and analysis of unique sensorised surgical scissor blades for application in minimally invasive robotic surgery (MIRS). The lack of haptic (force and tactile) feedback to the user is currently an unresolved issue with modern MIRS systems. This thesis presents details on smart sensing scissor blades which enable the measurement of instrument-tissue interaction forces for the purpose of force reflection and tissue property identification. A review of current literature established that there exists a need for small compact, biocompatible, sterilisable and robust sensors which meet the demands of current MIRS instruments. Therefore, the sensorised blades exploit the strain sensing capabilities of a single fibre Bragg grating (FBG) sensor bonded to their surface. The nature and magnitude of the strain likely to be experienced by the blades, and consequently the FBG sensor, while cutting soft tissue samples were characterised through the use of an application specific test-bed. Using the sensorised blades to estimate fracture properties is proposed, hence two methods of extracting fracture toughness information from the test samples are assessed and compared. Investigations were carried out on the factors affecting the transfer of strain from the blade material to the core of the FBG sensor for surface mounted or partially embedded arrangements. Results show that adhesive bond length, thickness and stiffness need to be carefully specified when bonding FBG sensors to ensure effective strain transfer. Calibration and dynamic cutting experiments were carried out using the characterisation test-bed. The complex nature of the blade interaction forces were modelled, primarily for the purpose of decoupling the direct, lateral, friction and fracture strains experienced by the bonded FBG sensor during cutting. The modelled and experimental results show that the approach taken in sensorising the blade enables detailed cutting force data to be obtained and consequently leads to a unique method in estimating the kinetic friction coefficient for the blades. The forces measured using the FBG are validated against a commercial load cell used in the test-bed. This research work demonstrates that this unique approach of placing a single optical fibre onto the scissor blades can, in an unobtrusive manner, measure interblade friction forces and material fracture properties occurring at the blade-tissue interface

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

Human-Machine Interfaces using Distributed Sensing and Stimulation Systems

As the technology moves towards more natural human-machine interfaces (e.g. bionic limbs, teleoperation, virtual reality), it is necessary to develop a sensory feedback system in order to foster embodiment and achieve better immersion in the control system. Contemporary feedback interfaces presented in research use few sensors and stimulation units to feedback at most two discrete feedback variables (e.g. grasping force and aperture), whereas the human sense of touch relies on a distributed network of mechanoreceptors providing a wide bandwidth of information. To provide this type of feedback, it is necessary to develop a distributed sensing system that could extract a wide range of information during the interaction between the robot and the environment. In addition, a distributed feedback interface is needed to deliver such information to the user. This thesis proposes the development of a distributed sensing system (e-skin) to acquire tactile sensation, a first integration of distributed sensing system on a robotic hand, the development of a sensory feedback system that compromises the distributed sensing system and a distributed stimulation system, and finally the implementation of deep learning methods for the classification of tactile data. It\u2019s core focus addresses the development and testing of a sensory feedback system, based on the latest distributed sensing and stimulation techniques. To this end, the thesis is comprised of two introductory chapters that describe the state of art in the field, the objectives, and the used methodology and contributions; as well as six studies that tackled the development of human-machine interfaces

Advanced Knowledge Application in Practice

The integration and interdependency of the world economy leads towards the creation of a global market that offers more opportunities, but is also more complex and competitive than ever before. Therefore widespread research activity is necessary if one is to remain successful on the market. This book is the result of research and development activities from a number of researchers worldwide, covering concrete fields of research