Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe

Wearable haptic systems for the fingertip and the hand: taxonomy, review and perspectives

In the last decade, we have witnessed a drastic change in the form factor of audio and vision technologies, from heavy and grounded machines to lightweight devices that naturally fit our bodies. However, only recently, haptic systems have started to be designed with wearability in mind. The wearability of haptic systems enables novel forms of communication, cooperation, and integration between humans and machines. Wearable haptic interfaces are capable of communicating with the human wearers during their interaction with the environment they share, in a natural and yet private way. This paper presents a taxonomy and review of wearable haptic systems for the fingertip and the hand, focusing on those systems directly addressing wearability challenges. The paper also discusses the main technological and design challenges for the development of wearable haptic interfaces, and it reports on the future perspectives of the field. Finally, the paper includes two tables summarizing the characteristics and features of the most representative wearable haptic systems for the fingertip and the hand

State of the art review on walking support system for visually impaired people

The technology for terrain detection and walking support system for blind people has rapidly been improved the last couple of decades but to assist visually impaired people may have started long ago. Currently, a variety of portable or wearable navigation system is available in the market to help the blind for navigating their way in his local or remote area. The focused category in this work can be subgroups as electronic travel aids (ETAs), electronic orientation aids (EOAs) and position locator devices (PLDs). However, we will focus mainly on electronic travel aids (ETAs). This paper presents a comparative survey among the various portable or wearable walking support systems as well as informative description (a subcategory of ETAs or early stages of ETAs) with its working principal advantages and disadvantages so that the researchers can easily get the current stage of assisting blind technology along with the requirement for optimising the design of walking support system for its users

Electrospun Bundled Carbon Nanofibers for Skin-Inspired Tactile Sensing, Proprioception and Gesture Tracking Applications

Abstract In this work, we report a class of wearable, stitchable, and sensitive carbon nanofiber (CNF)-polydimethylsiloxane (PDMS) composite-based piezoresistive sensors realized by carbonizing electrospun polyacrylonitrile (PAN) nanofibers and subsequently embedding in PDMS elastomeric thin films. Electro-mechanical tactile sensing characterization of the resulting piezoresistive strain sensors revealed a linear response with an average force sensitivity of ~1.82 kN−1 for normal forces up to 20 N. The real-time functionality of the CNF-PDMS composite sensors in wearable body sensor networks and advanced bionic skin applications was demonstrated through human motion and gesture monitoring experiments. A skin-inspired artificial soft sensor capable of demonstrating proprioceptive and tactile sensory perception utilizing CNF bundles has been shown. Furthermore, a 16-point pressure-sensitive flexible sensor array mimicking slow adapting low threshold mechanoreceptors of glabrous skin was demonstrated. Such devices in tandem with neuromorphic circuits can potentially recreate the sense of touch in robotic arms and restore somatosensory perception in amputees

Touch Technology in Affective Human, Robot, Virtual-Human Interactions: A Survey

Given the importance of affective touch in human interactions, technology designers are increasingly attempting to bring this modality to the core of interactive technology. Advances in haptics and touch-sensing technology have been critical to fostering interest in this area. In this survey, we review how affective touch is investigated to enhance and support the human experience with or through technology. We explore this question across three different research areas to highlight their epistemology, main findings, and the challenges that persist. First, we review affective touch technology through the human–computer interaction literature to understand how it has been applied to the mediation of human–human interaction and its roles in other human interactions particularly with oneself, augmented objects/media, and affect-aware devices. We further highlight the datasets and methods that have been investigated for automatic detection and interpretation of affective touch in this area. In addition, we discuss the modalities of affective touch expressions in both humans and technology in these interactions. Second, we separately review how affective touch has been explored in human–robot and real-human–virtual-human interactions where the technical challenges encountered and the types of experience aimed at are different. We conclude with a discussion of the gaps and challenges that emerge from the review to steer research in directions that are critical for advancing affective touch technology and recognition systems. In our discussion, we also raise ethical issues that should be considered for responsible innovation in this growing area

Design and fabrication of flexible tactile sensing and feedback interface for communication by deafblind people

Humans generally interact and communicate using five basic sensory modalities and mainly through vision, touch and audio. However, this does not work for deafblind people as they have both impaired hearing and vision modalities, and hence rely on touch-sensing. This necessitates the development of alternative means that allows them to independently interact and communicate. To do this requires a solution which has the capability for tactile sensing and feedback. Therefore, tactile interface becomes a critical component of any assistive device usable by deafblind people for interaction and communication. Given that existing solutions mainly use rigid and commercial components, there is a need to tap into the advancements in flexible electronics in order develop more effective and conformable solutions. This research involves the development of flexible tactile communication interface usable in assistive communication devices for deafblind people. First, commercial sensors and actuators were utilised as a proof-of-concept and then four novel tactile interfaces were explored which include two similar touch-sensitive electromagnetic actuators, one capacitive tactile sensing array, and a facile flexible inductance-based pressure sensor. The two fabricated touch-sensitive electromagnetic actuators (Type 1 and 2) are both based on electromagnetic principle and capable of simultaneous tactile sensing and feedback. Each comprises of a tandem combination of two main modules - the touch-sensing and the actuation module, with both modules integrated as a single device in each case. The actuation module employs a flexible planar spiral coil and a Neodymium magnet assembled in a soft Polydimethylsiloxane (PDMS) structure, while the touch-sensing module is a planar capacitive metal- insulator-metal structure of copper. The flexible coil (~17µm thick and with 45 turns) was fabricated on a Polyimide sheet using Lithographie Galvanoformung Abformung (LIGA) process. The results of characterisation of these actuators at frequencies ranging from 10Hz to 200Hz, shows a maximum displacement (~ 190µm) around 40Hz. Evaluation of this by 40 (20 deafblind and 20 sighted and hearing) participants show that they can feel vibration at this range. Another tactile interface fabricated is an 8 x 8 capacitive tactile sensing array. The sensor was developed on a flexible Polyvinyl Chloride (PVC) sheet with column electrodes deposited on one side and row electrodes on the reverse side. It is intended for use as an assistive tactile communication interface for deafblind people who communicate using deafblind manual alphabets as well as the English block letters. An inductance-based pressure sensor was also designed, fabricated and characterised for use as an input interface for finger Braille as well as other tactile communication methods for deafblind people. It was realised with a soft ferromagnetic elastomer and a 17µm-thick coil fabricated on a flexible 50 µm-thick polyimide sheet. The ferromagnetic elastomer acts as the core of the coil, which when pressed, sees the metal particles moving closer to each other, leading to changes in the inductance. The coil, with 75µm conductor and 25µm pitch, was also realised using LIGA micromolding technique. Seven different sensors were fabricated using different ratios (1:1, 1:2, 1:3, 1:5, 2:1, 3:1, and 5:1) of Ecoflex to Iron particles. The performance of each sensor was investigated and generally, sensors with higher Iron particles gave better sensitivity, linear as well as dynamic range. In comparison with all other fabricated sensors, the sensor made with 1:5DD was recommended for application as a tactile interface