A Novel Method for Vibrotactile Proprioceptive Feedback Using Spatial Encoding and Gaussian Interpolation

Objective: The bidirectional communication between the user and the prosthesis is an important requirement when developing prosthetic hands. Proprioceptive feedback is fundamental to perceiving prosthesis movement without the need for constant visual attention. We propose a novel solution to encode wrist rotation using a vibromotor array and Gaussian interpolation of vibration intensity. The approach generates tactile sensation that smoothly rotates around the forearm congruently with prosthetic wrist rotation. The performance of this scheme was systematically assessed for a range of parameter values (number of motors and Gaussian standard deviation). Methods: Fifteen able-bodied subjects and one individual with congenital limb deficiency used vibrational feedback to control the virtual hand in the target-achievement test. Performance was assessed by end-point error and efficiency as well as subjective impressions. Results: The results showed a preference for smooth feedback and a higher number of motors (8 and 6 versus 4). With 8 and 6 motors, the standard deviation, determining the sensation spread and continuity, could be modulated through a broad range of values (0.1 - 2) without a significant performance loss (error: ∼ 10%; efficiency: ∼ 30%). For low values of standard deviation (0.1-0.5), the number of motors could be reduced to 4 without a significant performance decrease. Conclusion: The study demonstrated that the developed strategy provided meaningful rotation feedback. Moreover, the Gaussian standard deviation can be used as an independent parameter to encode an additional feedback variable. Significance: The proposed method is a flexible and effective approach to providing proprioceptive feedback while adjusting the trade-off between sensation quality and the number of vibromotors

Computer-supported movement guidance: investigating visual/visuotactile guidance and informing the design of vibrotactile body-worn interfaces

This dissertation explores the use of interactive systems to support movement guidance, with applications in various fields such as sports, dance, physiotherapy, and immersive sketching. The research focuses on visual, haptic, and visuohaptic approaches and aims to overcome the limitations of traditional guidance methods, such as dependence on an expert and high costs for the novice. The main contributions of the thesis are (1) an evaluation of the suitability of various types of displays and visualizations of the human body for posture guidance, (2) an investigation into the influence of different viewpoints/perspectives, the addition of haptic feedback, and various movement properties on movement guidance in virtual environments, (3) an investigation into the effectiveness of visuotactile guidance for hand movements in a virtual environment, (4) two in-depth studies of haptic perception on the body to inform the design of wearable and handheld interfaces that leverage tactile output technologies, and (5) an investigation into new interaction techniques for tactile guidance of arm movements. The results of this research advance the state of the art in the field, provide design and implementation insights, and pave the way for new investigations in computer-supported movement guidance

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

The snake effect: Investigation of a novel haptic illusion

This study was based on tactual illusions produced by vibrotactile units. A novel haptic effect based on amplitude modulation was developed, called here the ”snake effect”, which consists on a continuous motion that is smooth, wavy and creepy. Two studies were conducted in order to parameterize this novel haptic effect aiming to: (1) find the fundamental parameters that allow the snake effect to happen in a straight line, (2) assess if the parameters can be implemented for curved trajectories after being combined with funneling, as seen for apparent motion in literature. Study 1 used a 2x6 haptic display in the dorsal part of the forearm, consisted of a pilot and a main study. Participants were asked to rate how the effect was being perceived in an adaptive method. It was found that the effect has a lower and an upper SOA (stimulus onset asynchrony) boundaries and that lower stimulus durations cause a decrease in smoothness and creepiness. It was also found that not every amplitude modulation works to produce the snake effect, and that the best options among the ones investigated are Sine, Sine-Squared and Gaussian modulation types. Study 2 used a 4x4 haptic display in the left forearm and asked participants to draw the motion and direction of movement they perceived in a sheet of paper. In this study, it was found that the direction of movement is easier to tell than the trajectory itself. Also, that the beginning and ending of the motion are harder to feel than the middle of the movement. These findings provide relevant parameters to apply this new haptic effect based on vibrotactile actuators in current and future haptic displays

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022, held in Hamburg, Germany, in May 2022. The 36 regular papers included in this book were carefully reviewed and selected from 129 submissions. They were organized in topical sections as follows: haptic science; haptic technology; and haptic applications

Novel Bidirectional Body - Machine Interface to Control Upper Limb Prosthesis

Objective. The journey of a bionic prosthetic user is characterized by the opportunities and limitations involved in adopting a device (the prosthesis) that should enable activities of daily living (ADL). Within this context, experiencing a bionic hand as a functional (and, possibly, embodied) limb constitutes the premise for mitigating the risk of its abandonment through the continuous use of the device. To achieve such a result, different aspects must be considered for making the artificial limb an effective support for carrying out ADLs. Among them, intuitive and robust control is fundamental to improving amputees’ quality of life using upper limb prostheses. Still, as artificial proprioception is essential to perceive the prosthesis movement without constant visual attention, a good control framework may not be enough to restore practical functionality to the limb. To overcome this, bidirectional communication between the user and the prosthesis has been recently introduced and is a requirement of utmost importance in developing prosthetic hands. Indeed, closing the control loop between the user and a prosthesis by providing artificial sensory feedback is a fundamental step towards the complete restoration of the lost sensory-motor functions. Within my PhD work, I proposed the development of a more controllable and sensitive human-like hand prosthesis, i.e., the Hannes prosthetic hand, to improve its usability and effectiveness. Approach. To achieve the objectives of this thesis work, I developed a modular and scalable software and firmware architecture to control the Hannes prosthetic multi-Degree of Freedom (DoF) system and to fit all users’ needs (hand aperture, wrist rotation, and wrist flexion in different combinations). On top of this, I developed several Pattern Recognition (PR) algorithms to translate electromyographic (EMG) activity into complex movements. However, stability and repeatability were still unmet requirements in multi-DoF upper limb systems; hence, I started by investigating different strategies to produce a more robust control. To do this, EMG signals were collected from trans-radial amputees using an array of up to six sensors placed over the skin. Secondly, I developed a vibrotactile system to implement haptic feedback to restore proprioception and create a bidirectional connection between the user and the prosthesis. Similarly, I implemented an object stiffness detection to restore tactile sensation able to connect the user with the external word. This closed-loop control between EMG and vibration feedback is essential to implementing a Bidirectional Body - Machine Interface to impact amputees’ daily life strongly. For each of these three activities: (i) implementation of robust pattern recognition control algorithms, (ii) restoration of proprioception, and (iii) restoration of the feeling of the grasped object's stiffness, I performed a study where data from healthy subjects and amputees was collected, in order to demonstrate the efficacy and usability of my implementations. In each study, I evaluated both the algorithms and the subjects’ ability to use the prosthesis by means of the F1Score parameter (offline) and the Target Achievement Control test-TAC (online). With this test, I analyzed the error rate, path efficiency, and time efficiency in completing different tasks. Main results. Among the several tested methods for Pattern Recognition, the Non-Linear Logistic Regression (NLR) resulted to be the best algorithm in terms of F1Score (99%, robustness), whereas the minimum number of electrodes needed for its functioning was determined to be 4 in the conducted offline analyses. Further, I demonstrated that its low computational burden allowed its implementation and integration on a microcontroller running at a sampling frequency of 300Hz (efficiency). Finally, the online implementation allowed the subject to simultaneously control the Hannes prosthesis DoFs, in a bioinspired and human-like way. In addition, I performed further tests with the same NLR-based control by endowing it with closed-loop proprioceptive feedback. In this scenario, the results achieved during the TAC test obtained an error rate of 15% and a path efficiency of 60% in experiments where no sources of information were available (no visual and no audio feedback). Such results demonstrated an improvement in the controllability of the system with an impact on user experience. Significance. The obtained results confirmed the hypothesis of improving robustness and efficiency of a prosthetic control thanks to of the implemented closed-loop approach. The bidirectional communication between the user and the prosthesis is capable to restore the loss of sensory functionality, with promising implications on direct translation in the clinical practice