Scalability of the Size of Patterns Drawn Using Tactile Hand Guidance

Haptic feedback for handwriting training has been extensively studied, but with primary focus on kinematic feedback. We provide vibrotactile feedback through a wrist worn sleeve to guide the user to recreate unknown patterns and study the impact of vibrational duration (1, 2, 3 seconds) on pattern scaling. User traces a line at 90° angles, while attempting to maintain a constant speed, in the direction of the motor activated till a different motor activation is perceived. Shape and size are two features of good letter formation. Study performed on three subjects showed the ability to utilize four vibrotactile motors to guide the hand towards correct shape formation with high accuracy (\u3e 95%). The overall size of the letter was observed to scale linearly with the vibrational duration. Implications for utilizing the vibrational feedback for handwriting correction are discussed

Handwriting Correction System using Wearable Sleeve with Optimal Tactor Configuration

Handwriting remains an elusive skill with practice worksheets being the common method of learning. Since these worksheets provide only visual feedback and no quantitative feedback, it can often be a challenge to improve. For children with learning disabilities, learning handwriting skills is one of the most difficult tasks. We propose a handwriting training system that uses off-the-shelf webcam, a pen tracking software and a haptic sleeve which provides active feedback to the user based on their deviation from the original pattern. The sleeve has 4 individual motors that vibrate at different intensities based on the direction (right, left, up or down) and severity of the deviation (\u3c 1cm, 1cm – 3cm, \u3e 3cm). Different motor placements around the forearm are evaluated for vibro-tactile feedback accuracy and time response, and a novel spaced-ring configuration is proposed. This paper provides details on the system architecture and sleeve characterization, and the results show promise in utilizing the system for self-correction and visual-motor skills development. The results from sleeve characterization suggest the applicability of the spaced-ring configuration (perceived feedback accuracy \u3e 98%, time response \u3c 1s) in other vibrotactile hand guidance systems, in addition to handwriting correction. Recommendations on tactor placements around the forearm are provided

Prediction of Human Trajectory Following a Haptic Robotic Guide Using Recurrent Neural Networks

Social intelligence is an important requirement for enabling robots to collaborate with people. In particular, human path prediction is an essential capability for robots in that it prevents potential collision with a human and allows the robot to safely make larger movements. In this paper, we present a method for predicting the trajectory of a human who follows a haptic robotic guide without using sight, which is valuable for assistive robots that aid the visually impaired. We apply a deep learning method based on recurrent neural networks using multimodal data: (1) human trajectory, (2) movement of the robotic guide, (3) haptic input data measured from the physical interaction between the human and the robot, (4) human depth data. We collected actual human trajectory and multimodal response data through indoor experiments. Our model outperformed the baseline result while using only the robot data with the observed human trajectory, and it shows even better results when using additional haptic and depth data.Comment: 6 pages, Submitted to IEEE World Haptics Conference 201

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

HUMAN-ROBOT COLLABORATION IN ROBOTIC-ASSISTED SURGICAL TRAINING

Ph.DDOCTOR OF PHILOSOPH

Effect of Slant Boards in Combination with Handwriting Practice

Handwriting difficulties affect 10% to 30% of children in elementary school often hindering their successful participation in a number of occupations, including academic participation. Occupational therapists provide treatments for handwriting difficulties; however, many of these interventions have limited to no evidence to support their effectiveness. One of these interventions is the use of a slant board, a treatment strategy often combined with handwriting practice. Clinicians commonly combine the use of slant boards and handwriting practice to facilitate the development of handwriting skills in young children. However, the effectiveness of this combination of interventions in improving the quality of handwriting remains unclear. The aim of this study was to investigate the difference in the change of letter formation scores in children who have practiced handwriting on slant boards compared with those who have practiced on a horizontal surface. A randomized block design was employed. Children entering the second through third grades who participated in a 19-day summer enrichment program were recruited via mailed recruitment letters and/or email. Twenty-one children were enrolled. Children were blocked by classroom and randomly assigned to a group that practiced handwriting on a slant board or a group that practiced on a horizontal surface. Children completed a total of 15 group sessions lasting 15 minutes each. These sessions occurred 3 to 5 days a week over the course of 4 weeks. During these sessions, they practiced writing letters and words utilizing the Handwriting Without Tears curriculum. There was no significant difference in average group change in letter formation performance as determined by independent samples t test. Children with below average handwriting at baseline made statistically significant changes in their handwriting, regardless of writing surface, when compared with their peers that was identified by secondary analyses

Optimizing Human Performance in Mobile Text Entry

Although text entry on mobile phones is abundant, research strives to achieve desktop typing performance "on the go". But how can researchers evaluate new and existing mobile text entry techniques? How can they ensure that evaluations are conducted in a consistent manner that facilitates comparison? What forms of input are possible on a mobile device? Do the audio and haptic feedback options with most touchscreen keyboards affect performance? What influences users' preference for one feedback or another? Can rearranging the characters and keys of a keyboard improve performance? This dissertation answers these questions and more. The developed TEMA software allows researchers to evaluate mobile text entry methods in an easy, detailed, and consistent manner. Many in academia and industry have adopted it. TEMA was used to evaluate a typical QWERTY keyboard with multiple options for audio and haptic feedback. Though feedback did not have a significant effect on performance, a survey revealed that users' choice of feedback is influenced by social and technical factors. Another study using TEMA showed that novice users entered text faster using a tapping technique than with a gesture or handwriting technique. This motivated rearranging the keys and characters to create a new keyboard, MIME, that would provide better performance for expert users. Data on character frequency and key selection times were gathered and used to design MIME. A longitudinal user study using TEMA revealed an entry speed of 17 wpm and a total error rate of 1.7% for MIME, compared to 23 wpm and 5.2% for QWERTY. Although MIME's entry speed did not surpass QWERTY's during the study, it is projected to do so after twelve hours of practice. MIME's error rate was consistently low and significantly lower than QWERTY's. In addition, participants found MIME more comfortable to use, with some reporting hand soreness after using QWERTY for extended periods