Haptic communication to support biopsy procedures learning in virtual environments

International audienceIn interventional radiology, physicians require high haptic sensitivity and fine motor skills development because of the limited real-time visual feedback of the surgical site. The transfer of this type of surgical skill to novices is a challenging issue. This paper presents a study on the design of a biopsy procedure learning system. Our methodology, based on a task-centered design approach, aims to bring out new design rules for virtual learning environments. A new collaborative haptic training paradigm is introduced to support human-haptic interaction in a virtual environment. The interaction paradigm supports haptic communication between two distant users to teach a surgical skill. In order to evaluate this paradigm, a user experiment was conducted. Sixty volunteer medical students participated in the study to assess the influence of the teaching method on their performance in a biopsy procedure task. The results show that to transfer the skills, the combination of haptic communication with verbal and visual communications improves the novices' performance compared to conventional teaching methods. Furthermore, the results show that, depending on the teaching method, participants developed different needle insertion profiles. We conclude that our interaction paradigm facilitates expert-novice haptic communication and improves skills transfer; and new skills acquisition depends on the availability of different communication channels between experts and novices. Our findings indicate that the traditional fellowship methods in surgery should evolve to an off-patient collaborative environment that will continue to support visual and verbal communication, but also haptic communication, in order to achieve a better and more complete skills training

Haptic communication to support biopsy procedures learning in virtual environments

International audienceIn interventional radiology, physicians require high haptic sensitivity and fine motor skills development because of the limited real-time visual feedback of the surgical site. The transfer of this type of surgical skill to novices is a challenging issue. This paper presents a study on the design of a biopsy procedure learning system. Our methodology, based on a task-centered design approach, aims to bring out new design rules for virtual learning environments. A new collaborative haptic training paradigm is introduced to support human-haptic interaction in a virtual environment. The interaction paradigm supports haptic communication between two distant users to teach a surgical skill. In order to evaluate this paradigm, a user experiment was conducted. Sixty volunteer medical students participated in the study to assess the influence of the teaching method on their performance in a biopsy procedure task. The results show that to transfer the skills, the combination of haptic communication with verbal and visual communications improves the novices' performance compared to conventional teaching methods. Furthermore, the results show that, depending on the teaching method, participants developed different needle insertion profiles. We conclude that our interaction paradigm facilitates expert-novice haptic communication and improves skills transfer; and new skills acquisition depends on the availability of different communication channels between experts and novices. Our findings indicate that the traditional fellowship methods in surgery should evolve to an off-patient collaborative environment that will continue to support visual and verbal communication, but also haptic communication, in order to achieve a better and more complete skills training

Influence of Haptic Communication on a Shared Manual Task in a Collaborative Virtual Environment

International audienceWith the advent of new haptic feedback devices, researchers are giving serious consideration to the incorporation of haptic communication in collaborative virtual environments. For instance, haptic interactions based tools can be used for medical and related education whereby students can train in minimal invasive surgery using virtual reality before approaching human subjects. To design virtual environments that support haptic communication, a deeper understanding of humans' haptic interactions is required. In this paper, human's haptic collaboration is investigated. A collaborative virtual environment was designed to support performing a shared manual task. To evaluate this system, 60 medical students participated to an experimental study. Participants were asked to perform in dyads a needle insertion task after a training period. Results show that compared to conventional training methods, a visual-haptic training improves user's collaborative performance. In addition, we found that haptic interaction influences the partners' verbal communication when sharing haptic information. This indicates that the haptic communication training changes the nature of the users' mental representations. Finally, we found that haptic interactions increased the sense of copresence in the virtual environment: haptic communication facilitates users' collaboration in a shared manual task within a shared virtual environment. Design implications for including haptic communication in virtual environments are outlined

Haptic communication to enhance collaboration in virtual environments

International audienceMotivation – To study haptic communication in collaborative virtual environments. Research approach – An experimental study was conducted, in which 60 students were asked to perform in dyads a shared manual task after a training period. Findings/Design – The results show that haptic communication can influence the common frame of reference development in a shared manual task. Research limitations/Implications – Deeper verbalization analyses are needed to evaluate the common frame of reference development. Originality/Value – This study highlights haptic interactions importance when designing virtual environment that support shared manual tasks. Take away message – Haptic communication, combined with visual and verbal communication, enriches interactions in virtual environments

WYFIWIF: A Haptic Communication Paradigm For Collaborative Motor Skills Learning

International audienceMotor skills transfer is a challenging issue for many applications such as surgery, design and industry. In order to design virtual environments that support motor skills learning, a deep understanding of humans' haptic interactions is required. To ensure skills transfer, experts and novices need to collaborate. This requires the construction of the common frame of reference between the teacher and the learner in order to understand each other. In this paper, human-human haptic collaboration is investigated in order to understand how haptic information is exchanged. Furthermore, WYFIWIF (What You Feel Is What I Feel), a haptic communication paradigm is introduced. This paradigm is based on a hand guidance metaphor. The paradigm helps operators to construct an efficient common frame of reference by allowing a direct haptic communication. A learning virtual environment is used to evaluate this haptic communication paradigm. Hence, 60 volunteer students performed a needle insertion learning task. The results of this experiment show that, compared to conventional methods, the learning method based on haptic communication improves the novices' performance in such a task. We conclude that the WYFIWIF paradigm facilitate expert-novice haptic collaboration to teach motor skills

WYFIWIF: A Haptic Communication Paradigm For Collaborative Motor Skills Learning

International audienceMotor skills transfer is a challenging issue for many applications such as surgery, design and industry. In order to design virtual environments that support motor skills learning, a deep understanding of humans' haptic interactions is required. To ensure skills transfer, experts and novices need to collaborate. This requires the construction of the common frame of reference between the teacher and the learner in order to understand each other. In this paper, human-human haptic collaboration is investigated in order to understand how haptic information is exchanged. Furthermore, WYFIWIF (What You Feel Is What I Feel), a haptic communication paradigm is introduced. This paradigm is based on a hand guidance metaphor. The paradigm helps operators to construct an efficient common frame of reference by allowing a direct haptic communication. A learning virtual environment is used to evaluate this haptic communication paradigm. Hence, 60 volunteer students performed a needle insertion learning task. The results of this experiment show that, compared to conventional methods, the learning method based on haptic communication improves the novices' performance in such a task. We conclude that the WYFIWIF paradigm facilitate expert-novice haptic collaboration to teach motor skills

Research on real-time physics-based deformation for haptic-enabled medical simulation

This study developed a multiple effective visuo-haptic surgical engine to handle a variety of surgical manipulations in real-time. Soft tissue models are based on biomechanical experiment and continuum mechanics for greater accuracy. Such models will increase the realism of future training systems and the VR/AR/MR implementations for the operating room

Robot Autonomy for Surgery

Autonomous surgery involves having surgical tasks performed by a robot operating under its own will, with partial or no human involvement. There are several important advantages of automation in surgery, which include increasing precision of care due to sub-millimeter robot control, real-time utilization of biosignals for interventional care, improvements to surgical efficiency and execution, and computer-aided guidance under various medical imaging and sensing modalities. While these methods may displace some tasks of surgical teams and individual surgeons, they also present new capabilities in interventions that are too difficult or go beyond the skills of a human. In this chapter, we provide an overview of robot autonomy in commercial use and in research, and present some of the challenges faced in developing autonomous surgical robots