Unsupervised Trajectory Segmentation for Surgical Gesture Recognition in Robotic Training

Dexterity and procedural knowledge are two critical skills that surgeons need to master to perform accurate and safe surgical interventions. However, current training systems do not allow us to provide an in-depth analysis of surgical gestures to precisely assess these skills. Our objective is to develop a method for the automatic and quantitative assessment of surgical gestures. To reach this goal, we propose a new unsupervised algorithm that can automatically segment kinematic data from robotic training sessions. Without relying on any prior information or model, this algorithm detects critical points in the kinematic data that define relevant spatio-temporal segments. Based on the association of these segments, we obtain an accurate recognition of the gestures involved in the surgical training task. We, then, perform an advanced analysis and assess our algorithm using datasets recorded during real expert training sessions. After comparing our approach with the manual annotations of the surgical gestures, we observe 97.4% accuracy for the learning purpose and an average matching score of 81.9% for the fully automated gesture recognition process. Our results show that trainees workflow can be followed and surgical gestures may be automatically evaluated according to an expert database. This approach tends toward improving training efficiency by minimizing the learning curve

An Arc-length Warping Algorithm for Gesture Recognition Using Quaternion Representation

International audienceThis paper presents a new algorithm, called Dynamic Arc-Length Warping algorithm (DALW) for hand gesture recognition based on the orientation data. In this algorithm, after calculating the quaternion for each orientation measurement, we use DALW algorithm to obtain a similarity measure between different trajectories. We present the benefits of using quaternion alongside the implementation of Dynamic Arc Length Warping to present an optimized tool for gesture recognition.We show the advantages of this approach compared with other techniques. This tool can be used to distinguish similar and different gestures. An experimental validation is carried out to classify a series of simple human gestures