Virtual reality training and assessment in laparoscopic rectum surgery

Background: Virtual-reality (VR) based simulation techniques offer an efficient and low cost alternative to conventional surgery training. This article describes a VR training and assessment system in laparoscopic rectum surgery. Methods: To give a realistic visual performance of interaction between membrane tissue and surgery tools, a generalized cylinder based collision detection and a multi-layer mass-spring model are presented. A dynamic assessment model is also designed for hierarchy training evaluation. Results: With this simulator, trainees can operate on the virtual rectum with both visual and haptic sensation feedback simultaneously. The system also offers surgeons instructions in real time when improper manipulation happens. The simulator has been tested and evaluated by ten subjects. Conclusions: This prototype system has been verified by colorectal surgeons through a pilot study. They believe the visual performance and the tactile feedback are realistic. It exhibits the potential to effectively improve the surgical skills of trainee surgeons and significantly shorten their learning curve. © 2014 John Wiley & Sons, Ltd

Non-Traditional Rig for virtual environment systems. Case study: Arm rig

Este trabajo presenta nuevas especificaciones de diseño para rigs de esqueleto basado en problemas encontrados en Entornos Virtuales, tomando en cuenta sus limitaciones y requerimientos, y la relación entre los usuarios y el avatar que encarnan. Este acercamiento es una alternativa al rig de esqueleto tradicionalmente usado en animación, que puede generar deformaciones indeseadas en el mesh, ya que suelen ser hechos con animación artesanal, y optimización de software, en mente. Este Trabajo incluye resultados prometedores en cuanto a una deformación más natural de la muñeca de un personaje digital, validado con la evaluación subjetiva de ocho expertos en el área de producción 3D.1- Introducción 2- Trabajos Previos 3- Nuestro Enfoque 4- Experimento y Resultados 5- ConclusiónThis paper presents new design specifications for skeleton rigs based on Virtual Environment problems, taking into account their limitations and requirements, and the relationship between users and the virtual avatar they embody. This approach is an alternative to traditional skeleton rigs used in animation, which may generate undesirable deformations in the mesh since they are usually made with handcrafted animation, and software optimization, in mind. This work includes promissory results in the naturalness of the deformation of the wrist of a digital character, validated with eight experts’ subjective evaluation in 3D production.Pregrad

Sketch-based skeleton-driven 2D animation and motion capture.

This research is concerned with the development of a set of novel sketch-based skeleton-driven 2D animation techniques, which allow the user to produce realistic 2D character animation efficiently. The technique consists of three parts: sketch-based skeleton-driven 2D animation production, 2D motion capture and a cartoon animation filter. For 2D animation production, the traditional way is drawing the key-frames by experienced animators manually. It is a laborious and time-consuming process. With the proposed techniques, the user only inputs one image ofa character and sketches a skeleton for each subsequent key-frame. The system then deforms the character according to the sketches and produces animation automatically. To perform 2D shape deformation, a variable-length needle model is developed, which divides the deformation into two stages: skeleton driven deformation and nonlinear deformation in joint areas. This approach preserves the local geometric features and global area during animation. Compared with existing 2D shape deformation algorithms, it reduces the computation complexity while still yielding plausible deformation results. To capture the motion of a character from exiting 2D image sequences, a 2D motion capture technique is presented. Since this technique is skeleton-driven, the motion of a 2D character is captured by tracking the joint positions. Using both geometric and visual features, this problem can be solved by ptimization, which prevents self-occlusion and feature disappearance. After tracking, the motion data are retargeted to a new character using the deformation algorithm proposed in the first part. This facilitates the reuse of the characteristics of motion contained in existing moving images, making the process of cartoon generation easy for artists and novices alike. Subsequent to the 2D animation production and motion capture,"Cartoon Animation Filter" is implemented and applied. Following the animation principles, this filter processes two types of cartoon input: a single frame of a cartoon character and motion capture data from an image sequence. It adds anticipation and follow-through to the motion with related squash and stretch effect

Example Based Caricature Synthesis

The likeness of a caricature to the original face image is an essential and often overlooked part of caricature production. In this paper we present an example based caricature synthesis technique, consisting of shape exaggeration, relationship exaggeration, and optimization for likeness. Rather than relying on a large training set of caricature face pairs, our shape exaggeration step is based on only one or a small number of examples of facial features. The relationship exaggeration step introduces two definitions which facilitate global facial feature synthesis. The first is the T-Shape rule, which describes the relative relationship between the facial elements in an intuitive manner. The second is the so called proportions, which characterizes the facial features in a proportion form. Finally we introduce a similarity metric as the likeness metric based on the Modified Hausdorff Distance (MHD) which allows us to optimize the configuration of facial elements, maximizing likeness while satisfying a number of constraints. The effectiveness of our algorithm is demonstrated with experimental results

Skin deformation and animation of character models based on static and dynamic ordinary differential equations.

Animated characters play an important role in the field of computer animation, simulation and games. The basic criterion of good character animation is that the animated characters should appear realistic. This can be achieve through proper skin deformations for characters. Although various skin deformation approaches (Joint-based, Example-based, Physics-based, Curve-based and PDE-based) have been developed, the problem of generating realistic skin deformations efficiently with a small data set is a big challenge. In order to address the limitations of skin deformation, this thesis presents a workflow consisting of three main steps. First, the research has developed a new statistical method to determine the positions of joints based on available X-ray images. Second, an effective method for transferring the deformations of the curves to the polygonal model with high accuracy has been developed. Lastly, the research has produced a simple and efficient method to animate skin deformations by introducing a curved-based surface manipulation method combined with physics and data-driven approaches. The novelty of this method depends on a new model of dynamic deformations and an efficient finite difference solution of the model. The application examples indicate that the curve-based dynamic method developed in this thesis can achieve good realism and high computational efficiency with small data sets in the creation of skin deformations