Deformable Shape Completion with Graph Convolutional Autoencoders

The availability of affordable and portable depth sensors has made scanning objects and people simpler than ever. However, dealing with occlusions and missing parts is still a significant challenge. The problem of reconstructing a (possibly non-rigidly moving) 3D object from a single or multiple partial scans has received increasing attention in recent years. In this work, we propose a novel learning-based method for the completion of partial shapes. Unlike the majority of existing approaches, our method focuses on objects that can undergo non-rigid deformations. The core of our method is a variational autoencoder with graph convolutional operations that learns a latent space for complete realistic shapes. At inference, we optimize to find the representation in this latent space that best fits the generated shape to the known partial input. The completed shape exhibits a realistic appearance on the unknown part. We show promising results towards the completion of synthetic and real scans of human body and face meshes exhibiting different styles of articulation and partiality.Comment: CVPR 201

A novel approach to modelling and simulating the contact behaviour between a human hand model and a deformable object

A deeper understanding of biomechanical behaviour of human hands becomes fundamental for any human hand-operated Q2 activities. The integration of biomechanical knowledge of human hands into product design process starts to play an increasingly important role in developing an ergonomic product-to-user interface for products and systems requiring high level of comfortable and responsive interactions. Generation of such precise and dynamic models can provide scientific evaluation tools to support product and system development through simulation. This type of support is urgently required in many applications such as hand skill training for surgical operations, ergonomic study of a product or system developed and so forth. The aim of this work is to study the contact behaviour between the operators’ hand and a hand-held tool or other similar contacts, by developing a novel and precise nonlinear 3D finite element model of the hand and by investigating the contact behaviour through simulation. The contact behaviour is externalised by solving the problem using the bi-potential method. The human body’s biomechanical characteristics, such as hand deformity and structural behaviour, have been fully modelled by implementing anisotropic hyperelastic laws. A case study is given to illustrate the effectiveness of the approac

A conceptual framework for interactive virtual storytelling

This paper presents a framework of an interactive storytelling system. It can integrate five components: management centre, evaluation centre, intelligent virtual agent, intelligent virtual environment, and users, making possible interactive solutions where the communication among these components is conducted in a rational and intelligent way. Environment plays an important role in providing heuristic information for agents through communicating with the management centre. The main idea is based on the principle of heuristic guiding of the behaviour of intelligent agents for guaranteeing the unexpectedness and consistent themes