313 research outputs found
Biharmonic deformation transfer with automatic key point selection
Deformation transfer is an important research problem in geometry processing
and computer animation.A fundamental problem for existing deformation transfer
methods is to build reliable correspondences. This is challenging, especially
when the source and target shapes differ significantly and manual labeling is
typically used. We propose a novel deformation transfer method that aims at
minimizing user effort. We adapt a biharmonic weight deformation framework
which is able to produce plausible deformation even with only a few key points.
We then develop an automatic algorithm to identify a minimum set of key points
on the source model that characterizes the deformation well. While minimal user
effort is still needed to specify corresponding points on the target model for the
selected key points, our approach avoids the difficult problem of choosing key
points. Experimental results demonstrate that our method, despite requiring
little user effort, produces better deformation results than alternative solutions.
Keywords: shape deformation; biharmonic weights; key point selection;
deformation transfe
Fully Automatic Facial Deformation Transfer
Facial Animation is a serious and ongoing challenge for the Computer Graphic industry.
Because diverse and complex emotions need to be expressed by different facial deformation and
animation, copying facial deformations from existing character to another is widely needed in both
industry and academia, to reduce time-consuming and repetitive manual work of modeling to create
the 3D shape sequences for every new character. But transfer of realistic facial animations between
two 3D models is limited and inconvenient for general use. Modern deformation transfer methods
require correspondences mapping, in most cases, which are tedious to get. In this paper, we present a
fast and automatic approach to transfer the deformations of the facial mesh models by obtaining the
3D point-wise correspondences in the automatic manner. The key idea is that we could estimate the
correspondences with different facial meshes using the robust facial landmark detection method by
projecting the 3D model to the 2D image. Experiments show that without any manual labelling efforts,
our method detects reliable correspondences faster and simpler compared with the state-of-the-art
automatic deformation transfer method on the facial models
A Revisit of Shape Editing Techniques: from the Geometric to the Neural Viewpoint
3D shape editing is widely used in a range of applications such as movie
production, computer games and computer aided design. It is also a popular
research topic in computer graphics and computer vision. In past decades,
researchers have developed a series of editing methods to make the editing
process faster, more robust, and more reliable. Traditionally, the deformed
shape is determined by the optimal transformation and weights for an energy
term. With increasing availability of 3D shapes on the Internet, data-driven
methods were proposed to improve the editing results. More recently as the deep
neural networks became popular, many deep learning based editing methods have
been developed in this field, which is naturally data-driven. We mainly survey
recent research works from the geometric viewpoint to those emerging neural
deformation techniques and categorize them into organic shape editing methods
and man-made model editing methods. Both traditional methods and recent neural
network based methods are reviewed
Heterogeneous volumetric data mapping and its medical applications
With the advance of data acquisition techniques, massive solid geometries are being collected routinely in scientific tasks, these complex and unstructured data need to be effectively correlated for various processing and analysis. Volumetric mapping solves bijective low-distortion correspondence between/among 3D geometric data, and can serve as an important preprocessing step in many tasks in compute-aided design and analysis, industrial manufacturing, medical image analysis, to name a few. This dissertation studied two important volumetric mapping problems: the mapping of heterogeneous volumes (with nonuniform inner structures/layers) and the mapping of sequential dynamic volumes. To effectively handle heterogeneous volumes, first, we studied the feature-aligned harmonic volumetric mapping. Compared to previous harmonic mapping, it supports the point, curve, and iso-surface alignment, which are important low-dimensional structures in heterogeneous volumetric data. Second, we proposed a biharmonic model for volumetric mapping. Unlike the conventional harmonic volumetric mapping that only supports positional continuity on the boundary, this new model allows us to have higher order continuity along the boundary surface. This suggests a potential model to solve the volumetric mapping of complex and big geometries through divide-and-conquer. We also studied the medical applications of our volumetric mapping in lung tumor respiratory motion modeling. We were building an effective digital platform for lung tumor radiotherapy based on effective volumetric CT/MRI image matching and analysis. We developed and integrated in this platform a set of geometric/image processing techniques including advanced image segmentation, finite element meshing, volumetric registration and interpolation. The lung organ/tumor and surrounding tissues are treated as a heterogeneous region and a dynamic 4D registration framework is developed for lung tumor motion modeling and tracking. Compared to the previous 3D pairwise registration, our new 4D parameterization model leads to a significantly improved registration accuracy. The constructed deforming model can hence approximate the deformation of the tissues and tumor
OptCtrlPoints: Finding the Optimal Control Points for Biharmonic 3D Shape Deformation
We propose OptCtrlPoints, a data-driven framework designed to identify the
optimal sparse set of control points for reproducing target shapes using
biharmonic 3D shape deformation. Control-point-based 3D deformation methods are
widely utilized for interactive shape editing, and their usability is enhanced
when the control points are sparse yet strategically distributed across the
shape. With this objective in mind, we introduce a data-driven approach that
can determine the most suitable set of control points, assuming that we have a
given set of possible shape variations. The challenges associated with this
task primarily stem from the computationally demanding nature of the problem.
Two main factors contribute to this complexity: solving a large linear system
for the biharmonic weight computation and addressing the combinatorial problem
of finding the optimal subset of mesh vertices. To overcome these challenges,
we propose a reformulation of the biharmonic computation that reduces the
matrix size, making it dependent on the number of control points rather than
the number of vertices. Additionally, we present an efficient search algorithm
that significantly reduces the time complexity while still delivering a nearly
optimal solution. Experiments on SMPL, SMAL, and DeformingThings4D datasets
demonstrate the efficacy of our method. Our control points achieve better
template-to-target fit than FPS, random search, and neural-network-based
prediction. We also highlight the significant reduction in computation time
from days to approximately 3 minutes.Comment: Pacific Graphics 2023 (Full Paper
Data-driven weight optimization for real-time mesh deformation
3D model deformation has been an active research topic in geometric processing. Due to its efficiency, linear blend skinning (LBS) and its follow-up methods are widely used in practical applications as an efficient method for deforming vector images, geometric models and animated characters. LBS needs to determine the control handles and specify their influence weights, which requires expertise and is time-consuming. Further studies have proposed a method for efficiently calculating bounded biharmonic weights of given control handles which reduces user effort and produces smooth deformation results. The algorithm defines a high-order shape-aware smoothness function which tends to produce smooth deformation results, but fails to generate locally rigid deformations.
To address this, we propose a novel data-driven approach to producing improved weights for handles that makes full use of available 3D model data by optimizing an energy consisting of data-driven, rigidity and sparsity terms, while maintaining its advantage of allowing handles of various forms. We further devise an efficient iterative optimization scheme. Through contrast experiments, it clearly shows that linear blend skinning based on our optimized weights better reflects the deformation characteristics of the model, leading to more accurate deformation results, outperforming existing methods. The method also retains real-time performance even with a large number of deformation examples. Our ablation experiments also show that each energy term is essential
- …