6,692 research outputs found
TEGLO: High Fidelity Canonical Texture Mapping from Single-View Images
Recent work in Neural Fields (NFs) learn 3D representations from
class-specific single view image collections. However, they are unable to
reconstruct the input data preserving high-frequency details. Further, these
methods do not disentangle appearance from geometry and hence are not suitable
for tasks such as texture transfer and editing. In this work, we propose TEGLO
(Textured EG3D-GLO) for learning 3D representations from single view
in-the-wild image collections for a given class of objects. We accomplish this
by training a conditional Neural Radiance Field (NeRF) without any explicit 3D
supervision. We equip our method with editing capabilities by creating a dense
correspondence mapping to a 2D canonical space. We demonstrate that such
mapping enables texture transfer and texture editing without requiring meshes
with shared topology. Our key insight is that by mapping the input image pixels
onto the texture space we can achieve near perfect reconstruction (>= 74 dB
PSNR at 1024^2 resolution). Our formulation allows for high quality 3D
consistent novel view synthesis with high-frequency details at megapixel image
resolution
Deep Reflectance Maps
Undoing the image formation process and therefore decomposing appearance into
its intrinsic properties is a challenging task due to the under-constraint
nature of this inverse problem. While significant progress has been made on
inferring shape, materials and illumination from images only, progress in an
unconstrained setting is still limited. We propose a convolutional neural
architecture to estimate reflectance maps of specular materials in natural
lighting conditions. We achieve this in an end-to-end learning formulation that
directly predicts a reflectance map from the image itself. We show how to
improve estimates by facilitating additional supervision in an indirect scheme
that first predicts surface orientation and afterwards predicts the reflectance
map by a learning-based sparse data interpolation.
In order to analyze performance on this difficult task, we propose a new
challenge of Specular MAterials on SHapes with complex IllumiNation (SMASHINg)
using both synthetic and real images. Furthermore, we show the application of
our method to a range of image-based editing tasks on real images.Comment: project page: http://homes.esat.kuleuven.be/~krematas/DRM
Dual-to-kernel learning with ideals
In this paper, we propose a theory which unifies kernel learning and symbolic
algebraic methods. We show that both worlds are inherently dual to each other,
and we use this duality to combine the structure-awareness of algebraic methods
with the efficiency and generality of kernels. The main idea lies in relating
polynomial rings to feature space, and ideals to manifolds, then exploiting
this generative-discriminative duality on kernel matrices. We illustrate this
by proposing two algorithms, IPCA and AVICA, for simultaneous manifold and
feature learning, and test their accuracy on synthetic and real world data.Comment: 15 pages, 1 figur
Gradient and Passive Circuit Structure in a Class of Non-linear Dynamics on a Graph
We consider a class of non-linear dynamics on a graph that contains and
generalizes various models from network systems and control and study
convergence to uniform agreement states using gradient methods. In particular,
under the assumption of detailed balance, we provide a method to formulate the
governing ODE system in gradient descent form of sum-separable energy
functions, which thus represent a class of Lyapunov functions; this class
coincides with Csisz\'{a}r's information divergences. Our approach bases on a
transformation of the original problem to a mass-preserving transport problem
and it reflects a little-noticed general structure result for passive network
synthesis obtained by B.D.O. Anderson and P.J. Moylan in 1975. The proposed
gradient formulation extends known gradient results in dynamical systems
obtained recently by M. Erbar and J. Maas in the context of porous medium
equations. Furthermore, we exhibit a novel relationship between inhomogeneous
Markov chains and passive non-linear circuits through gradient systems, and
show that passivity of resistor elements is equivalent to strict convexity of
sum-separable stored energy. Eventually, we discuss our results at the
intersection of Markov chains and network systems under sinusoidal coupling
- …