2,309 research outputs found
Graph Spectral Image Processing
Recent advent of graph signal processing (GSP) has spurred intensive studies
of signals that live naturally on irregular data kernels described by graphs
(e.g., social networks, wireless sensor networks). Though a digital image
contains pixels that reside on a regularly sampled 2D grid, if one can design
an appropriate underlying graph connecting pixels with weights that reflect the
image structure, then one can interpret the image (or image patch) as a signal
on a graph, and apply GSP tools for processing and analysis of the signal in
graph spectral domain. In this article, we overview recent graph spectral
techniques in GSP specifically for image / video processing. The topics covered
include image compression, image restoration, image filtering and image
segmentation
Fast Approximate Spectral Clustering for Dynamic Networks
Spectral clustering is a widely studied problem, yet its complexity is
prohibitive for dynamic graphs of even modest size. We claim that it is
possible to reuse information of past cluster assignments to expedite
computation. Our approach builds on a recent idea of sidestepping the main
bottleneck of spectral clustering, i.e., computing the graph eigenvectors, by
using fast Chebyshev graph filtering of random signals. We show that the
proposed algorithm achieves clustering assignments with quality approximating
that of spectral clustering and that it can yield significant complexity
benefits when the graph dynamics are appropriately bounded
Bilateral Filter: Graph Spectral Interpretation and Extensions
In this paper we study the bilateral filter proposed by Tomasi and Manduchi,
as a spectral domain transform defined on a weighted graph. The nodes of this
graph represent the pixels in the image and a graph signal defined on the nodes
represents the intensity values. Edge weights in the graph correspond to the
bilateral filter coefficients and hence are data adaptive. Spectrum of a graph
is defined in terms of the eigenvalues and eigenvectors of the graph Laplacian
matrix. We use this spectral interpretation to generalize the bilateral filter
and propose more flexible and application specific spectral designs of
bilateral-like filters. We show that these spectral filters can be implemented
with k-iterative bilateral filtering operations and do not require expensive
diagonalization of the Laplacian matrix
Approches tomographiques structurelles pour l'analyse du milieu urbain par tomographie SAR THR : TomoSAR
SAR tomography consists in exploiting multiple images from the same area acquired from a slightly different angle to retrieve the 3-D distribution of the complex reflectivity on the ground. As the transmitted waves are coherent, the desired spatial information (along with the vertical axis) is coded in the phase of the pixels. Many methods have been proposed to retrieve this information in the past years. However, the natural redundancies of the scene are generally not exploited to improve the tomographic estimation step. This Ph.D. presents new approaches to regularize the estimated reflectivity density obtained through SAR tomography by exploiting the urban geometrical structures.La tomographie SAR exploite plusieurs acquisitions d'une mĂȘme zone acquises d'un point de vue lĂ©gerement diffĂ©rent pour reconstruire la densitĂ© complexe de rĂ©flectivitĂ© au sol. Cette technique d'imagerie s'appuyant sur l'Ă©mission et la rĂ©ception d'ondes Ă©lectromagnĂ©tiques cohĂ©rentes, les donnĂ©es analysĂ©es sont complexes et l'information spatiale manquante (selon la verticale) est codĂ©e dans la phase. De nombreuse mĂ©thodes ont pu ĂȘtre proposĂ©es pour retrouver cette information. L'utilisation des redondances naturelles Ă certains milieux n'est toutefois gĂ©nĂ©ralement pas exploitĂ©e pour amĂ©liorer l'estimation tomographique. Cette thĂšse propose d'utiliser l'information structurelle propre aux structures urbaines pour rĂ©gulariser les densitĂ©s de rĂ©flecteurs obtenues par cette technique
Surface Networks
We study data-driven representations for three-dimensional triangle meshes,
which are one of the prevalent objects used to represent 3D geometry. Recent
works have developed models that exploit the intrinsic geometry of manifolds
and graphs, namely the Graph Neural Networks (GNNs) and its spectral variants,
which learn from the local metric tensor via the Laplacian operator. Despite
offering excellent sample complexity and built-in invariances, intrinsic
geometry alone is invariant to isometric deformations, making it unsuitable for
many applications. To overcome this limitation, we propose several upgrades to
GNNs to leverage extrinsic differential geometry properties of
three-dimensional surfaces, increasing its modeling power.
In particular, we propose to exploit the Dirac operator, whose spectrum
detects principal curvature directions --- this is in stark contrast with the
classical Laplace operator, which directly measures mean curvature. We coin the
resulting models \emph{Surface Networks (SN)}. We prove that these models
define shape representations that are stable to deformation and to
discretization, and we demonstrate the efficiency and versatility of SNs on two
challenging tasks: temporal prediction of mesh deformations under non-linear
dynamics and generative models using a variational autoencoder framework with
encoders/decoders given by SNs
- âŠ