66,827 research outputs found
Sampling Geometric Inhomogeneous Random Graphs in Linear Time
Real-world networks, like social networks or the internet infrastructure,
have structural properties such as large clustering coefficients that can best
be described in terms of an underlying geometry. This is why the focus of the
literature on theoretical models for real-world networks shifted from classic
models without geometry, such as Chung-Lu random graphs, to modern
geometry-based models, such as hyperbolic random graphs.
With this paper we contribute to the theoretical analysis of these modern,
more realistic random graph models. Instead of studying directly hyperbolic
random graphs, we use a generalization that we call geometric inhomogeneous
random graphs (GIRGs). Since we ignore constant factors in the edge
probabilities, GIRGs are technically simpler (specifically, we avoid hyperbolic
cosines), while preserving the qualitative behaviour of hyperbolic random
graphs, and we suggest to replace hyperbolic random graphs by this new model in
future theoretical studies.
We prove the following fundamental structural and algorithmic results on
GIRGs. (1) As our main contribution we provide a sampling algorithm that
generates a random graph from our model in expected linear time, improving the
best-known sampling algorithm for hyperbolic random graphs by a substantial
factor O(n^0.5). (2) We establish that GIRGs have clustering coefficients in
{\Omega}(1), (3) we prove that GIRGs have small separators, i.e., it suffices
to delete a sublinear number of edges to break the giant component into two
large pieces, and (4) we show how to compress GIRGs using an expected linear
number of bits.Comment: 25 page
Non-Vacuous Generalization Bounds at the ImageNet Scale: A PAC-Bayesian Compression Approach
Modern neural networks are highly overparameterized, with capacity to
substantially overfit to training data. Nevertheless, these networks often
generalize well in practice. It has also been observed that trained networks
can often be "compressed" to much smaller representations. The purpose of this
paper is to connect these two empirical observations. Our main technical result
is a generalization bound for compressed networks based on the compressed size.
Combined with off-the-shelf compression algorithms, the bound leads to state of
the art generalization guarantees; in particular, we provide the first
non-vacuous generalization guarantees for realistic architectures applied to
the ImageNet classification problem. As additional evidence connecting
compression and generalization, we show that compressibility of models that
tend to overfit is limited: We establish an absolute limit on expected
compressibility as a function of expected generalization error, where the
expectations are over the random choice of training examples. The bounds are
complemented by empirical results that show an increase in overfitting implies
an increase in the number of bits required to describe a trained network.Comment: 16 pages, 1 figure. Accepted at ICLR 201
OFDM Synthetic Aperture Radar Imaging with Sufficient Cyclic Prefix
The existing linear frequency modulated (LFM) (or step frequency) and random
noise synthetic aperture radar (SAR) systems may correspond to the frequency
hopping (FH) and direct sequence (DS) spread spectrum systems in the past
second and third generation wireless communications. Similar to the current and
future wireless communications generations, in this paper, we propose OFDM SAR
imaging, where a sufficient cyclic prefix (CP) is added to each OFDM pulse. The
sufficient CP insertion converts an inter-symbol interference (ISI) channel
from multipaths into multiple ISI-free subchannels as the key in a wireless
communications system, and analogously, it provides an inter-range-cell
interference (IRCI) free (high range resolution) SAR image in a SAR system. The
sufficient CP insertion along with our newly proposed SAR imaging algorithm
particularly for the OFDM signals also differentiates this paper from all the
existing studies in the literature on OFDM radar signal processing. Simulation
results are presented to illustrate the high range resolution performance of
our proposed CP based OFDM SAR imaging algorithm.Comment: This version has been accepted by IEEE Transactions on Geoscience and
Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing 201
Graph Spectral Image Processing
Recent advent of graph signal processing (GSP) has spurred intensive studies
of signals that live naturally on irregular data kernels described by graphs
(e.g., social networks, wireless sensor networks). Though a digital image
contains pixels that reside on a regularly sampled 2D grid, if one can design
an appropriate underlying graph connecting pixels with weights that reflect the
image structure, then one can interpret the image (or image patch) as a signal
on a graph, and apply GSP tools for processing and analysis of the signal in
graph spectral domain. In this article, we overview recent graph spectral
techniques in GSP specifically for image / video processing. The topics covered
include image compression, image restoration, image filtering and image
segmentation
- …