6,504 research outputs found
Asynchronous Gossip for Averaging and Spectral Ranking
We consider two variants of the classical gossip algorithm. The first variant
is a version of asynchronous stochastic approximation. We highlight a
fundamental difficulty associated with the classical asynchronous gossip
scheme, viz., that it may not converge to a desired average, and suggest an
alternative scheme based on reinforcement learning that has guaranteed
convergence to the desired average. We then discuss a potential application to
a wireless network setting with simultaneous link activation constraints. The
second variant is a gossip algorithm for distributed computation of the
Perron-Frobenius eigenvector of a nonnegative matrix. While the first variant
draws upon a reinforcement learning algorithm for an average cost controlled
Markov decision problem, the second variant draws upon a reinforcement learning
algorithm for risk-sensitive control. We then discuss potential applications of
the second variant to ranking schemes, reputation networks, and principal
component analysis.Comment: 14 pages, 7 figures. Minor revisio
Distributed on-line multidimensional scaling for self-localization in wireless sensor networks
The present work considers the localization problem in wireless sensor
networks formed by fixed nodes. Each node seeks to estimate its own position
based on noisy measurements of the relative distance to other nodes. In a
centralized batch mode, positions can be retrieved (up to a rigid
transformation) by applying Principal Component Analysis (PCA) on a so-called
similarity matrix built from the relative distances. In this paper, we propose
a distributed on-line algorithm allowing each node to estimate its own position
based on limited exchange of information in the network. Our framework
encompasses the case of sporadic measurements and random link failures. We
prove the consistency of our algorithm in the case of fixed sensors. Finally,
we provide numerical and experimental results from both simulated and real
data. Simulations issued to real data are conducted on a wireless sensor
network testbed.Comment: 32 pages, 5 figures, 1 tabl
Metastability in a stochastic neural network modeled as a velocity jump Markov process
One of the major challenges in neuroscience is to determine how noise that is
present at the molecular and cellular levels affects dynamics and information
processing at the macroscopic level of synaptically coupled neuronal
populations. Often noise is incorprated into deterministic network models using
extrinsic noise sources. An alternative approach is to assume that noise arises
intrinsically as a collective population effect, which has led to a master
equation formulation of stochastic neural networks. In this paper we extend the
master equation formulation by introducing a stochastic model of neural
population dynamics in the form of a velocity jump Markov process. The latter
has the advantage of keeping track of synaptic processing as well as spiking
activity, and reduces to the neural master equation in a particular limit. The
population synaptic variables evolve according to piecewise deterministic
dynamics, which depends on population spiking activity. The latter is
characterised by a set of discrete stochastic variables evolving according to a
jump Markov process, with transition rates that depend on the synaptic
variables. We consider the particular problem of rare transitions between
metastable states of a network operating in a bistable regime in the
deterministic limit. Assuming that the synaptic dynamics is much slower than
the transitions between discrete spiking states, we use a WKB approximation and
singular perturbation theory to determine the mean first passage time to cross
the separatrix between the two metastable states. Such an analysis can also be
applied to other velocity jump Markov processes, including stochastic
voltage-gated ion channels and stochastic gene networks
- …