28,342 research outputs found
Distributed Adaptive Learning with Multiple Kernels in Diffusion Networks
We propose an adaptive scheme for distributed learning of nonlinear functions
by a network of nodes. The proposed algorithm consists of a local adaptation
stage utilizing multiple kernels with projections onto hyperslabs and a
diffusion stage to achieve consensus on the estimates over the whole network.
Multiple kernels are incorporated to enhance the approximation of functions
with several high and low frequency components common in practical scenarios.
We provide a thorough convergence analysis of the proposed scheme based on the
metric of the Cartesian product of multiple reproducing kernel Hilbert spaces.
To this end, we introduce a modified consensus matrix considering this specific
metric and prove its equivalence to the ordinary consensus matrix. Besides, the
use of hyperslabs enables a significant reduction of the computational demand
with only a minor loss in the performance. Numerical evaluations with synthetic
and real data are conducted showing the efficacy of the proposed algorithm
compared to the state of the art schemes.Comment: Double-column 15 pages, 10 figures, submitted to IEEE Trans. Signal
Processin
Multi-hop Diffusion LMS for Energy-constrained Distributed Estimation
We propose a multi-hop diffusion strategy for a sensor network to perform
distributed least mean-squares (LMS) estimation under local and network-wide
energy constraints. At each iteration of the strategy, each node can combine
intermediate parameter estimates from nodes other than its physical neighbors
via a multi-hop relay path. We propose a rule to select combination weights for
the multi-hop neighbors, which can balance between the transient and the
steady-state network mean-square deviations (MSDs). We study two classes of
networks: simple networks with a unique transmission path from one node to
another, and arbitrary networks utilizing diffusion consultations over at most
two hops. We propose a method to optimize each node's information neighborhood
subject to local energy budgets and a network-wide energy budget for each
diffusion iteration. This optimization requires the network topology, and the
noise and data variance profiles of each node, and is performed offline before
the diffusion process. In addition, we develop a fully distributed and adaptive
algorithm that approximately optimizes the information neighborhood of each
node with only local energy budget constraints in the case where diffusion
consultations are performed over at most a predefined number of hops. Numerical
results suggest that our proposed multi-hop diffusion strategy achieves the
same steady-state MSD as the existing one-hop adapt-then-combine diffusion
algorithm but with a lower energy budget.Comment: 14 pages, 12 figures. Submitted for publicatio
Distributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View
Distributed adaptive filtering has been considered as an effective approach
for data processing and estimation over distributed networks. Most existing
distributed adaptive filtering algorithms focus on designing different
information diffusion rules, regardless of the nature evolutionary
characteristic of a distributed network. In this paper, we study the adaptive
network from the game theoretic perspective and formulate the distributed
adaptive filtering problem as a graphical evolutionary game. With the proposed
formulation, the nodes in the network are regarded as players and the local
combiner of estimation information from different neighbors is regarded as
different strategies selection. We show that this graphical evolutionary game
framework is very general and can unify the existing adaptive network
algorithms. Based on this framework, as examples, we further propose two
error-aware adaptive filtering algorithms. Moreover, we use graphical
evolutionary game theory to analyze the information diffusion process over the
adaptive networks and evolutionarily stable strategy of the system. Finally,
simulation results are shown to verify the effectiveness of our analysis and
proposed methods.Comment: Accepted by IEEE Transactions on Signal Processin
- …