158 research outputs found
Heterogeneous Stochastic Interactions for Multiple Agents in a Multi-armed Bandit Problem
We define and analyze a multi-agent multi-armed bandit problem in which
decision-making agents can observe the choices and rewards of their neighbors.
Neighbors are defined by a network graph with heterogeneous and stochastic
interconnections. These interactions are determined by the sociability of each
agent, which corresponds to the probability that the agent observes its
neighbors. We design an algorithm for each agent to maximize its own expected
cumulative reward and prove performance bounds that depend on the sociability
of the agents and the network structure. We use the bounds to predict the rank
ordering of agents according to their performance and verify the accuracy
analytically and computationally
Adaptive Network Dynamics and Evolution of Leadership in Collective Migration
The evolution of leadership in migratory populations depends not only on
costs and benefits of leadership investments but also on the opportunities for
individuals to rely on cues from others through social interactions. We derive
an analytically tractable adaptive dynamic network model of collective
migration with fast timescale migration dynamics and slow timescale adaptive
dynamics of individual leadership investment and social interaction. For large
populations, our analysis of bifurcations with respect to investment cost
explains the observed hysteretic effect associated with recovery of migration
in fragmented environments. Further, we show a minimum connectivity threshold
above which there is evolutionary branching into leader and follower
populations. For small populations, we show how the topology of the underlying
social interaction network influences the emergence and location of leaders in
the adaptive system. Our model and analysis can describe other adaptive network
dynamics involving collective tracking or collective learning of a noisy,
unknown signal, and likewise can inform the design of robotic networks where
agents use decentralized strategies that balance direct environmental
measurements with agent interactions.Comment: Submitted to Physica D: Nonlinear Phenomen
Collective Decision-Making in Ideal Networks: The Speed-Accuracy Tradeoff
We study collective decision-making in a model of human groups, with network
interactions, performing two alternative choice tasks. We focus on the
speed-accuracy tradeoff, i.e., the tradeoff between a quick decision and a
reliable decision, for individuals in the network. We model the evidence
aggregation process across the network using a coupled drift diffusion model
(DDM) and consider the free response paradigm in which individuals take their
time to make the decision. We develop reduced DDMs as decoupled approximations
to the coupled DDM and characterize their efficiency. We determine high
probability bounds on the error rate and the expected decision time for the
reduced DDM. We show the effect of the decision-maker's location in the network
on their decision-making performance under several threshold selection
criteria. Finally, we extend the coupled DDM to the coupled Ornstein-Uhlenbeck
model for decision-making in two alternative choice tasks with recency effects,
and to the coupled race model for decision-making in multiple alternative
choice tasks.Comment: to appear in IEEE TCN
Cooperative learning in multi-agent systems from intermittent measurements
Motivated by the problem of tracking a direction in a decentralized way, we
consider the general problem of cooperative learning in multi-agent systems
with time-varying connectivity and intermittent measurements. We propose a
distributed learning protocol capable of learning an unknown vector from
noisy measurements made independently by autonomous nodes. Our protocol is
completely distributed and able to cope with the time-varying, unpredictable,
and noisy nature of inter-agent communication, and intermittent noisy
measurements of . Our main result bounds the learning speed of our
protocol in terms of the size and combinatorial features of the (time-varying)
networks connecting the nodes
Nonuniform Coverage Control on the Line
This paper investigates control laws allowing mobile, autonomous agents to
optimally position themselves on the line for distributed sensing in a
nonuniform field. We show that a simple static control law, based only on local
measurements of the field by each agent, drives the agents close to the optimal
positions after the agents execute in parallel a number of
sensing/movement/computation rounds that is essentially quadratic in the number
of agents. Further, we exhibit a dynamic control law which, under slightly
stronger assumptions on the capabilities and knowledge of each agent, drives
the agents close to the optimal positions after the agents execute in parallel
a number of sensing/communication/computation/movement rounds that is
essentially linear in the number of agents. Crucially, both algorithms are
fully distributed and robust to unpredictable loss and addition of agents
Stability and drift of underwater vehicle dynamics: Mechanical systems with rigid motion symmetry
This paper develops the stability theory of relative equilibria for mechanical systems with symmetry. It is especially concerned with systems that have a noncompact symmetry group, such as the group of Euclidean motions, and with relative equilibria for such symmetry groups. For these systems with rigid motion symmetry, one gets stability but possibly with drift in certain rotational as well as translational directions. Motivated by questions on stability of underwater vehicle dynamics, it is of particular interest that, in some cases, we can allow the relative equilibria to have nongeneric values of their momentum. The results are proved by combining theorems of Patrick with the technique of reduction by stages.
This theory is then applied to underwater vehicle dynamics. The stability of specific relative equilibria for the underwater vehicle is studied. For example, we find conditions for Liapunov stability of the steadily rising and possibly spinning, bottom-heavy vehicle, which corresponds to a relative equilibrium with nongeneric momentum. The results of this paper should prove useful for the control of underwater vehicles
Joint Centrality Distinguishes Optimal Leaders in Noisy Networks
We study the performance of a network of agents tasked with tracking an
external unknown signal in the presence of stochastic disturbances and under
the condition that only a limited subset of agents, known as leaders, can
measure the signal directly. We investigate the optimal leader selection
problem for a prescribed maximum number of leaders, where the optimal leader
set minimizes total system error defined as steady-state variance about the
external signal. In contrast to previously established greedy algorithms for
optimal leader selection, our results rely on an expression of total system
error in terms of properties of the underlying network graph. We demonstrate
that the performance of any given set of leaders depends on their influence as
determined by a new graph measure of centrality of a set. We define the of a set of nodes in a network graph such that a leader set with
maximal joint centrality is an optimal leader set. In the case of a single
leader, we prove that the optimal leader is the node with maximal information
centrality. In the case of multiple leaders, we show that the nodes in the
optimal leader set balance high information centrality with a coverage of the
graph. For special cases of graphs, we solve explicitly for optimal leader
sets. We illustrate with examples.Comment: Conditionally accepted to IEEE TCN
- ā¦