7 research outputs found
Discovering Influencers in Opinion Formation over Social Graphs
The adaptive social learning paradigm helps model how networked agents are
able to form opinions on a state of nature and track its drifts in a changing
environment. In this framework, the agents repeatedly update their beliefs
based on private observations and exchange the beliefs with their neighbors. In
this work, it is shown how the sequence of publicly exchanged beliefs over time
allows users to discover rich information about the underlying network topology
and about the flow of information over graph. In particular, it is shown that
it is possible (i) to identify the influence of each individual agent to the
objective of truth learning, (ii) to discover how well informed each agent is,
(iii) to quantify the pairwise influences between agents, and (iv) to learn the
underlying network topology. The algorithm derived herein is also able to work
under non-stationary environments where either the true state of nature or the
network topology are allowed to drift over time. We apply the proposed
algorithm to different subnetworks of Twitter users, and identify the most
influential and central agents merely by using their public tweets (posts)
Dif-MAML: Decentralized Multi-Agent Meta-Learning
The objective of meta-learning is to exploit the knowledge obtained from
observed tasks to improve adaptation to unseen tasks. As such, meta-learners
are able to generalize better when they are trained with a larger number of
observed tasks and with a larger amount of data per task. Given the amount of
resources that are needed, it is generally difficult to expect the tasks, their
respective data, and the necessary computational capacity to be available at a
single central location. It is more natural to encounter situations where these
resources are spread across several agents connected by some graph topology.
The formalism of meta-learning is actually well-suited to this decentralized
setting, where the learner would be able to benefit from information and
computational power spread across the agents. Motivated by this observation, in
this work, we propose a cooperative fully-decentralized multi-agent
meta-learning algorithm, referred to as Diffusion-based MAML or Dif-MAML.
Decentralized optimization algorithms are superior to centralized
implementations in terms of scalability, avoidance of communication
bottlenecks, and privacy guarantees. The work provides a detailed theoretical
analysis to show that the proposed strategy allows a collection of agents to
attain agreement at a linear rate and to converge to a stationary point of the
aggregate MAML objective even in non-convex environments. Simulation results
illustrate the theoretical findings and the superior performance relative to
the traditional non-cooperative setting
Dif-MAML: Decentralized Multi-Agent Meta-Learning
The objective of meta-learning is to exploit knowledge obtained from observed tasks to improve adaptation to unseen tasks. Meta-learners are able to generalize better when they are trained with a larger number of observed tasks and with a larger amount of data per task. Given the amount of resources that are needed, it is generally difficult to expect the tasks, their respective data, and the necessary computational capacity to be available at a single central location. It is more natural to encounter situations where these resources are spread across several agents connected by some graph topology. The formalism of meta-learning is actually well-suited for this decentralized setting, where the learner benefits from information and computational power spread across the agents. Motivated by this observation, we propose a cooperative fully-decentralized multi-agent meta-learning algorithm, referred to as Diffusion-based MAML or Dif-MAML. Decentralized optimization algorithms are superior to centralized implementations in terms of scalability, robustness, avoidance of communication bottlenecks, and privacy guarantees. The work provides a detailed theoretical analysis to show that the proposed strategy allows a collection of agents to attain agreement at a linear rate and to converge to a stationary point of the aggregate MAML objective even in non-convex environments. Simulation results illustrate the theoretical findings and the superior performance relative to the traditional non-cooperative setting.AS
Policy Evaluation in Decentralized POMDPs With Belief Sharing
Most works on multi-agent reinforcement learning focus on scenarios where the state of the environment is fully observable. In this work, we consider a cooperative policy evaluation task in which agents are not assumed to observe the environment state directly. Instead, agents can only have access to noisy observations and to belief vectors. It is well-known that finding global posterior distributions under multi-agent settings is generally NP-hard. As a remedy, we propose a fully decentralized belief forming strategy that relies on individual updates and on localized interactions over a communication network. In addition to the exchange of the beliefs, agents exploit the communication network by exchanging value function parameter estimates as well. We analytically show that the proposed strategy allows information to diffuse over the network, which in turn allows the agents' parameters to have a bounded difference with a centralized baseline. A multi-sensor target tracking application is considered in the simulations
Social Opinion Formation Under Communication Trends
This work studies the learning process over social networks under partial and
random information sharing. In traditional social learning models, agents
exchange full belief information with each other while trying to infer the true
state of nature. We study the case where agents share information about only
one hypothesis, namely, the trending topic, which can be randomly changing at
every iteration. We show that agents can learn the true hypothesis even if they
do not discuss it, at rates comparable to traditional social learning. We also
show that using one's own belief as a prior for estimating the neighbors'
non-transmitted beliefs might create opinion clusters that prevent learning
with full confidence. This practice, however, avoids the complete rejection of
the truth.Comment: Submitted for publicatio
An atypical presentation of myopericytoma in palmar arch and review of the literature
Introduction. Myopericytoma is a very rare perivascular tumor that can be presented with painful mass in lower extremities. We aimed to present an atypical presentation and location of myopericytoma. Presentation of Case. An 18-year-old otherwise healthy individual was admitted to outpatient clinic with complaints of numbness and pain in his right hand. He has had no trauma. On volar aspect of his right hand, a well-circumscribed, painful mass was palpated. MRI results were related to hemangioma. Surgical excision was planned and performed. Pathological investigation revealed the mass is myopericytoma. Discussion. This case demonstrates a rare location and presentation of myopericytoma. Reviewing the literature, discussion was made to expand the horizon for diagnosis and treatment of patients with similar symptoms. Conclusion. Myopericytoma can rarely present with numbness and pain in affected region. Surgical excision is helpful for definitive diagnosis and symptom relief
Hidden Markov Modeling Over Graphs
This work proposes a multi-agent filtering algorithm over graphs for finite-state hidden Markov models (HMMs), which can be used for sequential state estimation or for tracking opinion formation over dynamic social networks. We show that the difference from the optimal centralized Bayesian solution is asymptotically bounded for geometrically ergodic transition models. Experiments illustrate the theoretical findings and in particular, demonstrate the superior performance of the proposed algorithm compared to a state-of-the-art social learning algorithm.AS