A scalable multi-core architecture with heterogeneous memory structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs)

Neuromorphic computing systems comprise networks of neurons that use asynchronous events for both computation and communication. This type of representation offers several advantages in terms of bandwidth and power consumption in neuromorphic electronic systems. However, managing the traffic of asynchronous events in large scale systems is a daunting task, both in terms of circuit complexity and memory requirements. Here we present a novel routing methodology that employs both hierarchical and mesh routing strategies and combines heterogeneous memory structures for minimizing both memory requirements and latency, while maximizing programming flexibility to support a wide range of event-based neural network architectures, through parameter configuration. We validated the proposed scheme in a prototype multi-core neuromorphic processor chip that employs hybrid analog/digital circuits for emulating synapse and neuron dynamics together with asynchronous digital circuits for managing the address-event traffic. We present a theoretical analysis of the proposed connectivity scheme, describe the methods and circuits used to implement such scheme, and characterize the prototype chip. Finally, we demonstrate the use of the neuromorphic processor with a convolutional neural network for the real-time classification of visual symbols being flashed to a dynamic vision sensor (DVS) at high speed.Comment: 17 pages, 14 figure

Neural Network Models of Learning and Memory: Leading Questions and an Emerging Framework

Office of Naval Research and the Defense Advanced Research Projects Agency (N00014-95-1-0409, N00014-1-95-0657); National Institutes of Health (NIH 20-316-4304-5

Opinion Formation by Informed Agents

Opinion formation and innovation diffusion have gained lots of attention in the last decade due to its application in social and political science. Control of the diffusion process usually takes place using the most influential people in the society, called opinion leaders or key players. But the opinion leaders can hardly be accessed or hired for spreading the desired opinion or information. This is where informed agents can play a key role. Informed agents are common people, not distinguishable from the other members of the society that act in coordination. In this paper we show that informed agents are able to gradually shift the public opinion toward a desired goal through microscopic interactions. In order to do so they pretend to have an opinion similar to others, but while interacting with them, gradually and intentionally change their opinion toward the desired direction. In this paper a computational model for opinion formation by the informed agents based on the bounded confidence model is proposed. The effects of different parameter settings including population size of the informed agents, their characteristics, and network structure, are investigated. The results show that social and open-minded informed agents are more efficient than selfish or closed-minded agents in control of the public opinion.Social Networks, Informed Agents, Innovation Diffusion, Bounded Confidence, Opinion Dynamics, Opinion Formation

ARTMAP: Supervised Real-Time Learning and Classification of Nonstationary Data by a Self-Organizing Neural Network

This article introduces a new neural network architecture, called ARTMAP, that autonomously learns to classify arbitrarily many, arbitrarily ordered vectors into recognition categories based on predictive success. This supervised learning system is built up from a pair of Adaptive Resonance Theory modules (ARTa and ARTb) that are capable of self-organizing stable recognition categories in response to arbitrary sequences of input patterns. During training trials, the ARTa module receives a stream {a^(p)} of input patterns, and ARTb receives a stream {b^(p)} of input patterns, where b^(p) is the correct prediction given a^(p). These ART modules are linked by an associative learning network and an internal controller that ensures autonomous system operation in real time. During test trials, the remaining patterns a^(p) are presented without b^(p), and their predictions at ARTb are compared with b^(p). Tested on a benchmark machine learning database in both on-line and off-line simulations, the ARTMAP system learns orders of magnitude more quickly, efficiently, and accurately than alternative algorithms, and achieves 100% accuracy after training on less than half the input patterns in the database. It achieves these properties by using an internal controller that conjointly maximizes predictive generalization and minimizes predictive error by linking predictive success to category size on a trial-by-trial basis, using only local operations. This computation increases the vigilance parameter ρa of ARTa by the minimal amount needed to correct a predictive error at ARTb· Parameter ρa calibrates the minimum confidence that ARTa must have in a category, or hypothesis, activated by an input a^(p) in order for ARTa to accept that category, rather than search for a better one through an automatically controlled process of hypothesis testing. Parameter ρa is compared with the degree of match between a^(p) and the top-down learned expectation, or prototype, that is read-out subsequent to activation of an ARTa category. Search occurs if the degree of match is less than ρa. ARTMAP is hereby a type of self-organizing expert system that calibrates the selectivity of its hypotheses based upon predictive success. As a result, rare but important events can be quickly and sharply distinguished even if they are similar to frequent events with different consequences. Between input trials ρa relaxes to a baseline vigilance pa When ρa is large, the system runs in a conservative mode, wherein predictions are made only if the system is confident of the outcome. Very few false-alarm errors then occur at any stage of learning, yet the system reaches asymptote with no loss of speed. Because ARTMAP learning is self stabilizing, it can continue learning one or more databases, without degrading its corpus of memories, until its full memory capacity is utilized.British Petroleum (98-A-1204); Defense Advanced Research Projects Agency (90-0083, 90-0175, 90-0128); National Science Foundation (IRI-90-00539); Army Research Office (DAAL-03-88-K0088

Modulating interaction times in an artificial society of robots

In a collaborative society, sharing information is advantageous for each individual as well as for the whole community. Maximizing the number of agent-to-agent interactions per time becomes an appealing behavior due to fast information spreading that maximizes the overall amount of shared information. However, if malicious agents are part of society, then the risk of interacting with one of them increases with an increasing number of interactions. In this paper, we investigate the roles of interaction rates and times (aka edge life) in artificial societies of simulated robot swarms. We adapt their social networks to form proper trust sub-networks and to contain attackers. Instead of sophisticated algorithms to build and administrate trust networks, we focus on simple control algorithms that locally adapt interaction times by changing only the robots' motion patterns. We successfully validate these algorithms in collective decision-making showing improved time to convergence and energy-efficient motion patterns, besides impeding the spread of undesired opinions

Link updating strategies influence consensus decisions as a function of the direction of communication

Consensus decision-making in social groups strongly depends on communication links that determine to whom individuals send, and from whom they receive, information. Here, we ask how consensus decisions are affected by strategic updating of links and how this effect varies with the direction of communication. We quantified the co-evolution of link and opinion dynamics in a large population with binary opinions using mean-field numerical simulations of two voter-like models of opinion dynamics: an Incoming model (where individuals choose who to receive opinions from) and an Outgoing model (where individuals choose who to send opinions to). We show that individuals can bias group-level outcomes in their favor by breaking disagreeing links while receiving opinions (Incoming Model) and retaining disagreeing links while sending opinions (Outgoing Model). Importantly, these biases can help the population avoid stalemates and achieve consensus. However, the role of disagreement avoidance is diluted in the presence of strong preferences - highly stubborn individuals can shape decisions to favor their preferences, giving rise to non-consensus outcomes. We conclude that collectively changing communication structures can bias consensus decisions, as a function of the strength of preferences and the direction of communication