Unsupervised Learning with Self-Organizing Spiking Neural Networks

We present a system comprising a hybridization of self-organized map (SOM) properties with spiking neural networks (SNNs) that retain many of the features of SOMs. Networks are trained in an unsupervised manner to learn a self-organized lattice of filters via excitatory-inhibitory interactions among populations of neurons. We develop and test various inhibition strategies, such as growing with inter-neuron distance and two distinct levels of inhibition. The quality of the unsupervised learning algorithm is evaluated using examples with known labels. Several biologically-inspired classification tools are proposed and compared, including population-level confidence rating, and n-grams using spike motif algorithm. Using the optimal choice of parameters, our approach produces improvements over state-of-art spiking neural networks

Contribution to Knowledge of the Genus Apsectus (Coleoptera, Dermestidae, Trinodinae) from Mexico and Neotropical Region

Apsectus kaliki sp. n. from Guyana is described, illustrated and compared with all the known Neotropical species of the genus Apsectus LeConte, 1854. Lectotypes are designated for Apsectus centralis Sharp, 1902 and Apsectus hystrix Sharp, 1902.Иллюстрированное описание Apsectus kaliki sp. n. из Гайяны и сравнение с известными неотропическими видами рода Apsectus LeConte, 1854. Обозначены лектотипы Apsectus centralis Sharp, 1902 and Apsectus hystrix Sharp, 1902

A Study On Monitoring Overhead Impact on Wireless Mesh Networks

International audienceA wireless mesh network is characterized by dynamicity. It needs to be monitored permanently to make sure its properties remain within certain limits in order to provide Quality-of-Service to the end users or to identify possible faults. To establish in every moment what is the appropriate reporting interval of the measured information and the way it is disseminated are important tasks. It has to achieve information quickly enough to solve any issue but excessive as to affect the data traffic. The problem that arises is that the monitoring information needs to travel in the network along with the user traffic and thus, potentially causing congestion. Considering that a wireless mesh network has highly dynamic characteristics there is a need for a good understanding of the influences of disseminating monitoring information in the network along with user traffic. In this paper we provide an evaluation of the network performance while monitoring information is collected from network nodes. We study how different monitoring packet sizes and different reporting frequency of the information can impact the user traffic and compare these values to the case in which only user data travels across the network

Energy-based General Sequential Episodic Memory Networks at the Adiabatic Limit

The General Associative Memory Model (GAMM) has a constant state-dependant energy surface that leads the output dynamics to fixed points, retrieving single memories from a collection of memories that can be asynchronously preloaded. We introduce a new class of General Sequential Episodic Memory Models (GSEMM) that, in the adiabatic limit, exhibit temporally changing energy surface, leading to a series of meta-stable states that are sequential episodic memories. The dynamic energy surface is enabled by newly introduced asymmetric synapses with signal propagation delays in the network's hidden layer. We study the theoretical and empirical properties of two memory models from the GSEMM class, differing in their activation functions. LISEM has non-linearities in the feature layer, whereas DSEM has non-linearity in the hidden layer. In principle, DSEM has a storage capacity that grows exponentially with the number of neurons in the network. We introduce a learning rule for the synapses based on the energy minimization principle and show it can learn single memories and their sequential relationships online. This rule is similar to the Hebbian learning algorithm and Spike-Timing Dependent Plasticity (STDP), which describe conditions under which synapses between neurons change strength. Thus, GSEMM combines the static and dynamic properties of episodic memory under a single theoretical framework and bridges neuroscience, machine learning, and artificial intelligence

Hidden Traveling Waves bind Working Memory Variables in Recurrent Neural Networks

Traveling waves are a fundamental phenomenon in the brain, playing a crucial role in short-term information storage. In this study, we leverage the concept of traveling wave dynamics within a neural lattice to formulate a theoretical model of neural working memory, study its properties, and its real world implications in AI. The proposed model diverges from traditional approaches, which assume information storage in static, register-like locations updated by interference. Instead, the model stores data as waves that is updated by the wave's boundary conditions. We rigorously examine the model's capabilities in representing and learning state histories, which are vital for learning history-dependent dynamical systems. The findings reveal that the model reliably stores external information and enhances the learning process by addressing the diminishing gradient problem. To understand the model's real-world applicability, we explore two cases: linear boundary condition (LBC) and non-linear, self-attention-driven boundary condition (SBC). The model with the linear boundary condition results in a shift matrix plus low-rank matrix currently used in H3 state space RNN. Further, our experiments with LBC reveal that this matrix is effectively learned by Recurrent Neural Networks (RNNs) through backpropagation when modeling history-dependent dynamical systems. Conversely, the SBC parallels the autoregressive loop of an attention-only transformer with the context vector representing the wave substrate. Collectively, our findings suggest the broader relevance of traveling waves in AI and its potential in advancing neural network architectures