Phase models and clustering in networks of oscillators with delayed coupling

We consider a general model for a network of oscillators with time delayed, circulant coupling. We use the theory of weakly coupled oscillators to reduce the system of delay differential equations to a phase model where the time delay enters as a phase shift. We use the phase model to study the existence and stability of cluster solutions. Cluster solutions are phase locked solutions where the oscillators separate into groups. Oscillators within a group are synchronized while those in different groups are phase-locked. We give model independent existence and stability results for symmetric cluster solutions. We show that the presence of the time delay can lead to the coexistence of multiple stable clustering solutions. We apply our analytical results to a network of Morris Lecar neurons and compare these results with numerical continuation and simulation studies

A Theory of Cortical Neural Processing.

This dissertation puts forth an original theory of cortical neural processing that is unique in its view of the interplay of chaotic and stable oscillatory neurodynamics and is meant to stimulate new ideas in artificial neural network modeling. Our theory is the first to suggest two new purposes for chaotic neurodynamics: (i) as a natural means of representing the uncertainty in the outcome of performed tasks, such as memory retrieval or classification, and (ii) as an automatic way of producing an economic representation of distributed information. We developed new models, to better understand how the cerebral cortex processes information, which led to our theory. Common to these models is a neuron interaction function that alternates between excitatory and inhibitory neighborhoods. Our theory allows characteristics of the input environment to influence the structural development of the cortex. We view low intensity chaotic activity as the a priori uncertain base condition of the cortex, resulting from the interaction of a multitude of stronger potential responses. Data, distinguishing one response from many others, drives bifurcations back toward the direction of less complex (stable) behavior. Stability appears as temporary bubble-like clusters within the boundaries of cortical columns and begins to propagate through frequency sensitive and non-specific neurons. But this is limited by destabilizing long-path connections. An original model of the post-natal development of ocular dominance columns in the striate cortex is presented and compared to autoradiographic images from the literature with good matching results. Finally, experiments are shown to favor computed update order over traditional approaches for better performance of the pattern completion process

Mammalian Brain As a Network of Networks

Acknowledgements AZ, SG and AL acknowledge support from the Russian Science Foundation (16-12-00077). Authors thank T. Kuznetsova for Fig. 6.Peer reviewedPublisher PD

Geometric Analysis of Synchronization in Neuronal Networks with Global Inhibition and Coupling Delays

We study synaptically coupled neuronal networks to identify the role of coupling delays in network's synchronized behaviors. We consider a network of excitable, relaxation oscillator neurons where two distinct populations, one excitatory and one inhibitory, are coupled and interact with each other. The excitatory population is uncoupled, while the inhibitory population is tightly coupled. A geometric singular perturbation analysis yields existence and stability conditions for synchronization states under different firing patterns between the two populations, along with formulas for the periods of such synchronous solutions. Our results demonstrate that the presence of coupling delays in the network promotes synchronization. Numerical simulations are conducted to supplement and validate analytical results. We show the results carry over to a model for spindle sleep rhythms in thalamocortical networks, one of the biological systems which motivated our study. The analysis helps to explain how coupling delays in either excitatory or inhibitory synapses contribute to producing synchronized rhythms.Comment: 43 pages, 12 figure

Dynamical principles in neuroscience

Dynamical modeling of neural systems and brain functions has a history of success over the last half century. This includes, for example, the explanation and prediction of some features of neural rhythmic behaviors. Many interesting dynamical models of learning and memory based on physiological experiments have been suggested over the last two decades. Dynamical models even of consciousness now exist. Usually these models and results are based on traditional approaches and paradigms of nonlinear dynamics including dynamical chaos. Neural systems are, however, an unusual subject for nonlinear dynamics for several reasons: (i) Even the simplest neural network, with only a few neurons and synaptic connections, has an enormous number of variables and control parameters. These make neural systems adaptive and flexible, and are critical to their biological function. (ii) In contrast to traditional physical systems described by well-known basic principles, first principles governing the dynamics of neural systems are unknown. (iii) Many different neural systems exhibit similar dynamics despite having different architectures and different levels of complexity. (iv) The network architecture and connection strengths are usually not known in detail and therefore the dynamical analysis must, in some sense, be probabilistic. (v) Since nervous systems are able to organize behavior based on sensory inputs, the dynamical modeling of these systems has to explain the transformation of temporal information into combinatorial or combinatorial-temporal codes, and vice versa, for memory and recognition. In this review these problems are discussed in the context of addressing the stimulating questions: What can neuroscience learn from nonlinear dynamics, and what can nonlinear dynamics learn from neuroscience?This work was supported by NSF Grant No. NSF/EIA-0130708, and Grant No. PHY 0414174; NIH Grant No. 1 R01 NS50945 and Grant No. NS40110; MEC BFI2003-07276, and Fundación BBVA

Mathematical modelling and brain dynamical networks

In this thesis, we study the dynamics of the Hindmarsh-Rose (HR) model which studies the spike-bursting behaviour of the membrane potential of a single neuron. We study the stability of the HR system and compute its Lyapunov exponents (LEs). We consider coupled general sections of the HR system to create an undirected brain dynamical network (BDN) of Nn neurons. Then, we study the concepts of upper bound of mutual information rate (MIR) and synchronisation measure and their dependence on the values of electrical and chemical couplings. We analyse the dynamics of neurons in various regions of parameter space plots for two elementary examples of 3 neurons with two different types of electrical and chemical couplings. We plot the upper bound Ic and the order parameter rho (the measure of synchronisation) and the two largest Lyapunov exponents LE1 and LE2 versus the chemical coupling gn and electrical coupling gl. We show that, even for small number of neurons, the dynamics of the system depends on the number of neurons and the type of coupling strength between them. Finally, we evolve a network of Hindmarsh-Rose neurons by increasing the entropy of the system. In particular, we choose the Kolmogorov-Sinai entropy: HKS (Pesin identity) as the evolution rule. First, we compute the HKS for a network of 4 HR neurons connected simultaneously by two undirected electrical and two undirected chemical links. We get different entropies with the use of different values for both the chemical and electrical couplings. If the entropy of the system is positive, the dynamics of the system is chaotic and if it is close to zero, the trajectory of the system converges to one of the fixed points and loses energy. Then, we evolve a network of 6 clusters of 10 neurons each. Neurons in each cluster are connected only by electrical links and their connections form small-world networks. The six clusters connect to each other only by chemical links. We compare between the combined effect of chemical and electrical couplings with the two concepts, the information flow capacity Ic and HKS in evolving the BDNs and show results that the brain networks might evolve based on the principle of the maximisation of their entropies

Temporal structure of neural oscillations underlying sensorimotor coordination: a theoretical approach with evolutionary robotics

The temporal structure of neural oscillations has become a widespread hypothetical \mechanism" to explain how neurodynamics give rise to neural functions. Despite the great number of empirical experiments in neuroscience and mathematical and computa- tional modelling investigating the temporal structure of the oscillations, there are still few systematic studies proposing dynamical explanations of how it operates within closed sensorimotor loops of agents performing minimally cognitive behaviours. In this thesis we explore this problem by developing and analysing theoretical models of evolutionary robotics controlled by oscillatory networks. The results obtained suggest that: i) the in- formational content in an oscillatory network about the sensorimotor dynamics is equally distributed throughout the entire range of phase relations; neither synchronous nor desyn- chronous oscillations carries a privileged status in terms of informational content in relation to an agent's sensorimotor activity; ii) although the phase relations of oscillations with a narrow frequency difference carry a relatively higher causal relevance than the rest of the phase relations to sensorimotor coordinations, overall there is no privileged functional causal contribution to either synchronous or desynchronous oscillations; and iii) oscilla- tory regimes underlying functional behaviours (e.g. phototaxis, categorical perception) are generated and sustained by the agent's sensorimotor loop dynamics, they depend not only on the dynamic structure of a sensory input but also on the coordinated coupling of the agent's motor-sensory dynamics. This thesis also contributes to the Coordination Dynam- ics framework (Kelso, 1995) by analysing the dynamics of the HKB (Haken-Kelso-Bunz) equation within a closed sensorimotor loop and by discussing the theoretical implications of such an analysis. Besides, it contributes to the ongoing philosophical debate about whether actions are either causally relevant or a constituent of cognitive functionalities by bringing this debate to the context of oscillatory neurodynamics and by illustrating the constitutive notion of actions to cognition

Adaptive dynamical networks

It is a fundamental challenge to understand how the function of a network is related to its structural organization. Adaptive dynamical networks represent a broad class of systems that can change their connectivity over time depending on their dynamical state. The most important feature of such systems is that their function depends on their structure and vice versa. While the properties of static networks have been extensively investigated in the past, the study of adaptive networks is much more challenging. Moreover, adaptive dynamical networks are of tremendous importance for various application fields, in particular, for the models for neuronal synaptic plasticity, adaptive networks in chemical, epidemic, biological, transport, and social systems, to name a few. In this review, we provide a detailed description of adaptive dynamical networks, show their applications in various areas of research, highlight their dynamical features and describe the arising dynamical phenomena, and give an overview of the available mathematical methods developed for understanding adaptive dynamical networks