Dynamical principles in neuroscience

Dynamical modeling of neural systems and brain functions has a history of success over the last half century. This includes, for example, the explanation and prediction of some features of neural rhythmic behaviors. Many interesting dynamical models of learning and memory based on physiological experiments have been suggested over the last two decades. Dynamical models even of consciousness now exist. Usually these models and results are based on traditional approaches and paradigms of nonlinear dynamics including dynamical chaos. Neural systems are, however, an unusual subject for nonlinear dynamics for several reasons: (i) Even the simplest neural network, with only a few neurons and synaptic connections, has an enormous number of variables and control parameters. These make neural systems adaptive and flexible, and are critical to their biological function. (ii) In contrast to traditional physical systems described by well-known basic principles, first principles governing the dynamics of neural systems are unknown. (iii) Many different neural systems exhibit similar dynamics despite having different architectures and different levels of complexity. (iv) The network architecture and connection strengths are usually not known in detail and therefore the dynamical analysis must, in some sense, be probabilistic. (v) Since nervous systems are able to organize behavior based on sensory inputs, the dynamical modeling of these systems has to explain the transformation of temporal information into combinatorial or combinatorial-temporal codes, and vice versa, for memory and recognition. In this review these problems are discussed in the context of addressing the stimulating questions: What can neuroscience learn from nonlinear dynamics, and what can nonlinear dynamics learn from neuroscience?This work was supported by NSF Grant No. NSF/EIA-0130708, and Grant No. PHY 0414174; NIH Grant No. 1 R01 NS50945 and Grant No. NS40110; MEC BFI2003-07276, and Fundación BBVA

Complex Dynamics in Dedicated / Multifunctional Neural Networks and Chaotic Nonlinear Systems

We study complex behaviors arising in neuroscience and other nonlinear systems by combining dynamical systems analysis with modern computational approaches including GPU parallelization and unsupervised machine learning. To gain insights into the behaviors of brain networks and complex central pattern generators (CPGs), it is important to understand the dynamical principles regulating individual neurons as well as the basic structural and functional building blocks of neural networks. In the first section, we discuss how symbolic methods can help us analyze neural dynamics such as bursting, tonic spiking and chaotic mixed-mode oscillations in various models of individual neurons, the bifurcations that underlie transitions between activity types, as well as emergent network phenomena through synergistic interactions seen in realistic neural circuits, such as network bursting from non-intrinsic bursters. The second section is focused on the origin and coexistence of multistable rhythms in oscillatory neural networks of inhibitory coupled cells. We discuss how network connectivity and intrinsic properties of the cells affect the dynamics, and how even simple circuits can exhibit a variety of mono/multi-stable rhythms including pacemakers, half-center oscillators, multiple traveling-waves, fully synchronous states, as well as various chimeras. Our analyses can help generate verifiable hypotheses for neurophysiological experiments on central pattern generators. In the last section, we demonstrate the inter-disciplinary nature of this research through the applications of these techniques to identify the universal principles governing both simple and complex dynamics, and chaotic structure in diverse nonlinear systems. Using a classical example from nonlinear laser optics, we elaborate on the multiplicity and self-similarity of key organizing structures in 2D parameter space such as homoclinic and heteroclinic bifurcation curves, Bykov T-point spirals, and inclination flips. This is followed by detailed computational reconstructions of the spatial organization and 3D embedding of bifurcation surfaces, parametric saddles, and isolated closed curves (isolas). The generality of our modeling approaches could lead to novel methodologies and nonlinear science applications in biological, medical and engineering systems

Towards a continuous dynamic model of the Hopfield theory on neuronal interaction and memory storage

The purpose of this work is to study the Hopfield model for neuronal interaction and memory storage, in particular the convergence to the stored patterns. Since the hypothesis of symmetric synapses is not true for the brain, we will study how we can extend it to the case of asymmetric synapses using a probabilistic approach. We then focus on the description of another feature of the memory process and brain: oscillations. Using the Kuramoto model we will be able to describe them completely, gaining the presence of synchronization between neurons. Our aim is therefore to understand how and why neurons can be seen as oscillators and to establish a strong link between this model and the Hopfield approach

Noise, coherent activity and network structure in neuronal cultures

In this thesis we apply a multidisciplinary approach, based on statistical physics and complex systems, to the study of neuronal dynamics. We focus on understanding, using theoretical and computational tools, how collective neuronal activity emerges in a controlled system, a neuronal culture. We show how the interplay between noise and network structure defines the emergent collective behavior of the system. We build, using theory and simulation, a framework that takes carefully describes spontaneous activity in neuronal cultures by taking into account the underlying network structure of neuronal cultures and use an accurate, yet simple, model for the individual neuronal dynamics. We show that the collective behavior of young cultures is dominated by the nucleation and propagations of activity fronts (bursts) throughout the system. These bursts nucleate at specific sites of the culture, called nucleation points, which result in a highly heterogeneous probability distribution of nucleation. We are able to explain the nucleation mechanism theoretically as a mechanism of noise propagation and amplification called noise focusing. We also explore the internal structure of activity avalanches by using well--defined regular networks, in which all the neurons have the same connectivity rules (motifs). Within these networks, we are able to associate to the avalanches an effective velocity and topological size and relate it to specific motifs. We also devise a continuum description of a neuronal culture at the mesoscale, i.e., we move away from the single neuron dynamics into a coarse--grained description that is able to capture most of the characteristic observables presented in previous chapters. This thesis also studies the spontaneous activity of neuronal cultures within the framework of quorum percolation. We study the effect of network structure within quorum percolation and propose a new model, called stochastic quorum percolation, that includes dynamics and the effect of internal noise. Finally, we use tools from information theory, namely transfer entropy, to show how to reliably infer the connectivity of a neuronal network from its activity, and how to distinguish between different excitatory and inhibitory connections purely from the activity, with no prior knowledge of the different neuronal types. The technique works directly on the fluorescence traces obtained in calcium imaging experiments, without the need to infer the underlying spike trains

Critical Parameters in Dynamic Network Modeling of Sepsis

In this work, we propose a dynamical systems perspective on the modeling of sepsis and its organ-damaging consequences. We develop a functional two-layer network model for sepsis based upon the interaction of parenchymal cells and immune cells via cytokines, and the coevolutionary dynamics of parenchymal, immune cells, and cytokines. By means of the simple paradigmatic model of phase oscillators in a two-layer system, we analyze the emergence of organ threatening interactions between the dysregulated immune system and the parenchyma. We demonstrate that the complex cellular cooperation between parenchyma and stroma (immune layer) either in the physiological or in the pathological case can be related to dynamical patterns of the network. In this way we explain sepsis by the dysregulation of the healthy homeostatic state (frequency synchronized) leading to a pathological state (desynchronized or multifrequency cluster) in the parenchyma. We provide insight into the complex stabilizing and destabilizing interplay of parenchyma and stroma by determining critical interaction parameters. The coupled dynamics of parenchymal cells (metabolism) and nonspecific immune cells (response of the innate immune system) is represented by nodes of a duplex layer. Cytokine interaction is modeled by adaptive coupling weights between nodes representing immune cells (with fast adaptation timescale) and parenchymal cells (slow adaptation timescale), and between pairs of parenchymal and immune cells in the duplex network (fixed bidirectional coupling). The proposed model allows for a functional description of organ dysfunction in sepsis and the recurrence risk in a plausible pathophysiological context.Peer Reviewe

The Kuramoto model in complex networks

181 pages, 48 figures. In Press, Accepted Manuscript, Physics Reports 2015 Acknowledgments We are indebted with B. Sonnenschein, E. R. dos Santos, P. Schultz, C. Grabow, M. Ha and C. Choi for insightful and helpful discussions. T.P. acknowledges FAPESP (No. 2012/22160-7 and No. 2015/02486-3) and IRTG 1740. P.J. thanks founding from the China Scholarship Council (CSC). F.A.R. acknowledges CNPq (Grant No. 305940/2010-4) and FAPESP (Grants No. 2011/50761-2 and No. 2013/26416-9) for financial support. J.K. would like to acknowledge IRTG 1740 (DFG and FAPESP).Peer reviewedPreprin

An Initial Framework Assessing the Safety of Complex Systems

Trabajo presentado en la Conference on Complex Systems, celebrada online del 7 al 11 de diciembre de 2020.Atmospheric blocking events, that is large-scale nearly stationary atmospheric pressure patterns, are often associated with extreme weather in the mid-latitudes, such as heat waves and cold spells which have significant consequences on ecosystems, human health and economy. The high impact of blocking events has motivated numerous studies. However, there is not yet a comprehensive theory explaining their onset, maintenance and decay and their numerical prediction remains a challenge. In recent years, a number of studies have successfully employed complex network descriptions of fluid transport to characterize dynamical patterns in geophysical flows. The aim of the current work is to investigate the potential of so called Lagrangian flow networks for the detection and perhaps forecasting of atmospheric blocking events. The network is constructed by associating nodes to regions of the atmosphere and establishing links based on the flux of material between these nodes during a given time interval. One can then use effective tools and metrics developed in the context of graph theory to explore the atmospheric flow properties. In particular, Ser-Giacomi et al. [1] showed how optimal paths in a Lagrangian flow network highlight distinctive circulation patterns associated with atmospheric blocking events. We extend these results by studying the behavior of selected network measures (such as degree, entropy and harmonic closeness centrality)at the onset of and during blocking situations, demonstrating their ability to trace the spatio-temporal characteristics of these events.This research was conducted as part of the CAFE (Climate Advanced Forecasting of sub-seasonal Extremes) Innovative Training Network which has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 813844

Using MapReduce Streaming for Distributed Life Simulation on the Cloud

Distributed software simulations are indispensable in the study of large-scale life models but often require the use of technically complex lower-level distributed computing frameworks, such as MPI. We propose to overcome the complexity challenge by applying the emerging MapReduce (MR) model to distributed life simulations and by running such simulations on the cloud. Technically, we design optimized MR streaming algorithms for discrete and continuous versions of Conway’s life according to a general MR streaming pattern. We chose life because it is simple enough as a testbed for MR’s applicability to a-life simulations and general enough to make our results applicable to various lattice-based a-life models. We implement and empirically evaluate our algorithms’ performance on Amazon’s Elastic MR cloud. Our experiments demonstrate that a single MR optimization technique called strip partitioning can reduce the execution time of continuous life simulations by 64%. To the best of our knowledge, we are the first to propose and evaluate MR streaming algorithms for lattice-based simulations. Our algorithms can serve as prototypes in the development of novel MR simulation algorithms for large-scale lattice-based a-life models.https://digitalcommons.chapman.edu/scs_books/1014/thumbnail.jp