Failure of Delayed Feedback Deep Brain Stimulation for Intermittent Pathological Synchronization in Parkinson's Disease

Suppression of excessively synchronous beta-band oscillatory activity in the brain is believed to suppress hypokinetic motor symptoms of Parkinson's disease. Recently, a lot of interest has been devoted to desynchronizing delayed feedback deep brain stimulation (DBS). This type of synchrony control was shown to destabilize the synchronized state in networks of simple model oscillators as well as in networks of coupled model neurons. However, the dynamics of the neural activity in Parkinson's disease exhibits complex intermittent synchronous patterns, far from the idealized synchronous dynamics used to study the delayed feedback stimulation. This study explores the action of delayed feedback stimulation on partially synchronized oscillatory dynamics, similar to what one observes experimentally in parkinsonian patients. We employ a model of the basal ganglia networks which reproduces experimentally observed fine temporal structure of the synchronous dynamics. When the parameters of our model are such that the synchrony is unphysiologically strong, the feedback exerts a desynchronizing action. However, when the network is tuned to reproduce the highly variable temporal patterns observed experimentally, the same kind of delayed feedback may actually increase the synchrony. As network parameters are changed from the range which produces complete synchrony to those favoring less synchronous dynamics, desynchronizing delayed feedback may gradually turn into synchronizing stimulation. This suggests that delayed feedback DBS in Parkinson's disease may boost rather than suppress synchronization and is unlikely to be clinically successful. The study also indicates that delayed feedback stimulation may not necessarily exhibit a desynchronization effect when acting on a physiologically realistic partially synchronous dynamics, and provides an example of how to estimate the stimulation effect.Comment: 19 pages, 8 figure

Model-Based and Machine Learning-Based Control of Biological Oscillators

Nonlinear oscillators - dynamical systems with stable periodic orbits - arise in many systems of physical, technological, and biological interest. This dissertation investigates the dynamics of such oscillators arising in biology, and develops several control algorithms to modify their collective behavior. We demonstrate that these control algorithms have potential in devising treatments for Parkinson's disease, cardiac alternans, and jet lag. Phase reduction, a classical reduction technique, has been instrumental in understanding such biological oscillators. In this dissertation, we investigate a new reduction technique called augmented phase reduction, and calculate its associated analytical expressions for six dynamically different planar systems: This helps us to understand the dynamical regimes for which the use of augmented phase reduction is advantageous over the standard phase reduction. We further this study by developing a novel optimal control algorithm based on the augmented phase reduction to change the phase of a single oscillator using a minimum energy input. We show that our control algorithm is effective even when a large phase change is required or when the nontrivial Floquet multiplier of the oscillator is close to unity; in such cases, the previously proposed control algorithm based on the standard phase reduction fails.We then devise a novel framework to control a population of biological oscillators as a whole, and change their collective behavior. Our first two control algorithms are Lyapunov-based, and our third is an optimal control algorithm which minimizes the control energy consumption while achieving the desired collective behavior of an oscillator population. We show that the developed control algorithms can synchronize, desynchronize, cluster, and phase shift the population.We continue this investigation by developing two novel machine learning control algorithms, which have a simple and intelligent structure that makes them effective even with a sparse data set. We show that these algorithms are powerful enough to control a wide variety of dynamical systems and not just biological oscillators. We conclude this study by understanding how the developed machine learning algorithms work in terms of phase reduction.In this dissertation, we have developed all these algorithms with the goal of ease of experimental implementation, for which the model parameters/training data can be measured experimentally. We close the loop on this dissertation by carrying out robustness analysis for the developed algorithms; demonstrating their resilience to noise, and thus their suitability for controlling living biological tissue. They truly hold great potential in devising treatments for Parkinson's disease, cardiac alternans, and jet lag

Circadian and Metabolic Effects of Light: Implications in Weight Homeostasis and Health

Daily interactions between the hypothalamic circadian clock at the suprachiasmatic nucleus (SCN) and peripheral circadian oscillators regulate physiology and metabolism to set temporal variations in homeostatic regulation. Phase coherence of these circadian oscillators is achieved by the entrainment of the SCN to the environmental 24-h light:dark (LD) cycle, coupled through downstream neural, neuroendocrine, and autonomic outputs. The SCN coordinate activity and feeding rhythms, thus setting the timing of food intake, energy expenditure, thermogenesis, and active and basal metabolism. In this work, we will discuss evidences exploring the impact of different photic entrainment conditions on energy metabolism. The steady-state interaction between the LD cycle and the SCN is essential for health and wellbeing, as its chronic misalignment disrupts the circadian organization at different levels. For instance, in nocturnal rodents, non-24 h protocols (i.e., LD cycles of different durations, or chronic jet-lag simulations) might generate forced desynchronization of oscillators from the behavioral to the metabolic level. Even seemingly subtle photic manipulations, as the exposure to a "dim light" scotophase, might lead to similar alterations. The daily amount of light integrated by the clock (i.e., the photophase duration) strongly regulates energy metabolism in photoperiodic species. Removing LD cycles under either constant light or darkness, which are routine protocols in chronobiology, can also affect metabolism, and the same happens with disrupted LD cycles (like shiftwork of jetlag) and artificial light at night in humans. A profound knowledge of the photic and metabolic inputs to the clock, as well as its endocrine and autonomic outputs to peripheral oscillators driving energy metabolism, will help us to understand and alleviate circadian health alterations including cardiometabolic diseases, diabetes, and obesity.Fil: Plano, Santiago Andrés. Pontificia Universidad Católica Argentina "Santa María de los Buenos Aires". Instituto de Investigaciones Biomédicas. Consejo Nacional de Investigaciones Científicas y Técnicas. Oficina de Coordinación Administrativa Houssay. Instituto de Investigaciones Biomédicas; ArgentinaFil: Casiraghi, Leandro Pablo. Universidad Nacional de Quilmes. Departamento de Ciencia y Tecnología. Laboratorio de Cronobiología; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Garcia Moro, Paula. Universidad Nacional de Quilmes. Departamento de Ciencia y Tecnología. Laboratorio de Cronobiología; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Paladino, Natalia. Universidad Nacional de Quilmes. Departamento de Ciencia y Tecnología. Laboratorio de Cronobiología; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Golombek, Diego Andrés. Universidad Nacional de Quilmes. Departamento de Ciencia y Tecnología. Laboratorio de Cronobiología; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Chiesa, Juan José. Universidad Nacional de Quilmes. Departamento de Ciencia y Tecnología. Laboratorio de Cronobiología; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentin

Learning to synchronize : how biological agents can couple neural task modules for dealing with the stability-plasticity dilemma

We provide a novel computational framework on how biological and artificial agents can learn to flexibly couple and decouple neural task modules for cognitive processing. In this way, they can address the stability-plasticity dilemma. For this purpose, we combine two prominent computational neuroscience principles, namely Binding by Synchrony and Reinforcement Learning. The model learns to synchronize task-relevant modules, while also learning to desynchronize currently task-irrelevant modules. As a result, old (but currently task-irrelevant) information is protected from overwriting (stability) while new information can be learned quickly in currently task-relevant modules (plasticity). We combine learning to synchronize with task modules that learn via one of several classical learning algorithms (Rescorla-Wagner, backpropagation, Boltzmann machines). The resulting combined model is tested on a reversal learning paradigm where it must learn to switch between three different task rules. We demonstrate that our combined model has significant computational advantages over the original network without synchrony, in terms of both stability and plasticity. Importantly, the resulting models' processing dynamics are also consistent with empirical data and provide empirically testable hypotheses for future MEG/EEG studies

Robust Engineering of Dynamic Structures in Complex Networks

Populations of nearly identical dynamical systems are ubiquitous in natural and engineered systems, in which each unit plays a crucial role in determining the functioning of the ensemble. Robust and optimal control of such large collections of dynamical units remains a grand challenge, especially, when these units interact and form a complex network. Motivated by compelling practical problems in power systems, neural engineering and quantum control, where individual units often have to work in tandem to achieve a desired dynamic behavior, e.g., maintaining synchronization of generators in a power grid or conveying information in a neuronal network; in this dissertation, we focus on developing novel analytical tools and optimal control policies for large-scale ensembles and networks. To this end, we first formulate and solve an optimal tracking control problem for bilinear systems. We developed an iterative algorithm that synthesizes the optimal control input by solving a sequence of state-dependent differential equations that characterize the optimal solution. This iterative scheme is then extended to treat isolated population or networked systems. We demonstrate the robustness and versatility of the iterative control algorithm through diverse applications from different fields, involving nuclear magnetic resonance (NMR) spectroscopy and imaging (MRI), electrochemistry, neuroscience, and neural engineering. For example, we design synchronization controls for optimal manipulation of spatiotemporal spike patterns in neuron ensembles. Such a task plays an important role in neural systems. Furthermore, we show that the formation of such spatiotemporal patterns is restricted when the network of neurons is only partially controllable. In neural circuitry, for instance, loss of controllability could imply loss of neural functions. In addition, we employ the phase reduction theory to leverage the development of novel control paradigms for cyclic deferrable loads, e.g., air conditioners, that are used to support grid stability through demand response (DR) programs. More importantly, we introduce novel theoretical tools for evaluating DR capacity and bandwidth. We also study pinning control of complex networks, where we establish a control-theoretic approach to identifying the most influential nodes in both undirected and directed complex networks. Such pinning strategies have extensive practical implications, e.g., identifying the most influential spreaders in epidemic and social networks, and lead to the discovery of degenerate networks, where the most influential node relocates depending on the coupling strength. This phenomenon had not been discovered until our recent study

A Framework to Control Functional Connectivity in the Human Brain

In this paper, we propose a framework to control brain-wide functional connectivity by selectively acting on the brain's structure and parameters. Functional connectivity, which measures the degree of correlation between neural activities in different brain regions, can be used to distinguish between healthy and certain diseased brain dynamics and, possibly, as a control parameter to restore healthy functions. In this work, we use a collection of interconnected Kuramoto oscillators to model oscillatory neural activity, and show that functional connectivity is essentially regulated by the degree of synchronization between different clusters of oscillators. Then, we propose a minimally invasive method to correct the oscillators' interconnections and frequencies to enforce arbitrary and stable synchronization patterns among the oscillators and, consequently, a desired pattern of functional connectivity. Additionally, we show that our synchronization-based framework is robust to parameter mismatches and numerical inaccuracies, and validate it using a realistic neurovascular model to simulate neural activity and functional connectivity in the human brain.Comment: To appear in the proceedings of the 58th IEEE Conference on Decision and Contro

Predicting the effects of deep brain stimulation using a reduced coupled oscillator model

This is the final version. Available on open access from Public Library of Science via the DOI in this recordData Availability: The data analysed in this manuscript is available from MRC BNDU Data Sharing platform at: https://data.mrc.ox.ac.uk/data-set/tremor-data-measured-essential-tremor-patients-subjected-phase-locked-deep-brain DOI: 10.5287/bodleian:xq24eN2KmDeep brain stimulation (DBS) is known to be an effective treatment for a variety of neurological disorders, including Parkinson’s disease and essential tremor (ET). At present, it involves administering a train of pulses with constant frequency via electrodes implanted into the brain. New ‘closed-loop’ approaches involve delivering stimulation according to the ongoing symptoms or brain activity and have the potential to provide improvements in terms of efficiency, efficacy and reduction of side effects. The success of closed-loop DBS depends on being able to devise a stimulation strategy that minimizes oscillations in neural activity associated with symptoms of motor disorders. A useful stepping stone towards this is to construct a mathematical model, which can describe how the brain oscillations should change when stimulation is applied at a particular state of the system. Our work focuses on the use of coupled oscillators to represent neurons in areas generating pathological oscillations. Using a reduced form of the Kuramoto model, we analyse how a patient should respond to stimulation when neural oscillations have a given phase and amplitude, provided a number of conditions are satisfied. For such patients, we predict that the best stimulation strategy should be phase specific but also that stimulation should have a greater effect if applied when the amplitude of brain oscillations is lower. We compare this surprising prediction with data obtained from ET patients. In light of our predictions, we also propose a new hybrid strategy which effectively combines two of the closed-loop strategies found in the literature, namely phase-locked and adaptive DBS

Shared inputs, entrainment, and desynchrony in elliptic bursters: from slow passage to discontinuous circle maps

What input signals will lead to synchrony vs. desynchrony in a group of biological oscillators? This question connects with both classical dynamical systems analyses of entrainment and phase locking and with emerging studies of stimulation patterns for controlling neural network activity. Here, we focus on the response of a population of uncoupled, elliptically bursting neurons to a common pulsatile input. We extend a phase reduction from the literature to capture inputs of varied strength, leading to a circle map with discontinuities of various orders. In a combined analytical and numerical approach, we apply our results to both a normal form model for elliptic bursting and to a biophysically-based neuron model from the basal ganglia. We find that, depending on the period and amplitude of inputs, the response can either appear chaotic (with provably positive Lyaponov exponent for the associated circle maps), or periodic with a broad range of phase-locked periods. Throughout, we discuss the critical underlying mechanisms, including slow-passage effects through Hopf bifurcation, the role and origin of discontinuities, and the impact of noiseComment: 17 figures, 40 page