33,242 research outputs found
Coherent Transport of Quantum States by Deep Reinforcement Learning
Some problems in physics can be handled only after a suitable \textit{ansatz
}solution has been guessed. Such method is therefore resilient to
generalization, resulting of limited scope. The coherent transport by adiabatic
passage of a quantum state through an array of semiconductor quantum dots
provides a par excellence example of such approach, where it is necessary to
introduce its so called counter-intuitive control gate ansatz pulse sequence.
Instead, deep reinforcement learning technique has proven to be able to solve
very complex sequential decision-making problems involving competition between
short-term and long-term rewards, despite a lack of prior knowledge. We show
that in the above problem deep reinforcement learning discovers control
sequences outperforming the \textit{ansatz} counter-intuitive sequence. Even
more interesting, it discovers novel strategies when realistic disturbances
affect the ideal system, with better speed and fidelity when energy detuning
between the ground states of quantum dots or dephasing are added to the master
equation, also mitigating the effects of losses. This method enables online
update of realistic systems as the policy convergence is boosted by exploiting
the prior knowledge when available. Deep reinforcement learning proves
effective to control dynamics of quantum states, and more generally it applies
whenever an ansatz solution is unknown or insufficient to effectively treat the
problem.Comment: 5 figure
Computational study of resting state network dynamics
Lo scopo di questa tesi è quello di mostrare, attraverso una simulazione con il software The Virtual Brain, le più importanti proprietà della dinamica cerebrale durante il resting state, ovvero quando non si è coinvolti in nessun compito preciso e non si è sottoposti a nessuno stimolo particolare. Si comincia con lo spiegare cos’è il resting state attraverso una breve revisione storica della sua scoperta, quindi si passano in rassegna alcuni metodi sperimentali utilizzati nell’analisi dell’attività cerebrale, per poi evidenziare la differenza tra connettività strutturale e funzionale. In seguito, si riassumono brevemente i concetti dei sistemi dinamici, teoria indispensabile per capire un sistema complesso come il cervello. Nel capitolo successivo, attraverso un approccio ‘bottom-up’, si illustrano sotto il profilo biologico le principali strutture del sistema nervoso, dal neurone alla corteccia cerebrale. Tutto ciò viene spiegato anche dal punto di vista dei sistemi dinamici, illustrando il pionieristico modello di Hodgkin-Huxley e poi il concetto di dinamica di popolazione. Dopo questa prima parte preliminare si entra nel dettaglio della simulazione. Prima di tutto si danno maggiori informazioni sul software The Virtual Brain, si definisce il modello di network del resting state utilizzato nella simulazione e si descrive il ‘connettoma’ adoperato. Successivamente vengono mostrati i risultati dell’analisi svolta sui dati ricavati, dai quali si mostra come la criticità e il rumore svolgano un ruolo chiave nell'emergenza di questa attività di fondo del cervello. Questi risultati vengono poi confrontati con le più importanti e recenti ricerche in questo ambito, le quali confermano i risultati del nostro lavoro. Infine, si riportano brevemente le conseguenze che porterebbe in campo medico e clinico una piena comprensione del fenomeno del resting state e la possibilità di virtualizzare l’attività cerebrale
Structure Learning in Coupled Dynamical Systems and Dynamic Causal Modelling
Identifying a coupled dynamical system out of many plausible candidates, each
of which could serve as the underlying generator of some observed measurements,
is a profoundly ill posed problem that commonly arises when modelling real
world phenomena. In this review, we detail a set of statistical procedures for
inferring the structure of nonlinear coupled dynamical systems (structure
learning), which has proved useful in neuroscience research. A key focus here
is the comparison of competing models of (ie, hypotheses about) network
architectures and implicit coupling functions in terms of their Bayesian model
evidence. These methods are collectively referred to as dynamical casual
modelling (DCM). We focus on a relatively new approach that is proving
remarkably useful; namely, Bayesian model reduction (BMR), which enables rapid
evaluation and comparison of models that differ in their network architecture.
We illustrate the usefulness of these techniques through modelling
neurovascular coupling (cellular pathways linking neuronal and vascular
systems), whose function is an active focus of research in neurobiology and the
imaging of coupled neuronal systems
Intrinsically-generated fluctuating activity in excitatory-inhibitory networks
Recurrent networks of non-linear units display a variety of dynamical regimes
depending on the structure of their synaptic connectivity. A particularly
remarkable phenomenon is the appearance of strongly fluctuating, chaotic
activity in networks of deterministic, but randomly connected rate units. How
this type of intrinsi- cally generated fluctuations appears in more realistic
networks of spiking neurons has been a long standing question. To ease the
comparison between rate and spiking networks, recent works investigated the
dynami- cal regimes of randomly-connected rate networks with segregated
excitatory and inhibitory populations, and firing rates constrained to be
positive. These works derived general dynamical mean field (DMF) equations
describing the fluctuating dynamics, but solved these equations only in the
case of purely inhibitory networks. Using a simplified excitatory-inhibitory
architecture in which DMF equations are more easily tractable, here we show
that the presence of excitation qualitatively modifies the fluctuating activity
compared to purely inhibitory networks. In presence of excitation,
intrinsically generated fluctuations induce a strong increase in mean firing
rates, a phenomenon that is much weaker in purely inhibitory networks.
Excitation moreover induces two different fluctuating regimes: for moderate
overall coupling, recurrent inhibition is sufficient to stabilize fluctuations,
for strong coupling, firing rates are stabilized solely by the upper bound
imposed on activity, even if inhibition is stronger than excitation. These
results extend to more general network architectures, and to rate networks
receiving noisy inputs mimicking spiking activity. Finally, we show that
signatures of the second dynamical regime appear in networks of
integrate-and-fire neurons
Statistical Physics and Representations in Real and Artificial Neural Networks
This document presents the material of two lectures on statistical physics
and neural representations, delivered by one of us (R.M.) at the Fundamental
Problems in Statistical Physics XIV summer school in July 2017. In a first
part, we consider the neural representations of space (maps) in the
hippocampus. We introduce an extension of the Hopfield model, able to store
multiple spatial maps as continuous, finite-dimensional attractors. The phase
diagram and dynamical properties of the model are analyzed. We then show how
spatial representations can be dynamically decoded using an effective Ising
model capturing the correlation structure in the neural data, and compare
applications to data obtained from hippocampal multi-electrode recordings and
by (sub)sampling our attractor model. In a second part, we focus on the problem
of learning data representations in machine learning, in particular with
artificial neural networks. We start by introducing data representations
through some illustrations. We then analyze two important algorithms, Principal
Component Analysis and Restricted Boltzmann Machines, with tools from
statistical physics
Consciousness, cognition, and the hierarchy of context: extending the global neuronal workspace model
We adapt an information theory analysis of interacting cognitive biological and social modules to the problem of the global neuronal workspace, the new standard neuroscience paradigm for consciousness. Tunable punctuation emerges in a natural way, suggesting the possibility of fitting appropriate phase transition power law, and away from transition, generalized Onsager relation expressions, to observational data on conscious reaction. The development can be extended in a straightforward manner to include psychosocial stress, culture, or other cognitive modules which constitute a structured, embedding hierarchy of contextual constraints acting at a slower rate than neuronal function itself. This produces a 'biopsychosociocultural' model of individual consciousness that, while otherwise quite close to the standard treatment, meets compelling philosophical and other objections to brain-only descriptions
Chronic infection: punctuated interpenetration and pathogen virulence
We apply an information dynamics formalism to the Levens and Lewontin vision of biological interpenetration between a 'cognitive condensation' including immune function embedded in social and cultural structure on the one hand, and an established, highly adaptive, parasite population on the other. We iterate the argument, beginning with direct interaction between cognitive condensation and pathogen, then extend the analysis to second order 'mutator' mechanisms inherent both to immune function and to certain forms of rapid pathogen antigenic variability.
The methodology, based on the Large Deviations Program of applied probability, produces synergistic cognitive/adaptive 'learning plateaus' that represent stages of chronic infection, and, for human populations, is able to encompass the fundamental biological reality of culture omitted by other approaches.
We conclude that, for 'evolution machine' pathogens like HIV and malaria, simplistic magic bullet 'medical' drug, vaccine, or behavior modification interventions which do not address the critical context of overall living and working conditions may constitute selection pressures triggering adaptations in life history strategy resulting in marked increase of pathogen virulenc
- …