5,158 research outputs found
Complexity without chaos: Plasticity within random recurrent networks generates robust timing and motor control
It is widely accepted that the complex dynamics characteristic of recurrent
neural circuits contributes in a fundamental manner to brain function. Progress
has been slow in understanding and exploiting the computational power of
recurrent dynamics for two main reasons: nonlinear recurrent networks often
exhibit chaotic behavior and most known learning rules do not work in robust
fashion in recurrent networks. Here we address both these problems by
demonstrating how random recurrent networks (RRN) that initially exhibit
chaotic dynamics can be tuned through a supervised learning rule to generate
locally stable neural patterns of activity that are both complex and robust to
noise. The outcome is a novel neural network regime that exhibits both
transiently stable and chaotic trajectories. We further show that the recurrent
learning rule dramatically increases the ability of RRNs to generate complex
spatiotemporal motor patterns, and accounts for recent experimental data
showing a decrease in neural variability in response to stimulus onset
Biological neurons act as generalization filters in reservoir computing
Reservoir computing is a machine learning paradigm that transforms the
transient dynamics of high-dimensional nonlinear systems for processing
time-series data. Although reservoir computing was initially proposed to model
information processing in the mammalian cortex, it remains unclear how the
non-random network architecture, such as the modular architecture, in the
cortex integrates with the biophysics of living neurons to characterize the
function of biological neuronal networks (BNNs). Here, we used optogenetics and
fluorescent calcium imaging to record the multicellular responses of cultured
BNNs and employed the reservoir computing framework to decode their
computational capabilities. Micropatterned substrates were used to embed the
modular architecture in the BNNs. We first show that modular BNNs can be used
to classify static input patterns with a linear decoder and that the modularity
of the BNNs positively correlates with the classification accuracy. We then
used a timer task to verify that BNNs possess a short-term memory of ~1 s and
finally show that this property can be exploited for spoken digit
classification. Interestingly, BNN-based reservoirs allow transfer learning,
wherein a network trained on one dataset can be used to classify separate
datasets of the same category. Such classification was not possible when the
input patterns were directly decoded by a linear decoder, suggesting that BNNs
act as a generalization filter to improve reservoir computing performance. Our
findings pave the way toward a mechanistic understanding of information
processing within BNNs and, simultaneously, build future expectations toward
the realization of physical reservoir computing systems based on BNNs.Comment: 31 pages, 5 figures, 3 supplementary figure
Spatiotemporal Data Augmentation of MODIS-LANDSAT Water Bodies Using Generative Adversarial Networks
The monitoring of the shape and area of a water body is an essential component for many Earth science and Hydrological applications. For this purpose, these applications require remote sensing data which provides accurate analysis of the water bodies. In this thesis the same is being attempted, first, a model is created that can map the information from one kind of satellite that captures the data from a distance of 500m to another data that is captured by a different satellite at a distance of 30m. To achieve this, we first collected the data from both of the satellites and translated the data from one satellite to another using our proposed Hydro-GAN model. This translation gives us the accurate shape, boundary, and area of the water body. We evaluated the method by using several different similarity metrics for the area and the shape of the water body. The second part of this thesis involves augmenting the data that we obtained from the Hydro-GAN model with the original data and using this enriched data to predict the area of a water body in the future. We used the case study of Great Salt lake for this purpose.
The results indicated that our proposed model was creating accurate area and shape of the water bodies. When we used our proposed model to generate data at a resolution of 30m it gave us better areal and shape accuracy. If we get more data at this resolution, we can use that data to better predict coastal lines, boundaries, as well as erosion monitoring
- β¦