27,774 research outputs found
Neuromorphic device architectures with global connectivity through electrolyte gating.
Information processing in the brain takes place in a network of neurons that are connected with each other by an immense number of synapses. At the same time, neurons are immersed in a common electrochemical environment, and global parameters such as concentrations of various hormones regulate the overall network function. This computational paradigm of global regulation, also known as homeoplasticity, has important implications in the overall behaviour of large neural ensembles and is barely addressed in neuromorphic device architectures. Here, we demonstrate the global control of an array of organic devices based on poly(3,4ethylenedioxythiophene):poly(styrene sulf) that are immersed in an electrolyte, a behaviour that resembles homeoplasticity phenomena of the neural environment. We use this effect to produce behaviour that is reminiscent of the coupling between local activity and global oscillations in the biological neural networks. We further show that the electrolyte establishes complex connections between individual devices, and leverage these connections to implement coincidence detection. These results demonstrate that electrolyte gating offers significant advantages for the realization of networks of neuromorphic devices of higher complexity and with minimal hardwired connectivity
Coupled Ensembles of Neural Networks
We investigate in this paper the architecture of deep convolutional networks.
Building on existing state of the art models, we propose a reconfiguration of
the model parameters into several parallel branches at the global network
level, with each branch being a standalone CNN. We show that this arrangement
is an efficient way to significantly reduce the number of parameters without
losing performance or to significantly improve the performance with the same
level of performance. The use of branches brings an additional form of
regularization. In addition to the split into parallel branches, we propose a
tighter coupling of these branches by placing the "fuse (averaging) layer"
before the Log-Likelihood and SoftMax layers during training. This gives
another significant performance improvement, the tighter coupling favouring the
learning of better representations, even at the level of the individual
branches. We refer to this branched architecture as "coupled ensembles". The
approach is very generic and can be applied with almost any DCNN architecture.
With coupled ensembles of DenseNet-BC and parameter budget of 25M, we obtain
error rates of 2.92%, 15.68% and 1.50% respectively on CIFAR-10, CIFAR-100 and
SVHN tasks. For the same budget, DenseNet-BC has error rate of 3.46%, 17.18%,
and 1.8% respectively. With ensembles of coupled ensembles, of DenseNet-BC
networks, with 50M total parameters, we obtain error rates of 2.72%, 15.13% and
1.42% respectively on these tasks
Recommended from our members
Network Properties Revealed during Multi-Scale Calcium Imaging of Seizure Activity in Zebrafish.
Seizures are characterized by hypersynchronization of neuronal networks. Understanding these networks could provide a critical window for therapeutic control of recurrent seizure activity, i.e., epilepsy. However, imaging seizure networks has largely been limited to microcircuits in vitro or small "windows" in vivo. Here, we combine fast confocal imaging of genetically encoded calcium indicator (GCaMP)-expressing larval zebrafish with local field potential (LFP) recordings to study epileptiform events at whole-brain and single-neuron levels in vivo. Using an acute seizure model (pentylenetetrazole, PTZ), we reliably observed recurrent electrographic ictal-like events associated with generalized activation of all major brain regions and uncovered a well-preserved anterior-to-posterior seizure propagation pattern. We also examined brain-wide network synchronization and spatiotemporal patterns of neuronal activity in the optic tectum microcircuit. Brain-wide and single-neuronal level analysis of PTZ-exposed and 4-aminopyridine (4-AP)-exposed zebrafish revealed distinct network dynamics associated with seizure and non-seizure hyperexcitable states, respectively. Neuronal ensembles, comprised of coactive neurons, were also uncovered during interictal-like periods. Taken together, these results demonstrate that macro- and micro-network calcium motifs in zebrafish may provide a greater understanding of epilepsy
Metrics for Graph Comparison: A Practitioner's Guide
Comparison of graph structure is a ubiquitous task in data analysis and
machine learning, with diverse applications in fields such as neuroscience,
cyber security, social network analysis, and bioinformatics, among others.
Discovery and comparison of structures such as modular communities, rich clubs,
hubs, and trees in data in these fields yields insight into the generative
mechanisms and functional properties of the graph.
Often, two graphs are compared via a pairwise distance measure, with a small
distance indicating structural similarity and vice versa. Common choices
include spectral distances (also known as distances) and distances
based on node affinities. However, there has of yet been no comparative study
of the efficacy of these distance measures in discerning between common graph
topologies and different structural scales.
In this work, we compare commonly used graph metrics and distance measures,
and demonstrate their ability to discern between common topological features
found in both random graph models and empirical datasets. We put forward a
multi-scale picture of graph structure, in which the effect of global and local
structure upon the distance measures is considered. We make recommendations on
the applicability of different distance measures to empirical graph data
problem based on this multi-scale view. Finally, we introduce the Python
library NetComp which implements the graph distances used in this work
- …