12,119 research outputs found
A Heterosynaptic Learning Rule for Neural Networks
In this article we intoduce a novel stochastic Hebb-like learning rule for
neural networks that is neurobiologically motivated. This learning rule
combines features of unsupervised (Hebbian) and supervised (reinforcement)
learning and is stochastic with respect to the selection of the time points
when a synapse is modified. Moreover, the learning rule does not only affect
the synapse between pre- and postsynaptic neuron, which is called homosynaptic
plasticity, but effects also further remote synapses of the pre- and
postsynaptic neuron. This more complex form of synaptic plasticity has recently
come under investigations in neurobiology and is called heterosynaptic
plasticity. We demonstrate that this learning rule is useful in training neural
networks by learning parity functions including the exclusive-or (XOR) mapping
in a multilayer feed-forward network. We find, that our stochastic learning
rule works well, even in the presence of noise. Importantly, the mean learning
time increases with the number of patterns to be learned polynomially,
indicating efficient learning.Comment: 19 page
Synaptic partner prediction from point annotations in insect brains
High-throughput electron microscopy allows recording of lar- ge stacks of
neural tissue with sufficient resolution to extract the wiring diagram of the
underlying neural network. Current efforts to automate this process focus
mainly on the segmentation of neurons. However, in order to recover a wiring
diagram, synaptic partners need to be identi- fied as well. This is especially
challenging in insect brains like Drosophila melanogaster, where one
presynaptic site is associated with multiple post- synaptic elements. Here we
propose a 3D U-Net architecture to directly identify pairs of voxels that are
pre- and postsynaptic to each other. To that end, we formulate the problem of
synaptic partner identification as a classification problem on long-range edges
between voxels to encode both the presence of a synaptic pair and its
direction. This formulation allows us to directly learn from synaptic point
annotations instead of more ex- pensive voxel-based synaptic cleft or vesicle
annotations. We evaluate our method on the MICCAI 2016 CREMI challenge and
improve over the current state of the art, producing 3% fewer errors than the
next best method
- …