Cortical Synchronization and Perceptual Framing

How does the brain group together different parts of an object into a coherent visual object representation? Different parts of an object may be processed by the brain at different rates and may thus become desynchronized. Perceptual framing is a process that resynchronizes cortical activities corresponding to the same retinal object. A neural network model is presented that is able to rapidly resynchronize clesynchronized neural activities. The model provides a link between perceptual and brain data. Model properties quantitatively simulate perceptual framing data, including psychophysical data about temporal order judgments and the reduction of threshold contrast as a function of stimulus length. Such a model has earlier been used to explain data about illusory contour formation, texture segregation, shape-from-shading, 3-D vision, and cortical receptive fields. The model hereby shows how many data may be understood as manifestations of a cortical grouping process that can rapidly resynchronize image parts which belong together in visual object representations. The model exhibits better synchronization in the presence of noise than without noise, a type of stochastic resonance, and synchronizes robustly when cells that represent different stimulus orientations compete. These properties arise when fast long-range cooperation and slow short-range competition interact via nonlinear feedback interactions with cells that obey shunting equations.Office of Naval Research (N00014-92-J-1309, N00014-95-I-0409, N00014-95-I-0657, N00014-92-J-4015); Air Force Office of Scientific Research (F49620-92-J-0334, F49620-92-J-0225)

Neural models of learning and visual grouping in the presence of finite conduction velocities

The hypothesis of object binding-by-synchronization in the visual cortex has been supported by recent experiments in awake monkeys. They demonstrated coherence among gamma-activities (30–90 Hz) of local neural groups and its perceptual modulation according to the rules of figure-ground segregation. Interactions within and between these neural groups are based on axonal spike conduction with finite velocities. Physiological studies confirmed that the majority of transmission delays is comparable to the temporal scale defined by gamma-activity (11–33 ms). How do these finite velocities influence the development of synaptic connections within and between visual areas? What is the relationship between the range of gamma-coherence and the velocity of signal transmission? Are these large temporal delays compatible with recently discovered phenomenon of gamma-waves traveling across larger parts of the primary visual cortex? The refinement of connections in the immature visual cortex depends on temporal Hebbian learning to adjust synaptic efficacies between spiking neurons. The impact of constant, finite, axonal spike conduction velocities on this process was investigated using a set of topographic network models. Random spike trains with a confined temporal correlation width mimicked cortical activity before visual experience. After learning, the lateral connectivity within one network layer became spatially restricted, the width of the connection profile being directly proportional to the lateral conduction velocity. Furthermore, restricted feedforward divergence developed between neurons of two successive layers. The size of this connection profile matched the lateral connection profile of the lower layer neuron. The mechanism in this network model is suitable to explain the emergence of larger receptive fields at higher visual areas while preserving a retinotopic mapping. The influence of finite conduction velocities on the local generation of gamma-activities and their spatial synchronization was investigated in a model of a mature visual area. Sustained input and local inhibitory feedback was sufficient for the emergence of coherent gamma-activity that extended across few millimeters. Conduction velocities had a direct impact on the frequency of gamma-oscillations, but did neither affect gamma-power nor the spatial extent of gamma-coherence. Adding long-range horizontal connections between excitatory neurons, as found in layer 2/3 of the primary visual cortex, increased the spatial range of gamma-coherence. The range was maximal for zero transmission delays, and for all distances attenuated with finite, decreasing lateral conduction velocities. Below a velocity of 0.5 m/s, gamma-power and gamma-coherence were even smaller than without these connections at all, i.e., slow horizontal connections actively desynchronized neural populations. In conclusion, the enhancement of gamma-coherence by horizontal excitatory connections critically depends on fast conduction velocities. Coherent gamma-activity in the primary visual cortex and the accompanying models was found to only cover small regions of the visual field. This challenges the role of gamma-synchronization to solve the binding problem for larger object representations. Further analysis of the previous model revealed that the patches of coherent gamma-activity (1.8 mm half-height decline) were part of more globally occurring gamma-waves, which coupled over much larger distances (6.3 mm half-height decline). The model gamma-waves observed here are very similar to those found in the primary visual cortex of awake monkeys, indicating that local recurrent inhibition and restricted horizontal connections with finite axonal velocities are sufficient requirements for their emergence. In conclusion, since the model is in accordance with the connectivity and gamma-processes in the primary visual cortex, the results support the hypothesis that gamma-waves provide a generalized concept for object binding in the visual cortex

Lateral Information Processing by Spiking Neurons: A Theoretical Model of the Neural Correlate of Consciousness

Cognitive brain functions, for example, sensory perception, motor control and learning, are understood as computation by axonal-dendritic chemical synapses in networks of integrate-and-fire neurons. Cognitive brain functions may occur either consciously or nonconsciously (on “autopilot”). Conscious cognition is marked by gamma synchrony EEG, mediated largely by dendritic-dendritic gap junctions, sideways connections in input/integration layers. Gap-junction-connected neurons define a sub-network within a larger neural network. A theoretical model (the “conscious pilot”) suggests that as gap junctions open and close, a gamma-synchronized subnetwork, or zone moves through the brain as an executive agent, converting nonconscious “auto-pilot” cognition to consciousness, and enhancing computation by coherent processing and collective integration. In this study we implemented sideways “gap junctions” in a single-layer artificial neural network to perform figure/ground separation. The set of neurons connected through gap junctions form a reconfigurable resistive grid or sub-network zone. In the model, outgoing spikes are temporally integrated and spatially averaged using the fixed resistive grid set up by neurons of similar function which are connected through gap-junctions. This spatial average, essentially a feedback signal from the neuron's output, determines whether particular gap junctions between neurons will open or close. Neurons connected through open gap junctions synchronize their output spikes. We have tested our gap-junction-defined sub-network in a one-layer neural network on artificial retinal inputs using real-world images. Our system is able to perform figure/ground separation where the laterally connected sub-network of neurons represents a perceived object. Even though we only show results for visual stimuli, our approach should generalize to other modalities. The system demonstrates a moving sub-network zone of synchrony, within which the contents of perception are represented and contained. This mobile zone can be viewed as a model of the neural correlate of consciousness in the brain

Progress toward an understanding of cortical computation

The additional data, perspectives, questions, and criticisms contributed by the commentaries strengthen our view that local cortical processors coordinate their activity with the context in which it occurs using contextual fields and synchronized population codes. We therefore predict that whereas the specialization of function has been the keynote of this century the coordination of function will be the keynote of the next

Нейросетевые технологии в задаче распознавания рукописных символов

Описаны структуры и механизмы работы классификатора LiRA и модульных нейронных сетей. Оба классификатора решают задачу распознавания изображений на основе поиска признаков в них. Эксперименты в сравнении двух классификаторов, показали, что последняя версия модульной нейронной сети обладает более высокой эффективностью (распознающей способностью), чем классификатор LiRA, хотя и несколько уступает ему в быстродействии.Результат - в статті розглянуті два типи нейронних класифікаторів: нейронний класифікатор LiRA і модульні нейронні мережі. Обидва класифікатора призначені для вирішення практичних завдань з розпізнавання зображень. Обидва класифікатора вирішують задачу на основі пошуку в зображеннях деякого набору заздалегідь сконструйованих ознак. Функціонування обох класифікаторів розглянуто на прикладі використання так званих LiRA-ознак. Здатність класифікаторів ефективно розпізнавати зображення базується саме на використанні дуже великої кількості (десятків і сотень тисяч) простих і ефективних LiRA-ознак. На основі результатів ряду експериментів в порівнянні класифікатора LiRA і модульної нейронної мережі, показано, що остання версія модульної нейронної мережі володіє більш високою ефективністю ніж класифікатор LiRA, хоча і дещо поступається йому за швидкодією.Results the article considers two types of neural classifiers: LiRA neural classifier and modular neural networks. Both classifiers are designed to solve practical problems of image recognition. Both classifiers solve the problem by searching a certain set of pre-constructed features in the images. Both classifiers use the so-called LiRA-features. The ability of classifiers to effectively recognize visual images is largely based on the use of a very large number (tens and hundreds of thousands) of simple and effective LiRA functions. A series of experiments is conducted comparing the LiRA classifier and the modular neural network. The experiments show that the latest version of the modular neural network has a higher efficiency (recognition ability) than the LiRA classifier, although it is slightly inferior in speed

The What and Why of Binding: The Modeler's Perspective

In attempts to formulate a computational understanding of brain function, one of the fundamental concerns is the data structure by which the brain represents information. For many decades, a conceptual framework has dominated the thinking of both brain modelers and neurobiologists. That framework is referred to here as "classical neural networks." It is well supported by experimental data, although it may be incomplete. A characterization of this framework will be offered in the next section. Difficulties in modeling important functional aspects of the brain on the basis of classical neural networks alone have led to the recognition that another, general mechanism must be invoked to explain brain function. That mechanism I call "binding." Binding by neural signal synchrony had been mentioned several times in the liter ature (Lege´ndy, 1970; Milner, 1974) before it was fully formulated as a general phenomenon (von der Malsburg, 1981). Although experimental evidence for neural syn chrony was soon found, the idea was largely ignored for many years. Only recently has it become a topic of animated discussion. In what follows, I will summarize the nature and the roots of the idea of binding, especially of temporal binding, and will discuss some of the objec tions raised against it