A Neural Model of Surface Perception: Lightness, Anchoring, and Filling-in

This article develops a neural model of how the visual system processes natural images under variable illumination conditions to generate surface lightness percepts. Previous models have clarified how the brain can compute the relative contrast of images from variably illuminate scenes. How the brain determines an absolute lightness scale that "anchors" percepts of surface lightness to us the full dynamic range of neurons remains an unsolved problem. Lightness anchoring properties include articulation, insulation, configuration, and are effects. The model quantatively simulates these and other lightness data such as discounting the illuminant, the double brilliant illusion, lightness constancy and contrast, Mondrian contrast constancy, and the Craik-O'Brien-Cornsweet illusion. The model also clarifies the functional significance for lightness perception of anatomical and neurophysiological data, including gain control at retinal photoreceptors, and spatioal contrast adaptation at the negative feedback circuit between the inner segment of photoreceptors and interacting horizontal cells. The model retina can hereby adjust its sensitivity to input intensities ranging from dim moonlight to dazzling sunlight. A later model cortical processing stages, boundary representations gate the filling-in of surface lightness via long-range horizontal connections. Variants of this filling-in mechanism run 100-1000 times faster than diffusion mechanisms of previous biological filling-in models, and shows how filling-in can occur at realistic speeds. A new anchoring mechanism called the Blurred-Highest-Luminance-As-White (BHLAW) rule helps simulate how surface lightness becomes sensitive to the spatial scale of objects in a scene. The model is also able to process natural images under variable lighting conditions.Air Force Office of Scientific Research (F49620-01-1-0397); Defense Advanced Research Projects Agency and the Office of Naval Research (N00014-95-1-0409); Office of Naval Research (N00014-01-1-0624

Neuromorphic analogue VLSI

Neuromorphic systems emulate the organization and function of nervous systems. They are usually composed of analogue electronic circuits that are fabricated in the complementary metal-oxide-semiconductor (CMOS) medium using very large-scale integration (VLSI) technology. However, these neuromorphic systems are not another kind of digital computer in which abstract neural networks are simulated symbolically in terms of their mathematical behavior. Instead, they directly embody, in the physics of their CMOS circuits, analogues of the physical processes that underlie the computations of neural systems. The significance of neuromorphic systems is that they offer a method of exploring neural computation in a medium whose physical behavior is analogous to that of biological nervous systems and that operates in real time irrespective of size. The implications of this approach are both scientific and practical. The study of neuromorphic systems provides a bridge between levels of understanding. For example, it provides a link between the physical processes of neurons and their computational significance. In addition, the synthesis of neuromorphic systems transposes our knowledge of neuroscience into practical devices that can interact directly with the real world in the same way that biological nervous systems do

A Computational Study on the Role of Gap Junctions and Rod Ih Conductance in the Enhancement of the Dynamic Range of the Retina

Recent works suggest that one of the roles of gap junctions in sensory systems is to enhance their dynamic range by avoiding early saturation in the first processing stages. In this work, we use a minimal conductance-based model of the ON rod pathways in the vertebrate retina to study the effects of electrical synaptic coupling via gap junctions among rods and among AII amacrine cells on the dynamic range of the retina. The model is also used to study the effects of the maximum conductance of rod hyperpolarization activated current Ih on the dynamic range of the retina, allowing a study of the interrelations between this intrinsic membrane parameter with those two retina connectivity characteristics. Our results show that for realistic values of Ih conductance the dynamic range is enhanced by rod-rod coupling, and that AII-AII coupling is less relevant to dynamic range amplification in comparison with receptor coupling. Furthermore, a plot of the retina output response versus input intensity for the optimal parameter configuration is well fitted by a power law with exponent . The results are consistent with predictions of more theoretical works and suggest that the earliest expression of gap junctions along the rod pathways, together with appropriate values of rod Ih conductance, has the highest impact on vertebrate retina dynamic range enhancement

Performance Analysis of Cone Detection Algorithms

Many algorithms have been proposed to help clinicians evaluate cone density and spacing, as these may be related to the onset of retinal diseases. However, there has been no rigorous comparison of the performance of these algorithms. In addition, the performance of such algorithms is typically determined by comparison with human observers. Here we propose a technique to simulate realistic images of the cone mosaic. We use the simulated images to test the performance of two popular cone detection algorithms and we introduce an algorithm which is used by astronomers to detect stars in astronomical images. We use Free Response Operating Characteristic (FROC) curves to evaluate and compare the performance of the three algorithms. This allows us to optimize the performance of each algorithm. We observe that performance is significantly enhanced by up-sampling the images. We investigate the effect of noise and image quality on cone mosaic parameters estimated using the different algorithms, finding that the estimated regularity is the most sensitive parameter. This paper was published in JOSA A and is made available as an electronic reprint with the permission of OSA. The paper can be found at the following URL on the OSA website: http://www.opticsinfobase.org/abstract.cfm?msid=224577. Systematic or multiple reproduction or distribution to multiple locations via electronic or other means is prohibited and is subject to penalties under law.Comment: 13 pages, 7 figures, 2 table

Retinal drug delivery: rethinking outcomes for the efficient replication of retinal behavior

The retina is a highly organized structure that is considered to be "an approachable part of the brain." It is attracting the interest of development scientists, as it provides a model neurovascular system. Over the last few years, we have been witnessing significant development in the knowledge of the mechanisms that induce the shape of the retinal vascular system, as well as knowledge of disease processes that lead to retina degeneration. Knowledge and understanding of how our vision works are crucial to creating a hardware-adaptive computational model that can replicate retinal behavior. The neuronal system is nonlinear and very intricate. It is thus instrumental to have a clear view of the neurophysiological and neuroanatomic processes and to take into account the underlying principles that govern the process of hardware transformation to produce an appropriate model that can be mapped to a physical device. The mechanistic and integrated computational models have enormous potential toward helping to understand disease mechanisms and to explain the associations identified in large model-free data sets. The approach used is modulated and based on different models of drug administration, including the geometry of the eye. This work aimed to review the recently used mathematical models to map a directed retinal network.The authors acknowledge the financial support received from the Portuguese Science and Technology Foundation (FCT/MCT) and the European Funds (PRODER/COMPETE) for the project UIDB/04469/2020 (strategic fund), co-financed by FEDER, under the Partnership Agreement PT2020. The authors also acknowledge FAPESP – São Paulo Research Foundation, for the financial support for the publication of the article.info:eu-repo/semantics/publishedVersio

Random Photon Absorption Model Elucidates How Early Gain Control in Fly Photoreceptors Arises from Quantal Sampling

Many diurnal photoreceptors encode vast real-world light changes effectively, but how this performance originates from photon sampling is unclear. A 4-module biophysically-realistic fly photoreceptor model, in which information capture is limited by the number of its sampling units (microvilli) and their photon-hit recovery time (refractoriness), can accurately simulate real recordings and their information content. However, sublinear summation in quantum bump production (quantum-gain-nonlinearity) may also cause adaptation by reducing the bump/photon gain when multiple photons hit the same microvillus simultaneously. Here, we use a Random Photon Absorption Model (RandPAM), which is the 1st module of the 4-module fly photoreceptor model, to quantify the contribution of quantum-gain-nonlinearity in light adaptation. We show how quantum-gain-nonlinearity already results from photon sampling alone. In the extreme case, when two or more simultaneous photon-hits reduce to a single sublinear value, quantum-gain-nonlinearity is preset before the phototransduction reactions adapt the quantum bump waveform. However, the contribution of quantum-gain-nonlinearity in light adaptation depends upon the likelihood of multi-photon-hits, which is strictly determined by the number of microvilli and light intensity. Specifically, its contribution to light-adaptation is marginal (≤1%) in fly photoreceptors with many thousands of microvilli, because the probability of simultaneous multi-photon-hits on any one microvillus is low even during daylight conditions. However, in cells with fewer sampling units, the impact of quantum-gain-nonlinearity increases with brightening light

A Model for the Diffusive Filling-In Algorithm Operating in Spike Mode

To run cortical circuit simulations in spike mode, i.e. taking into account the neural representation of information in terms of sequences of electrical pulses (also known as spikes), the use of customized hardware, which is specific for this purpose, is recommended. Simulations using more traditional hardware can be prohibitive. In this context, theoretical predictions are important for customized hardware design. For example, theoretical predictions lead to an adequate neuron model choice. To make such theoretical predictions, the cortical circuit simulations are carried out in amplitude mode. Differently from the spike mode, in amplitude mode information is represented by sequences of scalar values that describe neural input and output spike rates. In this paper, it was proposed amplitude and spike mode simulations of a cortical algorithm, namely the diffusive filling-in algorithm, to investigate whether predictions based on the amplitude-mode results approximate well the behavior of the customized hardware (spike mode results). The diffusive filling-in algorithm was chosen because it is simple enough for spike-mode simulation in a conventional computer, but the proposed amplitude-mode prediction method is the same for more complex algorithms or circuits. We provide a highly realistic comparison between amplitude-mode and spike-mode in the diffusive filling-in case, which suggests that the amplitude mode is reliable for theoretical predictions useful for customized hardware design for cortical circuit simulation. The goal of this paper is not to bring closure to these discussions but to suggest a way of avoiding possible issues that could compromise the success of the customized device design

The Role of Non-Linearities in Visual Perception studied with a Computational Model of the Vertebrate Retina

Processing of visual stimuli in the vertebrate retina is complex and diverse. The retinal output to the higher centres of the nervous system, mediated by ganglion cells, consists of several different channels. Neurons in these channels can have very distinct response properties, which originate in different retinal pathways. In this work, the retinal origins and possible functional implications of the segregation of visual pathways will be investigated with a detailed, biologically realistic computational model of the retina. This investigation will focus on the two main retino-cortical pathways in the mammalian retina, the parvocellular and magnocellular systems, which are crucial for conscious visual perception. These pathways differ in two important aspects. The parvocellular system has a high spatial, but low temporal resolution. Conversely, the magnocellular system has a high temporal fidelity, spatial sampling however is less dense than for parvocellular cells. Additionally, the responses of magnocellular ganglion cells can show pronounced nonlinearities, while the parvocellular system is essentially linear. The origin of magnocellular nonlinearities is unknown and will be investigated in the first part of this work. As their main source, the results suggest specific properties of the photoreceptor response and a specialised amacrine cell circuit in the inner retina. The results further show that their effect combines in a multiplicative way. The model is then used to examine the influence of nonlinearities on the responses of ganglion cells in the presence of involuntary fixational eye movements. Two different stimulus conditions will be considered: visual hyperacuity and motion induced illusions. In both cases, it is possible to directly compare properties of the ganglion cell population response with psychophysical data, which allows for an analysis of the influence of different components of the retinal circuitry. The simulation results suggest an important role for nonlinearities in the magnocellular stream for visual perception in both cases. First, it will be shown how nonlinearities, triggered by fixational eye movements, can strongly enhance the spatial precision of magnocellular ganglion cells. As a result, their performance in a hyperacuity task can be equal to or even surpass that of the parvocellular system. Second, the simulations imply that the origin of some of the illusory percepts elicited by fixational eye movements could be traced back to the nonlinear properties of magnocellular ganglion cells. As these activity patterns strongly differ from those in the parvocellular system, it appears that the magnocellular system can strongly dominate visual perception in certain conditions. Taken together, the results of this theoretical study suggest that retinal nonlinearities may be important for and strongly influence visual perception. The model makes several experimentally verifiable predictions to further test and quantify these findings. Furthermore, models investigating higher visual processing stages may benefit from this work, which could provide the basis to produce realistic afferent input