A silicon implementation of the fly's optomotor control system

Flies are capable of stabilizing their body during free flight by using visual motion information to estimate self-rotation. We have built a hardware model of this optomotor control system in a standard CMOS VLSI process. The result is a small, low-power chip that receives input directly from the real world through on-board photoreceptors and generates motor commands in real time. The chip was tested under closed-loop conditions typically used for insect studies. The silicon system exhibited stable control sufficiently analogous to the biological system to allow for quantitative comparisons

Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action

Egelhaaf M, Boeddeker N, Kern R, Kurtz R, Lindemann JP. Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action. Frontiers in Neural Circuits. 2012;6:108.Insects such as flies or bees, with their miniature brains, are able to control highly aerobatic flight maneuvres and to solve spatial vision tasks, such as avoiding collisions with obstacles, landing on objects, or even localizing a previously learnt inconspicuous goal on the basis of environmental cues. With regard to solving such spatial tasks, these insects still outperform man-made autonomous flying systems. To accomplish their extraordinary performance, flies and bees have been shown by their characteristic behavioral actions to actively shape the dynamics of the image flow on their eyes ("optic flow"). The neural processing of information about the spatial layout of the environment is greatly facilitated by segregating the rotational from the translational optic flow component through a saccadic flight and gaze strategy. This active vision strategy thus enables the nervous system to solve apparently complex spatial vision tasks in a particularly efficient and parsimonious way. The key idea of this review is that biological agents, such as flies or bees, acquire at least part of their strength as autonomous systems through active interactions with their environment and not by simply processing passively gained information about the world. These agent-environment interactions lead to adaptive behavior in surroundings of a wide range of complexity. Animals with even tiny brains, such as insects, are capable of performing extraordinarily well in their behavioral contexts by making optimal use of the closed action-perception loop. Model simulations and robotic implementations show that the smart biological mechanisms of motion computation and visually-guided flight control might be helpful to find technical solutions, for example, when designing micro air vehicles carrying a miniaturized, low-weight on-board processor

Preserving neural function under extreme scaling

Important brain functions need to be conserved throughout organisms of extremely varying sizes. Here we study the scaling properties of an essential component of computation in the brain: the single neuron. We compare morphology and signal propagation of a uniquely identifiable interneuron, the HS cell, in the blowfly (Calliphora) with its exact counterpart in the fruit fly (Drosophila) which is about four times smaller in each dimension. Anatomical features of the HS cell scale isometrically and minimise wiring costs but, by themselves, do not scale to preserve the electrotonic behaviour. However, the membrane properties are set to conserve dendritic as well as axonal delays and attenuation as well as dendritic integration of visual information. In conclusion, the electrotonic structure of a neuron, the HS cell in this case, is surprisingly stable over a wide range of morphological scales

Contrast sensitivity of insect motion detectors to natural images

How do animals regulate self-movement despite large variation in the luminance contrast of the environment? Insects are capable of regulating flight speed based on the velocity of image motion, but the mechanisms for this are unclear. The Hassenstein–Reichardt correlator model and elaborations can accurately predict responses of motion detecting neurons under many conditions but fail to explain the apparent lack of spatial pattern and contrast dependence observed in freely flying bees and flies. To investigate this apparent discrepancy, we recorded intracellularly from horizontal-sensitive (HS) motion detecting neurons in the hoverfly while displaying moving images of natural environments. Contrary to results obtained with grating patterns, we show these neurons encode the velocity of natural images largely independently of the particular image used despite a threefold range of contrast. This invariance in response to natural images is observed in both strongly and minimally motion-adapted neurons but is sensitive to artificial manipulations in contrast. Current models of these cells account for some, but not all, of the observed insensitivity to image contrast. We conclude that fly visual processing may be matched to commonalities between natural scenes, enabling accurate estimates of velocity largely independent of the particular scene

Neuronal processing of translational optic flow in the visual system of the shore crab Carcinus maenas

This paper describes a search for neurones sensitive to optic flow in the visual system of the shore crab Carcinus maenas using a procedure developed from that of Krapp and Hengstenberg. This involved determining local motion sensitivity and its directional selectivity at many points within the neurone's receptive field and plotting the results on a map. Our results showed that local preferred directions of motion are independent of velocity, stimulus shape and type of motion (circular or linear). Global response maps thus clearly represent real properties of the neurones' receptive fields. Using this method, we have discovered two families of interneurones sensitive to translational optic flow. The first family has its terminal arborisations in the lobula of the optic lobe, the second family in the medulla. The response maps of the lobula neurones (which appear to be monostratified lobular giant neurones) show a clear focus of expansion centred on or just above the horizon, but at significantly different azimuth angles. Response maps such as these, consisting of patterns of movement vectors radiating from a pole, would be expected of neurones responding to self-motion in a particular direction. They would be stimulated when the crab moves towards the pole of the neurone's receptive field. The response maps of the medulla neurones show a focus of contraction, approximately centred on the horizon, but at significantly different azimuth angles. Such neurones would be stimulated when the crab walked away from the pole of the neurone's receptive field. We hypothesise that both the lobula and the medulla interneurones are representatives of arrays of cells, each of which would be optimally activated by self-motion in a different direction. The lobula neurones would be stimulated by the approaching scene and the medulla neurones by the receding scene. Neurones tuned to translational optic flow provide information on the three-dimensional layout of the environment and are thought to play a role in the judgment of heading

Sensory Integration: Neuronal Adaptations for Robust Visual Self-Motion Estimation

SummaryRecent studies on the fly visual system have revealed how the morphology of visual interneurons and their lateral electrical connectivity helps overcome a notorious problem in visuomotor control — the ambiguity of local sensor signals

Neural encoding of behaviourally relevant visual-motion information in the fly

Egelhaaf M, Kern R, Krapp HG, Kretzberg J, Kurtz R, Warzecha A-K. Neural encoding of behaviourally relevant visual-motion information in the fly. Trends in Neurosciences. 2002;25(2):96-102.Information processing in visual systems is constrained by the spatial and temporal characteristics of the sensory input and by the biophysical properties of the neuronal circuits. Hence, to understand how visual systems encode behaviourally relevant information, we need to know about both the computational capabilities of the nervous system and the natural conditions under which animals normally operate. By combining behavioural, neurophysiological and computational approaches, it is now possible in the fly to assess adaptations that process visual-motion information under the constraints of its natural input. It is concluded that neuronal operating ranges and coding strategies appear to be closely matched to the inputs the animal encounters under behaviourally relevant conditions

Neurofly 2008 abstracts : the 12th European Drosophila neurobiology conference 6-10 September 2008 Wuerzburg, Germany

This volume consists of a collection of conference abstracts

Neural Action Fields for Optic Flow Based Navigation: A Simulation Study of the Fly Lobula Plate Network

Optic flow based navigation is a fundamental way of visual course control described in many different species including man. In the fly, an essential part of optic flow analysis is performed in the lobula plate, a retinotopic map of motion in the environment. There, the so-called lobula plate tangential cells possess large receptive fields with different preferred directions in different parts of the visual field. Previous studies demonstrated an extensive connectivity between different tangential cells, providing, in principle, the structural basis for their large and complex receptive fields. We present a network simulation of the tangential cells, comprising most of the neurons studied so far (22 on each hemisphere) with all the known connectivity between them. On their dendrite, model neurons receive input from a retinotopic array of Reichardt-type motion detectors. Model neurons exhibit receptive fields much like their natural counterparts, demonstrating that the connectivity between the lobula plate tangential cells indeed can account for their complex receptive field structure. We describe the tuning of a model neuron to particular types of ego-motion (rotation as well as translation around/along a given body axis) by its ‘action field’. As we show for model neurons of the vertical system (VS-cells), each of them displays a different type of action field, i.e., responds maximally when the fly is rotating around a particular body axis. However, the tuning width of the rotational action fields is relatively broad, comparable to the one with dendritic input only. The additional intra-lobula-plate connectivity mainly reduces their translational action field amplitude, i.e., their sensitivity to translational movements along any body axis of the fly

Pattern-Dependent Response Modulations in Motion-Sensitive Visual Interneurons—A Model Study

Even if a stimulus pattern moves at a constant velocity across the receptive field of motion-sensitive neurons, such as lobula plate tangential cells (LPTCs) of flies, the response amplitude modulates over time. The amplitude of these response modulations is related to local pattern properties of the moving retinal image. On the one hand, pattern-dependent response modulations have previously been interpreted as 'pattern-noise', because they deteriorate the neuron's ability to provide unambiguous velocity information. On the other hand, these modulations might also provide the system with valuable information about the textural properties of the environment. We analyzed the influence of the size and shape of receptive fields by simulations of four versions of LPTC models consisting of arrays of elementary motion detectors of the correlation type (EMDs). These models have previously been suggested to account for many aspects of LPTC response properties. Pattern-dependent response modulations decrease with an increasing number of EMDs included in the receptive field of the LPTC models, since spatial changes within the visual field are smoothed out by the summation of spatially displaced EMD responses. This effect depends on the shape of the receptive field, being the more pronounced - for a given total size - the more elongated the receptive field is along the direction of motion. Large elongated receptive fields improve the quality of velocity signals. However, if motion signals need to be localized the velocity coding is only poor but the signal provides – potentially useful – local pattern information. These modelling results suggest that motion vision by correlation type movement detectors is subject to uncertainty: you cannot obtain both an unambiguous and a localized velocity signal from the output of a single cell. Hence, the size and shape of receptive fields of motion sensitive neurons should be matched to their potential computational task