Modelling Drosophila motion vision pathways for decoding the direction of translating objects against cluttered moving backgrounds

Decoding the direction of translating objects in front of cluttered moving backgrounds, accurately and efficiently, is still a challenging problem. In nature, lightweight and low-powered flying insects apply motion vision to detect a moving target in highly variable environments during flight, which are excellent paradigms to learn motion perception strategies. This paper investigates the fruit fly Drosophila motion vision pathways and presents computational modelling based on cuttingedge physiological researches. The proposed visual system model features bio-plausible ON and OFF pathways, wide-field horizontal-sensitive (HS) and vertical-sensitive (VS) systems. The main contributions of this research are on two aspects: (1) the proposed model articulates the forming of both direction-selective and direction-opponent responses, revealed as principalfeaturesofmotionperceptionneuralcircuits,inafeed-forwardmanner;(2)italsoshowsrobustdirectionselectivity to translating objects in front of cluttered moving backgrounds, via the modelling of spatiotemporal dynamics including combination of motion pre-filtering mechanisms and ensembles of local correlators inside both the ON and OFF pathways, which works effectively to suppress irrelevant background motion or distractors, and to improve the dynamic response. Accordingly, the direction of translating objects is decoded as global responses of both the HS and VS systems with positive ornegativeoutputindicatingpreferred-direction or null-direction translation.The experiments have verified the effectiveness of the proposed neural system model, and demonstrated its responsive preference to faster-moving, higher-contrast and larger-size targets embedded in cluttered moving backgrounds

Bio-inspired motion detection in an FPGA-based smart camera module

Köhler T, Roechter F, Lindemann JP, Möller R. Bio-inspired motion detection in an FPGA-based smart camera module. Bioinspiration & Biomimetics. 2009;4(1):015008.Flying insects, despite their relatively coarse vision and tiny nervous system, are capable of carrying out elegant and fast aerial manoeuvres. Studies of the fly visual system have shown that this is accomplished by the integration of signals from a large number of elementary motion detectors (EMDs) in just a few global flow detector cells. We developed an FPGA-based smart camera module with more than 10000 single EMDs, which is closely modelled after insect motion-detection circuits with respect to overall architecture, resolution and inter-receptor spacing. Input to the EMD array is provided by a CMOS camera with a high frame rate. Designed as an adaptable solution for different engineering applications and as a testbed for biological models, the EMD detector type and parameters such as the EMD time constants, the motion-detection directions and the angle between correlated receptors are reconfigurable online. This allows a flexible and simultaneous detection of complex motion fields such as translation, rotation and looming, such that various tasks, e. g., obstacle avoidance, height/distance control or speed regulation can be performed by the same compact device

Constant Angular Velocity Regulation for Visually Guided Terrain Following

Insects use visual cues to control their flight behaviours. By estimating the angular velocity of the visual stimuli and regulating it to a constant value, honeybees can perform a terrain following task which keeps the certain height above the undulated ground. For mimicking this behaviour in a bio-plausible computation structure, this paper presents a new angular velocity decoding model based on the honeybee's behavioural experiments. The model consists of three parts, the texture estimation layer for spatial information extraction, the motion detection layer for temporal information extraction and the decoding layer combining information from pervious layers to estimate the angular velocity. Compared to previous methods on this field, the proposed model produces responses largely independent of the spatial frequency and contrast in grating experiments. The angular velocity based control scheme is proposed to implement the model into a bee simulated by the game engine Unity. The perfect terrain following above patterned ground and successfully flying over irregular textured terrain show its potential for micro unmanned aerial vehicles' terrain following

A First- and Second-Order Motion Energy Analysis of Peripheral Motion Illusions Leads to Further Evidence of “Feature Blur” in Peripheral Vision

Anatomical and physiological differences between the central and peripheral visual systems are well documented. Recent findings have suggested that vision in the periphery is not just a scaled version of foveal vision, but rather is relatively poor at representing spatial and temporal phase and other visual features. Shapiro, Lu, Huang, Knight, and Ennis (2010) have recently examined a motion stimulus (the “curveball illusion”) in which the shift from foveal to peripheral viewing results in a dramatic spatial/temporal discontinuity. Here, we apply a similar analysis to a range of other spatial/temporal configurations that create perceptual conflict between foveal and peripheral vision.To elucidate how the differences between foveal and peripheral vision affect super-threshold vision, we created a series of complex visual displays that contain opposing sources of motion information. The displays (referred to as the peripheral escalator illusion, peripheral acceleration and deceleration illusions, rotating reversals illusion, and disappearing squares illusion) create dramatically different perceptions when viewed foveally versus peripherally. We compute the first-order and second-order directional motion energy available in the displays using a three-dimensional Fourier analysis in the (x, y, t) space. The peripheral escalator, acceleration and deceleration illusions and rotating reversals illusion all show a similar trend: in the fovea, the first-order motion energy and second-order motion energy can be perceptually separated from each other; in the periphery, the perception seems to correspond to a combination of the multiple sources of motion information. The disappearing squares illusion shows that the ability to assemble the features of Kanisza squares becomes slower in the periphery.The results lead us to hypothesize “feature blur” in the periphery (i.e., the peripheral visual system combines features that the foveal visual system can separate). Feature blur is of general importance because humans are frequently bringing the information in the periphery to the fovea and vice versa

The Generation of Forces and Moments during Visual-Evoked Steering Maneuvers in Flying Drosophila

Sideslip force, longitudinal force, rolling moment, and pitching moment generated by tethered fruit flies, Drosophila melanogaster, were measured during optomotor reactions within an electronic flight simulator. Forces and torques were acquired by optically measuring the angular deflections of the beam to which the flies were tethered using a laser and a photodiode. Our results indicate that fruit flies actively generate both sideslip and roll in response to a lateral focus of expansion (FOE). The polarity of this behavior was such that the animal's aerodynamic response would carry it away from the expanding pattern, suggesting that it constitutes an avoidance reflex or centering response. Sideslip forces and rolling moments were sinusoidal functions of FOE position, whereas longitudinal force was proportional to the absolute value of the sine of FOE position. Pitching moments remained nearly constant irrespective of stimulus position or strength, with a direction indicating a tonic nose-down pitch under tethered conditions. These experiments expand our understanding of the degrees of freedom that a fruit fly can actually control in flight

Airsheds, watersheds and more – The flows that drive intra-extra-urban connections, and their implications for nature-based solutions (NBS)

This is the final version. Available on open access from Elsevier via the DOI in this recordCities are highly complex, inter-connected social-ecological systems, encompassing social, built and natural/semi-natural components. They interact with their surrounding extra-urban areas at varying scales, from peri-urban and rural to global. Space is a valuable commodity in cities. However, in most instances, city planners tend to think about interventions only within cities and rarely about the wider connected domains outside. Yet, considering the wider spatial context, including space outside of the city boundaries, may open up opportunities to achieve substantially greater benefit for city residents without sacrificing valuable space, leading to more sustainable city design for people and the environment. In this paper we discuss the intra-extra-urban flows which connect cities to their wider airsheds, watersheds, biosheds and resourcesheds, which in turn interact with their peoplesheds. For each domain, we illustrate the processes and the scales they operate at, and discuss the implications for optimum location of nature-based solutions (NBS) to address urban challenges. We suggest that integrating knowledge about these multiple sheds can inform holistic design of NBS to deliver greater benefit for city residents. This takes into account the synergies and multi-functional co-benefits which arise from a careful consideration of place and people, while minimising potential disbenefits and trade-offs