Bio-inspired motion detection in an FPGA-based smart camera module

Köhler T, Roechter F, Lindemann JP, Möller R. Bio-inspired motion detection in an FPGA-based smart camera module. Bioinspiration & Biomimetics. 2009;4(1):015008.Flying insects, despite their relatively coarse vision and tiny nervous system, are capable of carrying out elegant and fast aerial manoeuvres. Studies of the fly visual system have shown that this is accomplished by the integration of signals from a large number of elementary motion detectors (EMDs) in just a few global flow detector cells. We developed an FPGA-based smart camera module with more than 10000 single EMDs, which is closely modelled after insect motion-detection circuits with respect to overall architecture, resolution and inter-receptor spacing. Input to the EMD array is provided by a CMOS camera with a high frame rate. Designed as an adaptable solution for different engineering applications and as a testbed for biological models, the EMD detector type and parameters such as the EMD time constants, the motion-detection directions and the angle between correlated receptors are reconfigurable online. This allows a flexible and simultaneous detection of complex motion fields such as translation, rotation and looming, such that various tasks, e. g., obstacle avoidance, height/distance control or speed regulation can be performed by the same compact device

Coding Efficiency of Fly Motion Processing Is Set by Firing Rate, Not Firing Precision

To comprehend the principles underlying sensory information processing, it is important to understand how the nervous system deals with various sources of perturbation. Here, we analyze how the representation of motion information in the fly's nervous system changes with temperature and luminance. Although these two environmental variables have a considerable impact on the fly's nervous system, they do not impede the fly to behave suitably over a wide range of conditions. We recorded responses from a motion-sensitive neuron, the H1-cell, to a time-varying stimulus at many different combinations of temperature and luminance. We found that the mean firing rate, but not firing precision, changes with temperature, while both were affected by mean luminance. Because we also found that information rate and coding efficiency are mainly set by the mean firing rate, our results suggest that, in the face of environmental perturbations, the coding efficiency is improved by an increase in the mean firing rate, rather than by an increased firing precision

Visually Guided Avoidance in the Chameleon (Chamaeleo chameleon): Response Patterns and Lateralization

The common chameleon, Chamaeleo chameleon, is an arboreal lizard with highly independent, large-amplitude eye movements. In response to a moving threat, a chameleon on a perch responds with distinct avoidance movements that are expressed in its continuous positioning on the side of the perch distal to the threat. We analyzed body-exposure patterns during threat avoidance for evidence of lateralization, that is, asymmetry at the functional/behavioral levels. Chameleons were exposed to a threat approaching horizontally from the left or right, as they held onto a vertical pole that was either wider or narrower than the width of their head, providing, respectively, monocular or binocular viewing of the threat. We found two equal-sized sub-groups, each displaying lateralization of motor responses to a given direction of stimulus approach. Such an anti-symmetrical distribution of lateralization in a population may be indicative of situations in which organisms are regularly exposed to crucial stimuli from all spatial directions. This is because a bimodal distribution of responses to threat in a natural population will reduce the spatial advantage of predators

Robust Models for Optic Flow Coding in Natural Scenes Inspired by Insect Biology

The extraction of accurate self-motion information from the visual world is a difficult problem that has been solved very efficiently by biological organisms utilizing non-linear processing. Previous bio-inspired models for motion detection based on a correlation mechanism have been dogged by issues that arise from their sensitivity to undesired properties of the image, such as contrast, which vary widely between images. Here we present a model with multiple levels of non-linear dynamic adaptive components based directly on the known or suspected responses of neurons within the visual motion pathway of the fly brain. By testing the model under realistic high-dynamic range conditions we show that the addition of these elements makes the motion detection model robust across a large variety of images, velocities and accelerations. Furthermore the performance of the entire system is more than the incremental improvements offered by the individual components, indicating beneficial non-linear interactions between processing stages. The algorithms underlying the model can be implemented in either digital or analog hardware, including neuromorphic analog VLSI, but defy an analytical solution due to their dynamic non-linear operation. The successful application of this algorithm has applications in the development of miniature autonomous systems in defense and civilian roles, including robotics, miniature unmanned aerial vehicles and collision avoidance sensors

Estimates of protection levels against SARS-CoV-2 infection and severe COVID-19 in Germany before the 2022/2023 winter season: the IMMUNEBRIDGE project

PURPOSE: Despite the need to generate valid and reliable estimates of protection levels against SARS-CoV-2 infection and severe course of COVID-19 for the German population in summer 2022, there was a lack of systematically collected population-based data allowing for the assessment of the protection level in real time. METHODS: In the IMMUNEBRIDGE project, we harmonised data and biosamples for nine population-/hospital-based studies (total number of participants n = 33,637) to provide estimates for protection levels against SARS-CoV-2 infection and severe COVID-19 between June and November 2022. Based on evidence synthesis, we formed a combined endpoint of protection levels based on the number of self-reported infections/vaccinations in combination with nucleocapsid/spike antibody responses ("confirmed exposures"). Four confirmed exposures represented the highest protection level, and no exposure represented the lowest. RESULTS: Most participants were seropositive against the spike antigen; 37% of the participants ≥ 79 years had less than four confirmed exposures (highest level of protection) and 5% less than three. In the subgroup of participants with comorbidities, 46-56% had less than four confirmed exposures. We found major heterogeneity across federal states, with 4-28% of participants having less than three confirmed exposures. CONCLUSION: Using serological analyses, literature synthesis and infection dynamics during the survey period, we observed moderate to high levels of protection against severe COVID-19, whereas the protection against SARS-CoV-2 infection was low across all age groups. We found relevant protection gaps in the oldest age group and amongst individuals with comorbidities, indicating a need for additional protective measures in these groups