A USB3.0 FPGA Event-based Filtering and Tracking Framework for Dynamic Vision Sensors

Dynamic vision sensors (DVS) are frame-free sensors with an asynchronous variable-rate output that is ideal for hard real-time dynamic vision applications under power and latency constraints. Post-processing of the digital sensor output can reduce sensor noise, extract low level features, and track objects using simple algorithms that have previously been implemented in software. In this paper we present an FPGA-based framework for event-based processing that allows uncorrelated-event noise removal and real-time tracking of multiple objects, with dynamic capabilities to adapt itself to fast or slow and large or small objects. This framework uses a new hardware platform based on a Lattice FPGA which filters the sensor output and which then transmits the results through a super-speed Cypress FX3 USB microcontroller interface to a host computer. The packets of events and timestamps are transmitted to the host computer at rates of 10 Mega events per second. Experimental results are presented that demonstrate a low latency of 10us for tracking and computing the center of mass of a detected object.Ministerio de Economía y Competitividad TEC2012-37868-C04-0

Evaluation of trackers for Pan-Tilt-Zoom Scenarios

Tracking with a Pan-Tilt-Zoom (PTZ) camera has been a research topic in computer vision for many years. Compared to tracking with a still camera, the images captured with a PTZ camera are highly dynamic in nature because the camera can perform large motion resulting in quickly changing capture conditions. Furthermore, tracking with a PTZ camera involves camera control to position the camera on the target. For successful tracking and camera control, the tracker must be fast enough, or has to be able to predict accurately the next position of the target. Therefore, standard benchmarks do not allow to assess properly the quality of a tracker for the PTZ scenario. In this work, we use a virtual PTZ framework to evaluate different tracking algorithms and compare their performances. We also extend the framework to add target position prediction for the next frame, accounting for camera motion and processing delays. By doing this, we can assess if predicting can make long-term tracking more robust as it may help slower algorithms for keeping the target in the field of view of the camera. Results confirm that both speed and robustness are required for tracking under the PTZ scenario.Comment: 6 pages, 2 figures, International Conference on Pattern Recognition and Artificial Intelligence 201

Optomotor Swimming in Larval Zebrafish Is Driven by Global Whole-Field Visual Motion and Local Light-Dark Transitions

Stabilizing gaze and position within an environment constitutes an important task for the nervous system of many animals. The optomotor response (OMR) is a reflexive behavior, present across many species, in which animals move in the direction of perceived whole-field visual motion, therefore stabilizing themselves with respect to the visual environment. Although the OMR has been extensively used to probe visuomotor neuronal circuitry, the exact visual cues that elicit the behavior remain unidentified. In this study, we use larval zebrafish to identify spatio-temporal visual features that robustly elicit forward OMR swimming. These cues consist of a local, forward-moving, off edge together with on/off symmetric, similarly directed, global motion. Imaging experiments reveal neural units specifically activated by the forward-moving light-dark transition. We conclude that the OMR is driven not just by whole-field motion but by the interplay between global and local visual stimuli, where the latter exhibits a strong light-dark asymmetry

Zernike Piston Statistics in Turbulent Multi-Aperture Optical Systems

There is currently a lack of research into how the atmosphere effects Zernike piston. This Zernike piston is a coefficient related to the average phase delay of a wave. Usually Zernike piston can be ignored over a single aperture because it is merely a delay added to the entire wavefront. For multi-aperture interferometers though piston cannot be ignored. The statistics of Zernike piston could supplement and improve atmospheric monitoring, adaptive optics, stellar interferometers, and fringe tracking. This research will focus on developing a statistical model for Zernike piston introduced by atmospheric turbulence

LMODEL: A satellite precipitation methodology using cloud development modeling. Part I: Algorithm construction and calibration

The Lagrangian Model (LMODEL) is a new multisensor satellite rainfall monitoring methodology based on the use of a conceptual cloud-development model that is driven by geostationary satellite imagery and is locally updated using microwave-based rainfall measurements from low earth-orbiting platforms. This paper describes the cloud development model and updating procedures; the companion paper presents model validation results. The model uses single-band thermal infrared geostationary satellite imagery to characterize cloud motion, growth, and dispersal at high spatial resolution (similar to 4 km). These inputs drive a simple, linear, semi-Lagrangian, conceptual cloud mass balance model, incorporating separate representations of convective and stratiform processes. The model is locally updated against microwave satellite data using a two-stage process that scales precipitable water fluxes into the model and then updates model states using a Kalman filter. Model calibration and updating employ an empirical rainfall collocation methodology designed to compensate for the effects of measurement time difference, geolocation error, cloud parallax, and rainfall shear