Stereo Matching in Address-Event-Representation (AER) Bio-Inspired Binocular Systems in a Field-Programmable Gate Array (FPGA)

In stereo-vision processing, the image-matching step is essential for results, although it involves a very high computational cost. Moreover, the more information is processed, the more time is spent by the matching algorithm, and the more ine cient it is. Spike-based processing is a relatively new approach that implements processing methods by manipulating spikes one by one at the time they are transmitted, like a human brain. The mammal nervous system can solve much more complex problems, such as visual recognition by manipulating neuron spikes. The spike-based philosophy for visual information processing based on the neuro-inspired address-event-representation (AER) is currently achieving very high performance. The aim of this work was to study the viability of a matching mechanism in stereo-vision systems, using AER codification and its implementation in a field-programmable gate array (FPGA). Some studies have been done before in an AER system with monitored data using a computer; however, this kind of mechanism has not been implemented directly on hardware. To this end, an epipolar geometry basis applied to AER systems was studied and implemented, with other restrictions, in order to achieve good results in a real-time scenario. The results and conclusions are shown, and the viability of its implementation is proven.Ministerio de Economía y Competitividad TEC2016-77785-

3D Image Plane from Stereo Camera Calibration on Extrinsic Parameters in Stereo Vision Aplication

This paper presents a 3D image plane in a group of target or image during the process of stereo pair calibration. The extrinsic parameters of camera calibration can be viewed in 3D image or scene which contains the rotation and translation of vector. The error re-projection of a single image could determine the less error of distortion during the extraction of chessboard corner each image taken. The distortion model also generates an error coordinate system in pixel value. The 3D image will viewed the result and output of extrinsic parameters during the calibration process.

Application and evaluation of direct sparse visual odometry in marine vessels

With the international community pushing for a computer vision based option to the laws requiring a look-out for marine vehicles, there is now a significant motivation to provide digital solutions for navigation using these envisioned mandatory visual sensors. This paper explores the monocular direct sparse odometry algorithm when applied to a typical marine environment. The method uses a single camera to estimate a vessel\u27s motion and position over time and is then compared to ground truth to establish feasibility as both a local and global navigation system. Whilst it was inconsistent in accurately estimating vessel position, it was found that it could consistently estimate the vessel\u27s orientation in the majority of the situations the vessel was tasked with. It is therefore shown that monocular direct sparse odometry is partially suitable as a standalone navigation system and is a strong base for a multi-sensor solution

A Time-Evolving 3D Method Dedicated to the Reconstruction of Solar plumes and Results Using Extreme Ultra-Violet Data

An important issue in the tomographic reconstruction of the solar poles is the relatively rapid evolution of the polar plumes. We demonstrate that it is possible to take into account this temporal evolution in the reconstruction. The difficulty of this problem comes from the fact that we want a 4D reconstruction (three spatial dimensions plus time) while we only have 3D data (2D images plus time). To overcome this difficulty, we introduce a model that describes polar plumes as stationary objects whose intensity varies homogeneously with time. This assumption can be physically justified if one accepts the stability of the magnetic structure. This model leads to a bilinear inverse problem. We describe how to extend linear inversion methods to these kinds of problems. Studies of simulations show the reliability of our method. Results for SOHO/EIT data show that we are able to estimate the temporal evolution of polar plumes in order to improve the reconstruction of the solar poles from only one point of view. We expect further improvements from STEREO/EUVI data when the two probes will be separated by about 60 degrees

Neuronal Specialization for Fine-Grained Distance Estimation using a Real-Time Bio-Inspired Stereo Vision System

The human binocular system performs very complex operations in real-time tasks thanks to neuronal specialization and several specialized processing layers. For a classic computer vision system, being able to perform the same operation requires high computational costs that, in many cases, causes it to not work in real time: this is the case regarding distance estimation. This work details the functionality of the biological processing system, as well as the neuromorphic engineering research branch—the main purpose of which is to mimic neuronal processing. A distance estimation system based on the calculation of the binocular disparities with specialized neuron populations is developed. This system is characterized by several tests and executed in a real-time environment. The response of the system proves the similarity between it and human binocular processing. Further, the results show that the implemented system can work in a real-time environment, with a distance estimation error of 15% (8% for the characterization tests).Ministerio de Ciencia, Innovación y Universidades TEC2016-77785-

Sun Tracker Robotic Arm Optical Distance Measurement Evaluation at Different Positions Using Six Sigma Tools

This paper presents an optical distance evaluation solution, for a sun tracker robotic arm, with the help of Six Sigma. With the help of statistical tools any measurement system can be evaluated and a measurement system analysis (MSA) can be easily made. Like every measurement system, optical distance measurement can have errors. Six Sigma tools can evaluate the measurement system and can give useful data about its accuracy. Sometimes measurement system evaluation is done twice. First, initial tests are done, after some fine tuning and error correction is performed, and finally a repeated test is done, to show that the measurement errors were corrected

Low-cost navigation and guidance systems for unmanned aerial vehicles - part 1: Vision-based and integrated sensors

In this paper we present a new low-cost navigation system designed for small size Unmanned Aerial Vehicles (UAVs) based on Vision-Based Navigation (VBN) and other avionics sensors. The main objective of our research was to design a compact, light and relatively inexpensive system capable of providing the Required Navigation Performance (RNP) in all phases of flight of a small UAV, with a special focus on precision approach and landing, where Vision Based Navigation (VBN) techniques can be fully exploited in a multisensor integrated architecture. Various existing techniques for VBN were compared and the Appearance-Based Approach (ABA) was selected for implementation. Feature extraction and optical flow techniques were employed to estimate flight parameters such as roll angle, pitch angle, deviation from the runway and body rates. Additionally, we addressed the possible synergies between VBN, Global Navigation Satellite System (GNSS) and MEMS-IMU (Micro-Electromechanical System Inertial Measurement Unit) sensors, as well as the aiding from Aircraft Dynamics Models (ADMs)

A Feasibility Study on the Use of a Structured Light Depth-Camera for Three-Dimensional Body Measurements of Dairy Cows in Free-Stall Barns

Frequent checks on livestock\u2019s body growth can help reducing problems related to cow infertility or other welfare implications, and recognizing health\u2019s anomalies. In the last ten years, optical methods have been proposed to extract information on various parameters while avoiding direct contact with animals\u2019 body, generally causes stress. This research aims to evaluate a new monitoring system, which is suitable to frequently check calves and cow\u2019s growth through a three-dimensional analysis of their bodies\u2019 portions. The innovative system is based on multiple acquisitions from a low cost Structured Light Depth-Camera (Microsoft Kinect\u2122 v1). The metrological performance of the instrument is proved through an uncertainty analysis and a proper calibration procedure. The paper reports application of the depth camera for extraction of different body parameters. Expanded uncertainty ranging between 3 and 15 mm is reported in the case of ten repeated measurements. Coef\ufb01cients of determination R2> 0.84 and deviations lower than 6% from manual measurements where in general detected in the case of head size, hips distance, withers to tail length, chest girth, hips, and withers height. Conversely, lower performances where recognized in the case of animal depth (R2 = 0.74) and back slope (R2 = 0.12)

A 3D stereo camera system for precisely positioning animals in space and time

PLT was supported by the Scottish Funding Council (grant HR09011) through the Marine Alliance for Science and Technology for Scotland.Here, we describe a portable stereo camera system that integrates a GPS receiver, an attitude sensor and 3D stereo photogrammetry to rapidly estimate the position of multiple animals in space and time. We demonstrate the performance of the system during a field test by simultaneously tracking the individual positions of six long-finned pilot whales, Globicephala melas. In shore-based accuracy trials, a system with a 50-cm stereo baseline had an average range estimation error of 0.09 m at a 5-m distance increasing up to 3.2 at 50 m. The system is especially useful in field situations where it is necessary to follow groups of animals travelling over relatively long distances and time periods whilst obtaining individual positions with high spatial and temporal resolution (up to 8 Hz). These positions provide quantitative estimates of a variety of key parameters and indicators for behavioural studies such as inter-animal distances, group dispersion, speed and heading. This system can additionally be integrated with other techniques such as archival tags, photo-identification methods or acoustic playback experiments to facilitate fieldwork investigating topics ranging from natural social behaviour to how animals respond to anthropogenic disturbance. By grounding observations in quantitative metrics, the system can characterize fine-scale behaviour or detect changes as a result of disturbance that might otherwise be difficult to observe.PostprintPeer reviewe