A 3D Omnidirectional Sensor For Mobile Robot Applications

International audienc

The flow of baseline estimation using a single omnidirectional camera

Baseline is a distance between two cameras, but we cannot get information from a single camera. Baseline is one of the important parameters to find the depth of objects in stereo image triangulation. The flow of baseline is produced by moving the camera in horizontal axis from its original location. Using baseline estimation, we can determined the depth of an object by using only an omnidirectional camera. This research focus on determining the flow of baseline before calculating the disparity map. To estimate the flow and to tracking the object, we use three and four points in the surface of an object from two different data (panoramic image) that were already chosen. By moving the camera horizontally, we get the tracks of them. The obtained tracks are visually similar. Each track represent the coordinate of each tracking point. Two of four tracks have a graphical representation similar to second order polynomial

A flexible technique for accurate omnidirectional camera calibration and structure from motion

In this paper, we present a flexible new technique for single viewpoint omnidirectional camera calibration. The proposed method only requires the camera to observe a planar pattern shown at a few different orientations. Either the camera or the planar pattern can be freely moved. No a priori knowledge of the motion is required, nor a specific model of the omnidirectional sensor. The only assumption is that the image projection function can be described by a Taylor series expansion whose coefficients are estimated by solving a two-step least-squares linear minimization problem. To test the proposed technique, we calibrated a panoramic camera having a field of view greater than 200° in the vertical direction, and we obtained very good results. To investigate the accuracy of the calibration, we also used the estimated omni-camera model in a structure from motion experiment. We obtained a 3D metric reconstruction of a scene from two highly distorted omnidirectional images by using image correspondences only. Compared with classical techniques, which rely on a specific parametric model of the omnidirectional camera, the proposed procedure is independent of the sensor, easy to use, and flexible. 1

Omnidirectional underwater surveying and telepresence

Exploratory dives are traditionally the first step for marine scientists to acquire information on a previously unknown area of scientific interest. Manned submersibles have been the platform of choice for such exploration, as they allow a high level of environmental perception by the scientist on-board, and the ability to take informed decisions on what to explore next. However, manned submersibles have extremely high operation costs and provide very limited bottom time. Remotely operated vehicles (ROVs) can partially address these two issues, but have operational and cost constraints that restrict their usage. This paper discusses new capabilities to assist scientists operating lightweight hybrid remotely operated vehicles (HROV) in exploratory missions of mapping and surveying. The new capabilities, under development within the Spanish National project OMNIUS, provide a new layer of autonomy for HROVs by exploring three key concepts: Omni-directional optical sensing for collaborative immersive exploration, Proximity safety awareness and Online mapping during mission time.Peer Reviewe

New Omnidirectional Sensor Based on Open-Source Software and Hardware for Tracking and Backtracking of Dual-Axis Solar Trackers in Photovoltaic Plants

In this work, an omnidirectional sensor that enables identification of the direction of the celestial sphere with maximum solar irradiance is presented. The sensor, based on instantaneous measurements, functions as a position server for dual-axis solar trackers in photovoltaic plants. The proposed device has been developed with free software and hardware, which makes it a pioneering solution because it is open and accessible as well as capable of being improved by the scientific community, thereby contributing to the rapid advancement of technology. In addition, the device includes an algorithm developed ex professo that makes it possible to predetermine the regions of the celestial sphere for which, according to the geometric characteristics of the PV plant, there would be shading between the panels. In this way, solar trackers do not have to locate the Sun’s position at all times according to astronomical models, while taking into account factors such as shadows or cloudiness that also affect levels of incident irradiance on solar collectors. Therefore, with this device, it is possible to provide photovoltaic plants with dual-axis solar tracking with a low-cost device that helps to optimise the trajectory of the trackers and, consequently, their radiative capture and energy production

Direction of Arrival with One Microphone, a few LEGOs, and Non-Negative Matrix Factorization

Conventional approaches to sound source localization require at least two microphones. It is known, however, that people with unilateral hearing loss can also localize sounds. Monaural localization is possible thanks to the scattering by the head, though it hinges on learning the spectra of the various sources. We take inspiration from this human ability to propose algorithms for accurate sound source localization using a single microphone embedded in an arbitrary scattering structure. The structure modifies the frequency response of the microphone in a direction-dependent way giving each direction a signature. While knowing those signatures is sufficient to localize sources of white noise, localizing speech is much more challenging: it is an ill-posed inverse problem which we regularize by prior knowledge in the form of learned non-negative dictionaries. We demonstrate a monaural speech localization algorithm based on non-negative matrix factorization that does not depend on sophisticated, designed scatterers. In fact, we show experimental results with ad hoc scatterers made of LEGO bricks. Even with these rudimentary structures we can accurately localize arbitrary speakers; that is, we do not need to learn the dictionary for the particular speaker to be localized. Finally, we discuss multi-source localization and the related limitations of our approach.Comment: This article has been accepted for publication in IEEE/ACM Transactions on Audio, Speech, and Language processing (TASLP

HIEN-LO: An experiment for charge determination of cosmic rays of interplanetary and solar origin

The experiment is designed to measure the heavy ion environment at low altitude (HIEN-LO) in the energy range 0.3 to 100 MeV/nucleon. In order to cover this wide energy range a complement of three sensors is used. A large area ion drift chamber and a time-of-flight telescope are used to determine the mass and energy of the incoming cosmic rays. A third omnidirectional counter serves as a proton monitor. The analysis of mass, energy and incoming direction in combination with the directional geomagnetic cut-off allows the determination of the ionic charge of the cosmic rays. The ionic charge in this energy range is of particular interest because it provides clues to the origin of these particles and to the plasma conditions at the acceleration site. The experiment is expected to be flown in 1988/1989