Blind Detection and Compensation of Camera Lens Geometric Distortions

This paper presents a blind detection and compensation technique for camera lens geometric distortions. The lens distortion introduces higher-order correlations in the frequency domain and in turn it can be detected using higher-order spectral analysis tools without assuming any specific calibration target. The existing blind lens distortion removal method only considered a single-coefficient radial distortion model. In this paper, two coefficients are considered to model approximately the geometric distortion. All the models considered have analytical closed-form inverse formulae.Comment: 6 pages, 4 figures, 2 table

Determining the Phase and Amplitude Distortion of a Wavefront using a Plenoptic Sensor

We have designed a plenoptic sensor to retrieve phase and amplitude changes resulting from a laser beam's propagation through atmospheric turbulence. Compared with the commonly restricted domain of (-pi, pi) in phase reconstruction by interferometers, the reconstructed phase obtained by the plenoptic sensors can be continuous up to a multiple of 2pi. When compared with conventional Shack-Hartmann sensors, ambiguities caused by interference or low intensity, such as branch points and branch cuts, are less likely to happen and can be adaptively avoided by our reconstruction algorithm. In the design of our plenoptic sensor, we modified the fundamental structure of a light field camera into a mini Keplerian telescope array by accurately cascading the back focal plane of its object lens with a microlens array's front focal plane and matching the numerical aperture of both components. Unlike light field cameras designed for incoherent imaging purposes, our plenoptic sensor operates on the complex amplitude of the incident beam and distributes it into a matrix of images that are simpler and less subject to interference than a global image of the beam. Then, with the proposed reconstruction algorithms, the plenoptic sensor is able to reconstruct the wavefront and a phase screen at an appropriate depth in the field that causes the equivalent distortion on the beam. The reconstructed results can be used to guide adaptive optics systems in directing beam propagation through atmospheric turbulence. In this paper we will show the theoretical analysis and experimental results obtained with the plenoptic sensor and its reconstruction algorithms.Comment: This article has been accepted by JOSA

Advanced adaptive compensation system for free-space optical communications

Massive amounts of information are created daily in commercial fields like earth observation, that must be downloaded to earth ground stations in the short time of a satellite pass. Today, much of the collected information must be dropped due to lack of bandwidth, and laser downlinks can offer tenths of gigabits throughput solving this bottleneck limitation. In a down-link scenario, the performance of laser satellite communications is limited due to atmospheric turbulence, which causes fluctuations in the intensity and the phase of the received signal leading to an increase in bit error probability. In principle, a single-aperture phase-compensated receiver, based on adaptive optics, can overcome atmospheric limitations by adaptive tracking and correction of atmospherically induced aberrations. However, under strong-turbulence situations, the effectiveness of traditional adaptive optics systems is severely compromised. In such scenarios, sensor-less techniques offer robustness, hardware simplicity, and easiness of implementation and integration at a reduced cost, but the state-of-the-art approaches still require too many iterations to perform the correction, exceeding the temporal coherence of the field and thus falling behind the field evolution. This thesis proposes a new iterative AO technique for strong turbulence compensation that reduces the correction time, bridging the limitation of similar systems in lasercom applications. It is based on the standard sensor-less system design, but it additionally uses a short-exposure focal intensity image to accelerate the correction. The technique combines basic principles of Fourier optics, image processing, and quadratic signal optimization to correct the wave-front. This novel approach directly updates the phases of the most intense focal-plane speckles, maximizing the power coupled into a single-mode fiber convexly. Numerical analyses show that this method has a robust and excellent performance under very strong turbulence. Laboratory results confirm that a focal speckle pattern can be used to accelerate the iterative compensation. This technique delivers nearly twofold bandwidth reduction compared with standard methods, and sufficient signal gain and stability to allow high throughput data transmission with nearly error-free performance in emulated satellite downlink scenarios. A property highlight is the in-advance knowledge of the required number of iterations, allowing on-demand management of the loop bandwidth in different turbulent regimes. Besides remaining conceptually and technically simple, it opens a new insight to iterative solutions that may lead to the development of new methods. With further refinement, this technique can surely contribute to making possible the use of iterative solutions in laser communicationsSatélites de observación de la tierra diariamente generan gigantescas cantidades de datos que deben ser enviados a estaciones terrenas. La mayoría de la información recolectada debe desecharse debido al reducido tiempo visible de un satélite en movimiento y el limitado ancho de banda de transmisión. Enlaces ópticos pueden solucionar esta limitación ofreciendo multi-gigabit de ancho de banda. Sin embargo, el desempeño de un downlink laser está limitado por la turbulencia atmosférica, la cual induce variaciones en la intensidad y la fase de la señal recibida incrementando la probabilidad de error en los datos recibidos. En principio, un receptor basado en una apertura simple utilizando óptica adaptativa puede corregir las aberraciones de fase inducidas por la atmósfera, mejorando el canal de transmisión. Sin embargo, la eficiencia de los sistemas de óptica adaptativa tradicionales se ve seriamente reducida en situaciones de turbulencia fuerte. En tales escenarios, técnicas iterativas ofrecen mayor robustez, simplicidad de diseño e implementación, así como también facilidad de integración a un costo reducido. Desafortunadamente, dicha tecnología aún requiere demasiadas iteraciones para corregir la fase distorsionada, excediendo el tiempo de coherencia del frente de onda. Esta tesis propone una nueva técnica iterativa de óptica adaptativa capaz de reducir el tiempo de convergencia en escenarios de turbulencia fuerte. La técnica utiliza el diseño tradicional de los sistemas de corrección iterativos, agregando el uso de una imagen focal de intensidad para acelerar el proceso de corrección del campo distorsionado. En dicha técnica se combinan principios básicos de óptica de Fourier, procesamiento de imagen, y optimización cuadrática de la señal para corregir el frente de onda. De esta forma, la fase de los puntos focales de mayor intensidad (speckles) puede modificarse directamente y con ello maximizar de forma convexa la potencia acoplada en fibra. Los análisis numéricos demuestran robustez y un excelente desempeño en escenarios de turbulencia fuerte. Los resultados de laboratorio confirman que el moteado de intensidad puede utilizarse para acelerar la corrección iterativa. Esta técnica utiliza la mitad del ancho de banda requerido con la técnica tradicional, al mismo tiempo que ofrece suficiente ganancia y estabilidad de la señal para lograr enlaces ópticos con muy baja probabilidad de error. Al mismo tiempo, la técnica propuesta permite conocer con anticipación el número total de iteraciones y posibilita la administración bajo demanda del ancho de banda requerido en diferentes escenarios de turbulencia. Esta tesis ofrece una mirada diferente a los métodos iterativos, posibilitando el desarrollo de nuevos conceptos y contribuyendo al uso de soluciones iterativas en comunicaciones laser por espacio libre.Postprint (published version

Towards High-Frequency Tracking and Fast Edge-Aware Optimization

This dissertation advances the state of the art for AR/VR tracking systems by increasing the tracking frequency by orders of magnitude and proposes an efficient algorithm for the problem of edge-aware optimization. AR/VR is a natural way of interacting with computers, where the physical and digital worlds coexist. We are on the cusp of a radical change in how humans perform and interact with computing. Humans are sensitive to small misalignments between the real and the virtual world, and tracking at kilo-Hertz frequencies becomes essential. Current vision-based systems fall short, as their tracking frequency is implicitly limited by the frame-rate of the camera. This thesis presents a prototype system which can track at orders of magnitude higher than the state-of-the-art methods using multiple commodity cameras. The proposed system exploits characteristics of the camera traditionally considered as flaws, namely rolling shutter and radial distortion. The experimental evaluation shows the effectiveness of the method for various degrees of motion. Furthermore, edge-aware optimization is an indispensable tool in the computer vision arsenal for accurate filtering of depth-data and image-based rendering, which is increasingly being used for content creation and geometry processing for AR/VR. As applications increasingly demand higher resolution and speed, there exists a need to develop methods that scale accordingly. This dissertation proposes such an edge-aware optimization framework which is efficient, accurate, and algorithmically scales well, all of which are much desirable traits not found jointly in the state of the art. The experiments show the effectiveness of the framework in a multitude of computer vision tasks such as computational photography and stereo.Comment: PhD thesi

EXTRACTION of DEMS and ORTHOIMAGES from ARCHIVE AERIAL IMAGERY to SUPPORT PROJECT PLANNING in CIVIL ENGINEERING

Archive aerial photos represent a valuable heritage to provide information about land content and topography in the past years. Today, the availability of low-cost and open-source solutions for photogrammetric processing of close-range and drone images offers the chance to provide outputs such as DEM's and orthoimages in easy way. This paper is aimed at demonstrating somehow and to which level of accuracy digitized archive aerial photos may be used within a such kind of low-cost software (Agisoft Photoscan Professional®) to generate photogrammetric outputs. Different steps of the photogrammetric processing workflow are presented and discussed. The main conclusion is that this procedure may come to provide some final products, which however do not feature the high accuracy and resolution that may be obtained using high-end photogrammetric software packages specifically designed for aerial survey projects. In the last part a case study is presented about the use of four-epoch archive of aerial images to analyze the area where a tunnel has to be excavated

Intelligent laser scanning for computer aided manufacture.

Reverse engineering requires the acquisition of large amounts of data describing the surface of an object, sufficient to replicate that object accurately using appropriate fabrication techniques. This is important within a wide range of commercial and scientific fields where CAD models may be unavailable for parts that must be duplicated or modified, or where a physical model is used as a prototype. The three-dimensional digitisation of objects is an essential first step in reverse engineering. Optical triangulation laser sensors are one of the most popular and common non-contact methods used in the data acquisition process today. They provide the means for high resolution scanning of complex objects. Multiple scans of the object are usually required to capture the full 3D profile of the object. A number of factors, including scan resolution, system optics and the precision of the mechanical parts comprising the system may affect the accuracy of the process. A single perspective optical triangulation sensor provides an inexpensive method for the acquisition of 3D range image data

Frame registration for motion compensation in imaging photoplethysmography

© 2018 by the authors. Licensee MDPI, Basel, Switzerland. Imaging photoplethysmography (iPPG) is an emerging technology used to assess microcirculation and cardiovascular signs by collecting backscattered light from illuminated tissue using optical imaging sensors. An engineering approach is used to evaluate whether a silicone cast of a human palm might be effectively utilized to predict the results of image registration schemes for motion compensation prior to their application on live human tissue. This allows us to establish a performance baseline for each of the algorithms and to isolate performance and noise fluctuations due to the induced motion from the temporally changing physiological signs. A multi-stage evaluation model is developed to qualitatively assess the influence of the region of interest (ROI), system resolution and distance, reference frame selection, and signal normalization on extracted iPPG waveforms from live tissue. We conclude that the application of image registration is able to deliver up to 75% signal-to-noise (SNR) improvement (4.75 to 8.34) over an uncompensated iPPG signal by employing an intensity-based algorithm with a moving reference frame