Sub-camera calibration of a Penta-camera

Penta cameras consisting of a nadir and four inclined cameras are becoming more and more popular, having the advantage of imaging also facades in built up areas from four directions. Such system cameras require a boresight calibration of the geometric relation of the cameras to each other, but also a calibration of the sub-cameras. Based on data sets of the ISPRS/EuroSDR benchmark for multi platform photogrammetry the inner orientation of the used IGI Penta DigiCAM has been analyzed. The required image coordinates of the blocks Dortmund and Zeche Zollern have been determined by Pix4Dmapper and have been independently adjusted and analyzed by program system BLUH. With 4.1 million image points in 314 images respectively 3.9 million image points in 248 images a dense matching was provided by Pix4Dmapper. With up to 19 respectively 29 images per object point the images are well connected, nevertheless the high number of images per object point are concentrated to the block centres while the inclined images outside the block centre are satisfying but not very strongly connected. This leads to very high values for the Student test (T-test) of the finally used additional parameters or in other words, additional parameters are highly significant. The estimated radial symmetric distortion of the nadir sub-camera corresponds to the laboratory calibration of IGI, but there are still radial symmetric distortions also for the inclined cameras with a size exceeding 5μm even if mentioned as negligible based on the laboratory calibration. Radial and tangential effects of the image corners are limited but still available. Remarkable angular affine systematic image errors can be seen especially in the block Zeche Zollern. Such deformations are unusual for digital matrix cameras, but it can be caused by the correlation between inner and exterior orientation if only parallel flight lines are used. With exception of the angular affinity the systematic image errors for corresponding cameras of both blocks have the same trend, but as usual for block adjustments with self calibration, they still show significant differences. Based on the very high number of image points the remaining image residuals can be safely determined by overlaying and averaging the image residuals corresponding to their image coordinates. The size of the systematic image errors, not covered by the used additional parameters, is in the range of a square mean of 0.1 pixels corresponding to 0.6μm. They are not the same for both blocks, but show some similarities for corresponding cameras. In general the bundle block adjustment with a satisfying set of additional parameters, checked by remaining systematic errors, is required for use of the whole geometric potential of the penta camera. Especially for object points on facades, often only in two images and taken with a limited base length, the correct handling of systematic image errors is important. At least in the analyzed data sets the self calibration of sub-cameras by bundle block adjustment suffers from the correlation of the inner to the exterior calibration due to missing crossing flight directions. As usual, the systematic image errors differ from block to block even without the influence of the correlation to the exterior orientation

Direct Georeferencing in Aerial Photogrammetric Mapping

Aerial photogrammetric mapping is a well-established industry. Its methods have been evolving progressively but not explosively over many decades. Entrenched, reliable procedures have been developed to overcome pitfalls along the processing chain, allowing the delivery of high quality mapping products

Techniques GPS-RTK appliquées à la trajectographie

The Geodetic Engineering Laboratory of the EPFL, in collaboration with Dartfish, a specialist in video training software, leads innovative GPS projects within the framework of athlete trajectography

Trajectographie de courses de ski alpin avec GPS

Jusqu'à présent, les seules informations disponibles pour l'analyse des courses de ski se limitent aux temps intermédiaires et aux images vidéo. Bien que très spectaculaire pour le téléspectateur, une analyse vidéo (telle qua la technologie SimulCam de Darfish) ne fournit que des informations qualitatives et partielles. L'utilisation de la technique GPS permet d'obtenir des informations quantitatives très précises de trajectoire couvrant l'intégrité de la course

Géoréférencement direct des images par GPS/INS Approche rigoureuse pour le calibrage des excentricités angulaires (boresight calibration)

Au cours de la dernière décennie, les systèmes de cartographie mobile utilisant GPS et INS pour la détermination directe des paramètres d'orientation (géoréférencement direct) sont devenus une alternative pertinente aux techniques s'appuyant sur le géoréférencement indirect

ON RAW INERTIAL MEASUREMENTS IN DYNAMIC NETWORKS

Dynamic Networks have been introduced in the literature to solve multi-sensor fusion problems for navigation and mapping. They have been shown to outperform conventional methods in challenging scenarios, such as corridor mapping or self-calibration. In this work we investigate the problem of how raw inertial readings can be fused with GNSS position observations in Dynamic Networks (DN) with the goal of i) limiting the number of unknowns in the estimation problem and ii) improving the conditioning of the normal equations arising in least-squares adjustments in the absence of spatial constraints (e.g., image observations). For that we propose a modified version of the well known IMU-preintegration method, accounting for a non-constant gravity model, the Earth rotation and the apparent Coriolis force, and we compare it with the conventional DN formulation in a emulated scenario. This consists of a fixed-wing UAV flying four times over a 2 km long corridor

HELIMAP: Rapid Large Scale Mapping Using Handheld LiDAR/CCD/GPS/INS Sensors on Helicopters.

The HELIMAP is a portable mapping system for quick helicopter deployment. It integrates high accuracy navigation sensors (GPS/INS) with Airborne Laser Scanner (ALS) and high-resolution digital (CCD) camera. This paper presents the system hardware and software components, system calibration and a road map from acquisition to mapping product

Security event recognition for visual surveillance

With rapidly increasing deployment of surveillance cameras, the reliable methods for automatically analyzing the surveillance video and recognizing special events are demanded by different practical applications. This paper proposes a novel effective framework for security event analysis in surveillance videos. First, convolutional neural network (CNN) framework is used to detect objects of interest in the given videos. Second, the owners of the objects are recognized and monitored in real-time as well. If anyone moves any object, this person will be verified whether he/she is its owner. If not, this event will be further analyzed and distinguished between two different scenes: moving the object away or stealing it. To validate the proposed approach, a new video dataset consisting of various scenarios is constructed for more complex tasks. For comparison purpose, the experiments are also carried out on the benchmark databases related to the task on abandoned luggage detection. The experimental results show that the proposed approach outperforms the state-of-the-art methods and effective in recognizing complex security events. © 2017 Copernicus GmbH. All rights reserved

SEARCHING LOST PEOPLE WITH UAVS: THE SYSTEM AND RESULTS OF THE CLOSE-SEARCH PROJECT

This paper will introduce the goals, concept and results of the project named CLOSE-SEARCH, which stands for ’Accurate and safe EGNOS-SoL Navigation for UAV-based low-cost Search-And-Rescue (SAR) operations’. The main goal is to integrate a medium-size, helicopter-type Unmanned Aerial Vehicle (UAV), a thermal imaging sensor and an EGNOS-based multi-sensor navigation system, including an Autonomous Integrity Monitoring (AIM) capability, to support search operations in difficult-to-access areas and/or night operations. The focus of the paper is three-fold. Firstly, the operational and technical challenges of the proposed approach are discussed, such as ultra-safe multi-sensor navigation system, the use of combined thermal and optical vision (infrared plus visible) for person recognition and Beyond-Line-Of-Sight communications among others. Secondly, the implementation of the integrity concept for UAV platforms is discussed herein through the AIM approach. Based on the potential of the geodetic quality analysis and on the use of the European EGNOS system as a navigation performance starting point, AIM approaches integrity from the precision standpoint; that is, the derivation of Horizontal and Vertical Protection Levels (HPLs, VPLs) from a realistic precision estimation of the position parameters is performed and compared to predefined Alert Limits (ALs). Finally, some results from the project test campaigns are described to report on particular project achievements. Together with actual Search-and-Rescue teams, the system was operated in realistic, user-chosen test scenarios. In this context, and specially focusing on the EGNOS-based UAV navigation, the AIM capability and also the RGB/thermal imaging subsystem, a summary of the 1 INTRODUCTION The use of Unmanned Aerial Vehicles (UAVs) —more in gen- eral, Unmanned Aerial Systems (UASs)— for SAR operations is not new and has been traditionally fed by developments made in other fields. The main driver of UAV technology has been (and still is) the military field and this is because the nature of military developments is fairly overlapping SAR needs. As a example of that, we recall the UAVs used in the Iraq and Afghanistan wars were deployed to find people trapped in New Orleans buildings devastated by Hurricane Katrinas flood waters. Those platforms were equipped with thermal imaging systems to detect the body heat of storm survivors. A second example was the use of rotary- wing UAV platforms providing on-site imagery from the nuclear incident in Fukushima. More recently, a field that is increasingly putting effort on UAV development is Geomatics: the potential of those light-weight, easy-deployable platforms to quickly provide aerial and/or ground, good quality imagery is huge. A clear ex- ample of this interest raised within the geomatic community is the recent acquisition of Gateway, a provider of lightweight UAVs for photogrammetry and rapid terrain mapping applications, by Trimble. Indeed, the multi-application of the UAV potential to other fields, such as SAR, shall not be neglected. And even if [the lack of] regulations have been the stopper of the final jump to commercial applications, the willingness of regulators seems finally positive on pulling the trigger. As stated in the Institute of Navigation newsletter in winter 2011, ”the United States trans- portation secretary must develop a comprehensive plan to safely accelerate the integration of civil UAS into the national airspace system as soon as practicable, but not later than September 30th, 2015.” results is presented