OBLIQUE MULTI-CAMERA SYSTEMS - ORIENTATION AND DENSE MATCHING ISSUES

International audience3D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy <rupnik, franex, remondino>@fbk.eu, http://3dom.fbk.eu Commission III-WG4 ABS TRACT: The use of oblique imagery has become a standard for many civil and mapping applications, thanks to the development of airborne digital multi-camera systems, as proposed by many companies (Blomoblique, IGI, Leica, M idas, Pictometry, Vexcel/M icrosoft, VisionM ap, etc.). The indisputable virtue of oblique photography lies in its simplicity of interpretation and understanding for inexperienced users allowing their use of oblique images in very different applications, such as building detection and reconstruction, building structural damage classification, road land updating and administration services, etc. The paper reports an overview of the actual oblique commercial systems and presents a workflow for the automated orientation and dense matching of large image blocks. Perspectives, potentialities, pitfalls and suggestions for achieving satisfactory results are given. Tests performed on two datasets acquired with two multi-camera systems over urban areas are also reported. Figure 1: Large urban area pictured with an oblique multi-camera system. Once advanced image triangulation methods have retrieved interior and exterior parameters of the cameras, dense point clouds can be deriv ed for 3D city modelling, feature extraction and mapping purposes

Hybrid adjustment of UAS-based LiDAR and image data

Several advancements are going with Unmanned Aerial Systems (UAS) with the addition of multiple sensors and simultaneous data acquisition to obtain detailed geo-data for various applications. However, simultaneous data acquisition with multiple sensors, namely camera, and LiDAR, will also result in possible discrepancies associated with them, and they need to be solved to use a reliable and accurate final product. Several errors can be associated with both camera and LiDAR datasets due to the different characteristics of the sensors and terrain conditions. This research paper aimed to minimize the errors between LiDAR and the image datasets simultaneously acquired with an Unmanned Aerial System (UAS) by implementing a hybrid adjustment approach with a criterion for the roughness and threshold angle between surface normals. The initial trajectory of the UAS, raw LiDAR measurements, and image observations were the inputs used for the hybrid adjustment. The hybrid adjustment workflow minimizes the discrepancies with a least-squares-based simultaneous adjustment for both LiDAR and image datasets. For the hybrid adjustment process, three types of correspondences were established, namely: between image pairs, overlapping LiDAR strips, and between Image tie points and LiDAR strips. For quality control, mean Cloud-to-Cloud distances (C2C) were compared between both LiDAR and camera point clouds before and after hybrid adjustment. The surface-level analysis of the results was also carried out to analyze the errors before and after hybrid adjustment at a surface level for different types of surfaces. The results showed that the alignment between the point clouds has significantly improved from the range of meters to a centimeter-level after implementing the hybrid adjustment process. The proposed hybrid adjustment workflow can be used in mapping applications where a centimeter-level accuracy is requested

ICEPY4D: A PYTHON TOOLKIT FOR ADVANCED MULTI-EPOCH GLACIER MONITORING WITH DEEP-LEARNING PHOTOGRAMMETRY

Glacier monitoring plays a crucial role in understanding the impacts of climate change on these dynamic natural systems. One or more time-lapse cameras are often employed to acquire short-term observations of glacier flow dynamics. However, the lack of multi-camera photogrammetric software packages for multi-temporal 3D scene reconstruction, especially in case of wide camera baselines, hinders the application of Structure-from-Motion techniques to these scenarios. To address this, we present ICEpy4D, a novel Python toolkit designed for 4D monitoring of alpine glaciers using low-cost time-lapse cameras and state-of-the-art computer vision techniques. ICEpy4D leverages deep-learning-based matching algorithms to solve 3D reconstruction with wide camera baselines, making it well-suited for challenging scenarios encountered in mountainous regions. The toolkit offers comprehensive functionalities for multi-epoch monitoring, enabling short-term glacier 3D reconstruction and extraction of relevant information from time-series point clouds, such as volume variations and glacier retreat. In a pilot study on the Belvedere Glacier northern snout (Italian Alps), ICEpy4D estimated glacier volume loss of 63 × 103 m3 of ice and ∼17.5m of retreat. Results showcased the toolkit’s potential for analyzing a glacier ice cliff, with prospects for application to other glaciers with varying characteristics. ICEpy4D is actively being developed as an open-source project at github.com/labmgf-polimi/icepy4d/, promoting ease of extension and customization

Integration of range and image data for building reconstruction

The extraction of information from image and range data is one of the main research topics. In literature, several papers dealing with this topic has been already presented. In particular, several authors have suggested an integrated use of both range and image information in order to increase the reliability and the completeness of the results exploiting their complementary nature. In this paper, an integration between range and image data for the geometric reconstruction of man-made object is presented. The focus is on the edge extraction procedure performed in an integrated way exploiting both the from range and image data. Both terrestrial and aerial applications have been analysed for the faade extraction in terrestrial acquisitions and the roof outline extraction from aerial data. The algorithm and the achieved results will be described and discussed in detail

Oblique Aerial Photography Tool for Building Inspection and Damage Assessment

Aerial photography has a long history of being employed for mapping purposes due to some of its main advantages, including large area imaging from above and minimization of field work. Since few years multi-camera aerial systems are becoming a practical sensor technology across a growing geospatial market, as complementary to the traditional vertical views. Multi-camera aerial systems capture not only the conventional nadir views, but also tilted images at the same time. In this paper, a particular use of such imagery in the field of building inspection as well as disaster assessment is addressed. The main idea is to inspect a building from four cardinal directions by using monoplotting functionalities. The developed application allows to measure building height and distances and to digitize man-made structures, creating 3D surfaces and building models. The realized GUI is capable of identifying a building from several oblique points of views, as well as calculates the approximate height of buildings, ground distances and basic vectorization. The geometric accuracy of the results remains a function of several parameters, namely image resolution, quality of available parameters (DEM, calibration and orientation values), user expertise and measuring capability

Microdrone-Based Indoor Mapping with Graph SLAM

Unmanned aerial vehicles offer a safe and fast approach to the production of three-dimensional spatial data on the surrounding space. In this article, we present a low-cost SLAM-based drone for creating exploration maps of building interiors. The focus is on emergency response mapping in inaccessible or potentially dangerous places. For this purpose, we used a quadcopter microdrone equipped with six laser rangefinders (1D scanners) and an optical sensor for mapping and positioning. The employed SLAM is designed to map indoor spaces with planar structures through graph optimization. It performs loop-closure detection and correction to recognize previously visited places, and to correct the accumulated drift over time. The proposed methodology was validated for several indoor environments. We investigated the performance of our drone against a multilayer LiDAR-carrying macrodrone, a vision-aided navigation helmet, and ground truth obtained with a terrestrial laser scanner. The experimental results indicate that our SLAM system is capable of creating quality exploration maps of small indoor spaces, and handling the loop-closure problem. The accumulated drift without loop closure was on average 1.1% (0.35 m) over a 31-m-long acquisition trajectory. Moreover, the comparison results demonstrated that our flying microdrone provided a comparable performance to the multilayer LiDAR-based macrodrone, given the low deviation between the point clouds built by both drones. Approximately 85 % of the cloud-to-cloud distances were less than 10 cm