Multi-environment Georeferencing of RGB-D Panoramic Images from Portable Mobile Mapping – a Perspective for Infrastructure Management

Hochaufgelöste, genau georeferenzierte RGB-D-Bilder sind die Grundlage für 3D-Bildräume bzw. 3D Street-View-Webdienste, welche bereits kommerziell für das Infrastrukturmanagement eingesetzt werden. MMS ermöglichen eine schnelle und effiziente Datenerfassung von Infrastrukturen. Die meisten im Aussenraum eingesetzten MMS beruhen auf direkter Georeferenzierung. Diese ermöglicht in offenen Bereichen absolute Genauigkeiten im Zentimeterbereich. Bei GNSS-Abschattung fällt die Genauigkeit der direkten Georeferenzierung jedoch schnell in den Dezimeter- oder sogar in den Meterbereich. In Innenräumen eingesetzte MMS basieren hingegen meist auf SLAM. Die meisten SLAM-Algorithmen wurden jedoch für niedrige Latenzzeiten und für Echtzeitleistung optimiert und nehmen daher Abstriche bei der Genauigkeit, der Kartenqualität und der maximalen Ausdehnung in Kauf. Das Ziel dieser Arbeit ist, hochaufgelöste RGB-D-Bilder in verschiedenen Umgebungen zu erfassen und diese genau und zuverlässig zu georeferenzieren. Für die Datenerfassung wurde ein leistungsstarkes, bildfokussiertes und rucksackgetragenes MMS entwickelt. Dieses besteht aus einer Mehrkopf-Panoramakamera, zwei Multi-Beam LiDAR-Scannern und einer GNSS- und IMU-kombinierten Navigationseinheit der taktischen Leistungsklasse. Alle Sensoren sind präzise synchronisiert und ermöglichen Zugriff auf die Rohdaten. Das Gesamtsystem wurde in Testfeldern mit bündelblockbasierten sowie merkmalsbasierten Methoden kalibriert, was eine Voraussetzung für die Integration kinematischer Sensordaten darstellt. Für eine genaue und zuverlässige Georeferenzierung in verschiedenen Umgebungen wurde ein mehrstufiger Georeferenzierungsansatz entwickelt, welcher verschiedene Sensordaten und Georeferenzierungsmethoden vereint. Direkte und LiDAR SLAM-basierte Georeferenzierung liefern Initialposen für die nachträgliche bildbasierte Georeferenzierung mittels erweiterter SfM-Pipeline. Die bildbasierte Georeferenzierung führt zu einer präzisen aber spärlichen Trajektorie, welche sich für die Georeferenzierung von Bildern eignet. Um eine dichte Trajektorie zu erhalten, die sich auch für die Georeferenzierung von LiDAR-Daten eignet, wurde die direkte Georeferenzierung mit Posen der bildbasierten Georeferenzierung gestützt. Umfassende Leistungsuntersuchungen in drei weiträumigen anspruchsvollen Testgebieten zeigen die Möglichkeiten und Grenzen unseres Georeferenzierungsansatzes. Die drei Testgebiete im Stadtzentrum, im Wald und im Gebäude repräsentieren reale Bedingungen mit eingeschränktem GNSS-Empfang, schlechter Beleuchtung, sich bewegenden Objekten und sich wiederholenden geometrischen Mustern. Die bildbasierte Georeferenzierung erzielte die besten Genauigkeiten, wobei die mittlere Präzision im Bereich von 5 mm bis 7 mm lag. Die absolute Genauigkeit betrug 85 mm bis 131 mm, was einer Verbesserung um Faktor 2 bis 7 gegenüber der direkten und LiDAR SLAM-basierten Georeferenzierung entspricht. Die direkte Georeferenzierung mit CUPT-Stützung von Bildposen der bildbasierten Georeferenzierung, führte zu einer leicht verschlechterten mittleren Präzision im Bereich von 13 mm bis 16 mm, wobei sich die mittlere absolute Genauigkeit nicht signifikant von der bildbasierten Georeferenzierung unterschied. Die in herausfordernden Umgebungen erzielten Genauigkeiten bestätigen frühere Untersuchungen unter optimalen Bedingungen und liegen in derselben Grössenordnung wie die Resultate anderer Forschungsgruppen. Sie können für die Erstellung von Street-View-Services in herausfordernden Umgebungen für das Infrastrukturmanagement verwendet werden. Genau und zuverlässig georeferenzierte RGB-D-Bilder haben ein grosses Potenzial für zukünftige visuelle Lokalisierungs- und AR-Anwendungen

Mobile Panoramic Mapping using CCD-Line Camera and Laser Scanner

The fusion of panoramic camera data with laser scanner data is a new approach and allows the combination of high-resolution image and depth data. Application areas are city modelling, virtual reality and documentation of the cultural heritage. Panoramic recording of image data is realized by a CCD-line, which is precisely rotated around the projection centre. In the case of other possible movements, the actual position of the projection centre and the view direction has to be measured. Linear moving panoramas e.g. along a wall are an interesting extension of such rotational panoramas. Here, the instantaneous position and orientation determination can be realized with an integrated navigation system comprising differential GPS and an inertial measurement unit. This paper investigates the combination of a panoramic camera and a laser scanner with a navigation system for indoor and outdoor applications. First it will be reported about laboratory experiments, which were carried out to obtain valid parameters about the surveying accuracy achievable with both sensors panoramic camera and laser scanner respectively. Then out door surveying results using a position and orientation system as navigation sensor will be presented and discussed

Challenging multi-sensor data models and use of 360 images. The Twelve Months Fountain of Valentino park in Turin

The cultural heritage and the ways in which it is today studied and analysed as well as disseminated and enhanced for the purposes of conservation, requires high attention in the choice of 3D survey and modelling methods. This manuscript investigates the possible integrations and fusion of methods and data, among the vast availability of image and range based systems, especially in the sphere of low cost techniques, which in the context of heritage documentation makes the whole and complex process of conservation more sustainable. The investigation is carried out on a historical fountain that includes a quantity of cultural values and the need to document its context: its location in the historical Valentino of Turin park, its architectural values and the geometry of the complex typically related to the tastes of the late XIX century that consist in the extreme refinement of the statuary complexes and the underground portion with the technological equipment for the activation of the water games. Basically, it will be possible to appreciate solved issues and permanent criticalities derived from the integration of close range and UAV photogrammetry techniques in addition to the LiDAR survey, both classic from a fixed position, and in the portable scanner mode, based on SLAM technology

Geomatics and Forensic: Progress and Challenges

Since graphics hold qualitative and quantitative information of complex crime scenes, it becomes a basic key to develop hypothesis in police investigations and also to prove these hypotheses in court. Forensic analysis involves tasks of scene information mining as well as its reconstruction in order to extract elements for explanatory police test or to show forensic evidence in legal proceedings. Currently, the combination of sensors and technologies allows the integration of spatial data and the generation of virtual infographic products (orthoimages, solid images, point clouds, cross‐sections, etc.) which are extremely attractive. These products, which successfully retain accurate 3D metric information, are revolutionizing dimensional reconstruction of objects and crime scenes. Thus, it can be said that the reconstruction and 3D visualization of complex scenes are one of the main challenges for the international scientific community. To overcome this challenge, techniques related with computer vision, computer graphics and geomatics work closely. This chapter reviews a set of geomatic techniques, applied to improve infographic forensic products, and its evolution. The integration of data from different sensors whose final purpose is 3D accurate modelling is also described. As we move into a highly active research area, where there are still many uncertainties to be resolved, the final section addresses these challenges and outlines future perspectives

2D-based indoor mobile laser scanning for construction digital mapping application

A common issue which occurs often in construction projects is how to determine the discrepancies between as-built or existing constructions and initial design. Physical manual measurement usually brings many of problems such as long measuring time, high labor consumption, and measurement error accumulation and in some cases lower accuracy. Therefore, more advanced technologies such as laser scanning and total station, which are used in geospatial mapping and surveying have been adopted in order to provide much more reliable and accurate measurements. However, technical and financial issues still constrain the widespread applications of well-known 3-dimensional (3D) terrestrial and aerial laser scanning, such as high equipment cost, complex pre-preparation, inconvenience of use and spatial limitation. This paper aims to introduce an innovative laser scanning method for indoor construction mapping. This method integrates an IMU-GPS positioning approach with a more convenient, more time saving and lower costed 2-dimensional (2D) laser scanner to realize indoor mobile 3D mapping for construction model creation, which can be integrated with Building Information Modelling (BIM) design in order to realize the applications, such as quality control of as-built construction or indoor mapping of existing building. Although compared with traditional 3D laser scanning, its accuracy and reliability cannot reach such a high level currently, experimental results still indicate feasibility, reliability and potential capability of this indoor mobile laser scanning method. It is hoped that this method will be further improved to substitute the stationary 3D laser scanning for narrow and limited construction spatial mapping in the near future

Performance Investigation and Repeatability Assessment of a Mobile Robotic System for 3D Mapping

In this paper, we present a quantitative performance investigation and repeatability assessment of a mobile robotic system for 3D mapping. With the aim of a more efficient and automatic data acquisition process with respect to well-established manual topographic operations, a 3D laser scanner coupled with an inertial measurement unit is installed on a mobile platform and used to perform a high-resolution mapping of the surrounding environment. Point clouds obtained with the use of a mobile robot are compared with those acquired with the device carried manually as well as with a terrestrial laser scanner survey that serves as a ground truth. Experimental results show that both mapping modes provide similar accuracy and repeatability, whereas the robotic system compares favorably with respect to the handheld modality in terms of noise level and point distribution. The outcomes demonstrate the feasibility of the mobile robotic platform as a promising technology for automatic and accurate 3D mapping

04251 -- Imaging Beyond the Pinhole Camera

From 13.06.04 to 18.06.04, the Dagstuhl Seminar 04251 ``Imaging Beyond the Pin-hole Camera. 12th Seminar on Theoretical Foundations of Computer Vision\u27\u27 was held in the International Conference and Research Center (IBFI), Schloss Dagstuhl. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper. The first section describes the seminar topics and goals in general. Links to extended abstracts or full papers are provided, if available