Context-based urban terrain reconstruction from uav-videos for geoinformation applications

Urban terrain reconstruction has many applications in areas of civil engineering, urban planning, surveillance and defense research. Therefore the needs of covering ad-hoc demand and performing a close-range urban terrain reconstruction with miniaturized and relatively inexpensive sensor platforms are constantly growing. Using (miniaturized) unmanned aerial vehicles, (M) UAVs, represents one of the most attractive alternatives to conventional large-scale aerial imagery. We cover in this paper a four-step procedure of obtaining georeferenced 3D urban models from video sequences. The four steps of the procedure - orientation, dense reconstruction, urban terrain modeling and geo-referencing - are robust, straight-forward, and nearly fully-automatic. The two last steps - namely, urban terrain modeling from almost-nadir videos and co-registration of models - represent the main contribution of this work and will therefore be covered with more detail. The essential substeps of the third step include digital terrain model (DTM) extraction, segregation of buildings from vegetation, as well as instantiation of building and tree models. The last step is subdivided into quasi-intrasensorial registration of Euclidean reconstructions and intersensorial registration with a geo-referenced orthophoto. Finally, we present reconstruction results from a real data-set and outline ideas for future work

Earth observation for sustainable urban planning in developing countries: needs, trends, and future directions

Abstract: Cities are constantly changing and authorities face immense challenges in obtaining accurate and timely data to effectively manage urban areas. This is particularly problematic in the developing world where municipal records are often unavailable or not updated. Spaceborne earth observation (EO) has great potential for providing up-to-date spatial information about urban areas. This article reviews the application of EO for supporting urban planning. In particular, the article overviews case studies where EO was used to derive products and indicators required by urban planners. The review concludes that EO has sufficiently matured in recent years but that a shift from the current focus on purely science-driven EO applications to the provision of useful information for day-to-day decision-making and urban sustainability monitoring is clearly needed

Improved UAV-borne 3D mapping by fusing optical and laserscanner data

In this paper, a new method for fusing optical and laserscanner data is presented for improved UAV-borne 3D mapping. We propose to equip an unmanned aerial vehicle (UAV) with a small platform which includes two sensors: a standard low-cost digital camera and a lightweight Hokuyo UTM-30LX-EW laserscanning device (210 g without cable). Initially, a calibration is carried out for the utilized devices. This involves a geometric camera calibration and the estimation of the position and orientation offset between the two sensors by lever-arm and bore-sight calibration. Subsequently, a feature tracking is performed through the image sequence by considering extracted interest points as well as the projected 3D laser points. These 2D results are fused with the measured laser distances and fed into a bundle adjustment in order to obtain a Simultaneous Localization and Mapping (SLAM). It is demonstrated that an improvement in terms of precision for the pose estimation is derived by fusing optical and laserscanner data

Automatic reconstruction of three-dimensional building models from dense image matching datasets

PhD ThesisThe generation of three-dimensional (3D) building models without roof geometry is currently easily automated using a building footprint and single height value. The automatic reconstruction of roof structures, however, remains challenging because of the complexity and variability in building geometry. Attempts from imagery have utilised high spatial resolution but have only reconstructed simple geometry. This research addresses the complexity of roof geometry reconstruction by developing an approach, which focuses on the extraction of corners to reconstruct 3D buildings as boundary representation models, to try overcome the limitations of planar fitting procedures, which are currently favoured. Roof geometry information was extracted from surface models, true orthophotos and photogrammetric point clouds; reconstructed at the same spatial resolution of the captured aerial imagery, with developments in pixel-to-pixel matching. Edges of roof planes were extracted by the Canny edge detector, and then refined with a workflow based on the principles of scan-line segmentation to remove false positive detection. Line tracing procedures defined the corner positions of the extracted edges. A connectivity ruleset was developed, which searches around the endpoints of unconnected lines, testing for potential connecting corners. All unconnected lines were then removed reconstruct 3D models as a closed network of connecting roof corners. Building models have been reconstructed both as block models and also with roof structures. The methodology was tested on data of Newcastle upon Tyne, United Kingdom, with results showing corner extraction success at 75% and to within a planimetric accuracy of ±0.5 m. The methodology was then tested on data of Vaihingen, Germany, which forms part of the ISPRS 3D reconstruction benchmark. This allowed direct comparisons to be made with other methods. The results from both study areas showed similar planimetric accuracy of extracted corners. However, both sites were not as successful in the reconstruction of roof planes.Ordnance Surve

CONTEXT-BASED URBAN TERRAIN RECONSTRUCTION FROM IMAGES AND VIDEOS

Detection of buildings and vegetation, and even more reconstruction of urban terrain from sequences of aerial images and videos is known to be a challenging task. It has been established that those methods that have as input a high-quality Digital Surface Model (DSM), are more straight-forward and produce more robust and reliable results than those image-based methods that require matching line segments or even whole regions. This motivated us to develop a new dense matching technique for DSM generation that is capable of simultaneous integration of multiple images in the reconstruction process. The DSMs generated by this new multi-image matching technique can be used for urban object extraction. In the first contribution of this paper, two examples of external sources of information added to the reconstruction pipeline will be shown. The GIS layers are used for recognition of streets and suppressing false alarms in the depth maps that were caused by moving vehicles while the near infrared channel is applied for separating vegetation from buildings. Three examples of data sets including both UAV-borne video sequences with a relatively high number of frames and high-resolution (10 cm ground sample distance) data sets consisting of (few spatial-temporarily diverse) images from large-format aerial frame cameras, will be presented. By an extensive quantitative evaluation of the Vaihingen block from the ISPRS benchmark on urban object detection, it will become clear that our procedure allows a straight-forward, efficient, and reliable instantiation of 3D city models

Very fast road database verification using textured 3D city models obtained from airborne imagery

Road databases are known to be an important part of any geodata infrastructure, e.g. as the basis for urban planning or emergency services. Updating road databases for crisis events must be performed quickly and with the highest possible degree of automation. We present a semi-automatic algorithm for road verification using textured 3D city models, starting from aerial or even UAV-images. This algorithm contains two processes, which exchange input and output, but basically run independently from each other. These processes are textured urban terrain reconstruction and road verification. The first process contains a dense photogrammetric reconstruction of 3D geometry of the scene using depth maps. The second process is our core procedure, since it contains various methods for road verification. Each method re-presents a unique road model and a specific strategy, and thus is able to deal with a specific type of roads. Each method is designed to provide two probability distributions, where the first describes the state of a road object (correct, incorrect), and the second describes the state of its underlying road model (applicable, not applicable). Based on the Dempster-Shafer Theory, both distributions are mapped to a single distribution that refers to three states: correct, incorrect, and unknown. With respect to the interaction of both processes, the normalized elevation map and the digital orthophoto generated during 3D reconstruction are the necessary input - together with initial road database entries - for the road verification process. If the entries of the database are too obsolete or not available at all, sensor data evaluation enables classification of the road pixels of the elevation map followed by road map extraction by means of vectorization and filtering of the geometrically and topologically inconsistent objects. Depending on the time issue and availability of a geo-database for buildings, the urban terrain reconstruction procedure has semantic models of buildings, trees, and ground as output. Building s and ground are textured by means of available images. This facilitates the orientation in the model and the interactive verification of the road objects that where initially classified as unknown. The three main modules of the texturing algorithm are: Pose estimation (if the videos are not geo-referenced), occlusion analysis, and texture synthesis