Evaluation of automatic building detection approaches combining high resolution images and LiDAR data

In this paper, two main approaches for automatic building detection and localization using high spatial resolution imagery and LiDAR data are compared and evaluated: thresholding-based and object-based classification. The thresholding-based approach is founded on the establishment of two threshold values: one refers to the minimum height to be considered as building, defined using the LiDAR data, and the other refers to the presence of vegetation, which is defined according to the spectral response. The other approach follows the standard scheme of object-based image classification: segmentation, feature extraction and selection, and classification, here performed using decision trees. In addition, the effect of the inclusion in the building detection process of contextual relations with the shadows is evaluated. Quality assessment is performed at two different levels: area and object. Area-level evaluates the building delineation performance, whereas object-level assesses the accuracy in the spatial location of individual buildings. The results obtained show a high efficiency of the evaluated methods for building detection techniques, in particular the thresholding-based approach, when the parameters are properly adjusted and adapted to the type of urban landscape considered. © 2011 by the authors.The authors appreciate the financial support provided by the Spanish Ministry of Science and Innovation and FEDER in the framework of the projects CGL2009-14220 and CGL2010-19591/BTE, and the support of the Spanish Instituto Geografico Nacional (IGN).Hermosilla, T.; Ruiz Fernández, LÁ.; Recio Recio, JA.; Estornell Cremades, J. (2011). Evaluation of automatic building detection approaches combining high resolution images and LiDAR data. Remote Sensing. 3:1188-1210. https://doi.org/10.3390/rs3061188S118812103Mayer, H. (1999). Automatic Object Extraction from Aerial Imagery—A Survey Focusing on Buildings. Computer Vision and Image Understanding, 74(2), 138-149. doi:10.1006/cviu.1999.0750Kim, T., & Muller, J.-P. (1999). Development of a graph-based approach for building detection. Image and Vision Computing, 17(1), 3-14. doi:10.1016/s0262-8856(98)00092-4Irvin, R. B., & McKeown, D. M. (1989). Methods for exploiting the relationship between buildings and their shadows in aerial imagery. IEEE Transactions on Systems, Man, and Cybernetics, 19(6), 1564-1575. doi:10.1109/21.44071Lin, C., & Nevatia, R. (1998). Building Detection and Description from a Single Intensity Image. Computer Vision and Image Understanding, 72(2), 101-121. doi:10.1006/cviu.1998.0724Katartzis, A., & Sahli, H. (2008). A Stochastic Framework for the Identification of Building Rooftops Using a Single Remote Sensing Image. IEEE Transactions on Geoscience and Remote Sensing, 46(1), 259-271. doi:10.1109/tgrs.2007.904953Lee, D. S., Shan, J., & Bethel, J. S. (2003). Class-Guided Building Extraction from Ikonos Imagery. Photogrammetric Engineering & Remote Sensing, 69(2), 143-150. doi:10.14358/pers.69.2.143STASSOPOULOU, A., & CAELLI, T. (2000). BUILDING DETECTION USING BAYESIAN NETWORKS. International Journal of Pattern Recognition and Artificial Intelligence, 14(06), 715-733. doi:10.1142/s0218001400000477Jin, X., & Davis, C. H. (2005). Automated Building Extraction from High-Resolution Satellite Imagery in Urban Areas Using Structural, Contextual, and Spectral Information. EURASIP Journal on Advances in Signal Processing, 2005(14). doi:10.1155/asp.2005.2196Kim, Z., & Nevatia, R. (1999). Uncertain Reasoning and Learning for Feature Grouping. Computer Vision and Image Understanding, 76(3), 278-288. doi:10.1006/cviu.1999.0803Dare, P. M. (2005). Shadow Analysis in High-Resolution Satellite Imagery of Urban Areas. Photogrammetric Engineering & Remote Sensing, 71(2), 169-177. doi:10.14358/pers.71.2.169Weidner, U., & Förstner, W. (1995). Towards automatic building extraction from high-resolution digital elevation models. ISPRS Journal of Photogrammetry and Remote Sensing, 50(4), 38-49. doi:10.1016/0924-2716(95)98236-sCord, M., & Declercq, D. (2001). Three-dimensional building detection and modeling using a statistical approach. IEEE Transactions on Image Processing, 10(5), 715-723. doi:10.1109/83.918565Ma, R. (2005). DEM Generation and Building Detection from Lidar Data. Photogrammetric Engineering & Remote Sensing, 71(7), 847-854. doi:10.14358/pers.71.7.847Miliaresis, G., & Kokkas, N. (2007). Segmentation and object-based classification for the extraction of the building class from LIDAR DEMs. Computers & Geosciences, 33(8), 1076-1087. doi:10.1016/j.cageo.2006.11.012Zhang, K., Yan, J., & Chen, S.-C. (2006). Automatic Construction of Building Footprints From Airborne LIDAR Data. IEEE Transactions on Geoscience and Remote Sensing, 44(9), 2523-2533. doi:10.1109/tgrs.2006.874137Lafarge, F., Descombes, X., Zerubia, J., & Pierrot-Deseilligny, M. (2008). Automatic building extraction from DEMs using an object approach and application to the 3D-city modeling. ISPRS Journal of Photogrammetry and Remote Sensing, 63(3), 365-381. doi:10.1016/j.isprsjprs.2007.09.003Yu, B., Liu, H., Wu, J., Hu, Y., & Zhang, L. (2010). Automated derivation of urban building density information using airborne LiDAR data and object-based method. Landscape and Urban Planning, 98(3-4), 210-219. doi:10.1016/j.landurbplan.2010.08.004Paparoditis, N., Cord, M., Jordan, M., & Cocquerez, J.-P. (1998). Building Detection and Reconstruction from Mid- and High-Resolution Aerial Imagery. Computer Vision and Image Understanding, 72(2), 122-142. doi:10.1006/cviu.1998.0722Estornell, J., Ruiz, L. A., Velázquez-Martí, B., & Hermosilla, T. (2011). Analysis of the factors affecting LiDAR DTM accuracy in a steep shrub area. International Journal of Digital Earth, 4(6), 521-538. doi:10.1080/17538947.2010.533201Ruiz, L. A., Recio, J. A., Fernández-Sarría, A., & Hermosilla, T. (2011). A feature extraction software tool for agricultural object-based image analysis. Computers and Electronics in Agriculture, 76(2), 284-296. doi:10.1016/j.compag.2011.02.007Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973). Textural Features for Image Classification. IEEE Transactions on Systems, Man, and Cybernetics, SMC-3(6), 610-621. doi:10.1109/tsmc.1973.4309314Sutton, R. N., & Hall, E. L. (1972). Texture Measures for Automatic Classification of Pulmonary Disease. IEEE Transactions on Computers, C-21(7), 667-676. doi:10.1109/t-c.1972.223572Freund, Y. (1995). Boosting a Weak Learning Algorithm by Majority. Information and Computation, 121(2), 256-285. doi:10.1006/inco.1995.1136Shufelt, J. A. (1999). Performance evaluation and analysis of monocular building extraction from aerial imagery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(4), 311-326. doi:10.1109/34.761262Shan, J., & Lee, S. D. (2005). Quality of Building Extraction from IKONOS Imagery. Journal of Surveying Engineering, 131(1), 27-32. doi:10.1061/(asce)0733-9453(2005)131:1(27

Enhancment of dense urban digital surface models from VHR optical satellite stereo data by pre-segmentation and object detection

The generation of digital surface models (DSM) of urban areas from very high resolution (VHR) stereo satellite imagery requires advanced methods. In the classical approach of DSM generation from stereo satellite imagery, interest points are extracted and correlated between the stereo mates using an area based matching followed by a least-squares sub-pixel refinement step. After a region growing the 3D point list is triangulated to the resulting DSM. In urban areas this approach fails due to the size of the correlation window, which smoothes out the usual steep edges of buildings. Also missing correlations as for partly – in one or both of the images – occluded areas will simply be interpolated in the triangulation step. So an urban DSM generated with the classical approach results in a very smooth DSM with missing steep walls, narrow streets and courtyards. To overcome these problems algorithms from computer vision are introduced and adopted to satellite imagery. These algorithms do not work using local optimisation like the area-based matching but try to optimize a (semi-)global cost function. Analysis shows that dynamic programming approaches based on epipolar images like dynamic line warping or semiglobal matching yield the best results according to accuracy and processing time. These algorithms can also detect occlusions – areas not visible in one or both of the stereo images. Beside these also the time and memory consuming step of handling and triangulating large point lists can be omitted due to the direct operation on epipolar images and direct generation of a so called disparity image fitting exactly on the first of the stereo images. This disparity image – representing already a sort of a dense DSM – contains the distances measured in pixels in the epipolar direction (or a no-data value for a detected occlusion) for each pixel in the image. Despite the global optimization of the cost function many outliers, mismatches and erroneously detected occlusions remain, especially if only one stereo pair is available. To enhance these dense DSM – the disparity image – a pre-segmentation approach is presented in this paper. Since the disparity image is fitting exactly on the first of the two stereo partners (beforehand transformed to epipolar geometry) a direct correlation between image pixels and derived heights (the disparities) exist. This feature of the disparity image is exploited to integrate additional knowledge from the image into the DSM. This is done by segmenting the stereo image, transferring the segmentation information to the DSM and performing a statistical analysis on each of the created DSM segments. Based on this analysis and spectral information a coarse object detection and classification can be performed and in turn the DSM can be enhanced. After the description of the proposed method some results are shown and discussed

Object-Based Greenhouse Classification from GeoEye-1 and WorldView-2 Stereo Imagery

Remote sensing technologies have been commonly used to perform greenhouse detection and mapping. In this research, stereo pairs acquired by very high-resolution optical satellites GeoEye-1 (GE1) and WorldView-2 (WV2) have been utilized to carry out the land cover classification of an agricultural area through an object-based image analysis approach, paying special attention to greenhouses extraction. The main novelty of this work lies in the joint use of single-source stereo-photogrammetrically derived heights and multispectral information from both panchromatic and pan-sharpened orthoimages. The main features tested in this research can be grouped into different categories, such as basic spectral information, elevation data (normalized digital surface model; nDSM), band indexes and ratios, texture and shape geometry. Furthermore, spectral information was based on both single orthoimages and multiangle orthoimages. The overall accuracy attained by applying nearest neighbor and support vector machine classifiers to the four multispectral bands of GE1 were very similar to those computed from WV2, for either four or eight multispectral bands. Height data, in the form of nDSM, were the most important feature for greenhouse classification. The best overall accuracy values were close to 90%, and they were not improved by using multiangle orthoimages

Airborne photogrammetry and LIDAR for DSM extraction and 3D change detection over an urban area : a comparative study

A digital surface model (DSM) extracted from stereoscopic aerial images, acquired in March 2000, is compared with a DSM derived from airborne light detection and ranging (lidar) data collected in July 2009. Three densely built-up study areas in the city centre of Ghent, Belgium, are selected, each covering approximately 0.4 km(2). The surface models, generated from the two different 3D acquisition methods, are compared qualitatively and quantitatively as to what extent they are suitable in modelling an urban environment, in particular for the 3D reconstruction of buildings. Then the data sets, which are acquired at two different epochs t(1) and t(2), are investigated as to what extent 3D (building) changes can be detected and modelled over the time interval. A difference model, generated by pixel-wise subtracting of both DSMs, indicates changes in elevation. Filters are proposed to differentiate 'real' building changes from false alarms provoked by model noise, outliers, vegetation, etc. A final 3D building change model maps all destructed and newly constructed buildings within the time interval t(2) - t(1). Based on the change model, the surface and volume of the building changes can be quantified