Evaluation of automatic building detection approaches combining high resolution images and LiDAR data

In this paper, two main approaches for automatic building detection and localization using high spatial resolution imagery and LiDAR data are compared and evaluated: thresholding-based and object-based classification. The thresholding-based approach is founded on the establishment of two threshold values: one refers to the minimum height to be considered as building, defined using the LiDAR data, and the other refers to the presence of vegetation, which is defined according to the spectral response. The other approach follows the standard scheme of object-based image classification: segmentation, feature extraction and selection, and classification, here performed using decision trees. In addition, the effect of the inclusion in the building detection process of contextual relations with the shadows is evaluated. Quality assessment is performed at two different levels: area and object. Area-level evaluates the building delineation performance, whereas object-level assesses the accuracy in the spatial location of individual buildings. The results obtained show a high efficiency of the evaluated methods for building detection techniques, in particular the thresholding-based approach, when the parameters are properly adjusted and adapted to the type of urban landscape considered. © 2011 by the authors.The authors appreciate the financial support provided by the Spanish Ministry of Science and Innovation and FEDER in the framework of the projects CGL2009-14220 and CGL2010-19591/BTE, and the support of the Spanish Instituto Geografico Nacional (IGN).Hermosilla, T.; Ruiz Fernández, LÁ.; Recio Recio, JA.; Estornell Cremades, J. (2011). Evaluation of automatic building detection approaches combining high resolution images and LiDAR data. Remote Sensing. 3:1188-1210. https://doi.org/10.3390/rs3061188S118812103Mayer, H. (1999). Automatic Object Extraction from Aerial Imagery—A Survey Focusing on Buildings. Computer Vision and Image Understanding, 74(2), 138-149. doi:10.1006/cviu.1999.0750Kim, T., & Muller, J.-P. (1999). Development of a graph-based approach for building detection. Image and Vision Computing, 17(1), 3-14. doi:10.1016/s0262-8856(98)00092-4Irvin, R. B., & McKeown, D. M. (1989). Methods for exploiting the relationship between buildings and their shadows in aerial imagery. IEEE Transactions on Systems, Man, and Cybernetics, 19(6), 1564-1575. doi:10.1109/21.44071Lin, C., & Nevatia, R. (1998). Building Detection and Description from a Single Intensity Image. Computer Vision and Image Understanding, 72(2), 101-121. doi:10.1006/cviu.1998.0724Katartzis, A., & Sahli, H. (2008). A Stochastic Framework for the Identification of Building Rooftops Using a Single Remote Sensing Image. IEEE Transactions on Geoscience and Remote Sensing, 46(1), 259-271. doi:10.1109/tgrs.2007.904953Lee, D. S., Shan, J., & Bethel, J. S. (2003). Class-Guided Building Extraction from Ikonos Imagery. Photogrammetric Engineering & Remote Sensing, 69(2), 143-150. doi:10.14358/pers.69.2.143STASSOPOULOU, A., & CAELLI, T. (2000). BUILDING DETECTION USING BAYESIAN NETWORKS. International Journal of Pattern Recognition and Artificial Intelligence, 14(06), 715-733. doi:10.1142/s0218001400000477Jin, X., & Davis, C. H. (2005). Automated Building Extraction from High-Resolution Satellite Imagery in Urban Areas Using Structural, Contextual, and Spectral Information. EURASIP Journal on Advances in Signal Processing, 2005(14). doi:10.1155/asp.2005.2196Kim, Z., & Nevatia, R. (1999). Uncertain Reasoning and Learning for Feature Grouping. Computer Vision and Image Understanding, 76(3), 278-288. doi:10.1006/cviu.1999.0803Dare, P. M. (2005). Shadow Analysis in High-Resolution Satellite Imagery of Urban Areas. Photogrammetric Engineering & Remote Sensing, 71(2), 169-177. doi:10.14358/pers.71.2.169Weidner, U., & Förstner, W. (1995). Towards automatic building extraction from high-resolution digital elevation models. ISPRS Journal of Photogrammetry and Remote Sensing, 50(4), 38-49. doi:10.1016/0924-2716(95)98236-sCord, M., & Declercq, D. (2001). Three-dimensional building detection and modeling using a statistical approach. IEEE Transactions on Image Processing, 10(5), 715-723. doi:10.1109/83.918565Ma, R. (2005). DEM Generation and Building Detection from Lidar Data. Photogrammetric Engineering & Remote Sensing, 71(7), 847-854. doi:10.14358/pers.71.7.847Miliaresis, G., & Kokkas, N. (2007). Segmentation and object-based classification for the extraction of the building class from LIDAR DEMs. Computers & Geosciences, 33(8), 1076-1087. doi:10.1016/j.cageo.2006.11.012Zhang, K., Yan, J., & Chen, S.-C. (2006). Automatic Construction of Building Footprints From Airborne LIDAR Data. IEEE Transactions on Geoscience and Remote Sensing, 44(9), 2523-2533. doi:10.1109/tgrs.2006.874137Lafarge, F., Descombes, X., Zerubia, J., & Pierrot-Deseilligny, M. (2008). Automatic building extraction from DEMs using an object approach and application to the 3D-city modeling. ISPRS Journal of Photogrammetry and Remote Sensing, 63(3), 365-381. doi:10.1016/j.isprsjprs.2007.09.003Yu, B., Liu, H., Wu, J., Hu, Y., & Zhang, L. (2010). Automated derivation of urban building density information using airborne LiDAR data and object-based method. Landscape and Urban Planning, 98(3-4), 210-219. doi:10.1016/j.landurbplan.2010.08.004Paparoditis, N., Cord, M., Jordan, M., & Cocquerez, J.-P. (1998). Building Detection and Reconstruction from Mid- and High-Resolution Aerial Imagery. Computer Vision and Image Understanding, 72(2), 122-142. doi:10.1006/cviu.1998.0722Estornell, J., Ruiz, L. A., Velázquez-Martí, B., & Hermosilla, T. (2011). Analysis of the factors affecting LiDAR DTM accuracy in a steep shrub area. International Journal of Digital Earth, 4(6), 521-538. doi:10.1080/17538947.2010.533201Ruiz, L. A., Recio, J. A., Fernández-Sarría, A., & Hermosilla, T. (2011). A feature extraction software tool for agricultural object-based image analysis. Computers and Electronics in Agriculture, 76(2), 284-296. doi:10.1016/j.compag.2011.02.007Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973). Textural Features for Image Classification. IEEE Transactions on Systems, Man, and Cybernetics, SMC-3(6), 610-621. doi:10.1109/tsmc.1973.4309314Sutton, R. N., & Hall, E. L. (1972). Texture Measures for Automatic Classification of Pulmonary Disease. IEEE Transactions on Computers, C-21(7), 667-676. doi:10.1109/t-c.1972.223572Freund, Y. (1995). Boosting a Weak Learning Algorithm by Majority. Information and Computation, 121(2), 256-285. doi:10.1006/inco.1995.1136Shufelt, J. A. (1999). Performance evaluation and analysis of monocular building extraction from aerial imagery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(4), 311-326. doi:10.1109/34.761262Shan, J., & Lee, S. D. (2005). Quality of Building Extraction from IKONOS Imagery. Journal of Surveying Engineering, 131(1), 27-32. doi:10.1061/(asce)0733-9453(2005)131:1(27