Abstract
Building detection from the satellite image is a computer vision, Photogrammetry, and remote sensing task that has significant importance in geographical information system (GIS) based applications. In this study, a novel framework is developed for the automatic detection of different types of buildings in the complex environment of the satellite images. The framework consists of fuzzy-based pre-segmentation, information extraction, and Grab-cut partitioning. The pre-segmentation and information extraction are employed to generate the initialization data for the Grab-cut method in an unsupervised manner. Further, the Grab-cut method partition the input image in building and non-building classes depending on the initialization data is provided. The performance of the proposed algorithm is evaluated over pan-sharpened satellite images having diverse built-up characteristics. The qualitative and quantitative assessments are conducted using standard statistical parameters. The proposed algorithm has achieved the average performance in terms of the F - score is 65%, and in terms of recall is 84%. Also, the proposed algorithm is compared with the existing state-of-the-art methods to illustrate the superiority and potential of the proposed algorithm over the existing ones.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aytekin O, Ulusoy I, Abacioglu EZ, Gokcay E (2009a) Building detection in high resolution remotely sensed images based on morphological operators. In: 2009. RAST ’09. 4th International Conference on Recent Advances in Space Technologies, pp 376–379. https://doi.org/10.1109/RAST.2009.5158228
Aytekin O, Ulusoy I, Erener A, Duzgun HSB (2009b) Automatic and unsupervised building extraction in complex urban environments from multi spectral satellite imagery. In: 2009 4th International Conference on Recent Advances in Space Technologies, pp 287–291. https://doi.org/10.1109/RAST.2009.5158214
Aytekin O, Erener A, Ulusoy I, Duzgun HSB (2012) Unsupervised building detection in complex urban environments from multispectral satellite imagery. Int J Remote Sens 33(7):2152–2177. https://doi.org/10.1080/01431161.2011.606852
Bezdek JC (1981) Pattern Recognition with Fuzzy Objective Function Algorithms. Kluwer Academic Publishers, Norwell
Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239. https://doi.org/10.1109/34.969114
Boykov Y, Kolmogorov V (2004) An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision. IEEE Trans Pattern Anal Mach Intell 26(9):1124–1137. https://doi.org/10.1109/TPAMI.2004.60
Chandra N, Ghosh JK (2017) A cognitive method for building detection from high-resolution satellite images. Current Sci112 (5):1038–1044. https://doi.org/10.18520/cs/v112/i05/1038-1044https://doi.org/10.18520/cs/v112/i05/1038-1044
Chaudhuri D, Kushwaha NK, Samal A, Agarwal RC (2016) Automatic building detection from high-resolution satellite images based on morphology and internal gray variance. IEEE J Sel Top Appl Earth Observ Remote Sens 9(5):1767–1779. https://doi.org/10.1109/JSTARS.2015.2425655https://doi.org/10.1109/JSTARS.2015.2425655
Cheng G, Han J (2016) A survey on object detection in optical remote sensing images. ISPRS J Photogr Remote Sens 117:11–28. https://doi.org/10.1016/j.isprsjprs.2016.03.014. http://www.sciencedirect.com/science/article/pii/S0924271616300144
Dunn JC (1973) A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. J Cybern 3(3):32–57. https://doi.org/10.1080/01969727308546046
Gates DM (2003) Biophysical Ecology. Dover Publications
Ghaffarian S, Ghaffarian S (2014) Automatic building detection based on purposive fastica (pfica) algorithm using monocular high resolution google earth images. {ISPRS} J Photogr Remote Sens 97:152–159. https://doi.org/10.1016/j.isprsjprs.2014.08.017https://doi.org/10.1016/j.isprsjprs.2014.08.017. http://www.sciencedirect.com/science/article/pii/S0924271614002238
Ghanea M, Moallem P, Momeni M (2016) Building extraction from high-resolution satellite images in urban areas: recent methods and strategies against significant challenges. Int J Remote Sens 37(21):5234–5248. https://doi.org/10.1080/01431161.2016.1230287https://doi.org/10.1080/01431161.2016.1230287
Huang XZL (2011) A multidirectional and multiscale morphological index for automatic building extraction from multispectral geoeye-1 imagery. Photogr Eng Remote Sens 77:721–732
Huang X, Zhang L (2012) Morphological building/shadow index for building extraction from high-resolution imagery over urban areas. IEEE J Sel Top Appl Earth Observ Remote Sens 5(1):161–172. https://doi.org/10.1109/JSTARS.2011.2168195
Huang X, Yuan W, Li J, Zhang L (2017) A new building extraction postprocessing framework for high-spatial-resolution remote-sensing imagery. IEEE J Sel Top Appl Earth Observ Remote Sens 10:654–668. https://doi.org/10.1109/JSTARS.2016.2587324
Kolmogorov V, Zabin R (2004) What energy functions can be minimized via graph cuts? IEEE Trans Pattern Anal Mach Intell 26(2):147–159. https://doi.org/10.1109/TPAMI.2004.1262177
Konstantinidis D, Stathaki T, Argyriou V, Grammalidis N (2017) Building detection using enhanced hog -lbp features and region refinement processes. IEEE J Sel Top Appl Earth Observ Remote Sens 10(3):888–905. https://doi.org/10.1109/JSTARS.2016.2602439https://doi.org/10.1109/JSTARS.2016.2602439
Li E, Femiani J, Xu S, Zhang X, Wonka P (2015) Robust rooftop extraction from visible band images using higher order crf. IEEE Trans Geosci Remote Sens 53(8), 4483–4495. https://doi.org/10.1109/TGRS.2015.2400462
Li E, Xu S, Meng W, Zhang X (2017) Building extraction from remotely sensed images by integrating saliency cue. IEEE J Sel Top Appl Earth Observ Remote Sens 10(3):906–919. https://doi.org/10.1109/JSTARS.2016.2603184
Liasis G, Stavrou S (2016) Building extraction in satellite images using active contours and colour features. Int J Remote Sens 37 (5):1127–1153. https://doi.org/10.1080/01431161.2016.1148283
Manno-Kovács A, Ok AO (2015) Building detection from monocular vhr images by integrated urban area knowledge. IEEE Geosci Remote Sens Lett 12(10):2140–2144. https://doi.org/10.1109/LGRS.2015.2452962https://doi.org/10.1109/LGRS.2015.2452962
Mayer H (1999) Automatic object extraction from aerial imagery -a survey focusing on buildings. Comput Vis Image Underst 74(2):138–149. https://doi.org/10.1006/cviu.1999.0750. http://www.sciencedirect.com/science/article/pii/S1077314299907506
Ngo TT, Mazet V, Collet C, de Fraipont P (2017) Shape-based building detection in visible band images using shadow information. IEEE J Sel Top Appl Earth Observ Remote Sens 10(3):920–932. https://doi.org/10.1109/JSTARS.2016.2598856
Ok AO (2013a) Automated detection of buildings from single {VHR} multispectral images using shadow information and graph cuts. {ISPRS} J Photogr Remote Sens 86:21–40. https://doi.org/10.1016/j.isprsjprs.2013.09.004. http://www.sciencedirect.com/science/article/pii/S0924271613002050
Ok AO, Senaras C, Yuksel B (2013b) Automated detection of arbitrarily shaped buildings in complex environments from monocular vhr optical satellite imagery. IEEE Trans Geosci Remote Sens 51(3):1701–1717. https://doi.org/10.1109/TGRS.2012.2207123
Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66. https://doi.org/10.1109/TSMC.1979.4310076
Ozay M, Yarman-Vural FT (2012) A new fuzzy stacked generalization technique for deep learning and analysis of its performance. arXiv:1204.0171
Rother C, Kolmogorov V, Blake A (2004) “grabcut”: Interactive foreground extraction using iterated graph cuts. ACM Trans Graph 23(3):309–314. https://doi.org/10.1145/1015706.1015720
Senaras C, Ozay M, Vural FTY (2013) Building detection with decision fusion. IEEE J Sel Top Appl Earth Observ Remote Sens 6(3):1295–1304. https://doi.org/10.1109/JSTARS.2013.2249498
Senaras C, Vural FTY (2016) A self-supervised decision fusion framework for building detection. IEEE J Se Top Appl Earth Observ Remote Sens 9(5):1780–1791. https://doi.org/10.1109/JSTARS.2015.2463118https://doi.org/10.1109/JSTARS.2015.2463118
Sharma D SJ (2019) An object-based shadow detection method for building delineation in high-resolution satellite images. PFG- J Photogr Remote Sens Geoinform Sci 87(3):103–118
Sharma D SJ (2020) Fuzzy clustering algorithm with histogram based initialization for remotely sensed imagery. Advances in Electrical and Electronic Engineering (accepted)
Shi W, Mao Z (2016) Building extraction from panchromatic high-resolution remotely sensed imagery based on potential histogram and neighborhood total variation. Earth Sci Inf 9(4):497–509. https://doi.org/10.1007/s12145-016-0262-6
Shufelt JA (1999) Performance evaluation and analysis of monocular building extraction from aerial imagery. IEEE Trans Pattern Anal Mach Intell 21(4), 311–326. https://doi.org/10.1109/34.761262
Sirmacek B, Unsalan C (2009) Urban-area and building detection using sift keypoints and graph theory. IEEE Trans Geosci Remote Sens 47(4):1156–1167. https://doi.org/10.1109/TGRS.2008.2008440https://doi.org/10.1109/TGRS.2008.2008440
Sirmacek B, Unsalan C (2011) A probabilistic framework to detect buildings in aerial and satellite images. IEEE Trans Geosci Remote Sens 49(1):211–221. https://doi.org/10.1109/TGRS.2010.2053713https://doi.org/10.1109/TGRS.2010.2053713
Sumer E, Turker M (2013) An adaptive fuzzy-genetic algorithm approach for building detection using high-resolution satellite images. Comput Environ Urban Syst 39:48–62. https://doi.org/10.1016/j.compenvurbsys.2013.01.004. http://www.sciencedirect.com/science/article/pii/S0198971513000124
Teke M, Başeski E, Ok AO, Yüksel B, Şenaras C (2011) Multi-spectral false color shadow detection. In: Proceedings of the 2011 ISPRS Conference on Photogrammetric Image Analysis, PIA’11. Springer, Berlin, pp 109–119. http://dl.acm.org/citation.cfm?id=2050390.2050403
Thomas GB, Finney RL, Weir MD (1988) Calculus and Analytic Geometry, vol 7. Addison-Wesley, Reading
Tkalcic M, Tasic J.F (2003) Colour spaces: perceptual, historical and applicational background. In: The IEEE Region 8 EUROCON 2003. Computer as a Tool, vol 1, pp 304–308. https://doi.org/10.1109/EURCON.2003.1248032
Tucker CJ (1979) Red and photographic infrared linear combinations for monitoring vegetation. Remote Sens Environ 8(2):127–150. https://doi.org/10.1016/0034-4257(79)90013-0. http://www.sciencedirect.com/science/article/pii/0034425779900130
Wang J, Yang X, Qin X, Ye X, Qin Q (2015) An efficient approach for automatic rectangular building extraction from very high resolution optical satellite imagery. IEEE Geosci Remote Sens Lett 12(3):487–491. https://doi.org/10.1109/LGRS.2014.2347332
Zhang Q, Huang X, Zhang G (2016) A morphological building detection framework for high-resolution optical imagery over urban areas. IEEE Geosci Remote Sens Lett 13:1388–1392. https://doi.org/10.1109/LGRS.2016.2590481
Acknowledgments
The authors would like to thank’s Dr. Ali Ozgun Ok for providing the dataset.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by: H. Babaie
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sharma, D., Singhai, J. An unsupervised framework to extract the diverse building from the satellite images using Grab-cut method. Earth Sci Inform 14, 777–795 (2021). https://doi.org/10.1007/s12145-021-00569-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12145-021-00569-7