Extracting buildings from high-resolution remote sensing images by deep ConvNets equipped with structural-cue-guided feature alignment

https://doi.org/10.1016/j.jag.2022.102970Get rights and content
Under a Creative Commons license
open access

Highlights

  • A pyramid feature extraction module is proposed to capture contextual correlations.

  • An alignment module is designed to smooth the gaps between multi-level features.

  • A spatial attention module is proposed to capture the regular shapes of buildings.

  • The proposed method achieves state-of-the-art performance on two datasets.

Abstract

In surveying, mapping and geographic information systems, building extraction from remote sensing imagery is a common task. However, there are still some challenges in automatic building extraction. First, using only single-scale depth features cannot take into account the uncertainty of features such as the hue and texture of buildings in images, and the results are prone to missed detection. Moreover, extracted high-level features often lose structural information and have scale differences with low-level features, which results in less accurate extraction of boundaries. To simultaneously address these problems, we propose pyramid feature extraction (PFE) to construct multi-scale representations of buildings, which is inspired by the feature extraction of scale-invariant feature transform. We also apply attention modules in channel dimension and spatial dimension to PFE and low-level feature maps. Furthermore, we use the structural-cue-guided feature alignment module to learn the correlation between feature maps at different levels, obtaining high-resolution features with strong semantic representation and ensuring the integrity of high-level features in both structural and semantic dimensions. An edge loss is applied to get a highly accurate building boundary. For the WHU Building Dataset, our method achieves an F1 score of 95.3% and an Intersection over Union (IoU) score of 90.9%; for the Massachusetts Buildings Dataset, our method achieves an F1 score of 85.0% and an IoU score of 74.1%.

Keywords

Building extraction
Structural-cue-guided feature alignment
Convolutional neural network (convNet)

Cited by (0)