Building extraction from high-resolution aerial imagery using a generative adversarial network with spatial and channel attention mechanisms

Xuran Pan, Fan Yang, Lianru Gao, Zhengchao Chen, Bing Zhang, Hairui Fan, Jinchang Ren

Research output: Contribution to journalArticle

14 Citations (Scopus)
11 Downloads (Pure)

Abstract

Segmentation of high-resolution remote sensing images is an important challenge with wide practical applications. The increasing spatial resolution provides fine details for image segmentation but also incurs segmentation ambiguities. In this paper, we propose a generative adversarial network with spatial and channel attention mechanisms (GAN-SCA) for the robust segmentation of buildings in remote sensing images. The segmentation network (generator) of the proposed framework is composed of the well-known semantic segmentation architecture (U-Net) and the spatial and channel attention mechanisms (SCA). The adoption of SCA enables the segmentation network to selectively enhance more useful features in specific positions and channels and enables improved results closer to the ground truth. The discriminator is an adversarial network with channel attention mechanisms that can properly discriminate the outputs of the generator and the ground truth maps. The segmentation network and adversarial network are trained in an alternating fashion on the Inria aerial image labeling dataset and Massachusetts buildings dataset. Experimental results show that the proposed GAN-SCA achieves a higher score (the overall accuracy and intersection over the union of Inria aerial image labeling dataset are 96.61% and 77.75%, respectively, and the F 1 -measure of the Massachusetts buildings dataset is 96.36%) and outperforms several state-of-the-art approaches.

Original languageEnglish
Article number917
Number of pages18
JournalRemote Sensing
Volume11
Issue number8
DOIs
Publication statusPublished - 15 Apr 2019

Keywords

  • deep learning
  • generative adversarial network
  • high-resolution aerial images
  • inria aerial image labeling dataset
  • Massachusetts buildings dataset
  • semantic segmentation

Fingerprint Dive into the research topics of 'Building extraction from high-resolution aerial imagery using a generative adversarial network with spatial and channel attention mechanisms'. Together they form a unique fingerprint.

Cite this