Ground-based remote sensing cloud detection using dual pyramid network and encoder–decoder constraint

Zhong Zhang, Shuzhen Yang, Shuang Liu, Xiaozhong Cao, Tariq S. Durrani

Research output: Contribution to journalArticlepeer-review

12 Citations (Scopus)
32 Downloads (Pure)

Abstract

Many methods for ground-based remote sensing cloud detection learn representation features using the encoder–decoder structure. However, they only consider the information from single scale, which leads to incomplete feature extraction. In this article, we propose a novel deep network named dual pyramid network (DPNet) for ground-based remote sensing cloud detection, which possesses an encoder–decoder structure with dual pyramid pooling module (DPPM). Specifically, we process the feature maps of different scales in the encoder through dual pyramid pooling. Then, we fuse the outputs of the dual pyramid pooling in the same pyramid level using the attention fusion. Furthermore, we propose the encoder–decoder constraint (EDC) to relieve information loss in the process of encoding and decoding. It constrains the values and the gradients of probability maps from the encoder and the decoder to be consistent. Since the number of cloud images in the publicly available databases for ground-based remote sensing cloud detection is limited, we release the TJNU Large-scale Cloud Detection Database (TLCDD) that is the largest database in this field. We conduct a series of experiments on TLCDD, and the experimental results verify the effectiveness of the proposed method.
Original languageEnglish
Number of pages10
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume60
DOIs
Publication statusPublished - 29 Mar 2022

Keywords

  • cloud detection
  • dual pyramid network
  • ground based remote sensing

Fingerprint

Dive into the research topics of 'Ground-based remote sensing cloud detection using dual pyramid network and encoder–decoder constraint'. Together they form a unique fingerprint.

Cite this