TY - JOUR
T1 - PSGAN
T2 - A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening
AU - Liu, Qingjie
AU - Zhou, Huanyu
AU - Xu, Qizhi
AU - Liu, Xiangyu
AU - Wang, Yunhong
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2021/12/1
Y1 - 2021/12/1
N2 - This article addresses the problem of remote sensing image pan-sharpening from the perspective of generative adversarial learning. We propose a novel deep neural network-based method named pansharpening GAN (PSGAN). To the best of our knowledge, this is one of the first attempts at producing high-quality pan-sharpened images with generative adversarial networks (GANs). The PSGAN consists of two components: a generative network (i.e., generator) and a discriminative network (i.e., discriminator). The generator is designed to accept panchromatic (PAN) and multispectral (MS) images as inputs and maps them to the desired high-resolution (HR) MS images, and the discriminator implements the adversarial training strategy for generating higher fidelity pan-sharpened images. In this article, we evaluate several architectures and designs, namely, two-stream input, stacking input, batch normalization layer, and attention mechanism to find the optimal solution for pan-sharpening. Extensive experiments on QuickBird, GaoFen-2, and WorldView-2 satellite images demonstrate that the proposed PSGANs not only are effective in generating high-quality HR MS images and superior to state-of-the-art methods but also generalize well to full-scale images.
AB - This article addresses the problem of remote sensing image pan-sharpening from the perspective of generative adversarial learning. We propose a novel deep neural network-based method named pansharpening GAN (PSGAN). To the best of our knowledge, this is one of the first attempts at producing high-quality pan-sharpened images with generative adversarial networks (GANs). The PSGAN consists of two components: a generative network (i.e., generator) and a discriminative network (i.e., discriminator). The generator is designed to accept panchromatic (PAN) and multispectral (MS) images as inputs and maps them to the desired high-resolution (HR) MS images, and the discriminator implements the adversarial training strategy for generating higher fidelity pan-sharpened images. In this article, we evaluate several architectures and designs, namely, two-stream input, stacking input, batch normalization layer, and attention mechanism to find the optimal solution for pan-sharpening. Extensive experiments on QuickBird, GaoFen-2, and WorldView-2 satellite images demonstrate that the proposed PSGANs not only are effective in generating high-quality HR MS images and superior to state-of-the-art methods but also generalize well to full-scale images.
KW - Convolutional neural network (CNN)
KW - deep learning
KW - generative adversarial network (GAN)
KW - pan-sharpening
KW - residual learning
UR - http://www.scopus.com/inward/record.url?scp=85098790048&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2020.3042974
DO - 10.1109/TGRS.2020.3042974
M3 - Article
AN - SCOPUS:85098790048
SN - 0196-2892
VL - 59
SP - 10227
EP - 10242
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
IS - 12
ER -