TY - JOUR
T1 - Scale-Frequency Dual Modulation Method for Remote Sensing Image Continuous Super-Resolution
AU - Gao, Shize
AU - Wang, Guoqing
AU - Xie, Baorong
AU - Wei, Xin
AU - Wang, Jue
AU - Liu, Wenchao
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - In recent years, the development of continuous-scale super-resolution (SR) methods in the field of remote sensing (RS) has garnered significant attention. These innovative methods are capable of delivering arbitrary-scale image SR through a single, unified network. However, the majority of these methods employ the same feature extractor for different SR scales, which constrains the enhancement of network performance. Furthermore, the utilization of a multilayer perceptron (MLP) for image reconstruction results in the loss of a substantial quantity of high-frequency information, which is of particular significance in the context of remote sensing images. This, in turn, gives rise to the generation of blurred super-resolution results. In order to address the aforementioned issues, the scale-frequency dual modulation network (SFMNet) is proposed as a means of achieving RS image continuous SR. Firstly, scale modulation feature fusion (SMFF) can modulate different levels of feature fusion according to different scale factors, thereby fully integrating the scale information into the feature extraction process of the network. Subsequently, frequency modulation reconstruction (FMR) can modulate the frequency domain information at the root of the image reconstruction process, thereby enhancing the ability of the network to learn high-frequency information. The experimental results demonstrate that the proposed SFMNet outperforms existing RS image continuous SR methods in terms of quantitative indices and visual quality.
AB - In recent years, the development of continuous-scale super-resolution (SR) methods in the field of remote sensing (RS) has garnered significant attention. These innovative methods are capable of delivering arbitrary-scale image SR through a single, unified network. However, the majority of these methods employ the same feature extractor for different SR scales, which constrains the enhancement of network performance. Furthermore, the utilization of a multilayer perceptron (MLP) for image reconstruction results in the loss of a substantial quantity of high-frequency information, which is of particular significance in the context of remote sensing images. This, in turn, gives rise to the generation of blurred super-resolution results. In order to address the aforementioned issues, the scale-frequency dual modulation network (SFMNet) is proposed as a means of achieving RS image continuous SR. Firstly, scale modulation feature fusion (SMFF) can modulate different levels of feature fusion according to different scale factors, thereby fully integrating the scale information into the feature extraction process of the network. Subsequently, frequency modulation reconstruction (FMR) can modulate the frequency domain information at the root of the image reconstruction process, thereby enhancing the ability of the network to learn high-frequency information. The experimental results demonstrate that the proposed SFMNet outperforms existing RS image continuous SR methods in terms of quantitative indices and visual quality.
KW - Continuous scale
KW - frequency modulation
KW - remote sensing (RS) image
KW - scale modulation
KW - super -resolution (SR)
UR - http://www.scopus.com/inward/record.url?scp=85207390436&partnerID=8YFLogxK
U2 - 10.1109/JSTARS.2024.3483991
DO - 10.1109/JSTARS.2024.3483991
M3 - Article
AN - SCOPUS:85207390436
SN - 1939-1404
JO - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
JF - IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
ER -