Meta-TR: Meta-Attention Spatial Compressive Imaging Network With Swin Transformer

Can Cui, Linhan Xu, Boyu Yang, Jun Ke*

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

4 引用 (Scopus)

摘要

As a flourishing research topic in the field of remote sensing, spatial compressive imaging (SCI) can utilize prior knowledge to recover high-dimensional signals from low-resolution measurements through joint sampling and compression, thus contributing to the bandwidth reduction of information transmission. However, most of the existing SCI methods based on deep learning cannot effectively utilize prior information, and difficult to perform deep extraction of image features, so the reconstruction is not ideal in the case of low sampling ratio. To address the above difficulty, we propose an SCI network based on meta-attention (MA) and swin transformer, named Meta-TR. We adopt the swin transformer as the network backbone, through the wide application of self-attention mechanisms, to achieve deeper extraction of image features, thereby improving the reconstruction quality under low sampling ratios. In addition, we design an MA module, which adopts Squeeze-Excitation architecture to convert the metadata of SCI image degradation process to attention vectors. Then, the attention vectors are used in the channel modulation of network feature maps to guide the network training. Extensive experiments are performed on different benchmark remote sensing datasets and different sampling ratios to confirm the superiority of the proposed Meta-TR method.

源语言英语
页(从-至)6236-6247
页数12
期刊IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
15
DOI
出版状态已出版 - 2022

指纹

探究 'Meta-TR: Meta-Attention Spatial Compressive Imaging Network With Swin Transformer' 的科研主题。它们共同构成独一无二的指纹。

引用此