TY - JOUR
T1 - Integrated Spatio-Spectral-Temporal Fusion via Anisotropic Sparsity Constrained Low-Rank Tensor Approximation
AU - Li, Wei
AU - Wang, Yinjian
AU - Liu, Na
AU - Xiao, Chenchao
AU - Sun, Zhiwei
AU - Du, Qian
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - Although spatio-spectral and spatio-temporal fusion has been well explored, few efforts are made on integrating spatio-spectral-temporal features. As an intrinsic prior, low tensor rank has been successfully taken into effect by current fusion models, most of which, however, resort to establishing an overall low-rank norm without performing factorization techniques and thus have trouble capturing the latent high-order structure of hyperspectral data cube. To address that, a novel anisotropic sparsity (AS) tensor norm is developed to make the rank minimization a learnable process under the Tucker decomposition. The AS norm enables the model to minimize the multilinear tensor ranks if imposed on the core tensor after factorization; hence, it significantly improves the model's fusion performance. In the temporal domain, a Hadamard-product-based variability descriptor is incorporated into the fusion model to map the former information to the current time. In addition, piecewise smooth prior of the Tucker factors is employed by extra regularizers as supplement to the loss of spatial information. With the proximal differential matrix being developed for optimization, the proposed method reaches state-of-the-art results on both spatio-spectral and spatio-spectral-temporal fusion at a low computational cost.
AB - Although spatio-spectral and spatio-temporal fusion has been well explored, few efforts are made on integrating spatio-spectral-temporal features. As an intrinsic prior, low tensor rank has been successfully taken into effect by current fusion models, most of which, however, resort to establishing an overall low-rank norm without performing factorization techniques and thus have trouble capturing the latent high-order structure of hyperspectral data cube. To address that, a novel anisotropic sparsity (AS) tensor norm is developed to make the rank minimization a learnable process under the Tucker decomposition. The AS norm enables the model to minimize the multilinear tensor ranks if imposed on the core tensor after factorization; hence, it significantly improves the model's fusion performance. In the temporal domain, a Hadamard-product-based variability descriptor is incorporated into the fusion model to map the former information to the current time. In addition, piecewise smooth prior of the Tucker factors is employed by extra regularizers as supplement to the loss of spatial information. With the proximal differential matrix being developed for optimization, the proposed method reaches state-of-the-art results on both spatio-spectral and spatio-spectral-temporal fusion at a low computational cost.
KW - Hyperspectral image (HSI) and multispectral image (MSI)
KW - low-rank tensor
KW - remote sensing
KW - spatio-spectral-temporal fusion
UR - http://www.scopus.com/inward/record.url?scp=85162719995&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2023.3284481
DO - 10.1109/TGRS.2023.3284481
M3 - Article
AN - SCOPUS:85162719995
SN - 0196-2892
VL - 61
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5517416
ER -