GT-HAD: Gated Transformer for Hyperspectral Anomaly Detection

Jie Lian, Lizhi Wang, He Sun, Hua Huang

Research output: Contribution to journalArticlepeer-review

9 Citations (Scopus)

Abstract

Hyperspectral anomaly detection (HAD) aims to distinguish between the background and anomalies in a scene, which has been widely adopted in various applications. Deep neural network (DNN)-based methods have emerged as the predominant solution, wherein the standard paradigm is to discern the background and anomalies based on the error of self-supervised hyperspectral image (HSI) reconstruction. However, current DNN-based methods cannot guarantee correspondence between the background, anomalies, and reconstruction error, which limits the performance of HAD. In this article, we propose a novel gated transformer network for HAD (GT-HAD). Our key observation is that the spatial–spectral similarity in HSI can effectively distinguish between the background and anomalies, which aligns with the fundamental definition of HAD. Consequently, we develop GT-HAD to exploit the spatial–spectral similarity during HSI reconstruction. GT-HAD consists of two distinct branches that model the features of the background and anomalies, respectively, with content similarity as constraints. Furthermore, we introduce an adaptive gating unit to regulate the activation states of these two branches based on a content-matching method (CMM). Extensive experimental results demonstrate the superior performance of GT-HAD. The original code is publicly available at https://github.com/jeline0110/ GT-HAD, along with a comprehensive benchmark of state-of-the-art HAD methods.

Original languageEnglish
Pages (from-to)1-15
Number of pages15
JournalIEEE Transactions on Neural Networks and Learning Systems
DOIs
Publication statusAccepted/In press - 2024

Keywords

  • Anomaly detection
  • Content similarity
  • Feature extraction
  • Hyperspectral imaging
  • Image reconstruction
  • Task analysis
  • Tensors
  • Transformers
  • gating unit
  • hyperspectral anomaly detection (HAD)
  • transformer

Fingerprint

Dive into the research topics of 'GT-HAD: Gated Transformer for Hyperspectral Anomaly Detection'. Together they form a unique fingerprint.

Cite this