Sea-Net:Visual Cognition-enabled Sample and Embedding Adaptive Network for SAR Image Object Classification

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)

Abstract

In autonomous driving, the perception module typically utilizes a combination of millimeter-wave radar and LiDAR. However, when driving in challenging environmental conditions, this perception combination fails to effectively acquire geometric shape information about the surrounding environment. Therefore, we propose an alternative perception approach that employs Synthetic Aperture Radar (SAR). However, existing algorithms heavily rely on large-scale datasets. In light of this, we propose a meta-learning framework, named Sample and Embedding Adaptive Network (Sea-Net), for few-shot SAR image object classification. Furthermore, the semantics of SAR images and traditional optical images differ, and thus data enhancement methods that are effective on optical images are less so on SAR images. Based on this observation, we introduce a self-adaptive augmentation algorithm for the center of the target domain, which performs self-adaptive augmentation based on the semantic features of SAR images. The entire enhancement stage can be parallelized to speed up computation. Moreover, the imaging principle of SAR image results in coherent speckle noise with bright and dark interlacing in the image, causing a small difference between classes in the SAR image mapped to the embedded space. To address this issue, we propose the edge ambiguous embedding correction based on the self-attention mechanism. This method effectively increases the distance between different classes. Our experimental results on the MSTAR dataset demonstrate that the proposed model outperforms existing methods.

Original languageEnglish
Pages (from-to)1-14
Number of pages14
JournalIEEE Transactions on Intelligent Vehicles
DOIs
Publication statusAccepted/In press - 2023

Keywords

  • Data models
  • Few-shot
  • Metalearning
  • Radar
  • Radar imaging
  • Radar polarimetry
  • Synthetic aperture radar
  • Task analysis
  • data aumentation
  • meta-learning
  • synthetic aperture radar (SAR)

Fingerprint

Dive into the research topics of 'Sea-Net:Visual Cognition-enabled Sample and Embedding Adaptive Network for SAR Image Object Classification'. Together they form a unique fingerprint.

Cite this