GANMem-Siamese: GAN-enhanced deep feature generation for robust object tracking with memory fusion

  • Yashuo Bai
  • , Li Wang
  • , Yingbo He
  • , Ya Zhou
  • , Meng Zheng
  • , Yiqian Huang
  • , Hongyu He
  • , Shuqi Liu
  • , Teng Luo
  • , Nan Wang
  • , Yong Song*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Target tracking in dynamic environments faces challenges such as occlusions and appearance changes, especially long-time tracking. To address this, we propose GANMem-Siamese, integrating Generative Adversarial Networks (GANs) with Siamese networks, enhanced by a cycle memory mechanism and channel attention. The cycle memory mechanism selects key historical frames based on confidence scores, ensuring effective long-term representation. Within the selected frames, we introduce a channel attention-based feature fusion strategy, which adaptively integrates GAN-generated features with intermediate template features, enhancing feature diversity while maintaining temporal coherence. This approach mitigates feature drift and improves tracking robustness. Experimental results on benchmark datasets, including OTB100, VOT2016, and UAV123-20L, demonstrate that our method achieves state-of-the-art performance among unsupervised trackers, significantly improving long-term tracking stability and accuracy.

Original languageEnglish
Article number1043
JournalApplied Intelligence
Volume55
Issue number16
DOIs
Publication statusPublished - Nov 2025
Externally publishedYes

Keywords

  • Channel attention
  • GANs
  • Memory mechanisms
  • Object tracking
  • Siamese networks

Fingerprint

Dive into the research topics of 'GANMem-Siamese: GAN-enhanced deep feature generation for robust object tracking with memory fusion'. Together they form a unique fingerprint.

Cite this