Multi-frame Temporal Modeling for Multi-object Tracking in Satellite Video

Bingqian Chai, Tingting Qiao, Baorong Xie, Jue Wang*, Wenchao Liu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the advancement of remote sensing technology, video satellites have played an increasingly important role in both military and civilian domains, and they are widely used in areas such as military guidance, intelligent transportation, and disaster response. Multi-object tracking (MOT) in satellite video is a crucial research topic in these fields and has made certain progress. However, due to the difficulty of tracking objects in complex scene and low resolution, current MOT methods face issues of low accuracy in satellite video. In this work, we propose a joint-detection-and-tracking method called multi-frame temporal MOT (MFT-MOT). Firstly, a heatmap guided multi-frame temporal modeling method is introduced to extract features with temporal semantic information while suppressing background noise. Then, we utilize a weights-shared encoder-decoder network to facilitate interaction of temporal and spatial information and capture inter-frame object motion tracks at low resolution. Experiments on SAT-MTB dataset shows the effectiveness of our method.

Original languageEnglish
Title of host publicationIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331515669
DOIs
Publication statusPublished - 2024
Event2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024 - Zhuhai, China
Duration: 22 Nov 202424 Nov 2024

Publication series

NameIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024

Conference

Conference2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
Country/TerritoryChina
CityZhuhai
Period22/11/2424/11/24

Keywords

  • joint detection and tracking
  • multi-frame temporal model
  • multi-object tracking
  • satellite video

Fingerprint

Dive into the research topics of 'Multi-frame Temporal Modeling for Multi-object Tracking in Satellite Video'. Together they form a unique fingerprint.

Cite this