TY - JOUR
T1 - RAST
T2 - Reliability-Aware Spatiotemporal Modeling for Multiobject Tracking in Satellite Videos
AU - Shi, Yuting
AU - Wang, Guanqun
AU - Zhuang, Yin
AU - Zhang, Tong
AU - Chen, He
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2026
Y1 - 2026
N2 - Satellite remote sensing videos enable persistent wide-area observation, yet multiobject tracking (MOT) in this domain remains challenging due to tiny targets, cluttered backgrounds, subtle and nonlinear displacements, and time-varying observation quality. Such reliability-variant conditions can induce temporal representation drift, intensify multitask interference between detection and motion estimation, and make conventional reliability-invariant association brittle, leading to fragmented trajectories and identity switches. From a unified reliability-aware spatiotemporal modeling perspective, we propose RAST, an online and causal tracking framework that progressively improves robustness from representation learning to data association. RAST consists of three complementary components: 1) a dual-view temporal enhancement mechanism (DVTEM) that couples forward inertia propagation with backward contextual verification within a causal window to suppress drift accumulation; 2) a motion-guided dynamic feature aggregation mechanism (MGDFAM) that constructs motion priors from a temporal feature bank and performs task-specific deformable attention with decoupled representations for detection and displacement estimation; and 3) a hybrid-driven cascade association strategy (HDCAS) that leverages detection confidence as a proxy of observation reliability to adaptively switch between displacement-guided matching and Kalman-filter-based inertial association. Extensive experiments on two satellite video MOT benchmarks, SatVideoDT and SatMTB-MOT, demonstrate that RAST consistently outperforms state-of-the-art (SOTA) methods. In particular, RAST achieves 67.0% MOTA and 75.1% Rcll on SatVideoDT, and attains the best MOTA across all three subsets of SatMTB-MOT, validating its robustness under crowded tiny-object scenarios and multiclass variations.
AB - Satellite remote sensing videos enable persistent wide-area observation, yet multiobject tracking (MOT) in this domain remains challenging due to tiny targets, cluttered backgrounds, subtle and nonlinear displacements, and time-varying observation quality. Such reliability-variant conditions can induce temporal representation drift, intensify multitask interference between detection and motion estimation, and make conventional reliability-invariant association brittle, leading to fragmented trajectories and identity switches. From a unified reliability-aware spatiotemporal modeling perspective, we propose RAST, an online and causal tracking framework that progressively improves robustness from representation learning to data association. RAST consists of three complementary components: 1) a dual-view temporal enhancement mechanism (DVTEM) that couples forward inertia propagation with backward contextual verification within a causal window to suppress drift accumulation; 2) a motion-guided dynamic feature aggregation mechanism (MGDFAM) that constructs motion priors from a temporal feature bank and performs task-specific deformable attention with decoupled representations for detection and displacement estimation; and 3) a hybrid-driven cascade association strategy (HDCAS) that leverages detection confidence as a proxy of observation reliability to adaptively switch between displacement-guided matching and Kalman-filter-based inertial association. Extensive experiments on two satellite video MOT benchmarks, SatVideoDT and SatMTB-MOT, demonstrate that RAST consistently outperforms state-of-the-art (SOTA) methods. In particular, RAST achieves 67.0% MOTA and 75.1% Rcll on SatVideoDT, and attains the best MOTA across all three subsets of SatMTB-MOT, validating its robustness under crowded tiny-object scenarios and multiclass variations.
KW - Multiobject tracking (MOT)
KW - reliability-aware
KW - satellite video
KW - spatiotemporal modeling
UR - https://www.scopus.com/pages/publications/105043129730
U2 - 10.1109/TGRS.2026.3705110
DO - 10.1109/TGRS.2026.3705110
M3 - Article
AN - SCOPUS:105043129730
SN - 0196-2892
VL - 64
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5628419
ER -