An Occlusion-Aware Tracker With Local-Global Features Modeling in UAV Videos

Qiuyu Jin, Yuqi Han*, Wenzheng Wang, Linbo Tang, Jianan Li, Chenwei Deng

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

2 引用 (Scopus)

摘要

Recently, tracking with unmanned aerial vehicle (UAVs) platforms has played significant roles in Earth observation tasks. However, target occlusion remains a challenging factor during the continuous tracking procedure. In particular, incomplete local appearance features can mislead the tracking network to produce inaccurate size and position estimations when the target is occluded. Furthermore, the tracking network lacks sufficient occlusion supervision information, which may lead to template degradation during template updating. To address these challenges, in this article, we design an occlusion-aware tracker with local-global features modeling, which contains two key components, namely the feature intrinsic association module (FIAM) and the feature verification module (FVM). Specifically, the FIAM divides the local features into blocks and utilizes the transformer network to explore the relative relationships among each subblock, which supplements the damaged local target features and assists the modeling for global target features. In addition, the FVM establishes a correlation measurement network between the target and the template. To precisely evaluate the occlusion status, masked samples with occlusion exceeding 50% are selected as negative samples for independent training, which ensures the purity of the target template. Qualitative and quantitative experiments are conducted on publicly available datasets, including UAV20 L, UAV123, and LaSOT. Qualitative and quantitative experiments have demonstrated the effectiveness of the proposed tracking algorithm over the other state-of-the-art trackers in occlusion scenarios.

源语言英语
页(从-至)5403-5415
页数13
期刊IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
17
DOI
出版状态已出版 - 2024

指纹

探究 'An Occlusion-Aware Tracker With Local-Global Features Modeling in UAV Videos' 的科研主题。它们共同构成独一无二的指纹。

引用此

Jin, Q., Han, Y., Wang, W., Tang, L., Li, J., & Deng, C. (2024). An Occlusion-Aware Tracker With Local-Global Features Modeling in UAV Videos. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 17, 5403-5415. https://doi.org/10.1109/JSTARS.2024.3368035