TY - GEN
T1 - Small Object Tracking in Satellite Videos with Gaussian Wasserstein Distance
AU - Wu, Xinyu
AU - Li, Yaowen
AU - Jiang, Zhizhuo
AU - Chen, Liang
AU - Liu, Yu
AU - He, You
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Tracking small objects is a major challenge in satellite video object tracking. The traditional metric, i.e. intersection over union (IoU) of bounding boxes, is sensitive to target scale, while minor location deviation can cause a significant drop. Especially for tiny objects occupying very limited pixels, the boxes may not overlap or be fully inclusive and thus the IoU metric fails to provide a consistent measure. This paper proposes a new method named GWD-SiamFC++, which introduces a novel bounding box metric based on the Gaussian Wasserstein distance (GWD) to the classical SiamFC++ framework to address this issue. GWD is a continuous and consistent metric, offering a more precise representation of pixel weights within bounding boxes and accurately distinguishing between non-overlapping or fully inclusive boxes. Besides, it features scale invariance and is insensitive to object size, making it more suitable for small object tracking. Furthermore, nonlinear transformations are devised based on the GWD concept and yield the training normalized Gaussian Wasserstein distance (TrGWD) and testing normalized Gaussian Wasserstein distance (TeGWD), which are integrated into the classical SiamFC++ framework for the training and the testing phases, respectively. Experimental results on the SatSOT dataset reveal that the proposed method attains a success rate of 48.2% and a precision rate of 70.6%, and maintains satisfying computational efficiency.
AB - Tracking small objects is a major challenge in satellite video object tracking. The traditional metric, i.e. intersection over union (IoU) of bounding boxes, is sensitive to target scale, while minor location deviation can cause a significant drop. Especially for tiny objects occupying very limited pixels, the boxes may not overlap or be fully inclusive and thus the IoU metric fails to provide a consistent measure. This paper proposes a new method named GWD-SiamFC++, which introduces a novel bounding box metric based on the Gaussian Wasserstein distance (GWD) to the classical SiamFC++ framework to address this issue. GWD is a continuous and consistent metric, offering a more precise representation of pixel weights within bounding boxes and accurately distinguishing between non-overlapping or fully inclusive boxes. Besides, it features scale invariance and is insensitive to object size, making it more suitable for small object tracking. Furthermore, nonlinear transformations are devised based on the GWD concept and yield the training normalized Gaussian Wasserstein distance (TrGWD) and testing normalized Gaussian Wasserstein distance (TeGWD), which are integrated into the classical SiamFC++ framework for the training and the testing phases, respectively. Experimental results on the SatSOT dataset reveal that the proposed method attains a success rate of 48.2% and a precision rate of 70.6%, and maintains satisfying computational efficiency.
KW - bounding box metric
KW - Gaussian Wasserstein distance
KW - satellite video
KW - small object tracking
UR - http://www.scopus.com/inward/record.url?scp=86000014651&partnerID=8YFLogxK
U2 - 10.1109/ICSIDP62679.2024.10868841
DO - 10.1109/ICSIDP62679.2024.10868841
M3 - Conference contribution
AN - SCOPUS:86000014651
T3 - IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
BT - IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
Y2 - 22 November 2024 through 24 November 2024
ER -