TY - JOUR
T1 - Robust Object Tracking with Discrete Graph-Based Multiple Experts
AU - Li, Jiatong
AU - Deng, Chenwei
AU - Xu, Richard Yi Da
AU - Tao, Dacheng
AU - Zhao, Baojun
N1 - Publisher Copyright:
© 1992-2012 IEEE.
PY - 2017/6
Y1 - 2017/6
N2 - Variations of target appearances due to illumination changes, heavy occlusions, and target deformations are the major factors for tracking drift. In this paper, we show that the tracking drift can be effectively corrected by exploiting the relationship between the current tracker and its historical tracker snapshots. Here, a multi-expert framework is established by the current tracker and its historical trained tracker snapshots. The proposed scheme is formulated into a unified discrete graph optimization framework, whose nodes are modeled by the hypotheses of the multiple experts. Furthermore, an exact solution of the discrete graph exists giving the object state estimation at each time step. With the unary and binary compatibility graph scores defined properly, the proposed framework corrects the tracker drift via selecting the best expert hypothesis, which implicitly analyzes the recent performance of the multi-expert by only evaluating graph scores at the current frame. Three base trackers are integrated into the proposed framework to validate its effectiveness. We first integrate the online SVM on a budget algorithm into the framework with significant improvement. Then, the regression correlation filters with hand-crafted features and deep convolutional neural network features are introduced, respectively, to further boost the tracking performance. The proposed three trackers are extensively evaluated on three data sets: TB-50, TB-100, and VOT2015. The experimental results demonstrate the excellent performance of the proposed approaches against the state-of-the-art methods.
AB - Variations of target appearances due to illumination changes, heavy occlusions, and target deformations are the major factors for tracking drift. In this paper, we show that the tracking drift can be effectively corrected by exploiting the relationship between the current tracker and its historical tracker snapshots. Here, a multi-expert framework is established by the current tracker and its historical trained tracker snapshots. The proposed scheme is formulated into a unified discrete graph optimization framework, whose nodes are modeled by the hypotheses of the multiple experts. Furthermore, an exact solution of the discrete graph exists giving the object state estimation at each time step. With the unary and binary compatibility graph scores defined properly, the proposed framework corrects the tracker drift via selecting the best expert hypothesis, which implicitly analyzes the recent performance of the multi-expert by only evaluating graph scores at the current frame. Three base trackers are integrated into the proposed framework to validate its effectiveness. We first integrate the online SVM on a budget algorithm into the framework with significant improvement. Then, the regression correlation filters with hand-crafted features and deep convolutional neural network features are introduced, respectively, to further boost the tracking performance. The proposed three trackers are extensively evaluated on three data sets: TB-50, TB-100, and VOT2015. The experimental results demonstrate the excellent performance of the proposed approaches against the state-of-the-art methods.
KW - Object tracking
KW - convolutional neural network
KW - correlation filter
KW - discrete graph
KW - dynamic programming
KW - support vector machine
UR - http://www.scopus.com/inward/record.url?scp=85018783004&partnerID=8YFLogxK
U2 - 10.1109/TIP.2017.2686601
DO - 10.1109/TIP.2017.2686601
M3 - Article
C2 - 28358683
AN - SCOPUS:85018783004
SN - 1057-7149
VL - 26
SP - 2736
EP - 2750
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
IS - 6
M1 - 7885500
ER -