TY - JOUR
T1 - Nonconvex Truncated Nuclear Norm Minimization Based on Adaptive Bisection Method
AU - Su, Xinhua
AU - Wang, Yilun
AU - Kang, Xuejing
AU - Tao, Ran
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2019/11
Y1 - 2019/11
N2 - The explosive growth in high-dimensional visual data requires effective regularization techniques to utilize the underlying low-dimensional structure. We consider low-rank matrix recovery, and many existing approaches are based on the nuclear norm regularization. Recently, truncated nuclear norm (TNNR) has been proposed to achieve a better approximation to the rank function than that of the traditional nuclear norm. TNNR was defined by the nuclear norm by subtracting the sum of the largest r singular values. However, the estimation of r is not trivial. In addition, the original algorithm based on TNNR only considers the matrix completion cases and requires double loops, which is not quite computationally efficient. Correspondingly, in this paper, we propose the adaptive bisection method to adaptively estimate r, which can efficiently reduce the cost of computation. Moreover, to further accelerate computing, we apply iteratively reweighted nuclear norm to solve the nonconvex TNNR directly, and the convergence can also be guaranteed. Finally, we extend the applications of TNNR from the matrix completion problems to the general low-rank matrix recovery. Extensive experiments validate the superiority of the proposed algorithm over the state-of the-art methods.
AB - The explosive growth in high-dimensional visual data requires effective regularization techniques to utilize the underlying low-dimensional structure. We consider low-rank matrix recovery, and many existing approaches are based on the nuclear norm regularization. Recently, truncated nuclear norm (TNNR) has been proposed to achieve a better approximation to the rank function than that of the traditional nuclear norm. TNNR was defined by the nuclear norm by subtracting the sum of the largest r singular values. However, the estimation of r is not trivial. In addition, the original algorithm based on TNNR only considers the matrix completion cases and requires double loops, which is not quite computationally efficient. Correspondingly, in this paper, we propose the adaptive bisection method to adaptively estimate r, which can efficiently reduce the cost of computation. Moreover, to further accelerate computing, we apply iteratively reweighted nuclear norm to solve the nonconvex TNNR directly, and the convergence can also be guaranteed. Finally, we extend the applications of TNNR from the matrix completion problems to the general low-rank matrix recovery. Extensive experiments validate the superiority of the proposed algorithm over the state-of the-art methods.
KW - Low rank matrices
KW - adaptive bisection method
KW - iteratively reweighted nuclear norm
KW - nonconvex optimization
KW - sparse optimization
KW - truncated nuclear norm
UR - http://www.scopus.com/inward/record.url?scp=85055886235&partnerID=8YFLogxK
U2 - 10.1109/TCSVT.2018.2878803
DO - 10.1109/TCSVT.2018.2878803
M3 - Article
AN - SCOPUS:85055886235
SN - 1051-8215
VL - 29
SP - 3159
EP - 3172
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 11
M1 - 8515262
ER -