TY - JOUR
T1 - Accelerated first-order continuous-time algorithm for solving convex-concave bilinear saddle point problem
AU - Zeng, Xianlin
AU - Dou, Lihua
AU - Chen, Jie
N1 - Publisher Copyright:
Copyright © 2020 The Authors. This is an open access article under the CC BY-NC-ND license
PY - 2020
Y1 - 2020
N2 - First-order methods have simple structures and are of great importance to big data problems because first-order methods are easy to implement in a distributed or parallel way. However, in the worst cases, first-order methods often converge at a rate O(1/t), which is slow. This paper considers a class of convex-concave bilinear saddle point problems and proposes an accelerated first-order continuous-time algorithm. We design the accelerated algorithm by using both increasing and decreasing damping coefficients in the saddle point dynamics. If parameters of the proposed algorithm are proper, the algorithm owns O(1/t2) convergence without any strict or strong convexity requirement. Finally, we apply the algorithm to numerical examples to show the superior performance of the proposed algorithm over existing ones.
AB - First-order methods have simple structures and are of great importance to big data problems because first-order methods are easy to implement in a distributed or parallel way. However, in the worst cases, first-order methods often converge at a rate O(1/t), which is slow. This paper considers a class of convex-concave bilinear saddle point problems and proposes an accelerated first-order continuous-time algorithm. We design the accelerated algorithm by using both increasing and decreasing damping coefficients in the saddle point dynamics. If parameters of the proposed algorithm are proper, the algorithm owns O(1/t2) convergence without any strict or strong convexity requirement. Finally, we apply the algorithm to numerical examples to show the superior performance of the proposed algorithm over existing ones.
KW - Accelerated method
KW - Continuous-time algorithm
KW - First-order algorithm
KW - Saddle-point problem
UR - http://www.scopus.com/inward/record.url?scp=85105089835&partnerID=8YFLogxK
U2 - 10.1016/j.ifacol.2020.12.1257
DO - 10.1016/j.ifacol.2020.12.1257
M3 - Conference article
AN - SCOPUS:85105089835
SN - 2405-8963
VL - 53
SP - 7362
EP - 7367
JO - IFAC-PapersOnLine
JF - IFAC-PapersOnLine
IS - 2
T2 - 21st IFAC World Congress 2020
Y2 - 12 July 2020 through 17 July 2020
ER -