TY - GEN
T1 - A robust change-point detection method by eliminating sparse noises from time series
AU - Qin, Kun
AU - Sun, Lei
AU - Liu, Bo
AU - Fan, Yuan
AU - Toh, Kar Ann
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/7/16
Y1 - 2018/7/16
N2 - Singular Spectrum Transform (SST) is a fundamental subspace analysis technique which has been widely adopted for solving change-point detection (CPD) problems in information security applications. However, the performance of a SST based CPD algorithm is limited to the lack of robustness to corrupted observations with large noises in practice. Based on the observation that large noises in practical time series are generally sparse, in this paper, we study a combination of Robust Principal Component Analysis (RPCA) and SST to obtain a robust CPD algorithm dealing with sparse large noises. The sparse large noises are to be eliminated from observation trajectory matrices by performing a low-rank matrix recovery procedure of RPCA. The noise-eliminated matrices are then used to extract SST subspaces for CPD. The effectiveness of the proposed method is demonstrated through experiments based on both synthetic and real-world datasets. Experimental results show that the proposed method outperforms the competing state-of-the-arts in terms of detection accuracy for time series with sparse large noises.
AB - Singular Spectrum Transform (SST) is a fundamental subspace analysis technique which has been widely adopted for solving change-point detection (CPD) problems in information security applications. However, the performance of a SST based CPD algorithm is limited to the lack of robustness to corrupted observations with large noises in practice. Based on the observation that large noises in practical time series are generally sparse, in this paper, we study a combination of Robust Principal Component Analysis (RPCA) and SST to obtain a robust CPD algorithm dealing with sparse large noises. The sparse large noises are to be eliminated from observation trajectory matrices by performing a low-rank matrix recovery procedure of RPCA. The noise-eliminated matrices are then used to extract SST subspaces for CPD. The effectiveness of the proposed method is demonstrated through experiments based on both synthetic and real-world datasets. Experimental results show that the proposed method outperforms the competing state-of-the-arts in terms of detection accuracy for time series with sparse large noises.
KW - Change-point detection
KW - Information security
KW - Robust principal component analysis
KW - Singular spectrum transform
UR - http://www.scopus.com/inward/record.url?scp=85051030176&partnerID=8YFLogxK
U2 - 10.1109/DSC.2018.00029
DO - 10.1109/DSC.2018.00029
M3 - Conference contribution
AN - SCOPUS:85051030176
T3 - Proceedings - 2018 IEEE 3rd International Conference on Data Science in Cyberspace, DSC 2018
SP - 146
EP - 152
BT - Proceedings - 2018 IEEE 3rd International Conference on Data Science in Cyberspace, DSC 2018
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 3rd IEEE International Conference on Data Science in Cyberspace, DSC 2018
Y2 - 18 June 2018 through 21 June 2018
ER -