李群流形上的在线视频稳像算法

The traditional video stabilization algorithms cannot achieve good performance with a low latency. Aiming at this problem, an algorithm is proposed using the Lie group manifold based Kalman filter to stabilize videos in real time. The video frame motion is separated into rotation component and translation component. The rotation component can be represented by the rotation matrix obtained via the gyroscope data, while the translation component is provided by the translation matrix computed by the matching between video frames. Both the sequence of the rotation matrices and the translation matrices can form the motion paths on the Lie group manifold. Therefore, the Lie group manifold based Kalman filter is used to smooth the rotation and translation component, respectively. Finally, the video frame sequence can be stabilized by the motion compensation. The experimental results show that the proposed algorithm achieves high online real-time video stabilization performance on the mobile device.