目标运动轨迹匹配式的红外-可见光视频自动配准

In order to realize accurate and automatic infrared-visible video registration, a novel registration method was proposed based on matching the motion trajectories of targets. First, the top pixel of each foreground was tracked by using the multi-target tracking algorithm based on KCF. In this way, the trajectory of each target was obtained. Then, the normalized motion orientation descriptor and the normalized motion magnitude descriptor were established for each trajectory. The stepwise constraint matching framework was structured by using time analysis, orientation descriptor matching and magnitude descriptor matching. Finally, the best registration matrix was obtained with iterative updating. The method proposed was validated with the nine pairs of videos in the LITIV database. The results indicate that the overlap error of the proposed method is smaller than 0.2, which is close to or better than the manual Ground-Truth matrix. By adequately using the motion information of target, the algorithm can realize precise infrared-visible image sequence registration.