Real-time video stitching based on ORB features and SVM

Ruifeng Yuan, Ming Liu, Mei Hui, Yuejin Zhao, Liquan Dong, Lingqin Kong, Zhi Cai

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Real-time video stitching, which is used to obtain a large field video by some small field cameras, has great significance in real life. The existing video mosaic method based on SIFT features and RANSAC algorithm takes too much time in the processing of the first frame image, and the transformation matrix will have large errors when the number of the feature points matched correctly is small. In this paper, a real-time video stitching method based on ORB features and support vector machine (SVM) using binocular cameras is proposed. Firstly, the distortion of the cameras is corrected. Secondly, the ORB features in the overlapped regions of the first two frame images are extracted. Each pair of the feature points matched is filtered through the pre-trained SVM model. The matching calculation is terminated after 4 pairs of feature points are obtained and the transformation matrix can be calculated. Finally, the video stitching result can be obtained by image registration. The experiments show that the real-time seamless wide-field video can be obtained, and the first frame processing time of this method is much shorter than the other methods available, the frame frequency is 30fps.

Original languageEnglish
Title of host publicationApplications of Digital Image Processing XLI
EditorsAndrew G. Tescher
PublisherSPIE
ISBN (Print)9781510620759
DOIs
Publication statusPublished - 2018
EventApplications of Digital Image Processing XLI 2018 - San Diego, United States
Duration: 20 Aug 201823 Aug 2018

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume10752
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceApplications of Digital Image Processing XLI 2018
Country/TerritoryUnited States
CitySan Diego
Period20/08/1823/08/18

Keywords

  • ORB
  • SVM
  • image registration
  • video stitching

Fingerprint

Dive into the research topics of 'Real-time video stitching based on ORB features and SVM'. Together they form a unique fingerprint.

Cite this