Template Matching Between Visible Light and Infrared Images

Jia Liu, Ming Liu*, Yuejin Zhao, Liquan Dong, Mei Hui, Lingqin Kong

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

In the field of computer vision, template matching technology is an important research direction. This technique compares the template image with the sample image to find out the position of the template image in the sample image. It has the characteristics of simple algorithm, small amount of calculation and high recognition rate, so it is usually used in other computer vision fields such as object detection and target tracking. In addition, with the popularity of infrared sensors, and infrared images can obtain additional information that is not included in visible light images, the integrated processing of visible light and infrared information has always been a research hotspot. The traditional template matching algorithm mainly focuses on the matching between visible light images. For the information difference between visible light and infrared images, the traditional template matching algorithms are difficult to achieve accurate matching between the two types of images, and the amount of calculation is large. In response to this problem, a template matching algorithm based on feature extraction of convolutional neural networks is proposed in this paper. Our method draws on the robust template matching using scale-adaptive deep convolutional features. We use a scale-adaptive method to extract the deep features of visible light and infrared images, and then uses the traditional NCC matching algorithm to obtain the matching position of the template on the feature map. Then the regression and optimization of the template position are performed to obtain the position of the template image on the sample image. The research results show that our method can achieve the matching of the infrared template on the visible light image, and the position error is not large.

Original languageEnglish
Title of host publication2021 International Conference on Optical Instruments and Technology
Subtitle of host publicationOptical Systems, Optoelectronic Instruments, Novel Display, and Imaging Technology
EditorsJuan Liu, Baohua Jia, Liangcai Cao, Xincheng Yao, Yongtian Wang, Takanori Nomura
PublisherSPIE
ISBN (Electronic)9781510655591
DOIs
Publication statusPublished - 2022
Event2021 International Conference on Optical Instruments and Technology: Optical Systems, Optoelectronic Instruments, Novel Display, and Imaging Technology - Virtual, Online, China
Duration: 8 Apr 202210 Apr 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12277
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference2021 International Conference on Optical Instruments and Technology: Optical Systems, Optoelectronic Instruments, Novel Display, and Imaging Technology
Country/TerritoryChina
CityVirtual, Online
Period8/04/2210/04/22

Keywords

  • Deep Learning
  • Infrared Image
  • Template Matching
  • Visible Light Image

Fingerprint

Dive into the research topics of 'Template Matching Between Visible Light and Infrared Images'. Together they form a unique fingerprint.

Cite this