Thermal infrared image coloring method and evaluation method based on edge consistency

Jiaming Cai, Xin Tang, Yao Hu*, Shaohui Zhang, Qun Hao

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Thermal imaging cameras have broad application prospects due to the characteristics of their shooting principles. With the development of deep learning technology, thermal infrared grayscale images can be transformed into RGB color images through a grayscale image colorization model, which provides more application possibilities for thermal infrared grayscale images. However, thermal infrared grayscale images are more difficult to color than visible and near-infrared grayscale images due to their lack of pixel-level matching visible light color map data. Therefore, we propose an unsupervised learning scheme based on CycleGAN, which reduces the loss of effective edge information and suppresses the generation of abnormal edge information during the colorization process by increasing the self-supervision of edge information in the cycle process. In addition, we propose a new edge similarity indicator Edge Consistency Index Measure (ECIM), which evaluates the quality of the coloring results from the perspective of edge consistency before and after colorization. By comparing with the existing methods, we show that our method is better than the existing methods in coloring effect, and the proposed ECIM can well describe the consistency of the edges before and after colorization.

Original languageEnglish
Article number104946
JournalInfrared Physics and Technology
Volume135
DOIs
Publication statusPublished - Dec 2023

Keywords

  • Deep learning
  • Edge consistency index measure
  • Edge consistency loss
  • Style transfer
  • Thermal to visible
  • Unsupervised

Fingerprint

Dive into the research topics of 'Thermal infrared image coloring method and evaluation method based on edge consistency'. Together they form a unique fingerprint.

Cite this