An Unsupervised Colorization Method of Thermal Infrared Image Based on Edge Consistency

Jiaming Cai, Xin Tang, Yao Hu*, Shaohui Zhang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Due to the lack of pixel level structural matching data, thermal infrared grayscale images are more difficult to color than visible and near-infrared grayscale images. Therefore, this paper proposes a unsupervised learning method based on CycleGAN. On the basis of CycleGAN, a pre trained edge monitor is introduced to calculate the edge feature map before and after image transformation, and the edge similarity loss function is calculated as the basis for optimizing the neural network parameters. The experimental results show that the proposed method effectively reduces the loss of effective edge information during the coloring process and suppresses the generation of abnormal edge information during the coloring process.

Original languageEnglish
Title of host publicationThird International Conference on Advanced Algorithms and Neural Networks, AANN 2023
EditorsPavel Loskot, Xiaofeng Ding
PublisherSPIE
ISBN (Electronic)9781510668355
DOIs
Publication statusPublished - 2023
Event3rd International Conference on Advanced Algorithms and Neural Networks, AANN 2023 - Qingdao, China
Duration: 5 May 20237 May 2023

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12791
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference3rd International Conference on Advanced Algorithms and Neural Networks, AANN 2023
Country/TerritoryChina
CityQingdao
Period5/05/237/05/23

Keywords

  • Thermal to visible
  • deep learning
  • edge consistency loss
  • style transfer

Fingerprint

Dive into the research topics of 'An Unsupervised Colorization Method of Thermal Infrared Image Based on Edge Consistency'. Together they form a unique fingerprint.

Cite this