A Dual Network Approach with Enhanced Feature Guidance for SAR-to-Optical Image Translation

Jingfei He, Yongfei Mao, Liangbo Zhao, Zihan Cui, Yu Wang, Hao Shi*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Synthetic Aperture Radar (SAR) images own dominant merits, such as all-weather and all-day working conditions, but it is difficult for unprofessional people to interpret SAR images. Translating SAR images into optical images to assist interpretation can facilitate the transformation of SAR data into usable information. Therefore, an advanced SAR to Optical (S2O) image translation method utilizing a parallel Generative Adversarial Network (GAN) framework was proposed. This method incorporates an optical image reconstruction network alongside the S2O translation network, enhancing the fidelity and color consistency of the translated images. By employing a domain alignment module and a deep supervision feature loss module, the network effectively utilizes abundant optical image features to overcome the scarcity of SAR-optical image pairs. Experiments conducted on the SEN1-2 dataset demonstrate superior performance over existing methods, particularly in preserving detailed structural information in images.

Original languageEnglish
Title of host publicationIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331515669
DOIs
Publication statusPublished - 2024
Event2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024 - Zhuhai, China
Duration: 22 Nov 202424 Nov 2024

Publication series

NameIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024

Conference

Conference2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
Country/TerritoryChina
CityZhuhai
Period22/11/2424/11/24

Keywords

  • generative adversarial networks
  • SAR-to-image translation
  • Synthetic aperture radar

Fingerprint

Dive into the research topics of 'A Dual Network Approach with Enhanced Feature Guidance for SAR-to-Optical Image Translation'. Together they form a unique fingerprint.

Cite this

He, J., Mao, Y., Zhao, L., Cui, Z., Wang, Y., & Shi, H. (2024). A Dual Network Approach with Enhanced Feature Guidance for SAR-to-Optical Image Translation. In IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024 (IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICSIDP62679.2024.10868756