Restoration of turbulence-degraded images based on deep convolutional network

Xiangyu Bai, Ming Liu, Chuan He, Liquan Dong, Yuejin Zhao, Xiaohua Liu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Citations (Scopus)

Abstract

Atmospheric turbulence is an irregular form of motion in the atmosphere. Because of turbulence interference, when the optical system through the atmosphere of the target imaging, the observed image will appear point intensity diffusion, image blur, image drift and other turbulence effects. Digital recovery of the turbulence-degraded images technique is a classical ill-conditioned problem by removing the blurring effect and suppressing the noise. Traditional approaches relying on image heuristics suffer from high frequency noise amplification and processing artifacts. In this paper, the image degradation models of the turbulent flow are given, the point spread function of turbulence is simulated by the similar Gaussian function model, and investigated a general framework of neural networks for restoring turbulence-degraded images. The blur and additive noise are considered simultaneously. Two solutions respectively exploiting fully convolutional networks (FCN) and conditional Generative Adversarial Networks (CGAN) are presented. The FCN based on minimizing the mean squared reconstruction error (MSE) in pixel space gets high PSNR. On the other side, the CGAN based on perceptual loss optimization criterion retrieves more textures. We conduct comparison experiments to demonstrate the performance at different degree of turbulence intensity from the training configuration. The results indicate that the proposed networks outperform traditional approaches for restoring high frequency details and suppressing noise effectively.

Original languageEnglish
Title of host publicationApplications of Machine Learning
EditorsMichael E. Zelinski, Tarek M. Taha, Jonathan Howe, Abdul A. S. Awwal, Khan M. Iftekharuddin
PublisherSPIE
ISBN (Electronic)9781510629714
DOIs
Publication statusPublished - 2019
EventApplications of Machine Learning 2019 - San Diego, United States
Duration: 13 Aug 201914 Aug 2019

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11139
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceApplications of Machine Learning 2019
Country/TerritoryUnited States
CitySan Diego
Period13/08/1914/08/19

Keywords

  • Conditional Generative Adversarial Networks
  • Fully Convolutional Networks
  • Turbulence-degraded Images

Fingerprint

Dive into the research topics of 'Restoration of turbulence-degraded images based on deep convolutional network'. Together they form a unique fingerprint.

Cite this