TY - GEN
T1 - Restoration of turbulence-degraded images based on deep convolutional network
AU - Bai, Xiangyu
AU - Liu, Ming
AU - He, Chuan
AU - Dong, Liquan
AU - Zhao, Yuejin
AU - Liu, Xiaohua
N1 - Publisher Copyright:
© COPYRIGHT SPIE. Downloading of the abstract is permitted for personal use only.
PY - 2019
Y1 - 2019
N2 - Atmospheric turbulence is an irregular form of motion in the atmosphere. Because of turbulence interference, when the optical system through the atmosphere of the target imaging, the observed image will appear point intensity diffusion, image blur, image drift and other turbulence effects. Digital recovery of the turbulence-degraded images technique is a classical ill-conditioned problem by removing the blurring effect and suppressing the noise. Traditional approaches relying on image heuristics suffer from high frequency noise amplification and processing artifacts. In this paper, the image degradation models of the turbulent flow are given, the point spread function of turbulence is simulated by the similar Gaussian function model, and investigated a general framework of neural networks for restoring turbulence-degraded images. The blur and additive noise are considered simultaneously. Two solutions respectively exploiting fully convolutional networks (FCN) and conditional Generative Adversarial Networks (CGAN) are presented. The FCN based on minimizing the mean squared reconstruction error (MSE) in pixel space gets high PSNR. On the other side, the CGAN based on perceptual loss optimization criterion retrieves more textures. We conduct comparison experiments to demonstrate the performance at different degree of turbulence intensity from the training configuration. The results indicate that the proposed networks outperform traditional approaches for restoring high frequency details and suppressing noise effectively.
AB - Atmospheric turbulence is an irregular form of motion in the atmosphere. Because of turbulence interference, when the optical system through the atmosphere of the target imaging, the observed image will appear point intensity diffusion, image blur, image drift and other turbulence effects. Digital recovery of the turbulence-degraded images technique is a classical ill-conditioned problem by removing the blurring effect and suppressing the noise. Traditional approaches relying on image heuristics suffer from high frequency noise amplification and processing artifacts. In this paper, the image degradation models of the turbulent flow are given, the point spread function of turbulence is simulated by the similar Gaussian function model, and investigated a general framework of neural networks for restoring turbulence-degraded images. The blur and additive noise are considered simultaneously. Two solutions respectively exploiting fully convolutional networks (FCN) and conditional Generative Adversarial Networks (CGAN) are presented. The FCN based on minimizing the mean squared reconstruction error (MSE) in pixel space gets high PSNR. On the other side, the CGAN based on perceptual loss optimization criterion retrieves more textures. We conduct comparison experiments to demonstrate the performance at different degree of turbulence intensity from the training configuration. The results indicate that the proposed networks outperform traditional approaches for restoring high frequency details and suppressing noise effectively.
KW - Conditional Generative Adversarial Networks
KW - Fully Convolutional Networks
KW - Turbulence-degraded Images
UR - http://www.scopus.com/inward/record.url?scp=85075720826&partnerID=8YFLogxK
U2 - 10.1117/12.2527593
DO - 10.1117/12.2527593
M3 - Conference contribution
AN - SCOPUS:85075720826
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - Applications of Machine Learning
A2 - Zelinski, Michael E.
A2 - Taha, Tarek M.
A2 - Howe, Jonathan
A2 - Awwal, Abdul A. S.
A2 - Iftekharuddin, Khan M.
PB - SPIE
T2 - Applications of Machine Learning 2019
Y2 - 13 August 2019 through 14 August 2019
ER -