基于双残差注意力网络的ICMOS图像去噪算法

Xia Wang, Xin Zhang, Gangcheng Jiao, Ye Yang, Hongchang Cheng, Bo Yan

科研成果: 期刊稿件文章同行评审

2 引用 (Scopus)

摘要

Low-light-level night vision technology is to explore the photoelectric technology that how to enhance, transmit, store, reproduce and apply the images captured under low light conditions. It is an important part of modern optoelectronic technology. ICCD/ICMOS (Intensified CCD/CMOS) is a solid low-light imaging device with a wide range of applications and the lowest working illuminance which is formed by coupling an image intensifier and CCD/CMOS. Although ICMOS can image under low-light night vision conditions, the image intensifier also amplifies the intensity of the noise while enhancing the signal, resulting in obvious random noise in the captured image, and the noise characteristics are more complex than that of traditional CMOS imaging. Due to the microchannel plates, ICMOS sensing image noise is not independent and identically distributed, but aggregated random noise with spatial correlation. Aggregated noise destroys the original structural features of the image, which also greatly increases the difficulty of denoising. In this paper, we propose a dual residual attention network for ICMOS sensing image denoising. There are three main ideas for our method. First, the network adopts the idea of residual learning, which means that the output of the network is the noise image, not the denoised image. Then the denoised image is achieved by subtracting the noise image from the original image. The residual learning network only needs to extract the noise component from the original image, which greatly reduces the difficulty of training the network. Secondly, we introduce four residual attention modules in our model, and the number of feature maps of each module is constantly decreasing. Each residual attention module consists of four residual blocks, one channel attention layer and one convolutional layer. The basic unit of the module is the residual block, which can effectively improve the network performance. At the same time, the introduction of the residual module can better solve the problems of gradient dispersion, gradient explosion and gradient degradation. Finally, the network introduces the channel attention layer, which can assign different weights to the output feature map of the middle layer, thereby analyzing the importance of each feature channel, and then enhancing the useful features and suppressing slight features according to this importance, and finally guide the network to continuously reduce the dimension of the feature map. Existing deep learning denoising methods mostly work for simulated Gauss-Poisson distributed noise and real noise data of some natural images. These methods can not be directly applied to ICMOS sensing images. Due to the particularity of ICMOS imaging noise, we made the ICMOS image dataset ourselves. We adopt the multi-frame averaging method to obtain the label image The image sequence is captured from a static scene under a certain fixed illumination in the dark room, and then one label clean image of the image sequence is synthesized by a multi-frame weighted average method. The scene illuminance is accurately measured with an illuminance meter. This dataset is mainly based on three different illuminances 2 × 10 - 1 、 3 × 10 - 2 、 2 × 10 - 3 l x for image acquisition, and seven different static scenes are collected under each illuminance condition. Due to the inconsistency of noise intensity and brightness, we conduct model training for images under different illuminances. Two static scenes with 1 000 images are used as training sets under each illuminance. Our method applied the L1 loss as the loss function. From the subjective and objective results, it can be seen that our method has better denoising results and higher efficiency than other state-of-art methods.

投稿的翻译标题Dual Residual Attention Network for ICMOS Sensing Image
源语言繁体中文
文章编号0610002
期刊Guangzi Xuebao/Acta Photonica Sinica
51
6
DOI
出版状态已出版 - 1 6月 2022

关键词

  • Attention module
  • ICMOS sensing image
  • Image denoising
  • Low-light-level night vision
  • Residual learning

指纹

探究 '基于双残差注意力网络的ICMOS图像去噪算法' 的科研主题。它们共同构成独一无二的指纹。

引用此