TY - GEN
T1 - Image inpainting using Wasserstein Generative Adversarial Network
AU - Hua, Peng
AU - Liu, Xiaohua
AU - Liu, Ming
AU - Dong, Liquan
AU - Hui, Mei
AU - Zhao, Yuejin
N1 - Publisher Copyright:
© 2018 SPIE.
PY - 2018
Y1 - 2018
N2 - Recent advances in convolution neural networks have shown promising results for the challenging task of filling large missing regions in an image with semantically plausible and context aware details. These learning-based methods are significantly more effective in capturing high-level features than prior techniques, but often create distorted structures or blurry textures inconsistent with existing areas. This is mainly due to ineffectiveness of convolutional neural networks in explicitly borrowing or copying information from distant locations. Motivated by these observations, we use a convolution neural networks architecture with Atrous Spatial Pyramid Pooling module, which can obtain multi-scale objection information, to be our inpainting network. We also use global and local Wasserstein discriminators that are jointly trained to distinguish real images from completed ones. We evaluate our approach on four datasets including faces (CelebA) and natural images (Paris Streetview, COCO, ImageNet) and achieved state-of-the-art inpainting accuracy.
AB - Recent advances in convolution neural networks have shown promising results for the challenging task of filling large missing regions in an image with semantically plausible and context aware details. These learning-based methods are significantly more effective in capturing high-level features than prior techniques, but often create distorted structures or blurry textures inconsistent with existing areas. This is mainly due to ineffectiveness of convolutional neural networks in explicitly borrowing or copying information from distant locations. Motivated by these observations, we use a convolution neural networks architecture with Atrous Spatial Pyramid Pooling module, which can obtain multi-scale objection information, to be our inpainting network. We also use global and local Wasserstein discriminators that are jointly trained to distinguish real images from completed ones. We evaluate our approach on four datasets including faces (CelebA) and natural images (Paris Streetview, COCO, ImageNet) and achieved state-of-the-art inpainting accuracy.
KW - Atrous Spatial Pyramid Pooling
KW - Wasserstein discriminators
KW - convolution neural networks
KW - inpainting
UR - https://www.scopus.com/pages/publications/85054690729
U2 - 10.1117/12.2320212
DO - 10.1117/12.2320212
M3 - Conference contribution
AN - SCOPUS:85054690729
SN - 9781510620735
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - Optics and Photonics for Information Processing XII
A2 - Iftekharuddin, Khan M.
A2 - Diaz-Ramirez, Victor H.
A2 - Vazquez, Mireya Garcia
A2 - Awwal, Abdul A. S.
A2 - Marquez, Andres
PB - SPIE
T2 - Optics and Photonics for Information Processing XII 2018
Y2 - 19 August 2018 through 20 August 2018
ER -