Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Jun Gong, Siyuan Li, Shiyu Chen, Liang Nie, Xin Cheng*, Zhiqiang Zhang, Wenxin Yu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Recently, learning-based image inpainting has gained much attention. It widely utilizes an auto-encoder structure and can obtain compact feature representation in the encoder to achieve high-quality image inpainting. Although this approach has achieved encouraging inpainting results, it inevitably reduces the high-resolution representation due to interval downsampling. In order to solve this problem and achieve an excellent image inpainting effect, this paper proposes a brand-new generative network, Interactive Separation Network, which retains the high-resolution information and extracts the semantic features from corrupted images. Furthermore, this paper also discusses network designs with different complexity in different application scenarios. Finally, to improve the effectiveness and robustness of our proposal to large corrupted regions in the inpainting image, we further propose a flexible and highly reusable reconstruction scheme to complete the inpainting in the prediction process gradually. Experiments show that our proposed generation network and reconstruction scheme can significantly improve the quality of repaired images. The proposed method significantly outperforms the state-of-the-art image inpainting approaches in image quality.

Original languageEnglish
Pages (from-to)67814-67825
Number of pages12
JournalIEEE Access
Volume10
DOIs
Publication statusPublished - 2022

Keywords

  • Image inpainting
  • feature fusion
  • image completion
  • reconstruction algorithms

Fingerprint

Dive into the research topics of 'Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm'. Together they form a unique fingerprint.

Cite this