Research on Image Restoration Algorithms Based on Transformer Prediction Networks

Qingjuan Wang*, Shan Xiao, Yan Zhou, Lin Wang

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In recent years, with the rapid development of computer vision, there have been significant advancements in image restoration techniques. However, many current algorithms still struggle with accurately restoring degraded images with lost information. In this paper, we present a new image restoration algorithm called CodeFormerGAN, which is based on the Transformer model. This algorithm consists of three main components: Codebook, CLT network, and CFT. The Codebook module is responsible for learning self-reconstruction and storing high-quality face image parts. The Transformer in the CLT network models the overall composition of the face using low-quality input. The CFT module transforms image features to achieve a flexible balance between restoration quality and fidelity. Additionally, we introduce a GAN-based image super-resolution enhancement algorithm to enhance the sharpness of the restored image. The results of our experiments demonstrate that our proposed method produces higher-quality restoration results and exhibits better robustness when processing images in complex scenes.

源语言英语
主期刊名2023 IEEE 4th International Conference on Pattern Recognition and Machine Learning, PRML 2023
出版商Institute of Electrical and Electronics Engineers Inc.
243-249
页数7
ISBN(电子版)9798350324303
DOI
出版状态已出版 - 2023
活动4th IEEE International Conference on Pattern Recognition and Machine Learning, PRML 2023 - Urumqi, 中国
期限: 4 8月 20236 8月 2023

出版系列

姓名2023 IEEE 4th International Conference on Pattern Recognition and Machine Learning, PRML 2023

会议

会议4th IEEE International Conference on Pattern Recognition and Machine Learning, PRML 2023
国家/地区中国
Urumqi
时期4/08/236/08/23

指纹

探究 'Research on Image Restoration Algorithms Based on Transformer Prediction Networks' 的科研主题。它们共同构成独一无二的指纹。

引用此