Temporal Difference Enhancement for High-Resolution Video Frame Interpolation

Xiulei Tan, Chongwen Wang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Video frame interpolation techniques provide a smoother visual experience by enhancing the temporal resolution of videos. To generate intermediate frames, numerous techniques estimate various parameters, such as optical flow and occlusion masks, directly on the original resolution images. As a result, processing high-resolution images requires more computing power and inference time. This paper proposes a lightweight network for high-resolution video frame interpolation that performs a complete interpolation workflow on low-resolution images to provide accurate low-resolution optical flow and occlusion masks. To effectively restore the optical flow and mask of the original resolution image, we propose an extremely lightweight temporal difference enhancement module that makes use of the hidden motion information in the temporal difference to aid in the restoration of optical flow and mask. The proposed network has comparable performance and faster inference speed for high-resolution video interpolation compared to the current mainstream network. The ablation experiment demonstrates the importance of the temporal difference module.

Original languageEnglish
Title of host publicationICMLC 2023 - Proceedings of the 2023 15th International Conference on Machine Learning and Computing
PublisherAssociation for Computing Machinery
Pages433-437
Number of pages5
ISBN (Electronic)9781450398411
DOIs
Publication statusPublished - 17 Feb 2023
Event15th International Conference on Machine Learning and Computing, ICMLC 2023 - Hybrid, Zhuhai, China
Duration: 17 Feb 202320 Feb 2023

Publication series

NameACM International Conference Proceeding Series

Conference

Conference15th International Conference on Machine Learning and Computing, ICMLC 2023
Country/TerritoryChina
CityHybrid, Zhuhai
Period17/02/2320/02/23

Keywords

  • High-resolution network
  • Lightweight network
  • Temporal difference
  • Video frame interpolation

Fingerprint

Dive into the research topics of 'Temporal Difference Enhancement for High-Resolution Video Frame Interpolation'. Together they form a unique fingerprint.

Cite this