Multi-View Reconstruction of Bullet Time Effect Based on Improved NSFF Model

Linquan Yu, Yan Gao, Feng Pan, Yan Helong, Yangtian Yan, Wentao Zeng

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Bullet time is a type of visual effect commonly used in films, television and games that makes time seem to slow down or stop while still preserving dynamic details in the scene. It usually requires multiple sets of cameras to move slowly with the subject and is synthesized using post-production techniques, which is costly and one-time. The dynamic scene perspective reconstruction technology based on the neural rendering field can be used to solve this requirement. However, most current methods are poor in reconstruction accuracy due to the blurred input image and overfitting of dynamic and static regions. Based on the NSFF algorithm, we reconstruct the common time special effects scenes in movies and television from a new perspective. We add a fuzzy kernel to the network for reconstruction and analysis of the fuzzy process and input the clear perspective after analysis into NSFF to improve accuracy. We use the optical flow prediction information to suppress the dynamic network timely and force it to improve the reconstruction effect of dynamic and static scenes independently, which improves the network's ability to understand and reconstruct dynamic and static scenes. We design a new dynamic and static cross-entropy loss to solve the overfitting problem of dynamic and static scenes. Experimental results show the improved NSFF-DSC model improves the reconstruction accuracy and enhances the understanding ability of dynamic and static scenes.

源语言英语
主期刊名Proceedings - 2023 China Automation Congress, CAC 2023
出版商Institute of Electrical and Electronics Engineers Inc.
682-687
页数6
ISBN(电子版)9798350303759
DOI
出版状态已出版 - 2023
活动2023 China Automation Congress, CAC 2023 - Chongqing, 中国
期限: 17 11月 202319 11月 2023

出版系列

姓名Proceedings - 2023 China Automation Congress, CAC 2023

会议

会议2023 China Automation Congress, CAC 2023
国家/地区中国
Chongqing
时期17/11/2319/11/23

指纹

探究 'Multi-View Reconstruction of Bullet Time Effect Based on Improved NSFF Model' 的科研主题。它们共同构成独一无二的指纹。

引用此