Fourier Feature Activated Neural-field Modelling For Human Avatar Representation

Qing Yang, Dongdong Weng*, Hua Zhang

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

In this paper, we introduce a novel neural representation method called Fourier Feature Activated Neural-field Modelling (FFANM) for 3D models. FFANM is designed to accurately and efficiently capture the surface geometry of 4D human avatars, which has numerous applications in the fields of remote conferencing, livestreaming marketing, short video web-cast, VR/AR, and video games and movie industry. While existing neural modelling methods are capable of representing either low-frequency or high-frequency surface geometry, they cannot do so simultaneously, resulting in poor overall representation quality. To address this limitation, we propose FFANM, which incorporates position encoding and periodic activation to leverage its Fourier properties for better representation of high-frequency information, while maintaining smooth surfaces free from noise. Our experiments demonstrate that FFANM outperforms state-of-the-art methods both quantitatively and qualitatively in terms of overall model reconstruction quality and high-frequency geometry details representation. Finally, We apply our proposed method, FFANM, in the 4D human avatar digitization pipeline and Metaverse application, and its superior visual performance demonstrates its capability in dynamic scenarios.

源语言英语
主期刊名Proceedings - 2023 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing and Data Security, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PCDS/Metaverse 2023
出版商Institute of Electrical and Electronics Engineers Inc.
ISBN(电子版)9798350319804
DOI
出版状态已出版 - 2023
活动9th IEEE Smart World Congress, SWC 2023 - Portsmouth, 英国
期限: 28 8月 202331 8月 2023

出版系列

姓名Proceedings - 2023 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Autonomous and Trusted Vehicles, Scalable Computing and Communications, Digital Twin, Privacy Computing and Data Security, Metaverse, SmartWorld/UIC/ATC/ScalCom/DigitalTwin/PCDS/Metaverse 2023

会议

会议9th IEEE Smart World Congress, SWC 2023
国家/地区英国
Portsmouth
时期28/08/2331/08/23

指纹

探究 'Fourier Feature Activated Neural-field Modelling For Human Avatar Representation' 的科研主题。它们共同构成独一无二的指纹。

引用此