面向虚拟现实场景的房间脉冲响应计算模型

Zhiyu Li, Jing Wang*, Xinwen Yue, Lidong Yang, Shenghui Zhao, Xiang Xie

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

摘要

This study proposes a room impulse response (RIR) computation model tailored for virtual reality applications, integrating deep learning neural network techniques with psychoacoustic perception parameters. This model can efficiently predict perceptually meaningful RIRs from virtual reality scene data while ensuring high-quality predictions. It meets the requirements for real-time generation, high sampling rate, unrestricted length, and lightweight implementation in virtual reality audio scenarios. The model first encodes the acoustic information from the scene using a graph convolutional neural network, then decodes this information through a neural sound field and transposed convolution model to obtain the RIR perception parameters. Finally, the RIR signal is reconstructed from these parameters. Experimental results demonstrate that the proposed model offers significant advantages in RIR generation quality, computational efficiency, and functionality, making it well-suited to meet the real-time RIR generation needs of virtual reality audio.

投稿的翻译标题Room impulse response calculation model for virtual reality scenarios
源语言繁体中文
页(从-至)1186-1196
页数11
期刊Shengxue Xuebao/Acta Acustica
49
6
DOI
出版状态已出版 - 11月 2024

关键词

  • Deep learning
  • Perceptual parameter
  • Room impulse response
  • Virtual reality

指纹

探究 '面向虚拟现实场景的房间脉冲响应计算模型' 的科研主题。它们共同构成独一无二的指纹。

引用此