TY - GEN
T1 - A source separation approach for the joint representation of OBA and SBA under reverberation conditions
AU - Peng, Jiawei
AU - Zhao, Shenghui
AU - Li, Zhiyu
AU - Cao, Xiao
AU - Wang, Jing
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Spatial audio is implemented in three formats, i.e., Channel-Based Audio (CBA), Object-Based Audio (OBA), and Scene-Based audio (SBA). The joint representation of multiple audio formats can combine their advantages to satisfy the technical requirements of complex audio scenes. Specifically, the joint representation of object-based audio and scene-based audio plays a crucial role in spatial audio. However, the recorded SBA signal contains the associated components of OBA, which results in mutual interference during sound field reconstruction. Therefore, separating the target SBA component from the original SBA signal becomes the key to achieving the combination of the two audio formats.In fact, our previous work deals with outdoor applications, and a source separation approach for the recorded SBA signals in the joint representation of OBA and SBA under non-reverberation conditions was proposed. In this paper, a linear convolution model for the original SBA signal under reverberation conditions is firstly built up for the indoor applications. Then an NMF-based sound source separation algorithm is proposed, while a novel EM parameter initialization method is also proposed for the algorithm. Finally, the effectiveness of the proposed separation algorithm is verified by groups of experiments.
AB - Spatial audio is implemented in three formats, i.e., Channel-Based Audio (CBA), Object-Based Audio (OBA), and Scene-Based audio (SBA). The joint representation of multiple audio formats can combine their advantages to satisfy the technical requirements of complex audio scenes. Specifically, the joint representation of object-based audio and scene-based audio plays a crucial role in spatial audio. However, the recorded SBA signal contains the associated components of OBA, which results in mutual interference during sound field reconstruction. Therefore, separating the target SBA component from the original SBA signal becomes the key to achieving the combination of the two audio formats.In fact, our previous work deals with outdoor applications, and a source separation approach for the recorded SBA signals in the joint representation of OBA and SBA under non-reverberation conditions was proposed. In this paper, a linear convolution model for the original SBA signal under reverberation conditions is firstly built up for the indoor applications. Then an NMF-based sound source separation algorithm is proposed, while a novel EM parameter initialization method is also proposed for the algorithm. Finally, the effectiveness of the proposed separation algorithm is verified by groups of experiments.
KW - joint representation
KW - object-based audio
KW - scene-based audio
KW - source separation
UR - https://www.scopus.com/pages/publications/86000009956
U2 - 10.1109/ICSIDP62679.2024.10868345
DO - 10.1109/ICSIDP62679.2024.10868345
M3 - Conference contribution
AN - SCOPUS:86000009956
T3 - IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
BT - IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
Y2 - 22 November 2024 through 24 November 2024
ER -