An audio-visual quality assessment methodology in virtual reality environment

Bo Zhang, Zhaoyu Yan, Jing Wang*, Yiyu Luo, Shu Yang, Zesong Fei

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Citations (Scopus)

Abstract

Panoramic video and spatial audio are widely used in Virtual Reality (VR) experience. To evaluate the quality of experience with higher veracity and efficiency, this paper presents a quality assessment methodology for audio-visual multimedia in virtual reality environment. By employing the audiovisual sequences with multiple combinations of video, audio and their alignment distortions, we conduct subjective assessment experiment and obtain user perception. The quality factors which represent different distortions are applied as the input to neural network. And thus the audio-visual objective quality assessment model is established. Ulteriorly, the performance of the model is evaluated, proving that the proposed methodology is suitable for audio-visual quality assessment in VR environment.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538641958
DOIs
Publication statusPublished - 28 Nov 2018
Event2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018 - San Diego, United States
Duration: 23 Jul 201827 Jul 2018

Publication series

Name2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018

Conference

Conference2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018
Country/TerritoryUnited States
CitySan Diego
Period23/07/1827/07/18

Keywords

  • Virtual reality
  • audio-visual quality assessment
  • audio-visual synchronization
  • panoramic audio
  • spatial audio

Fingerprint

Dive into the research topics of 'An audio-visual quality assessment methodology in virtual reality environment'. Together they form a unique fingerprint.

Cite this

Zhang, B., Yan, Z., Wang, J., Luo, Y., Yang, S., & Fei, Z. (2018). An audio-visual quality assessment methodology in virtual reality environment. In 2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018 Article 8551522 (2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMEW.2018.8551522