Annotation Tool for Precise Emotion Ground Truth Label Acquisition while Watching 360° VR Videos

Tong Xue, Abdallah El Ali, Gangyi Ding, Pablo Cesar

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)

Abstract

We demonstrate an HMD-based annotation tool for collecting precise emotion ground truth labels while users are watching 360° videos in Virtual Reality (VR). Our tool uses an HTC VIVE Pro Eye HMD for displaying 360° videos, a Joy-Con controller for inputting emotion annotations, and an Empatica E4 wristband for capturing physiological signals. Timestamps of these devices are synchronized via an NTP server. Following dimensional emotion models, users can report their emotion in terms of valence and arousal as they watch a video in VR. Annotation feedback is provided through two peripheral visualization techniques: HaloLight and DotSize. Our annotation tool provides a starting point for researchers to design momentary and continuous self-reports in virtual environments to enable fine-grained emotion recognition.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages371-372
Number of pages2
ISBN (Electronic)9781728174631
DOIs
Publication statusPublished - Dec 2020
Event3rd IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020 - Virtual, Utrecht, Netherlands
Duration: 14 Dec 202018 Dec 2020

Publication series

NameProceedings - 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020

Conference

Conference3rd IEEE International Conference on Artificial Intelligence and Virtual Reality, AIVR 2020
Country/TerritoryNetherlands
CityVirtual, Utrecht
Period14/12/2018/12/20

Keywords

  • 360°video
  • continuous
  • emotion annotation
  • ground truth labels

Fingerprint

Dive into the research topics of 'Annotation Tool for Precise Emotion Ground Truth Label Acquisition while Watching 360° VR Videos'. Together they form a unique fingerprint.

Cite this