Wearable Eye-Tracking System for Synchronized Multimodal Data Acquisition

Minqiang Yang, Yujie Gao, Longzhe Tang, Jian Hou, Bin Hu

Research output: Contribution to journalArticlepeer-review

8 Citations (Scopus)

Abstract

Eye-tracking technology is extensively utilized in affective computing research, enabling the investigation of emotional responses through the analysis of eye movements. Integration of eye-tracking with other modalities, allows for the collection of multimodal data, leading to a more comprehensive understanding of emotions and their relationship with physiological responses. This paper presents a novel head-mounted eye-tracking system for multimodal data acquisition with a completely redesigned structure and improved performance. We propose a novel method for pupil-fitting with high efficiency and robustness based on deep learning and RANSAC, which gets better performance of pupil segmentation when it is partially occluded, and build a 3D model to obtain gaze points. Existing eye trackers for multi-modal synchronous data collection either have limited device support or suffer from significant synchronization delays. Our proposed hard real-time synchronization mechanism implements microsecond level latency with low cost, which facilitates multimodal analysis for affective computing research. The uniquely designed exterior effectively reduces facial occlusion, making it more comfortable for the wearer while facilitating the capture of facial expressions.

Original languageEnglish
Pages (from-to)1
Number of pages1
JournalIEEE Transactions on Circuits and Systems for Video Technology
DOIs
Publication statusAccepted/In press - 2023
Externally publishedYes

Keywords

  • Cameras
  • Gaze tracking
  • Pupils
  • Solid modeling
  • Synchronization
  • Three-dimensional displays
  • Tracking
  • Wearable eye tracker
  • affective computing
  • eye movements
  • hard real-time synchronization

Fingerprint

Dive into the research topics of 'Wearable Eye-Tracking System for Synchronized Multimodal Data Acquisition'. Together they form a unique fingerprint.

Cite this