Wearable Eye-Tracking System for Synchronized Multimodal Data Acquisition

Minqiang Yang, Yujie Gao, Longzhe Tang, Jian Hou, Bin Hu

科研成果: 期刊稿件文章同行评审

12 引用 (Scopus)

摘要

Eye-tracking technology is extensively utilized in affective computing research, enabling the investigation of emotional responses through the analysis of eye movements. Integration of eye-tracking with other modalities, allows for the collection of multimodal data, leading to a more comprehensive understanding of emotions and their relationship with physiological responses. This paper presents a novel head-mounted eye-tracking system for multimodal data acquisition with a completely redesigned structure and improved performance. We propose a novel method for pupil-fitting with high efficiency and robustness based on deep learning and RANSAC, which gets better performance of pupil segmentation when it is partially occluded, and build a 3D model to obtain gaze points. Existing eye trackers for multi-modal synchronous data collection either have limited device support or suffer from significant synchronization delays. Our proposed hard real-time synchronization mechanism implements microsecond level latency with low cost, which facilitates multimodal analysis for affective computing research. The uniquely designed exterior effectively reduces facial occlusion, making it more comfortable for the wearer while facilitating the capture of facial expressions.

源语言英语
页(从-至)1
页数1
期刊IEEE Transactions on Circuits and Systems for Video Technology
DOI
出版状态已接受/待刊 - 2023
已对外发布

指纹

探究 'Wearable Eye-Tracking System for Synchronized Multimodal Data Acquisition' 的科研主题。它们共同构成独一无二的指纹。

引用此

Yang, M., Gao, Y., Tang, L., Hou, J., & Hu, B. (已接受/印刷中). Wearable Eye-Tracking System for Synchronized Multimodal Data Acquisition. IEEE Transactions on Circuits and Systems for Video Technology, 1. https://doi.org/10.1109/TCSVT.2023.3332814