Low-cost gaze and pulse analysis using realsense

Qiang Qiu; Zhuoqing Chang; Mark Draelos; Jie Chen; Alex Bronstein; Guillermo Sapiro

doi:10.4108/eai.14-10-2015.2261657

Low-cost gaze and pulse analysis using realsense

Qiang Qiu
, Zhuoqing Chang
, Mark Draelos
, Jie Chen
, Alex Bronstein
, Guillermo Sapiro

Duke University
University of Oulu
Tel Aviv University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Citations (Scopus)

Abstract

Intel's newly-Announced low-cost and high precision RealSense 3D (RGBD) camera is becoming ubiquitous in laptops and mobile devices starting this year, opening the door for new applications in the mobile health arena. In this paper, we demonstrate how the Intel RealSense 3D camera can be used for low-cost gaze tracking and passive pulse rate estimation. We develop a novel 3D gaze and fixation tracker based on the eye surface geometry as well as an illumination invari-ant pulse rate estimation method using near-infrared images captured with RealSense. We achieve a mean error of 1 cm at 20-30 cm for the gaze tracker and 2:26 bpm (beats per minute) for pulse estimation, which is adequate in many medical applications, demonstrating the great potential of novel consumer-grade RGBD technology in mobile health.

Original language	English
Title of host publication	MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies
Editors	Akram Alomainy, Yang Hao, William Whittow, Konstantina S. Nikita, Clive G. Parini
Publisher	ICST
ISBN (Electronic)	9781631900884
DOIs	https://doi.org/10.4108/eai.14-10-2015.2261657
Publication status	Published - 22 Dec 2015
Externally published	Yes
Event	5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies, MOBIHEALTH 2015 - London, United Kingdom Duration: 14 Oct 2015 → 16 Oct 2015

Publication series

Name	MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies

Conference

Conference	5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies, MOBIHEALTH 2015
Country/Territory	United Kingdom
City	London
Period	14/10/15 → 16/10/15

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 3 Good Health and Well-being

Keywords

Depth Camera
Gaze Tracker
Human Computer Interaction
Infrared
Mental Health
Mobile Health
Pulse Rate

Access to Document

10.4108/eai.14-10-2015.2261657

Cite this

Qiu, Q., Chang, Z., Draelos, M., Chen, J., Bronstein, A., & Sapiro, G. (2015). Low-cost gaze and pulse analysis using realsense. In A. Alomainy, Y. Hao, W. Whittow, K. S. Nikita, & C. G. Parini (Eds.), MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies (MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies). ICST. https://doi.org/10.4108/eai.14-10-2015.2261657

Qiu, Qiang ; Chang, Zhuoqing ; Draelos, Mark et al. / Low-cost gaze and pulse analysis using realsense. MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies. editor / Akram Alomainy ; Yang Hao ; William Whittow ; Konstantina S. Nikita ; Clive G. Parini. ICST, 2015. (MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies).

@inproceedings{f7d466f8cd2543358f1e566c5a4470b2,

title = "Low-cost gaze and pulse analysis using realsense",

abstract = "Intel's newly-Announced low-cost and high precision RealSense 3D (RGBD) camera is becoming ubiquitous in laptops and mobile devices starting this year, opening the door for new applications in the mobile health arena. In this paper, we demonstrate how the Intel RealSense 3D camera can be used for low-cost gaze tracking and passive pulse rate estimation. We develop a novel 3D gaze and fixation tracker based on the eye surface geometry as well as an illumination invari-ant pulse rate estimation method using near-infrared images captured with RealSense. We achieve a mean error of 1 cm at 20-30 cm for the gaze tracker and 2:26 bpm (beats per minute) for pulse estimation, which is adequate in many medical applications, demonstrating the great potential of novel consumer-grade RGBD technology in mobile health.",

keywords = "Depth Camera, Gaze Tracker, Human Computer Interaction, Infrared, Mental Health, Mobile Health, Pulse Rate",

author = "Qiang Qiu and Zhuoqing Chang and Mark Draelos and Jie Chen and Alex Bronstein and Guillermo Sapiro",

note = "Publisher Copyright: Copyright {\textcopyright} 2015 ICST.; 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies, MOBIHEALTH 2015 ; Conference date: 14-10-2015 Through 16-10-2015",

year = "2015",

month = dec,

day = "22",

doi = "10.4108/eai.14-10-2015.2261657",

language = "English",

series = "MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies",

publisher = "ICST",

editor = "Akram Alomainy and Yang Hao and William Whittow and Nikita, \{Konstantina S.\} and Parini, \{Clive G.\}",

booktitle = "MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies",

}

Qiu, Q, Chang, Z, Draelos, M, Chen, J, Bronstein, A & Sapiro, G 2015, Low-cost gaze and pulse analysis using realsense. in A Alomainy, Y Hao, W Whittow, KS Nikita & CG Parini (eds), MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies. MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies, ICST, 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies, MOBIHEALTH 2015, London, United Kingdom, 14/10/15. https://doi.org/10.4108/eai.14-10-2015.2261657

Low-cost gaze and pulse analysis using realsense. / Qiu, Qiang; Chang, Zhuoqing; Draelos, Mark et al.
MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies. ed. / Akram Alomainy; Yang Hao; William Whittow; Konstantina S. Nikita; Clive G. Parini. ICST, 2015. (MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Low-cost gaze and pulse analysis using realsense

AU - Qiu, Qiang

AU - Chang, Zhuoqing

AU - Draelos, Mark

AU - Chen, Jie

AU - Bronstein, Alex

AU - Sapiro, Guillermo

PY - 2015/12/22

Y1 - 2015/12/22

N2 - Intel's newly-Announced low-cost and high precision RealSense 3D (RGBD) camera is becoming ubiquitous in laptops and mobile devices starting this year, opening the door for new applications in the mobile health arena. In this paper, we demonstrate how the Intel RealSense 3D camera can be used for low-cost gaze tracking and passive pulse rate estimation. We develop a novel 3D gaze and fixation tracker based on the eye surface geometry as well as an illumination invari-ant pulse rate estimation method using near-infrared images captured with RealSense. We achieve a mean error of 1 cm at 20-30 cm for the gaze tracker and 2:26 bpm (beats per minute) for pulse estimation, which is adequate in many medical applications, demonstrating the great potential of novel consumer-grade RGBD technology in mobile health.

AB - Intel's newly-Announced low-cost and high precision RealSense 3D (RGBD) camera is becoming ubiquitous in laptops and mobile devices starting this year, opening the door for new applications in the mobile health arena. In this paper, we demonstrate how the Intel RealSense 3D camera can be used for low-cost gaze tracking and passive pulse rate estimation. We develop a novel 3D gaze and fixation tracker based on the eye surface geometry as well as an illumination invari-ant pulse rate estimation method using near-infrared images captured with RealSense. We achieve a mean error of 1 cm at 20-30 cm for the gaze tracker and 2:26 bpm (beats per minute) for pulse estimation, which is adequate in many medical applications, demonstrating the great potential of novel consumer-grade RGBD technology in mobile health.

KW - Depth Camera

KW - Gaze Tracker

KW - Human Computer Interaction

KW - Infrared

KW - Mental Health

KW - Mobile Health

KW - Pulse Rate

UR - https://www.scopus.com/pages/publications/85035023688

U2 - 10.4108/eai.14-10-2015.2261657

DO - 10.4108/eai.14-10-2015.2261657

M3 - Conference contribution

AN - SCOPUS:85035023688

T3 - MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies

BT - MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies

A2 - Alomainy, Akram

A2 - Hao, Yang

A2 - Whittow, William

A2 - Nikita, Konstantina S.

A2 - Parini, Clive G.

PB - ICST

T2 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies, MOBIHEALTH 2015

Y2 - 14 October 2015 through 16 October 2015

ER -

Qiu Q, Chang Z, Draelos M, Chen J, Bronstein A, Sapiro G. Low-cost gaze and pulse analysis using realsense. In Alomainy A, Hao Y, Whittow W, Nikita KS, Parini CG, editors, MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies. ICST. 2015. (MOBIHEALTH 2015 - 5th EAI International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare through Innovations in Mobile and Wireless Technologies). doi: 10.4108/eai.14-10-2015.2261657

Low-cost gaze and pulse analysis using realsense

Abstract

Publication series

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Fingerprint

Cite this