Intent capturing through multimodal inputs

Weimin Guo; Cheng Cheng; Mingkai Cheng; Yonghan Jiang; Honglin Tang

doi:10.1007/978-3-642-39330-3_26

Intent capturing through multimodal inputs

Weimin Guo, Cheng Cheng, Mingkai Cheng, Yonghan Jiang, Honglin Tang

School of Computer Science and Technology

Beijing Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Citations (Scopus)

Abstract

Virtual manufacturing environments need complex and accurate 3D human-computer interaction. One main problem of current virtual environments (VEs) is the heavy overloads of the users on both cognitive and motor operational aspects. This paper investigated multimodal intent delivery and intent inferring in virtual environments. Eye gazing modality is added into virtual assembly system. Typical intents expressed by dual hands and eye gazing modalities are designed. The reliability and accuracy of eye gazing modality is examined through experiments. The experiments showed that eye gazing and hand multimodal cooperation has a great potential to enhance the naturalness and efficiency of human-computer interaction (HCI).

Original language	English
Title of host publication	Human-Computer Interaction
Subtitle of host publication	Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings
Pages	243-251
Number of pages	9
Edition	PART 4
DOIs	https://doi.org/10.1007/978-3-642-39330-3_26
Publication status	Published - 2013
Event	15th International Conference on Human-Computer Interaction, HCI International 2013 - Las Vegas, NV, United States Duration: 21 Jul 2013 → 26 Jul 2013

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 4
Volume	8007 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	15th International Conference on Human-Computer Interaction, HCI International 2013
Country/Territory	United States
City	Las Vegas, NV
Period	21/07/13 → 26/07/13

Keywords

Eye tracking
human-computer interaction
intent
multimodal input
virtual assembly
virtual environment

Access to Document

10.1007/978-3-642-39330-3_26

Cite this

Guo, W., Cheng, C., Cheng, M., Jiang, Y., & Tang, H. (2013). Intent capturing through multimodal inputs. In Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings (PART 4 ed., pp. 243-251). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8007 LNCS, No. PART 4). https://doi.org/10.1007/978-3-642-39330-3_26

Guo, Weimin ; Cheng, Cheng ; Cheng, Mingkai et al. / Intent capturing through multimodal inputs. Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4. ed. 2013. pp. 243-251 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4).

@inproceedings{d7b158b6c6c94db7b0a7e6f34df07b82,

title = "Intent capturing through multimodal inputs",

abstract = "Virtual manufacturing environments need complex and accurate 3D human-computer interaction. One main problem of current virtual environments (VEs) is the heavy overloads of the users on both cognitive and motor operational aspects. This paper investigated multimodal intent delivery and intent inferring in virtual environments. Eye gazing modality is added into virtual assembly system. Typical intents expressed by dual hands and eye gazing modalities are designed. The reliability and accuracy of eye gazing modality is examined through experiments. The experiments showed that eye gazing and hand multimodal cooperation has a great potential to enhance the naturalness and efficiency of human-computer interaction (HCI).",

keywords = "Eye tracking, human-computer interaction, intent, multimodal input, virtual assembly, virtual environment",

author = "Weimin Guo and Cheng Cheng and Mingkai Cheng and Yonghan Jiang and Honglin Tang",

year = "2013",

doi = "10.1007/978-3-642-39330-3_26",

language = "English",

isbn = "9783642393297",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 4",

pages = "243--251",

booktitle = "Human-Computer Interaction",

edition = "PART 4",

note = "15th International Conference on Human-Computer Interaction, HCI International 2013 ; Conference date: 21-07-2013 Through 26-07-2013",

}

Guo, W, Cheng, C, Cheng, M, Jiang, Y & Tang, H 2013, Intent capturing through multimodal inputs. in Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 4, vol. 8007 LNCS, pp. 243-251, 15th International Conference on Human-Computer Interaction, HCI International 2013, Las Vegas, NV, United States, 21/07/13. https://doi.org/10.1007/978-3-642-39330-3_26

Intent capturing through multimodal inputs. / Guo, Weimin; Cheng, Cheng; Cheng, Mingkai et al.
Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4. ed. 2013. p. 243-251 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8007 LNCS, No. PART 4).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Intent capturing through multimodal inputs

AU - Guo, Weimin

AU - Cheng, Cheng

AU - Cheng, Mingkai

AU - Jiang, Yonghan

AU - Tang, Honglin

PY - 2013

Y1 - 2013

N2 - Virtual manufacturing environments need complex and accurate 3D human-computer interaction. One main problem of current virtual environments (VEs) is the heavy overloads of the users on both cognitive and motor operational aspects. This paper investigated multimodal intent delivery and intent inferring in virtual environments. Eye gazing modality is added into virtual assembly system. Typical intents expressed by dual hands and eye gazing modalities are designed. The reliability and accuracy of eye gazing modality is examined through experiments. The experiments showed that eye gazing and hand multimodal cooperation has a great potential to enhance the naturalness and efficiency of human-computer interaction (HCI).

AB - Virtual manufacturing environments need complex and accurate 3D human-computer interaction. One main problem of current virtual environments (VEs) is the heavy overloads of the users on both cognitive and motor operational aspects. This paper investigated multimodal intent delivery and intent inferring in virtual environments. Eye gazing modality is added into virtual assembly system. Typical intents expressed by dual hands and eye gazing modalities are designed. The reliability and accuracy of eye gazing modality is examined through experiments. The experiments showed that eye gazing and hand multimodal cooperation has a great potential to enhance the naturalness and efficiency of human-computer interaction (HCI).

KW - Eye tracking

KW - human-computer interaction

KW - intent

KW - multimodal input

KW - virtual assembly

KW - virtual environment

UR - http://www.scopus.com/inward/record.url?scp=84880646860&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-39330-3_26

DO - 10.1007/978-3-642-39330-3_26

M3 - Conference contribution

AN - SCOPUS:84880646860

SN - 9783642393297

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 243

EP - 251

BT - Human-Computer Interaction

T2 - 15th International Conference on Human-Computer Interaction, HCI International 2013

Y2 - 21 July 2013 through 26 July 2013

ER -

Guo W, Cheng C, Cheng M, Jiang Y, Tang H. Intent capturing through multimodal inputs. In Human-Computer Interaction: Interaction Modalities and Techniques - 15th International Conference, HCI International 2013, Proceedings. PART 4 ed. 2013. p. 243-251. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 4). doi: 10.1007/978-3-642-39330-3_26

Intent capturing through multimodal inputs

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this