Effects of spatial frequency on audiovisual integration for communication between human and robot

Fengxia Wu, Xiaoyu Tang, Weiping Yang, Ejima Yoshimichi, Qiong Wu, Yanna Ren, Takanori Ohara, Satoshi Takahashi, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Combing audiovisual signals across modalities can facilitate human perception when communicate with each other in a noisy environment, but robot can't realize communication with human in a complex environment. Recent studies showed that audiovisual integration effects occurred for low intensity visual inputs, and whether visual spatial frequency can influence audiovisual integration is unclear. In order to investigate this, we design the audiovisual integration experiment used a high frequency auditory stimuli and low intensity visual spatial frequency stimuli. Participants were instructed to maintain central fixation and to make a speeded button response with their right index finger when a stimulus in either sensory modality (unimodal or bimodal) was detected. The results showed that low intensity visual facilitate the audiovisual integration, but there were not different among spatial frequency. These findings provide unique insight into how the brain processes an auditory stimuli and visual signal of different frequencies, and will provide some basic data for communication between human and robot.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1995-2000
Number of pages6
ISBN (Electronic)9781509023943
DOIs
Publication statusPublished - 1 Sept 2016
Externally publishedYes
Event13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 - Harbin, Heilongjiang, China
Duration: 7 Aug 201610 Aug 2016

Publication series

Name2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016

Conference

Conference13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
Country/TerritoryChina
CityHarbin, Heilongjiang
Period7/08/1610/08/16

Keywords

  • audiovisual integration
  • low intensity visual
  • robot communication system
  • spatial frequency

Cite this