The effect of temporal asynchrony on audiovisual integration

Jingjing Yang, Xiujun Li, Qi Li, Jinglong Wu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Many studies have shown that temporal asynchrony of visual-auditory stimuli can influence the integration between visual and auditory modality, however, the multisensory mechanisms of asynchronous inputs were not well understood. To investigate the effect of temporal asynchrony on audiovisual integration, we measured event-related potentials (ERPs) and behavior in human subjects. In this study, visual and auditory stimuli onset asynchronous (SOA= ±100 ms, ±50 ms, 0 ms), both the auditory and visual stimuli were attended. Using event-related potential, the differences of audiovisual integration elicited by asynchronous audiovisual stimuli were found at 140-200 ms over a wide parietal and occipital regions. These results revealed the asynchronous audiovisual stimuli enhanced the detection and elicited audiovisual integration. We expect that these results could helpful to process the audiovisual information of artificial intelligence.

Original languageEnglish
Title of host publication2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2338-2343
Number of pages6
ISBN (Electronic)9781509023943
DOIs
Publication statusPublished - 1 Sept 2016
Externally publishedYes
Event13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016 - Harbin, Heilongjiang, China
Duration: 7 Aug 201610 Aug 2016

Publication series

Name2016 IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016

Conference

Conference13th IEEE International Conference on Mechatronics and Automation, IEEE ICMA 2016
Country/TerritoryChina
CityHarbin, Heilongjiang
Period7/08/1610/08/16

Keywords

  • Audiovisual interaction
  • event-related potential
  • spatial information

Fingerprint

Dive into the research topics of 'The effect of temporal asynchrony on audiovisual integration'. Together they form a unique fingerprint.

Cite this