Auditory Attention Decoding in Four-Talker Environment with EEG

Yujie Yan, Xiran Xu, Haolin Zhu, Pei Tian, Zhongshu Ge, Xihong Wu, Jing Chen

Research output: Contribution to journalConference articlepeer-review

Abstract

Auditory Attention Decoding (AAD) is a technique that determines the focus of a listener's attention in complex auditory scenes according to cortical neural responses.Existing research largely examines two-talker scenarios, insufficient for real-world complexity.This study introduced a new AAD database for a four-talker scenario with speeches from four distinct talkers simultaneously presented and spatially separated, and listeners' EEG was recorded.Temporal response functions (TRFs) analysis showed that attended speech TRFs are stronger than each unattended speech.AAD methods based on stimulus-reconstruction (SR) and cortical spatial lateralization were employed and compared.Results indicated decoding accuracy of 77.5% in 60s (chance level of 25%) using SR.Using auditory spatial attention detection (ASAD) methods also indicated high accuracy (94.7% with DenseNet-3D in 1s), demonstrating ASAD methods' generalization performance.

Original languageEnglish
Pages (from-to)432-436
Number of pages5
JournalProceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
DOIs
Publication statusPublished - 2024
Externally publishedYes
Event25th Interspeech Conferece 2024 - Kos Island, Greece
Duration: 1 Sept 20245 Sept 2024

Keywords

  • auditory attention decoding
  • auditory spatial attention detection
  • DenseNet
  • EEG
  • stimulus reconstruction
  • temporal response functions

Fingerprint

Dive into the research topics of 'Auditory Attention Decoding in Four-Talker Environment with EEG'. Together they form a unique fingerprint.

Cite this

Yan, Y., Xu, X., Zhu, H., Tian, P., Ge, Z., Wu, X., & Chen, J. (2024). Auditory Attention Decoding in Four-Talker Environment with EEG. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 432-436. https://doi.org/10.21437/Interspeech.2024-739