TY - JOUR
T1 - Neuroanatomy-Informed Brain–Machine Hybrid Intelligence for Robust Acoustic Target Detection
AU - Shi, Jianting
AU - Wang, Jiaqi
AU - Fei, Weijie
AU - Feleke, Aberham Genetu
AU - Bi, Luzheng
N1 - Publisher Copyright:
Copyright © 2025 Jianting Shi et al.
PY - 2025/1
Y1 - 2025/1
N2 - Sound target detection (STD) plays a critical role in modern acoustic sensing systems. However, existing automated STD methods show poor robustness and limited generalization, especially under low signal-to-noise ratio (SNR) conditions or when processing previously unencountered sound categories. To overcome these limitations, we first propose a brain–computer interface (BCI)-based STD method that utilizes neural responses to auditory stimuli. Our approach features the Triple-Region Spatiotemporal Dynamics Attention Network (Tri-SDANet), an electroencephalogram (EEG) decoding model incorporating neuroanatomical priors derived from EEG source analysis to enhance decoding accuracy and provide interpretability in complex auditory scenes. Recognizing the inherent limitations of stand-alone BCI systems (notably their high false alarm rates), we further develop an adaptive confidence-based brain–machine fusion strategy that intelligently combines decisions from both the BCI and conventional acoustic detection models. This hybrid approach effectively merges the complementary strengths of neural perception and acoustic feature learning. We validate the proposed method through experiments with 16 participants. Experimental results demonstrate that the Tri-SDANet achieves state-of-the-art performance in neural decoding under complex acoustic conditions. Moreover, the hybrid system maintains reliable detection performance at low SNR levels while exhibiting remarkable generalization to unseen target classes. In addition, source-level EEG analysis reveals distinct brain activation patterns associated with target perception, offering neuroscientific validation for our model design. This work pioneers a neuro-acoustic fusion paradigm for robust STD, offering a generalizable solution for real-world applications through the integration of noninvasive neural signals with artificial intelligence.
AB - Sound target detection (STD) plays a critical role in modern acoustic sensing systems. However, existing automated STD methods show poor robustness and limited generalization, especially under low signal-to-noise ratio (SNR) conditions or when processing previously unencountered sound categories. To overcome these limitations, we first propose a brain–computer interface (BCI)-based STD method that utilizes neural responses to auditory stimuli. Our approach features the Triple-Region Spatiotemporal Dynamics Attention Network (Tri-SDANet), an electroencephalogram (EEG) decoding model incorporating neuroanatomical priors derived from EEG source analysis to enhance decoding accuracy and provide interpretability in complex auditory scenes. Recognizing the inherent limitations of stand-alone BCI systems (notably their high false alarm rates), we further develop an adaptive confidence-based brain–machine fusion strategy that intelligently combines decisions from both the BCI and conventional acoustic detection models. This hybrid approach effectively merges the complementary strengths of neural perception and acoustic feature learning. We validate the proposed method through experiments with 16 participants. Experimental results demonstrate that the Tri-SDANet achieves state-of-the-art performance in neural decoding under complex acoustic conditions. Moreover, the hybrid system maintains reliable detection performance at low SNR levels while exhibiting remarkable generalization to unseen target classes. In addition, source-level EEG analysis reveals distinct brain activation patterns associated with target perception, offering neuroscientific validation for our model design. This work pioneers a neuro-acoustic fusion paradigm for robust STD, offering a generalizable solution for real-world applications through the integration of noninvasive neural signals with artificial intelligence.
UR - https://www.scopus.com/pages/publications/105018949192
U2 - 10.34133/cbsystems.0438
DO - 10.34133/cbsystems.0438
M3 - Article
AN - SCOPUS:105018949192
SN - 2097-1087
VL - 6
JO - Cyborg and Bionic Systems
JF - Cyborg and Bionic Systems
M1 - 0438
ER -