TY - GEN
T1 - Hierarchical Window Attention for Motor Imagery EEG Classification
AU - Mou, Haonan
AU - Yang, Wenting
AU - Zhang, Shihao
AU - Pei, Zhaodi
AU - Li, Ziyu
AU - Wu, Xia
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Electroencephalography (EEG) plays a pivotal role in brain-computer interface (BCI). Among the various paradigms, motor imagery (MI) stands out as a spontaneous and valuable paradigm for applications in both cognitive neuroscience and clinical rehabilitation. The rapid propagation of action potentials suggests that crucial neural information may reside within local temporal domains, an aspect that has been underemphasized in previous study. To address this issue, we focus on extracting features from temporal neighborhoods of different scales and propose the utilization of a hierarchical window attention network for MI-EEG classification. Specifically, the temporal spatial embedding (TSE) module transforms EEG signals into token sequence. The local window attention (LWA) module and a hierarchical structure are devised for adaptive learning of local temporal dependencies within non-overlapping windows at various scales. Additionally, we employ a segmentation and reconstruction strategy for data augmentation. Our method outperforms other approaches, yielding an average classification accuracy of 90.84% on the BCI III-3a dataset and 83.14% on the BCI IV-2a dataset. Ablation studies and feature visualization further affirm the effectiveness of these modules.
AB - Electroencephalography (EEG) plays a pivotal role in brain-computer interface (BCI). Among the various paradigms, motor imagery (MI) stands out as a spontaneous and valuable paradigm for applications in both cognitive neuroscience and clinical rehabilitation. The rapid propagation of action potentials suggests that crucial neural information may reside within local temporal domains, an aspect that has been underemphasized in previous study. To address this issue, we focus on extracting features from temporal neighborhoods of different scales and propose the utilization of a hierarchical window attention network for MI-EEG classification. Specifically, the temporal spatial embedding (TSE) module transforms EEG signals into token sequence. The local window attention (LWA) module and a hierarchical structure are devised for adaptive learning of local temporal dependencies within non-overlapping windows at various scales. Additionally, we employ a segmentation and reconstruction strategy for data augmentation. Our method outperforms other approaches, yielding an average classification accuracy of 90.84% on the BCI III-3a dataset and 83.14% on the BCI IV-2a dataset. Ablation studies and feature visualization further affirm the effectiveness of these modules.
KW - Electroencephalography
KW - attention mechanism
KW - hierarchical structure
KW - local information
KW - motor imagery
UR - https://www.scopus.com/pages/publications/85203365209
U2 - 10.1109/ISBI56570.2024.10635122
DO - 10.1109/ISBI56570.2024.10635122
M3 - Conference contribution
AN - SCOPUS:85203365209
T3 - Proceedings - International Symposium on Biomedical Imaging
BT - IEEE International Symposium on Biomedical Imaging, ISBI 2024 - Conference Proceedings
PB - IEEE Computer Society
T2 - 21st IEEE International Symposium on Biomedical Imaging, ISBI 2024
Y2 - 27 May 2024 through 30 May 2024
ER -