Spatiotemporal Graph Convolutional Networks for EEG-Based Emotion Recognition

Weifeng Li, Wenbin Shi, Chien Hung Yeh*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Emotion recognition is a critical task in understanding human affective states and their impact on interactions with products, services, and brands. In this study, we introduce a novel spatiotemporal graph convolutional network (GCN) framework for EEG-based emotion recognition. Unlike conventional CNN and RNN models that struggle with non-Euclidean data structures, our approach leverages the spatial and temporal relationships between EEG channels, captured using advanced GCN techniques. The proposed framework includes spatial and spatiotemporal models, each further divided based on different feature inputs, including Differential Entropy (DE) and Power Spectral Density (PSD). We validate our models on the DEAP dataset, where the spatiotemporal model achieved a valence classification accuracy of 79.7% and an arousal classification accuracy of 68.2%. These results demonstrate that the optimal model configuration significantly enhances emotion classification accuracy, particularly in the recognition of both valence and arousal states. The findings suggest that incorporating GCNs into emotion recognition systems can effectively address the challenges posed by the complex, non-Euclidean structure of EEG data.

Original languageEnglish
Title of host publicationIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331515669
DOIs
Publication statusPublished - 2024
Event2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024 - Zhuhai, China
Duration: 22 Nov 202424 Nov 2024

Publication series

NameIEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024

Conference

Conference2nd IEEE International Conference on Signal, Information and Data Processing, ICSIDP 2024
Country/TerritoryChina
CityZhuhai
Period22/11/2424/11/24

Keywords

  • EEG
  • Emotion Recognition
  • Feature Extraction
  • GCN

Cite this