TY - JOUR
T1 - Spatiotemporal convolution sleep network based on graph attention mechanism with automatic feature extraction
AU - Hu, Yidong
AU - Shi, Wenbin
AU - Yeh, Chien Hung
N1 - Publisher Copyright:
© 2023 Elsevier B.V.
PY - 2024/2
Y1 - 2024/2
N2 - Background and objective: Graph neural networks (GNNs) are widely used for automatic sleep staging. However, the majority of GNNs are based on spectral approaches, as far as we know, which heavily depend on the Laplacian eigenbasis determined by the graph structure with a large computing cost. Methods: We introduced a non-spectral approach named graph attention networks v2 (GATv2) as the core of our network to extract spatial information (S-GATv2 in our work), which is more flexible and intuitive than the routined spectral method. Meanwhile, to resolve the issue of weak generalization of using traditional feature extraction, the multi-convolutional layers are implemented to automatically extract features. In this work, the proposed spatiotemporal convolution sleep network (ST-GATv2) consists of multi-convolution layers and a GATv2 block. Of note, the graph attention technique to the time domain was applied to construct temporal GATv2 (T-GATv2), which intends to capture the connection between two channels in the adjacent sleep stages. Besides, the modified function is further proposed to capture the hidden changing trend information by the difference in the feature's value of the two adjacent stages. Results: In our experiment, we used the SS3 datasets in the MASS as our test datasets to compare with other advanced models. Our result reveals our model achieves the highest accuracy at 89.0 %. Besides, the proposed T-GATv2 block and modified function bring an approximate 0.5 % improvement in Kappa and F1-score. Conclusions: Our results support the potential of graph attention mechanisms and creative blocks (T-GATv2 and modified function) in sleep classification. We suggest the proposed ST-GATv2 model as an effective tool in sleep staging in either healthy or diseased states.
AB - Background and objective: Graph neural networks (GNNs) are widely used for automatic sleep staging. However, the majority of GNNs are based on spectral approaches, as far as we know, which heavily depend on the Laplacian eigenbasis determined by the graph structure with a large computing cost. Methods: We introduced a non-spectral approach named graph attention networks v2 (GATv2) as the core of our network to extract spatial information (S-GATv2 in our work), which is more flexible and intuitive than the routined spectral method. Meanwhile, to resolve the issue of weak generalization of using traditional feature extraction, the multi-convolutional layers are implemented to automatically extract features. In this work, the proposed spatiotemporal convolution sleep network (ST-GATv2) consists of multi-convolution layers and a GATv2 block. Of note, the graph attention technique to the time domain was applied to construct temporal GATv2 (T-GATv2), which intends to capture the connection between two channels in the adjacent sleep stages. Besides, the modified function is further proposed to capture the hidden changing trend information by the difference in the feature's value of the two adjacent stages. Results: In our experiment, we used the SS3 datasets in the MASS as our test datasets to compare with other advanced models. Our result reveals our model achieves the highest accuracy at 89.0 %. Besides, the proposed T-GATv2 block and modified function bring an approximate 0.5 % improvement in Kappa and F1-score. Conclusions: Our results support the potential of graph attention mechanisms and creative blocks (T-GATv2 and modified function) in sleep classification. We suggest the proposed ST-GATv2 model as an effective tool in sleep staging in either healthy or diseased states.
KW - Deep learning
KW - EEG
KW - Graph attention
KW - Representing learning
KW - Sleep classification
KW - Spatiotemporal graph convolution
UR - http://www.scopus.com/inward/record.url?scp=85181681489&partnerID=8YFLogxK
U2 - 10.1016/j.cmpb.2023.107930
DO - 10.1016/j.cmpb.2023.107930
M3 - Article
C2 - 38008039
AN - SCOPUS:85181681489
SN - 0169-2607
VL - 244
JO - Computer Methods and Programs in Biomedicine
JF - Computer Methods and Programs in Biomedicine
M1 - 107930
ER -