TY - GEN
T1 - Skeleton-Based Multi-Stream Adaptive Graph Convolutional Network for Indoor Scene Action Recognition
AU - Li, Jiazhuo
AU - Chen, Luefeng
AU - Li, Min
AU - Wu, Min
AU - Pedrycz, Witold
AU - Hirota, Kaoru
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - With the rapid advances in computer vision, human action recognition has gradually received attention, but the current methods still exhibit some problems in indoor environments. The human skeleton, as the framework of human motion, contains high-quality actional feature information, and the skeleton-based action recognition method effectively avoid the interference of interior background noise and has advantages in indoor action recognition. The outstanding effect of graph convolutional networks on graph structure data processing has led to its rapid development and wide application in skeleton-based action recognition. Second-order skeletal information also contains a large number of actional features but is not effectively utilized. The artificial predefined topology of the human skeleton map has limitations, and cannot reflect the interaction between limbs. To solve the above problems, this article designs an adaptive weighted multi-stream graph convolutional network (AM-GCN) based on skeletal information, using an attention mechanism to enhance the network's ability to extract actional features, and an adaptive layer to make the construction graph more flexible, incorporating second-order skeletal features through a dual-stream architecture. In this article, the NTU-RGB+D dataset has been used for the experiments, the results show that the method in this article has good results.
AB - With the rapid advances in computer vision, human action recognition has gradually received attention, but the current methods still exhibit some problems in indoor environments. The human skeleton, as the framework of human motion, contains high-quality actional feature information, and the skeleton-based action recognition method effectively avoid the interference of interior background noise and has advantages in indoor action recognition. The outstanding effect of graph convolutional networks on graph structure data processing has led to its rapid development and wide application in skeleton-based action recognition. Second-order skeletal information also contains a large number of actional features but is not effectively utilized. The artificial predefined topology of the human skeleton map has limitations, and cannot reflect the interaction between limbs. To solve the above problems, this article designs an adaptive weighted multi-stream graph convolutional network (AM-GCN) based on skeletal information, using an attention mechanism to enhance the network's ability to extract actional features, and an adaptive layer to make the construction graph more flexible, incorporating second-order skeletal features through a dual-stream architecture. In this article, the NTU-RGB+D dataset has been used for the experiments, the results show that the method in this article has good results.
KW - action recognition
KW - adaptive layer
KW - attention mechanism
KW - second-order skeleton information
KW - skeleton-based
UR - http://www.scopus.com/inward/record.url?scp=85189327444&partnerID=8YFLogxK
U2 - 10.1109/CAC59555.2023.10451388
DO - 10.1109/CAC59555.2023.10451388
M3 - Conference contribution
AN - SCOPUS:85189327444
T3 - Proceedings - 2023 China Automation Congress, CAC 2023
SP - 6103
EP - 6108
BT - Proceedings - 2023 China Automation Congress, CAC 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2023 China Automation Congress, CAC 2023
Y2 - 17 November 2023 through 19 November 2023
ER -