Skeleton-Based Multi-Stream Adaptive Graph Convolutional Network for Indoor Scene Action Recognition

Jiazhuo Li, Luefeng Chen*, Min Li, Min Wu, Witold Pedrycz, Kaoru Hirota

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With the rapid advances in computer vision, human action recognition has gradually received attention, but the current methods still exhibit some problems in indoor environments. The human skeleton, as the framework of human motion, contains high-quality actional feature information, and the skeleton-based action recognition method effectively avoid the interference of interior background noise and has advantages in indoor action recognition. The outstanding effect of graph convolutional networks on graph structure data processing has led to its rapid development and wide application in skeleton-based action recognition. Second-order skeletal information also contains a large number of actional features but is not effectively utilized. The artificial predefined topology of the human skeleton map has limitations, and cannot reflect the interaction between limbs. To solve the above problems, this article designs an adaptive weighted multi-stream graph convolutional network (AM-GCN) based on skeletal information, using an attention mechanism to enhance the network's ability to extract actional features, and an adaptive layer to make the construction graph more flexible, incorporating second-order skeletal features through a dual-stream architecture. In this article, the NTU-RGB+D dataset has been used for the experiments, the results show that the method in this article has good results.

Original languageEnglish
Title of host publicationProceedings - 2023 China Automation Congress, CAC 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6103-6108
Number of pages6
ISBN (Electronic)9798350303759
DOIs
Publication statusPublished - 2023
Externally publishedYes
Event2023 China Automation Congress, CAC 2023 - Chongqing, China
Duration: 17 Nov 202319 Nov 2023

Publication series

NameProceedings - 2023 China Automation Congress, CAC 2023

Conference

Conference2023 China Automation Congress, CAC 2023
Country/TerritoryChina
CityChongqing
Period17/11/2319/11/23

Keywords

  • action recognition
  • adaptive layer
  • attention mechanism
  • second-order skeleton information
  • skeleton-based

Fingerprint

Dive into the research topics of 'Skeleton-Based Multi-Stream Adaptive Graph Convolutional Network for Indoor Scene Action Recognition'. Together they form a unique fingerprint.

Cite this