A Multimodal Fusion Behaviors Estimation Method for Public Dangerous Monitoring

Renkai Hou, Xiangyang Xu*, Yaping Dai, Shuai Shao, Kaoru Hirota

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

At the present stage, the identification of dangerous behaviors in public places mostly relies on manual work, which is subjective and has low identification efficiency. This paper proposes an automatic identification method for dangerous behaviors in public places, which analyzes group behavior and speech emotion through deep learning network and then performs multimodal information fusion. Based on the fusion results, people can judge the emotional atmosphere of the crowd, make early warning, and alarm for possible dangerous behaviors. Experiments show that the algorithm adopted in this paper can accurately identify dangerous behaviors and has great application value.

Original languageEnglish
Pages (from-to)520-527
Number of pages8
JournalJournal of Advanced Computational Intelligence and Intelligent Informatics
Volume28
Issue number3
DOIs
Publication statusPublished - May 2024

Keywords

  • deep learning
  • group behavior recognition
  • multimodal fusion
  • speech emotion recognition

Fingerprint

Dive into the research topics of 'A Multimodal Fusion Behaviors Estimation Method for Public Dangerous Monitoring'. Together they form a unique fingerprint.

Cite this