TY - JOUR
T1 - A Multimodal Fusion Behaviors Estimation Method for Public Dangerous Monitoring
AU - Hou, Renkai
AU - Xu, Xiangyang
AU - Dai, Yaping
AU - Shao, Shuai
AU - Hirota, Kaoru
N1 - Publisher Copyright:
© Fuji Technology Press Ltd.
PY - 2024/5
Y1 - 2024/5
N2 - At the present stage, the identification of dangerous behaviors in public places mostly relies on manual work, which is subjective and has low identification efficiency. This paper proposes an automatic identification method for dangerous behaviors in public places, which analyzes group behavior and speech emotion through deep learning network and then performs multimodal information fusion. Based on the fusion results, people can judge the emotional atmosphere of the crowd, make early warning, and alarm for possible dangerous behaviors. Experiments show that the algorithm adopted in this paper can accurately identify dangerous behaviors and has great application value.
AB - At the present stage, the identification of dangerous behaviors in public places mostly relies on manual work, which is subjective and has low identification efficiency. This paper proposes an automatic identification method for dangerous behaviors in public places, which analyzes group behavior and speech emotion through deep learning network and then performs multimodal information fusion. Based on the fusion results, people can judge the emotional atmosphere of the crowd, make early warning, and alarm for possible dangerous behaviors. Experiments show that the algorithm adopted in this paper can accurately identify dangerous behaviors and has great application value.
KW - deep learning
KW - group behavior recognition
KW - multimodal fusion
KW - speech emotion recognition
UR - http://www.scopus.com/inward/record.url?scp=85194734505&partnerID=8YFLogxK
U2 - 10.20965/jaciii.2024.p0520
DO - 10.20965/jaciii.2024.p0520
M3 - Article
AN - SCOPUS:85194734505
SN - 1343-0130
VL - 28
SP - 520
EP - 527
JO - Journal of Advanced Computational Intelligence and Intelligent Informatics
JF - Journal of Advanced Computational Intelligence and Intelligent Informatics
IS - 3
ER -