TY - JOUR
T1 - A broad-deep fusion network-based fuzzy emotional intention inference model for teaching validity evaluation
AU - Li, Min
AU - Chen, Luefeng
AU - Wu, Min
AU - Hirota, Kaoru
N1 - Publisher Copyright:
© 2023 Elsevier Inc.
PY - 2024/1
Y1 - 2024/1
N2 - A broad-deep fusion network-based fuzzy emotional inference model with personal information (BDFEI) is proposed for emotional intention understanding in human-robot interaction. It aims to understand students' intentions and evaluate the teaching validity through quantitative analysis in the university teaching scene. Specifically, broad-deep fusion network is carried out for facial emotion and behavior recognition. Then, fuzzy inference with personal information is used to understand the intention. The V-A emotion space is used to quantify students' studying status with originality, by mapping the output of Softmax. Finally, teaching validity is obtained by fuzzy inference. According to the recognition results, the accuracy on bimodal face and body gesture database (FABO) of our proposal is 12.21%, 1.89% and 0.78% higher than those of the sparse autoencoder-based fuzzy deep neural network (FDNNSA), geodesic flow kernel integrated with residual network (ResNet-101+GFK), the hierarchical classification fusion strategy (HCFS), respectively. Through the experiment on the self-built database, the accuracy of intention understanding is 90.48%, and the effectiveness of teaching validity evaluation method is confirmed.
AB - A broad-deep fusion network-based fuzzy emotional inference model with personal information (BDFEI) is proposed for emotional intention understanding in human-robot interaction. It aims to understand students' intentions and evaluate the teaching validity through quantitative analysis in the university teaching scene. Specifically, broad-deep fusion network is carried out for facial emotion and behavior recognition. Then, fuzzy inference with personal information is used to understand the intention. The V-A emotion space is used to quantify students' studying status with originality, by mapping the output of Softmax. Finally, teaching validity is obtained by fuzzy inference. According to the recognition results, the accuracy on bimodal face and body gesture database (FABO) of our proposal is 12.21%, 1.89% and 0.78% higher than those of the sparse autoencoder-based fuzzy deep neural network (FDNNSA), geodesic flow kernel integrated with residual network (ResNet-101+GFK), the hierarchical classification fusion strategy (HCFS), respectively. Through the experiment on the self-built database, the accuracy of intention understanding is 90.48%, and the effectiveness of teaching validity evaluation method is confirmed.
KW - Broad-deep network
KW - Emotional intention
KW - Teaching validity
UR - http://www.scopus.com/inward/record.url?scp=85176141650&partnerID=8YFLogxK
U2 - 10.1016/j.ins.2023.119837
DO - 10.1016/j.ins.2023.119837
M3 - Article
AN - SCOPUS:85176141650
SN - 0020-0255
VL - 654
JO - Information Sciences
JF - Information Sciences
M1 - 119837
ER -