A Multi-Modal Behavior Quantitative Analysis Model for Autism Early Screening

Jiayi Lei, E. Zhang, Yingying She*, Xin Wang, Yuhan Liao, Bin Hu, Hang Wu, Minqiang Yang, Jiajia Tian, Yong Wang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Human-Computer Interaction (HCI) and Machine Learning (ML) technologies have potential for the behavioral screening of autistic children but how to design a tool and analyse behavior reliably is challenging. Based on psychophysiological computation, this paper proposes an interactive behavior perception analytical model for autism screening. We presented the multi-scenario reactive behavior paradigms that designed based on the atypical characteristics of autistic children. We recorded the eye movement data and facial data of 91 participants, and performed multi-modal feature extraction, used machine learning to train classification model. We conducted comparative experiments, and the experimental results verified the advantages of multi-scenario paradigms and multi-modal feature groups, which indicates that our analysis methods and screening models are effective and reliable and have real research significance.

Original languageEnglish
Title of host publication2023 IEEE International Conference on Systems, Man, and Cybernetics
Subtitle of host publicationImproving the Quality of Life, SMC 2023 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages5132-5139
Number of pages8
ISBN (Electronic)9798350337020
DOIs
Publication statusPublished - 2023
Event2023 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2023 - Hybrid, Honolulu, United States
Duration: 1 Oct 20234 Oct 2023

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
ISSN (Print)1062-922X

Conference

Conference2023 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2023
Country/TerritoryUnited States
CityHybrid, Honolulu
Period1/10/234/10/23

Fingerprint

Dive into the research topics of 'A Multi-Modal Behavior Quantitative Analysis Model for Autism Early Screening'. Together they form a unique fingerprint.

Cite this