跳到主要导航 跳到搜索 跳到主要内容

Facial-Based Heterogeneous Graph Representation Learning for Autism Spectrum Disorder Detection

  • Yongfeng Tao
  • , Tongxu Su
  • , Minqiang Yang*
  • , Minghui Ni
  • , Yingying She
  • , Weihao Zheng
  • , Bin Hu
  • *此作品的通讯作者
  • Lanzhou University
  • Xiamen University

科研成果: 期刊稿件文章同行评审

摘要

Autism spectrum disorder (ASD) is a neurodevelopmental disorder whose early manifestations may include atypical facial behaviors. Prior facial-based ASD studies often focus on localized static cues or short-range temporal variations, while under-exploring the joint modeling of temporal dynamics and non-local semantic consistency across facial states. In this work, we propose a graph representation learning framework consisting of a Graph Construction module (GC) and a heterogeneous graph neural network, HGMoE. The GC module builds a temporal–semantic heterogeneous graph from facial videos, where video frames are treated as nodes and heterogeneous edges encode both local temporal continuity and semantic similarity across frames. To better model heterogeneous relations and capture diverse graph signals, HGMoE integrates a Mixture-of-Experts (MoE) architecture with relation-aware edge attention. Specifically, the MoE dynamically routes messages to specialized experts, while the edge attention mechanism explicitly leverages edge types and initial semantic weights to modulate message passing across relations. Experiments on our recruited dataset achieve a classification accuracy of 97.4%, demonstrating the potential of the proposed framework for supporting facial-based ASD screening.

源语言英语
期刊IEEE Transactions on Affective Computing
DOI
出版状态已接受/待刊 - 2026
已对外发布

指纹

探究 'Facial-Based Heterogeneous Graph Representation Learning for Autism Spectrum Disorder Detection' 的科研主题。它们共同构成独一无二的指纹。

引用此