Skip to main navigation Skip to search Skip to main content

A Multi-Graph Cross-Attention-Based Region-Aware Feature Fusion Network Using Multi-Template for Brain Disorder Diagnosis

  • Yulan Ma
  • , Weigang Cui
  • , Jingyu Liu
  • , Yuzhu Guo
  • , Huiling Chen
  • , Yang Li*
  • *Corresponding author for this work
  • Beihang University
  • Wenzhou University

Research output: Contribution to journalArticlepeer-review

Abstract

Functional connectivity (FC) networks based on resting-state functional magnetic imaging (rs-fMRI) are reliable and sensitive for brain disorder diagnosis. However, most existing methods are limited by using a single template, which may be insufficient to reveal complex brain connectivities. Furthermore, these methods usually neglect the complementary information between static and dynamic brain networks, and the functional divergence among different brain regions, leading to suboptimal diagnosis performance. To address these limitations, we propose a novel multi-graph cross-Attention based region-Aware feature fusion network (MGCA-RAFFNet) by using multi-Template for brain disorder diagnosis. Specifically, we first employ multi-Template to parcellate the brain space into different regions of interest (ROIs). Then, a multi-graph cross-Attention network (MGCAN), including static and dynamic graph convolutions, is developed to explore the deep features contained in multi-Template data, which can effectively analyze complex interaction patterns of brain networks for each template, and further adopt a dual-view cross-Attention (DVCA) to acquire complementary information. Finally, to efficiently fuse multiple static-dynamic features, we design a region-Aware feature fusion network (RAFFNet), which is beneficial to improve the feature discrimination by considering the underlying relations among static-dynamic features in different brain regions. Our proposed method is evaluated on both public ADNI-2 and ABIDE-I datasets for diagnosing mild cognitive impairment (MCI) and autism spectrum disorder (ASD). Extensive experiments demonstrate that the proposed method outperforms the state-of-The-Art methods. Our source code is available at https://github.com/mylbuaa/MGCA-RAFFNet.

Original languageEnglish
Pages (from-to)1045-1059
Number of pages15
JournalIEEE Transactions on Medical Imaging
Volume43
Issue number3
DOIs
Publication statusPublished - 1 Mar 2024

Keywords

  • autism spectrum disorder (ASD)
  • deep learning
  • feature fusion
  • Mild cognitive impairment (MCI)
  • multi-graph cross-Attention
  • multi-Template

Fingerprint

Dive into the research topics of 'A Multi-Graph Cross-Attention-Based Region-Aware Feature Fusion Network Using Multi-Template for Brain Disorder Diagnosis'. Together they form a unique fingerprint.

Cite this