TY - GEN
T1 - IG-GRD
T2 - 20th International Conference on Intelligent Computing, ICIC 2024
AU - Feng, Shuang
AU - Wang, Letian
AU - Li, Chang
AU - Wan, Xiaohua
AU - Zhang, Fa
AU - Hu, Bin
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2024.
PY - 2024
Y1 - 2024
N2 - Integrating imaging and genetic data provides a comprehensive approach to analyze brain disorders from different perspectives, which has important implications for the early diagnosis of Alzheimer’s Disease (AD) and the exploration of its underlying mechanisms. Current fusion methods focus primarily on the correlation between modalities or rely on decision-level fusion. However, due to the heterogeneity of imaging and genetic data, as well as the necessity to simultaneously consider their correlation and independence, current methods often face challenges in adequately integrating and fully learning from multimodal information. Therefore, in this paper, we propose a novel multimodal data fusion method, named IG-GRD, based on graph representation learning for imaging and genetic data. Firstly, we construct imaging graphs and genetic graphs based on the characteristics of fMRI and SNP data, mapping the data from these two modalities into a unified representation space. Subsequently, we use a disentangled representation learning method on multimodal graphs that considers structural information and complex relationships between nodes to capture common and private graph representations. Finally, the disentangled feature graphs are fused at the graph level to synthesize the collaborative and individual effects of imaging and genetic information on the disease. Experimental results demonstrate that IG-GRD excels not only in recognizing mild cognitive impairment (MCI), but also in identifying brain regions and genes closely associated with AD and cognition. This work offers a novel methodology for the fusion of imaging and genetic data and provides new directions for the early diagnosis of AD and the investigation of its pathogenesis.
AB - Integrating imaging and genetic data provides a comprehensive approach to analyze brain disorders from different perspectives, which has important implications for the early diagnosis of Alzheimer’s Disease (AD) and the exploration of its underlying mechanisms. Current fusion methods focus primarily on the correlation between modalities or rely on decision-level fusion. However, due to the heterogeneity of imaging and genetic data, as well as the necessity to simultaneously consider their correlation and independence, current methods often face challenges in adequately integrating and fully learning from multimodal information. Therefore, in this paper, we propose a novel multimodal data fusion method, named IG-GRD, based on graph representation learning for imaging and genetic data. Firstly, we construct imaging graphs and genetic graphs based on the characteristics of fMRI and SNP data, mapping the data from these two modalities into a unified representation space. Subsequently, we use a disentangled representation learning method on multimodal graphs that considers structural information and complex relationships between nodes to capture common and private graph representations. Finally, the disentangled feature graphs are fused at the graph level to synthesize the collaborative and individual effects of imaging and genetic information on the disease. Experimental results demonstrate that IG-GRD excels not only in recognizing mild cognitive impairment (MCI), but also in identifying brain regions and genes closely associated with AD and cognition. This work offers a novel methodology for the fusion of imaging and genetic data and provides new directions for the early diagnosis of AD and the investigation of its pathogenesis.
KW - Data Fusion
KW - Disentangled Graph Representation Learning
KW - Imaging Genetics
UR - http://www.scopus.com/inward/record.url?scp=85201069987&partnerID=8YFLogxK
U2 - 10.1007/978-981-97-5581-3_12
DO - 10.1007/978-981-97-5581-3_12
M3 - Conference contribution
AN - SCOPUS:85201069987
SN - 9789819755806
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 142
EP - 153
BT - Advanced Intelligent Computing Technology and Applications - 20th International Conference, ICIC 2024, Proceedings
A2 - Huang, De-Shuang
A2 - Pan, Yijie
A2 - Zhang, Xiankun
PB - Springer Science and Business Media Deutschland GmbH
Y2 - 5 August 2024 through 8 August 2024
ER -