Reimagining China-US Relations Prediction: A Multi-modal, Knowledge-Driven Approach with KDSCINet

Rui Zhou*, Jialin Hao, Ying Zou, Yushi Zhu, Chi Zhang, Fusheng Jin

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Statistical models and data driven models have achieved remarkable results in international relation forecasting. However, most of these models have several common drawbacks, including (i) rely on large amounts of expert knowledge, limiting the objectivity, applicability, usability, interpretability and sustainability of models, (ii) can only use structured unimodal data or cannot make full use of multimodal data. To address these two problems, we proposed a Knowledge-Driven neural network architecture that conducts Sample Convolution and Interaction, named KDSCINet, for China-US relation forecasting. Firstly, we filter events pertaining to China-US relations from the GDELT database. Then, we extract text descriptions and images from news articles and utilize the fine-tuned pre-trained model MKGformer to obtain embeddings. Finally we connect textual and image embeddings of the event with the structured event value in GDELT database through multi-head attention mechanism to generate time series data, which is then feed into KDSCINet for China-US relation forecasting. Our approach enhances prediction accuracy by establishing a knowledge-driven temporal forecasting model that combines structured data, textual data and image data. Experiments demonstrate that KDSCINet can (i) outperform state-of-the-art methods on time series forecasting problem in the area of international relation forecasting, (ii) improving forecasting performance through the use of multimodal knowledge.

Original languageEnglish
Title of host publicationNeural Information Processing - 30th International Conference, ICONIP 2023, Proceedings
EditorsBiao Luo, Long Cheng, Zheng-Guang Wu, Hongyi Li, Chaojie Li
PublisherSpringer Science and Business Media Deutschland GmbH
Pages317-331
Number of pages15
ISBN (Print)9789819980819
DOIs
Publication statusPublished - 2024
Event30th International Conference on Neural Information Processing, ICONIP 2023 - Changsha, China
Duration: 20 Nov 202323 Nov 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14448 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference30th International Conference on Neural Information Processing, ICONIP 2023
Country/TerritoryChina
CityChangsha
Period20/11/2323/11/23

Keywords

  • China-US relation
  • Knowledge-driven
  • Multimodal data
  • Time-series forecasting

Fingerprint

Dive into the research topics of 'Reimagining China-US Relations Prediction: A Multi-modal, Knowledge-Driven Approach with KDSCINet'. Together they form a unique fingerprint.

Cite this