TY - JOUR
T1 - Look one step ahead through first-order aggregation in reinforcement learning-based knowledge graph reasoning
AU - Wang, Hao
AU - Song, Dandan
AU - Wu, Zhijing
AU - Tian, Yu Hang
AU - Xu, Jing
N1 - Publisher Copyright:
© 2025
PY - 2025/11
Y1 - 2025/11
N2 - Multi-hop reasoning is an effective and interpretable approach for query answering, as it finds reasoning paths over knowledge graphs (KGs) to enhance interpretability. Recent studies have applied reinforcement learning-based (RL-based) methods with policy agents to solve this problem. However, these methods primarily focus on sequential reasoning paths and candidate nodes, while overlooking the local structural information of adjacency subgraphs and the semantic correlations between relations at each decision step. In this paper, we propose a novel RL-based multi-hop reasoning model, Look One Step Ahead (LOSA), which leverages first-order aggregation to regard more expressive adjacency subgraphs rather than nodes as candidate actions and pays attention to the semantic correlations between relations. Specifically, an adjacency aggregation module encodes the local subgraph information and feeds the representations into the policy network to guide decision-making, thereby reducing backtracking and mitigating sparse-reward issues. Furthermore, a semantic matching module is designed to emphasize the semantic correlations of relations to improve the rationality of the reasoning paths. Extensive experiments on benchmark datasets demonstrate the effectiveness of the proposed approach.
AB - Multi-hop reasoning is an effective and interpretable approach for query answering, as it finds reasoning paths over knowledge graphs (KGs) to enhance interpretability. Recent studies have applied reinforcement learning-based (RL-based) methods with policy agents to solve this problem. However, these methods primarily focus on sequential reasoning paths and candidate nodes, while overlooking the local structural information of adjacency subgraphs and the semantic correlations between relations at each decision step. In this paper, we propose a novel RL-based multi-hop reasoning model, Look One Step Ahead (LOSA), which leverages first-order aggregation to regard more expressive adjacency subgraphs rather than nodes as candidate actions and pays attention to the semantic correlations between relations. Specifically, an adjacency aggregation module encodes the local subgraph information and feeds the representations into the policy network to guide decision-making, thereby reducing backtracking and mitigating sparse-reward issues. Furthermore, a semantic matching module is designed to emphasize the semantic correlations of relations to improve the rationality of the reasoning paths. Extensive experiments on benchmark datasets demonstrate the effectiveness of the proposed approach.
KW - Knowledge graph completion
KW - Knowledge graph reasoning
KW - Link prediction
KW - Multi-hop reasoning
UR - http://www.scopus.com/inward/record.url?scp=105007147574&partnerID=8YFLogxK
U2 - 10.1016/j.ins.2025.122373
DO - 10.1016/j.ins.2025.122373
M3 - Article
AN - SCOPUS:105007147574
SN - 0020-0255
VL - 718
JO - Information Sciences
JF - Information Sciences
M1 - 122373
ER -