TY - GEN
T1 - Urban Image Geolocation via Knowledge-Driven Cue Mining and Reasoning
AU - Zhao, Zihan
AU - Liu, Cheng
AU - Yu, Zuyuan
AU - Wang, Shaojie
AU - Wu, Siran
AU - Wang, Ziru
AU - Min, Rong
AU - Wu, Weichao
N1 - Publisher Copyright:
©2026 IEEE.
PY - 2026
Y1 - 2026
N2 - Traditional geo-localization techniques such as GPS and inertial navigation systems rely either on external signals or on specialized onboard sensors, which limits their applicability in signal-denied or privacy-sensitive environments. Vision-based geo-localization offers an alternative by inferring location directly from images, but most existing methods formulate the task as large-scale visual matching, requiring extensive annotated data and exhibiting degraded performance in complex urban scenes with high visual ambiguity. Moreover, these approaches lack explicit reasoning mechanisms, resulting in limited robustness and poor interpretability. To address these limitations, we propose URBAN-REASON, a knowledge-driven framework for image location reasoning based on visual cue mining and multimodal reasoning. The framework is designed to systematically overcome the weaknesses of conventional image matching approaches through three key components. First, a modular multimodal geo-knowledge base is constructed to associate fine-grained urban visual cues with structured geographic semantics. Second, a dynamic hybrid retrieval mechanism retrieves relevant external geographic knowledge guided by visual cues during inference, reducing reliance on exhaustive visual exemplars. Third, a chain-of-thought-driven hierarchical reasoning strategy decomposes localization into progressive stages of visual parsing, cue association, and location inference, enabling gradual narrowing of the candidate location space. Experiments on a newly constructed dataset of large-scale non-landmark urban street images demonstrate that URBAN-REASON consistently outperforms a representative state-of-the-art image-matching baseline in both fine-grained and coarse-grained localization tasks. In addition, the proposed framework produces explicit and interpretable reasoning chains, supporting more reliable decision-making in complex urban environments.
AB - Traditional geo-localization techniques such as GPS and inertial navigation systems rely either on external signals or on specialized onboard sensors, which limits their applicability in signal-denied or privacy-sensitive environments. Vision-based geo-localization offers an alternative by inferring location directly from images, but most existing methods formulate the task as large-scale visual matching, requiring extensive annotated data and exhibiting degraded performance in complex urban scenes with high visual ambiguity. Moreover, these approaches lack explicit reasoning mechanisms, resulting in limited robustness and poor interpretability. To address these limitations, we propose URBAN-REASON, a knowledge-driven framework for image location reasoning based on visual cue mining and multimodal reasoning. The framework is designed to systematically overcome the weaknesses of conventional image matching approaches through three key components. First, a modular multimodal geo-knowledge base is constructed to associate fine-grained urban visual cues with structured geographic semantics. Second, a dynamic hybrid retrieval mechanism retrieves relevant external geographic knowledge guided by visual cues during inference, reducing reliance on exhaustive visual exemplars. Third, a chain-of-thought-driven hierarchical reasoning strategy decomposes localization into progressive stages of visual parsing, cue association, and location inference, enabling gradual narrowing of the candidate location space. Experiments on a newly constructed dataset of large-scale non-landmark urban street images demonstrate that URBAN-REASON consistently outperforms a representative state-of-the-art image-matching baseline in both fine-grained and coarse-grained localization tasks. In addition, the proposed framework produces explicit and interpretable reasoning chains, supporting more reliable decision-making in complex urban environments.
KW - interpretable localization
KW - knowledge-assisted reasoning
KW - urban environments
KW - vision-based geo-localization
KW - visual cue mining
UR - https://www.scopus.com/pages/publications/105049067235
U2 - 10.1109/ICCCR69988.2026.11642640
DO - 10.1109/ICCCR69988.2026.11642640
M3 - Conference contribution
AN - SCOPUS:105049067235
T3 - 2026 6th International Conference on Computer, Control and Robotics, ICCCR 2026
SP - 163
EP - 169
BT - 2026 6th International Conference on Computer, Control and Robotics, ICCCR 2026
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 6th International Conference on Computer, Control and Robotics, ICCCR 2026
Y2 - 15 May 2026 through 17 May 2026
ER -