GraphAVO: Self-Supervised Visual Odometry Based on Graph-Assisted Geometric Consistency

Rujun Song, Jiaqi Liu, Zhuoling Xiao*, Bo Yan

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Learning-based monocular visual odometry (VO) has recently attracted considerable attention for its robustness to camera parameters and environmental variations. Despite traditional pose graph optimization enhancing pose accuracy, its integration with deep learning may lead to error accumulation due to insufficient motion information exchange. Our method, GraphAVO, concentrates simultaneously on the adjacent and interval co-visibility correspondence to establish a feature and pose graph optimization for pose consistency. We design a graph-assisted Windowed Feature Graph Refinement (WFGR) component to operationalize pose graph optimization for deep feature refinement. The geometric consistency is further constrained by a Cycle Consistency Loss. Additionally, the Cascade Dilated Convolution Fusion (CDCF) component is incorporated to handle different degrees of pixel movement, facilitating the joint detection of slight and distinct motion cues for subsequent feature enhancement. Extensive experiments on the KITTI, Malaga, RobotCar, and self-collected outdoor datasets have demonstrated the promising performance and generalization ability of GraphAVO. It achieves competitive results against classical algorithms and outperforms related state-of-the-art methods by up to 24.4% and 40.1% on average translational and rotational evaluation, respectively.

Original languageEnglish
Pages (from-to)20673-20682
Number of pages10
JournalIEEE Transactions on Intelligent Transportation Systems
Volume25
Issue number12
DOIs
Publication statusPublished - 2024
Externally publishedYes

Keywords

  • Feature refinement
  • graph neural network
  • pose consistency
  • self-supervised learning
  • visual odometry

Fingerprint

Dive into the research topics of 'GraphAVO: Self-Supervised Visual Odometry Based on Graph-Assisted Geometric Consistency'. Together they form a unique fingerprint.

Cite this