Skip to main navigation Skip to search Skip to main content

OpenMulti: Open-Vocabulary Instance-Level Multi-Agent Distributed Implicit Mapping

  • Jianyu Dou
  • , Yinan Deng
  • , Jiahui Wang
  • , Xingsi Tang
  • , Yi Yang
  • , Yufeng Yue*
  • *Corresponding author for this work
  • Beijing Institute of Technology

Research output: Contribution to journal › Article › peer-review

Abstract

Multi-agent distributed collaborative mapping provides comprehensive and efficient representations for robots. However, existing approaches lack instance-level awareness and semantic understanding of environments, limiting their effectiveness for downstream applications. To address this issue, we propose OpenMulti, an open-vocabulary instance-level multi-agent distributed implicit mapping framework. Specifically, we introduce a Cross-Agent Instance Alignment module, which constructs an Instance Collaborative Graph to ensure consistent instance understanding across agents. To alleviate the degradation of mapping accuracy due to the blind-zone optimization trap, we leverage Cross Rendering Supervision to enhance distributed learning of the scene. Experimental results show that OpenMulti outperforms related algorithms in both fine-grained geometric accuracy and zero-shot semantic accuracy. In addition, OpenMulti supports instance-level retrieval tasks, delivering semantic annotations for downstream applications.

Original languageEnglish
Pages (from-to)9878-9885
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume10
Issue number10
DOIs
Publication statusPublished - 2025
Externally publishedYes

Keywords

  • Multi-agent
  • implicit mapping
  • instance-level
  • open-vocabulary

Fingerprint

Dive into the research topics of 'OpenMulti: Open-Vocabulary Instance-Level Multi-Agent Distributed Implicit Mapping'. Together they form a unique fingerprint.

Cite this