Multi-vehicle cooperative military training simulation system based on augmented reality

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Citations (Scopus)

Abstract

The military training systems based on augmented reality(AR) present challenges for cooperation training and confrontation training. In this paper, we propose a multi-vehicle cooperative military training simulation system based on video see-Through AR. Our system combines robust tracking algorithm, realistic AR display and network module to overlay virtual forces accurately on each soldier's real-world view. We present our tracking algorithm using a monocular camera in combination with an inertial measurement unit(IMU) and GPS in a loosely coupled Extended Kalman Filter(EKF)-based framework to obtain robust and real-Time pose estimation. Our AR display provides real-Time dynamic painting of virtual forces, battlefield situational awareness, and visual feedback for a variety of training activities. The inserted virtual forces can move in a pre-defined trajectory and shoot real vehicles in the specified range. The network module is used to support multi-vehicle real-Time cooperative training. We evaluate the accuracy of the tracking algorithm by comparing with DGPS. The consistency of rendering on different soldiers' AR displays is analyzed. In addition, we test our distinctive multi-vehicle cooperative confrontation training system online in a small team.

Original languageEnglish
Title of host publicationAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages128-133
Number of pages6
ISBN (Electronic)9781728147659
DOIs
Publication statusPublished - Oct 2019
Event18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 - Beijing, China
Duration: 14 Oct 201918 Oct 2019

Publication series

NameAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019

Conference

Conference18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
Country/TerritoryChina
CityBeijing
Period14/10/1918/10/19

Keywords

  • Augmented reality
  • Military simulation
  • Multi-sensor fusion
  • SLAM

Fingerprint

Dive into the research topics of 'Multi-vehicle cooperative military training simulation system based on augmented reality'. Together they form a unique fingerprint.

Cite this