From simulation to reality: Ground vehicle detection in aerial imagery based on deep learning

Yu Yang, Chengpo Mu, Ruiheng Zhang, Xuejian Li, Ruixin Yang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Collecting aerial data from physical world is usually time-consuming. Image simulation is a significant data source for various ground target detection systems. Unfortunately, the reality gap between simulated and real data makes the model trained on simulated image not workable on real image. A translation method is proposed for tackling the simulation-toreality problem in this paper. First, image simulation system is employed for data preparation. Then, the simulated data is converted into a more similar one to the real image. The segmentation map is the bridge between simulated and real data. At last, the target detection model is used as the utility evaluation method for the simulated data. The simulated and synthesized data is used to train a vehicle detection model. Experiments show that results trained by synthesized data are really close to the real results. The proposed translation method can assist real image for target detection task, which is an effective data augmentation method for aerial data.

Original languageEnglish
Title of host publicationEleventh International Conference on Digital Image Processing, ICDIP 2019
EditorsJenq-Neng Hwang, Xudong Jiang
PublisherSPIE
ISBN (Electronic)9781510630758
DOIs
Publication statusPublished - 2019
Event11th International Conference on Digital Image Processing, ICDIP 2019 - Guangzhou, China
Duration: 10 May 201913 May 2019

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume11179
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference11th International Conference on Digital Image Processing, ICDIP 2019
Country/TerritoryChina
CityGuangzhou
Period10/05/1913/05/19

Keywords

  • Convolution neural network
  • GAN
  • Image simulation
  • UAV
  • Vehicle detection

Fingerprint

Dive into the research topics of 'From simulation to reality: Ground vehicle detection in aerial imagery based on deep learning'. Together they form a unique fingerprint.

Cite this