An efficient 3D pedestrian detector with calibrated RGB camera and 3D LiDAR

Lei Pang, Zhiqiang Cao, Junzhi Yu, Shuang Liang, Xuechao Chen, Weimin Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Citations (Scopus)

Abstract

Pedestrian detection plays an important role in the environmental perception and autonomous navigation for robotics, which provides critical information for the safe operation in complex environments. In this paper, a 3D pedestrian detector with calibrated LiDAR and RGB Camera is proposed, which takes full advantage of the precise range information of 3D LiDAR scanner and semantic information acquired from RGB image. The proposed approach integrates the segmented object clusters of point cloud and 2D bounding boxes generated by a visual object detector. The point cloud is segmented by a three-step segmentation approach, which can segment point cloud with both high precision and high efficiency. By fusion multi-sensor information in the image domain, the proposed approach provides 3D information of pedestrians in both LiDAR and camera coordinate systems. Experiments was conducted to evaluate the performance of the proposed approach.

Original languageEnglish
Title of host publicationIEEE International Conference on Robotics and Biomimetics, ROBIO 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2902-2907
Number of pages6
ISBN (Electronic)9781728163215
DOIs
Publication statusPublished - Dec 2019
Event2019 IEEE International Conference on Robotics and Biomimetics, ROBIO 2019 - Dali, China
Duration: 6 Dec 20198 Dec 2019

Publication series

NameIEEE International Conference on Robotics and Biomimetics, ROBIO 2019

Conference

Conference2019 IEEE International Conference on Robotics and Biomimetics, ROBIO 2019
Country/TerritoryChina
CityDali
Period6/12/198/12/19

Keywords

  • 3D pedestrian detection
  • LiDAR segmentation
  • Multi-sensor fusion
  • Visual detector

Fingerprint

Dive into the research topics of 'An efficient 3D pedestrian detector with calibrated RGB camera and 3D LiDAR'. Together they form a unique fingerprint.

Cite this