Real-Time Pedestrian Tracking System Based on Depth Camera for Quadruped Robot

Yunxin Zhang, Xuemei Ren*, Dongdong Zheng

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Quadruped robots have a wide range of applications now because of their strong adaptability to unstructured terrain. In the field of service robots, quadruped robots can track pedestrian users to provide more personalized services. This paper proposes a real-time depth camera-based pedestrian detection and tracking system for a quadruped robot. Firstly, YOLOv5 method is used for target detection, and then the DeepSORT method is used to collect real-time pedestrian features to complete pedestrian tracking. In order to reduce the adverse effects of target occlusion and fast movement on real-time tracking, this paper improves the performance of pedestrian feature extraction network by adding the CBAM attention module and verifies its superiority on the Market-1501 dataset. Compared with the original network, the Rank-1 accuracy increases by 6.3%, and the mean Average Precision (mAP) increases by 11.9%. Finally, a controller is designed based on kinematic method, and its stability is guaranteed by Lyapunov method.

Original languageEnglish
Title of host publicationProceedings of 2023 Chinese Intelligent Systems Conference - Volume III
EditorsYingmin Jia, Weicun Zhang, Yongling Fu, Jiqiang Wang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages461-471
Number of pages11
ISBN (Print)9789819968855
DOIs
Publication statusPublished - 2023
Event19th Chinese Intelligent Systems Conference, CISC 2023 - Ningbo, China
Duration: 14 Oct 202315 Oct 2023

Publication series

NameLecture Notes in Electrical Engineering
Volume1091 LNEE
ISSN (Print)1876-1100
ISSN (Electronic)1876-1119

Conference

Conference19th Chinese Intelligent Systems Conference, CISC 2023
Country/TerritoryChina
CityNingbo
Period14/10/2315/10/23

Keywords

  • Depth camera
  • Feature extraction
  • Lyapunov stability
  • Pedestrian tracking
  • Quadruped robot

Fingerprint

Dive into the research topics of 'Real-Time Pedestrian Tracking System Based on Depth Camera for Quadruped Robot'. Together they form a unique fingerprint.

Cite this