A disturbance rejection control method based on deep reinforcement learning for a biped robot

Chuzhao Liu, Junyao Gao*, Dingkui Tian, Xuefeng Zhang, Huaxin Liu, Libo Meng

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

8 Citations (Scopus)

Abstract

The disturbance rejection performance of a biped robot when walking has long been a focus of roboticists in their attempts to improve robots. There are many traditional stabilizing control methods, such as modifying foot placements and the target zero moment point (ZMP), e.g., in model ZMP control. The disturbance rejection control method in the forward direction of the biped robot is an important technology, whether it comes from the inertia generated by walking or from external forces. The first step in solving the instability of the humanoid robot is to add the ability to dynamically adjust posture when the robot is standing still. The control method based on the model ZMP control is among the main methods of disturbance rejection for biped robots. We use the state-of-the-art deep-reinforcement-learning algorithm combined with model ZMP control in simulating the balance experiment of the cart–table model and the disturbance rejection experiment of the ASIMO humanoid robot standing still. Results show that our proposed method effectively reduces the probability of falling when the biped robot is subjected to an external force in the x-direction.

Original languageEnglish
Article number1587
Pages (from-to)1-17
Number of pages17
JournalApplied Sciences (Switzerland)
Volume11
Issue number4
DOIs
Publication statusPublished - 2 Feb 2021

Keywords

  • Biped robot
  • Deep reinforcement learning
  • Model zero-moment-point control

Fingerprint

Dive into the research topics of 'A disturbance rejection control method based on deep reinforcement learning for a biped robot'. Together they form a unique fingerprint.

Cite this