Reinforcement Learning Control for Robot Arm Grasping Based on Improved DDPG

Guangjun Qi, Yuan Li

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Citations (Scopus)

Abstract

Although the traditional robot arm grasping control has high control accuracy, its price is based on high-precision hardware and lacks flexibility. In order to achieve high control accuracy and flexibility on a relatively inexpensive robot arm. This paper proposes an improved DDPG (Deep Deterministic Policy Gradient) reinforcement learning algorithm to control the gripping of a robot arm. First, build a simulation environment for a six-DOF (six-degree-of-freedom) manipulator with a gripper in ROS (Robot Operating System). Then, aiming at the shortcomings of traditional DDPG rewards, research and design a composite reward function. Aiming at the problem of low sampling efficiency in the free exploration of the robot arm, a batch of teaching data was added to the experience replay pool to improve learning efficiency. The simulation experiment results show that under the same number of episode of training. The improved DDPG grasping control algorithm has significantly improved the grasping success rate. The grasping success rate after comprehensive improvement reaches 70%, which is higher than the 36% level of unimproved DDPG.

Original languageEnglish
Title of host publicationProceedings of the 40th Chinese Control Conference, CCC 2021
EditorsChen Peng, Jian Sun
PublisherIEEE Computer Society
Pages4132-4137
Number of pages6
ISBN (Electronic)9789881563804
DOIs
Publication statusPublished - 26 Jul 2021
Event40th Chinese Control Conference, CCC 2021 - Shanghai, China
Duration: 26 Jul 202128 Jul 2021

Publication series

NameChinese Control Conference, CCC
Volume2021-July
ISSN (Print)1934-1768
ISSN (Electronic)2161-2927

Conference

Conference40th Chinese Control Conference, CCC 2021
Country/TerritoryChina
CityShanghai
Period26/07/2128/07/21

Keywords

  • DDPG
  • Demonstration
  • Reward Function
  • Six-DOF Arm Robot

Fingerprint

Dive into the research topics of 'Reinforcement Learning Control for Robot Arm Grasping Based on Improved DDPG'. Together they form a unique fingerprint.

Cite this