The Vector Control Scheme for Amphibious Spherical Robots Based on Reinforcement Learning

He Yin, Shuxiang Guo*, Liwei Shi*, Mugen Zhou, Xihuan Hou, Zan Li, Debin Xia

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

Due to variable underwater working conditions and unfavorable environments, it is difficult to design a controller suitable for underwater robots. This paper uses the adaptive ability of reinforcement learning to propose a two-layer network framework based on reinforcement learning to realize the control of amphibious spherical robots. The upper planning layer mainly plans the total torque of the robot at each moment according to the desired position and speed. The lower control layer mainly configures the parameters of the four machine legs according to the planning instructions of the upper planning layer. Through the cooperation of the planning layer and the control layer, the adaptive motion control of the amphibious spherical robot can finally be realized. Finally, the proposed scheme was verified on a simulated amphibious spherical robot.

Original languageEnglish
Title of host publication2021 IEEE International Conference on Mechatronics and Automation, ICMA 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages594-599
Number of pages6
ISBN (Electronic)9781665441001
DOIs
Publication statusPublished - 8 Aug 2021
Event18th IEEE International Conference on Mechatronics and Automation, ICMA 2021 - Takamatsu, Japan
Duration: 8 Aug 202111 Aug 2021

Publication series

Name2021 IEEE International Conference on Mechatronics and Automation, ICMA 2021

Conference

Conference18th IEEE International Conference on Mechatronics and Automation, ICMA 2021
Country/TerritoryJapan
CityTakamatsu
Period8/08/2111/08/21

Keywords

  • Amphibious spherical robot
  • Motion control
  • Reinforcement learning

Fingerprint

Dive into the research topics of 'The Vector Control Scheme for Amphibious Spherical Robots Based on Reinforcement Learning'. Together they form a unique fingerprint.

Cite this