MARL Control of On-Orbit Peg-in-Hole Assembly in Macro-Micro Robots

Hao Li; Xuchao Huang; Yibo Zhang; Quan An; Yao Zhang

doi:10.1016/j.ifacol.2025.11.471

MARL Control of On-Orbit Peg-in-Hole Assembly in Macro-Micro Robots

Hao Li^*
, Xuchao Huang^*
, Yibo Zhang
, Quan An^*
, Yao Zhang^*

^*此作品的通讯作者

空天科学与技术学院

Beijing Institute of Technology
China University of Mining & Technology, Beijing

科研成果: 期刊稿件 › 会议文章 › 同行评审

摘要

In recent years, on-orbit operations have become a research hotspot. Traditional on-orbit assembly using only robotic arms suffers from low precision. Therefore, this paper proposes a Macro-Micro Coordinated Robotic System (MMCRS) consisting of a robotic arm and a Stewart platform. The paper analyzes the kinematic characteristics of the MMCRS for the on-orbit peg-in-hole assembly problem and introduces a Multi-Agent Reinforcement Learning algorithm, Full-State MADDPG. A staged, variable-parameter reward function is designed, and the effectiveness of the algorithm is verified through simulations.

源语言	英语
页（从-至）	2113-2118
页数	6
期刊	IFAC-PapersOnLine
卷	59
期	20
DOI	https://doi.org/10.1016/j.ifacol.2025.11.471
出版状态	已出版 - 1 8月 2025
活动	23th IFAC Symposium on Automatic Control in Aerospace, ACA 2025 - Harbin, 中国期限: 2 8月 2025 → 6 8月 2025

访问文件

10.1016/j.ifacol.2025.11.471

其它文件与链接

链接到 Scopus 的出版物

引用此

@article{9052183c92744e6f822263f3328f78b3,

title = "MARL Control of On-Orbit Peg-in-Hole Assembly in Macro-Micro Robots",

abstract = "In recent years, on-orbit operations have become a research hotspot. Traditional on-orbit assembly using only robotic arms suffers from low precision. Therefore, this paper proposes a Macro-Micro Coordinated Robotic System (MMCRS) consisting of a robotic arm and a Stewart platform. The paper analyzes the kinematic characteristics of the MMCRS for the on-orbit peg-in-hole assembly problem and introduces a Multi-Agent Reinforcement Learning algorithm, Full-State MADDPG. A staged, variable-parameter reward function is designed, and the effectiveness of the algorithm is verified through simulations.",

keywords = "Dynamic Reward Function, Macro-Micro Coordinated Robots, MARL, On-Orbit Assembly, Peg-in-Hole",

author = "Hao Li and Xuchao Huang and Yibo Zhang and Quan An and Yao Zhang",

note = "Publisher Copyright: Copyright {\textcopyright} 2025 The Authors.; 23th IFAC Symposium on Automatic Control in Aerospace, ACA 2025 ; Conference date: 02-08-2025 Through 06-08-2025",

year = "2025",

month = aug,

day = "1",

doi = "10.1016/j.ifacol.2025.11.471",

language = "English",

volume = "59",

pages = "2113--2118",

journal = "IFAC-PapersOnLine",

issn = "2405-8963",

publisher = "Elsevier B.V.",

number = "20",

}

TY - JOUR

T1 - MARL Control of On-Orbit Peg-in-Hole Assembly in Macro-Micro Robots

AU - Li, Hao

AU - Huang, Xuchao

AU - Zhang, Yibo

AU - An, Quan

AU - Zhang, Yao

PY - 2025/8/1

Y1 - 2025/8/1

N2 - In recent years, on-orbit operations have become a research hotspot. Traditional on-orbit assembly using only robotic arms suffers from low precision. Therefore, this paper proposes a Macro-Micro Coordinated Robotic System (MMCRS) consisting of a robotic arm and a Stewart platform. The paper analyzes the kinematic characteristics of the MMCRS for the on-orbit peg-in-hole assembly problem and introduces a Multi-Agent Reinforcement Learning algorithm, Full-State MADDPG. A staged, variable-parameter reward function is designed, and the effectiveness of the algorithm is verified through simulations.

AB - In recent years, on-orbit operations have become a research hotspot. Traditional on-orbit assembly using only robotic arms suffers from low precision. Therefore, this paper proposes a Macro-Micro Coordinated Robotic System (MMCRS) consisting of a robotic arm and a Stewart platform. The paper analyzes the kinematic characteristics of the MMCRS for the on-orbit peg-in-hole assembly problem and introduces a Multi-Agent Reinforcement Learning algorithm, Full-State MADDPG. A staged, variable-parameter reward function is designed, and the effectiveness of the algorithm is verified through simulations.

KW - Dynamic Reward Function

KW - Macro-Micro Coordinated Robots

KW - MARL

KW - On-Orbit Assembly

KW - Peg-in-Hole

UR - https://www.scopus.com/pages/publications/105025898690

U2 - 10.1016/j.ifacol.2025.11.471

DO - 10.1016/j.ifacol.2025.11.471

M3 - Conference article

AN - SCOPUS:105025898690

SN - 2405-8963

VL - 59

SP - 2113

EP - 2118

JO - IFAC-PapersOnLine

JF - IFAC-PapersOnLine

IS - 20

T2 - 23th IFAC Symposium on Automatic Control in Aerospace, ACA 2025

Y2 - 2 August 2025 through 6 August 2025

ER -

MARL Control of On-Orbit Peg-in-Hole Assembly in Macro-Micro Robots

摘要

访问文件

其它文件与链接

指纹

引用此