Online Optimization of Reconfiguration Planning for SRMS Based on DQN

Sihan Huang*, Zhicheng Peng, Jintang Huang, Guoxin Wang, Yan Yan

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

Abstract

Reconfigurable machine tools (RMTs) as key equipment of smart reconfigurable manufacturing systems (SRMS) can promote its flexibility when demand changes. The fundamental problem lies in dynamically reconfiguring the RMTs in SRMS efficiently and accurately by considering the flexibility of production precedence and operation sequences simultaneously. Therefore, a dynamic reconfiguration planning method for SRMS based on deep reinforcement learning is proposed in this chapter. The reconfiguration processes of SRMS are modeled by considering reconfiguration cost, moving cost, and processing cost. Deep Q-network (DQN) is adopted to find the optimal reconfiguration scheme with the highest return. A case study is presented to demonstrate the effectiveness and efficiency of the proposed method.

Original languageEnglish
Title of host publicationSpringer Series in Advanced Manufacturing
PublisherSpringer Nature
Pages65-87
Number of pages23
DOIs
Publication statusPublished - 2026

Publication series

NameSpringer Series in Advanced Manufacturing
VolumePart F975
ISSN (Print)1860-5168
ISSN (Electronic)2196-1735

Fingerprint

Dive into the research topics of 'Online Optimization of Reconfiguration Planning for SRMS Based on DQN'. Together they form a unique fingerprint.

Cite this