Deep Reinforcement Learning-Based Dynamic Reconfiguration Planning for Digital Twin-Driven Smart Manufacturing Systems With Reconfigurable Machine Tools

Jintang Huang, Sihan Huang*, Shokraneh K. Moghaddam, Yuqian Lu, Guoxin Wang, Yan Yan, Xuejiang Shi

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

6 引用 (Scopus)

摘要

Smart manufacturing systems are a new paradigm in Industry 4.0 driven by the emerging information and communication technology and artificial intelligence that converge to digital twin, which are able to perceive, recognize, and handle the changes in demand and production. Reconfigurable machine tools (RMTs) can promote the flexibility of smart manufacturing systems. The fundamental problem lies in dynamically reconfiguring the RMTs in smart manufacturing systems efficiently and accurately by considering the flexibility of production precedence and operation sequences simultaneously. Therefore, in this article, a deep reinforcement learning-based reconfiguration planning method of digital twin-driven smart manufacturing systems with RMT is proposed to seek optimal reconfiguration policy online. The reconfiguration processes of smart manufacturing systems are modeled by considering reconfiguration cost, moving cost, and processing cost. Deep Q-network is adopted to explore the state space and action space to find the optimal reconfiguration scheme with the highest return. An industry case study is presented to demonstrate the effectiveness and efficiency of the proposed method, where the reconfiguration processes of a smart manufacturing system consisting of five RMTs for producing four parts are discussed.

源语言英语
页(从-至)13135-13146
页数12
期刊IEEE Transactions on Industrial Informatics
20
11
DOI
出版状态已出版 - 2024

指纹

探究 'Deep Reinforcement Learning-Based Dynamic Reconfiguration Planning for Digital Twin-Driven Smart Manufacturing Systems With Reconfigurable Machine Tools' 的科研主题。它们共同构成独一无二的指纹。

引用此

Huang, J., Huang, S., Moghaddam, S. K., Lu, Y., Wang, G., Yan, Y., & Shi, X. (2024). Deep Reinforcement Learning-Based Dynamic Reconfiguration Planning for Digital Twin-Driven Smart Manufacturing Systems With Reconfigurable Machine Tools. IEEE Transactions on Industrial Informatics, 20(11), 13135-13146. https://doi.org/10.1109/TII.2024.3431095