TY - JOUR
T1 - Transfer Reinforcement Learning Aided Distributed Network Slicing Optimization in Industrial IoT
AU - Mai, Tianle
AU - Yao, Haipeng
AU - Zhang, Ni
AU - He, Wenji
AU - Guo, Dong
AU - Guizani, Mohsen
N1 - Publisher Copyright:
© 2005-2012 IEEE.
PY - 2022/6/1
Y1 - 2022/6/1
N2 - With the growth of the number of Internet of Things (IoT) devices and the emergence of new applications, satisfying distinct QoS in the same physical network becomes more challenging. Recently, with the advance of network functions virtualization and software-defined networking (SDN) technologies, the network slicing technique has emerged as a promising solution. It can divide a physical network into multiple virtual networks, therefore providing different network services. In this article, to meet distinct QoS in industrial IoT, we design a network slicing architecture over the SDN-based long-range wide area network. The SDN controller can dynamically split the network into multiple virtual networks according to different business requirements. On this basis, we proposed a deep deterministic policy gradient (DDPG) based slice optimization algorithm. It enables LoRa gateways to intelligently configure slice parameters (e.g., transmission power and spreading factor) to improve the slice performance in terms of QoS, energy efficiency, and reliability. In addition, to accelerate the training process across multiple LoRa gateways, we leverage the transfer learning framework and design a transfer learning-based multiagent DDPG algorithm.
AB - With the growth of the number of Internet of Things (IoT) devices and the emergence of new applications, satisfying distinct QoS in the same physical network becomes more challenging. Recently, with the advance of network functions virtualization and software-defined networking (SDN) technologies, the network slicing technique has emerged as a promising solution. It can divide a physical network into multiple virtual networks, therefore providing different network services. In this article, to meet distinct QoS in industrial IoT, we design a network slicing architecture over the SDN-based long-range wide area network. The SDN controller can dynamically split the network into multiple virtual networks according to different business requirements. On this basis, we proposed a deep deterministic policy gradient (DDPG) based slice optimization algorithm. It enables LoRa gateways to intelligently configure slice parameters (e.g., transmission power and spreading factor) to improve the slice performance in terms of QoS, energy efficiency, and reliability. In addition, to accelerate the training process across multiple LoRa gateways, we leverage the transfer learning framework and design a transfer learning-based multiagent DDPG algorithm.
KW - Industrial Internet of Things (IoT)
KW - Multiagent reinforcement learning
KW - Network slicing
KW - Transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85120877797&partnerID=8YFLogxK
U2 - 10.1109/TII.2021.3132136
DO - 10.1109/TII.2021.3132136
M3 - Article
AN - SCOPUS:85120877797
SN - 1551-3203
VL - 18
SP - 4308
EP - 4316
JO - IEEE Transactions on Industrial Informatics
JF - IEEE Transactions on Industrial Informatics
IS - 6
ER -