TY - GEN
T1 - Cascade Optimal Operation of Community Integrated Energy System Based on Improved Soft Actor-Critic
AU - Li, Peng
AU - Jiang, Lei
AU - Dou, Zhenlan
AU - Wang, Nan
AU - Zhang, Chunyan
AU - Wang, Jiahao
AU - Zhou, Xichao
AU - Wen, Miao
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Integrated energy system realizes multi-energy complementarity through coupling mechanism between multiple energies. It can significantly improve the efficiency of energy utilization, thereby contributing to low-carbon transformation of global energy system. However, existing research has not fully considered the field of optimal operation of integrated energy system from the perspective of energy supply structure, which is likely to cause energy loss in whole system. In order to solve the above problem, a cascade optimization operation strategy of community integrated energy system based on improved Soft Actor-Critic algorithm is proposed. Firstly, considering diversified demands of community integrated energy system, load is divided according to energy grade, and a cascade optimization model of community integrated energy system is established. Moreover, the cascade optimization operation problem is transformed into a reinforcement learning framework. The corresponding Markov decision process model is constructed and the rationality of action selection is guaranteed by combining domain knowledge rules. Finally, the effectiveness and superiority of the proposed method in improving energy efficiency and reducing operating cost of the system is verified by a case.
AB - Integrated energy system realizes multi-energy complementarity through coupling mechanism between multiple energies. It can significantly improve the efficiency of energy utilization, thereby contributing to low-carbon transformation of global energy system. However, existing research has not fully considered the field of optimal operation of integrated energy system from the perspective of energy supply structure, which is likely to cause energy loss in whole system. In order to solve the above problem, a cascade optimization operation strategy of community integrated energy system based on improved Soft Actor-Critic algorithm is proposed. Firstly, considering diversified demands of community integrated energy system, load is divided according to energy grade, and a cascade optimization model of community integrated energy system is established. Moreover, the cascade optimization operation problem is transformed into a reinforcement learning framework. The corresponding Markov decision process model is constructed and the rationality of action selection is guaranteed by combining domain knowledge rules. Finally, the effectiveness and superiority of the proposed method in improving energy efficiency and reducing operating cost of the system is verified by a case.
KW - Markov decision process
KW - cascade optimization
KW - community integrated energy system
KW - deep reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=85143437398&partnerID=8YFLogxK
U2 - 10.1109/ICPSAsia55496.2022.9949691
DO - 10.1109/ICPSAsia55496.2022.9949691
M3 - Conference contribution
AN - SCOPUS:85143437398
T3 - I and CPS Asia 2022 - 2022 IEEE IAS Industrial and Commercial Power System Asia
SP - 643
EP - 649
BT - I and CPS Asia 2022 - 2022 IEEE IAS Industrial and Commercial Power System Asia
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2022 IEEE IAS Industrial and Commercial Power System Asia, I and CPS Asia 2022
Y2 - 8 July 2022 through 11 July 2022
ER -
